In-house Telecommunications United States Company newsroom

AT&T

Enterprise Knowledge Search · IT Operations Automation · Risk Management

AT&T wanted to put generative AI into everyday employee workflows so software developers, engineers, finance teams, supply chain staff, HR, customer service, and fraud teams could work faster on code, data analysis, support, and risk-related tasks while using a consistent internal architecture and keeping humans in the loop.

in some cases 2x the speed, 1/2 the cost
more than 30,000 AT&T employees have access to Ask AT&T
reduce our response times from days or weeks to literal seconds

Reported impact

Business outcome

AT&T expanded AI access to more than 30,000 employees, accelerated coding and vulnerability remediation, enabled natural-language data analysis, improved Spark pipeline efficiency, and scaled real-time inference for production AI and internal question answering.

  • Cost Reduction
  • Productivity Improvement
  • Risk Reduction
  • Scalability

Solution

AT&T built Ask AT&T as an internal generative AI platform for employees and initially powered it with OpenAI's ChatGPT functionality, while keeping the system interoperable with other large language models including Meta's LLaMA 2 and Falcon transformers. The platform serves users through a conversational interface that accepts plain-English prompts for coding, question answering, and data analysis. AT&T feeds the system with enterprise content such as contracts, financial materials, HR information, AT&T content, software code, and network-related data so it can generate code, answer questions, and analyze operational data by detecting fields, joining tables, and creating code automatically. Beyond the employee-facing tool, AT&T uses NVIDIA RAPIDS AI software to accelerate Spark pipelines, Triton Inference Server to scale production AI/ML and Ask AT&T real-time inference, CuOpt for field technician routing optimization, and Riva for speech-to-text in front of GenAI applications, all aligned to a shared "single source of truth" architecture across common platforms, databases, and code.

Data flow

AT&T ingests enterprise content and operational data including software code, contracts, financial materials, HR information, AT&T content, and network data into Ask AT&T and related AI workflows. Employees query the system in natural language; the platform uses ChatGPT or alternative LLMs to generate code, answer questions, and analyze data, while RAPIDS accelerates Spark processing and Triton serves real-time inference on shared internal platforms and databases.

Solution architecture

8 components · 2 layers
  1. Compute
    • OpenAI ChatGPT It provided the initial generative AI functionality behind Ask AT&T.
    • Meta LLaMA 2 It is one of the alternative LLMs that Ask AT&T can interoperate with for different applications.
    • Falcon transformers They are additional open-source LLM options that Ask AT&T can use as part of its multi-model design.
    • NVIDIA RAPIDS AI software It accelerates Spark data pipelines used in AT&T's AI and data workloads.
    • NVIDIA CuOpt It performs more frequent vehicle routing optimization for AT&T field technicians.
  2. Serving
    • Ask AT&T AT&T's internal conversational platform gives employees a plain-English interface for coding, question answering, and data analysis.
    • NVIDIA Triton Inference Server It scales production AI models and Ask AT&T question-and-answer inference for real-time use.
    • NVIDIA Riva It provides speech-to-text in front of several generative AI applications.

Architecture clues

  • AT&T is building and customizing LLMs with NVIDIA.
  • AT&T is standardizing on a "single source of truth" target architecture with shared platforms, databases, and code.
  • Ask AT&T is interoperable with multiple LLMs rather than tied to one model.
  • Humans remain in the loop to monitor and refine vulnerability remediation outputs.
  • Triton is used for real-time inferencing in both traditional AI/ML and Ask AT&T Q&A on AT&T content.

Evidence from the source

"AT&T has built its own generative AI tool for our employees to use. We call it Ask AT&T. It's an intuitive, conversational platform that you can interact with in plain English"
"Ask AT&T was originally built on OpenAI's ChatGPT functionality. But Ask AT&T is also interoperable with other Large Language Models (LLMs), including Meta's LLaMA 2 and the open-source Falcon transformers."
"This tool can detect issues in our software code and, crucially, write and automate patches and fixes as they occur."
"Today, more than 30,000 AT&T employees have access to Ask AT&T"
"We are also testing NVIDIA Riva for tying voice to text in front of several GenAI applications."
"deploying NVIDIA Triton Inference Server for real-time inferencing for use in traditional AI/ML, and Ask AT&T's question and answer chats on AT&T content"
"our initial use case was for software developers to use it to write and refine code"
"we have also applied their RAPIDS AI software for faster/more cost effective (in some cases 2x the speed, 1/2 the cost) Spark data pipelines"
"we'll be able to reduce our response times from days or weeks to literal seconds"
Transparency Evidence & methodology 90/100 reference value · 94% confidence · 1 source

Review how this reference was scored and trace each normalized claim back to its documented source.

01

Scoring methodology

How scores are calculated

Customer Reference Value measures usefulness as a customer reference. Evidence Confidence measures the quality and traceability of available evidence, not independent verification.

Customer reference value90/100
  • Problem clarity20/20
    Measures whether the customer's operational problem is specific enough to compare.
  • Implementation depth25/25
    Rewards named components, data flow, integrations, and architecture detail.
  • Outcome specificity20/20
    Measures whether the reported benefit is concrete rather than a generic claim.
  • Quantified impact15/25
    1 metric describe measurable impact.
  • Deployment scale10/10
    Rewards evidence of a live or scaled deployment and meaningful integration scope.
Evidence confidence94%
  • Source authority25/25
    The deployment is described by the adopting organization or a government source.
  • Claim traceability21/25
    10 of 12 key fields link to a named source.
  • Direct evidence20/20
    9 direct source quotes retained.
  • Date provenance10/10
    The publication date comes from the source page or publisher.
  • Source transparency8/10
    1 source reference document publisher, URL, authority, retrieval, and supported fields.
  • Implementation specificity10/10
    Rewards source-backed components, data flow, quantified impact, and a specific outcome.
02

Traceability

Sources & provenance

Field coverage shows which facts each source supports. Dates are shown only when documented by the source.

  1. AT&T

    AT&T customer story

    First-party
    https://about.att.com/blogs/2023/expanding-ai-across-company.html
    Source type
    Customer-published story
    Published
    Sep 7, 2023
    Supports
    • Customer
    • Business problem
    • Solution
    • Products
    • Solution components
    • Data flow
    • Integrations
    • technical area
    • use case category
    • Business outcome
    • outcome category
    • Metrics
    • Architecture
    • evidence quotes
    • Publication date

Date evidence

Not separately sourced Industry, Region, Company size. Treat these normalized attributes as lower-confidence until a dedicated source is added.