Document Processing · Enterprise Knowledge Search
BT Group needed a secure, centrally governed way to scale generative AI beyond ad hoc experimentation, with cost control, privacy, prompt security, model monitoring, and flexibility to use multiple LLM providers without lock-in.
Reported impact
BT Group launched GenAI Gateway into live beta use, giving the company a centralized platform for safe, flexible generative AI adoption at scale. The first use cases include summarizing Openreach engineering notes to simplify processes and boost productivity, plus contract analysis for business, legal, and procurement teams.
BT Group’s Digital Unit built the internal GenAI Gateway with AWS as a shared generative AI enablement layer for business teams and engineers. The platform is deployed on AWS and exposed through secure APIs inside BT Group’s modular digital architecture so applications can access approved LLM capabilities through one controlled entry point instead of standing up separate model stacks. GenAI Gateway uses Amazon Bedrock to provide access to multiple foundation model providers through a single API and Amazon SageMaker to support machine learning operations for BT’s use cases. The platform adds prompt security, chat history, enterprise search, per-use-case FinOps billing, and access to multiple corporate data sources. BT also applies central privacy controls such as separate tenants per use case, PII filters, UK data location, and isolation between trained models. Guardrails filter unsafe or out-of-scope prompts, while BT’s data fabric platform enforces data governance, access control, and data sovereignty restrictions.
Users and internal applications call GenAI Gateway through secure APIs. The gateway applies prompt security, privacy controls, tenancy separation, PII filtering, guardrails, and budget controls, then routes requests to foundation models accessed via Amazon Bedrock and AI tooling in Amazon SageMaker. Corporate data sources and enterprise search features are brought into the workflow, and BT’s data fabric governs policy enforcement, access, and sovereignty constraints before responses are returned to business use cases.
"A trial in Openreach is summarising engineering notes on Ethernet and full fibre jobs, helping to simplify processes and boost productivity"
"Ad-hoc use of LLMs, whilst appropriate for test and development work, is not well suited to large scale use; cost control, security and privacy need more careful management."
"Central privacy controls include separate tenants for each use case, the use of Personal Identifiable Information filters, the location of the data within the UK"
"GenAI Gateway, deployed on AWS, is accessed via secure APIs, like all the components of BT Group’s modular digital architecture."
"Guardrails are built into the GenAI Gateway, limiting the risk of jailbreaks or toxic interactions"
"The GenAI Gateway, built in collaboration with AWS and using Amazon Bedrock Amazon SageMaker and AWS Professional Services capabilities, provides secure, private access to a range of natural-language processing and large language models"
"The platform supports prompt security, chat history, FinOps billing per use case, enterprise search, as well as use of multiple corporate data sources."
"we will also use our ‘data fabric’ data management platform to help enforce governing policies for how data can be used, as well as to manage access control and data sovereignty restrictions."
Review how this reference was scored and trace each normalized claim back to its documented source.
Scoring methodology
Customer Reference Value measures usefulness as a customer reference. Evidence Confidence measures the quality and traceability of available evidence, not independent verification.
Traceability
Field coverage shows which facts each source supports. Dates are shown only when documented by the source.
Related
AWS Sample Apr 17, 2024 Chunghwa Telecom Furthermore, Chunghwa Telecom needed a platform with robust security controls. To improve artificial intelligence (AI) data security and governance, the company migrated its generative AI projects to AWS. The first generative AI solution, the SDLC assistant, has saved developers an estimated 13 percent of their… Amazon Bedrock · Amazon Polly 
OpenAI Sample Mar 21, 2025 MEO Portugal MEO's legal analysts had to handle a steady stream of regulatory requests that required cross-referencing corporate legal records and manually processing large volumes of legal documents, consuming significant time and… AI assistant · ChatGPT · controlled, private document repository 
Microsoft Sample Feb 5, 2025 Vodafone In the face of rising customer demand for new digital services, global telecommunications provider Vodafone is exploring innovative ways to enhance the customer experience, including better handling of complex inquiries… Africa, Vodafone serves more than 330 million customers in 15 countries Azure AI Foundry · Azure AI Search · Azure AI Services 