BT Group's Digital Unit has announced the launch of GenAI Gateway, a new internal platform aimed at leveraging large language models (LLMs) from providers such as Anthropic, Meta, Claude, Cohere, and Amazon. Developed in partnership with AWS, the platform utilises Amazon Bedrock and Amazon SageMaker to provide secure access to advanced natural language processing tools. The GenAI Gateway provides private access to a range of natural language processing and large language models, a critical tool BT Group will use as it embeds AI into the way it runs the business, the British operator said Tuesday.
Also Read: BT Group, Equinix, and Toshiba Trial Quantum-Secured Data Center Connection
Addressing Challenges in LLM Deployment
The GenAI Gateway addresses several challenges associated with LLM deployment, including cost control, security, and performance monitoring. Reportedly, it mitigates the risks of vendor lock-in, allowing BT engineers to select the most suitable model for specific applications while ensuring compliance with data privacy regulations.
Key features of the platform include:
- Centralised Management: Streamlines API usage, security configurations, and infrastructure, reducing duplication and costs.
- Privacy Controls: Implements strict measures to protect personally identifiable information and ensure compliance with UK regulations.
- Performance Monitoring: Tracks model behaviour to prevent errors and maintain reliability.
Also Read: BT Group to Trial MAUD Technology with Edgio as First CDN Partner
Gen AI Gateway
Gen AI Gateway is one of the several key enablers we are deploying to enable BT Group as an AI-enabled enterprise. We will also use our "data fabric" data management platform to help enforce governing policies for how data can be used, as well as to manage access control and data sovereignty restrictions, the company said.
Pilot Projects
According to BT Group, GenAI Gateway is live today with its first beta use cases. It is already in use for two pilot projects: summarising engineering notes for Openreach's fiber jobs, which helps simplify processes and boost productivity for both its teams and Communications Provider customers, and aiding contract analysis for the Group's legal and procurement teams.
Also Read: BT Group Achieves Enhanced 5G SA Uplink Performance With Carrier Aggregation
Commenting on the launch, the Managing Director of Data and AI at BT Group's Digital Unit said, "AI is helping us reimagine the future of our company. We believe that where our data is a constant, we need flexibility with our LLMs. GenAI Gateway allows us to tap into this powerful new set of technologies at scale, in a way that is safe, responsible, flexible and scalable, delivering the ambition we have for AI to unlock the human potential within BT Group, today and in the future."
