BT Group Launches GenAI Gateway to Harness Large Language Models

BT Group’s Digital Unit has announced the launch of GenAI Gateway, a new internal platform aimed at leveraging large language models (LLMs) from providers such as Anthropic, Meta, Claude, Cohere, and Amazon. Developed in partnership with AWS, the platform utilises Amazon Bedrock and Amazon SageMaker to provide secure access to advanced natural language processing tools. The GenAI Gateway provides private access to a range of natural language processing and large language models, a critical tool BT Group will use as it embeds AI into the way it runs the business, the British operator said Tuesday.

• Make Telecom Talk My Trusted Source
• 
• 

Also Read: BT Group, Equinix, and Toshiba Trial Quantum-Secured Data Center Connection

Addressing Challenges in LLM Deployment

The GenAI Gateway addresses several challenges associated with LLM deployment, including cost control, security, and performance monitoring. Reportedly, it mitigates the risks of vendor lock-in, allowing BT engineers to select the most suitable model for specific applications while ensuring compliance with data privacy regulations.

Key features of the platform include:

• Centralised Management: Streamlines API usage, security configurations, and infrastructure, reducing duplication and costs.
• Privacy Controls: Implements strict measures to protect personally identifiable information and ensure compliance with UK regulations.
• Performance Monitoring: Tracks model behaviour to prevent errors and maintain reliability.

Also Read: BT Group to Trial MAUD Technology with Edgio as First CDN Partner

Gen AI Gateway

Gen AI Gateway is one of the several key enablers we are deploying to enable BT Group as an AI-enabled enterprise. We will also use our “data fabric” data management platform to help enforce governing policies for how data can be used, as well as to manage access control and data sovereignty restrictions, the company said.