Business

AT&T Routes 40 Percent of Employee AI Work to Open Models

Telecom giant AT&T is shifting 40 percent of its internal AI traffic to cheaper open-source models, demonstrating how automated routing can slash enterprise technology costs.

The Neuron2 days agoBusiness
Image: The Neuron

AT&T has begun shifting a significant portion of its internal artificial intelligence workload away from expensive proprietary systems toward cheaper open-source alternatives. According to industry reports, the telecommunications giant is already routing 40 percent of its employee AI usage to open models. By transitioning its coding tasks to these open models, the company managed to cut its expenses by 56 percent while experiencing only a minor 2 percent tradeoff in quality.

This strategic pivot aims to keep AT&T's spending flat with major AI providers like OpenAI and Anthropic. Reports from The Information indicate that using smart routing techniques has reduced costs by 80 to 90 percent for certain internal applications. Instead of relying on a single premium model for every basic summary or analysis, the company dynamically directs simpler tasks to self-hosted open models and reserves high-end proprietary systems for highly complex workloads.

The shift at AT&T reflects a broader industry trend toward model routing and optimization. Other players are rapidly entering this space, highlighted by Stripe's massive 7 billion dollar acquisition of Openrouter. Additionally, the fintech firm Ramp recently introduced its own tool called Router to select models based on cost, difficulty, or test scores, while startup Callosum secured 100 million dollars in funding to optimize model and chip combinations for individual queries.

For enterprise developers and IT practitioners, this evolution changes the deployment strategy from a rigid, single-provider stack to a flexible, per-task decision. To successfully implement this approach, teams must establish clear benchmarks to define what constitutes acceptable quality for a given task. Without precise internal measurements, routing algorithms risk delivering inconsistent results, but when managed correctly, they allow organizations to dramatically scale their AI capabilities without exponential budget growth.

This is our own summary of reporting by The Neuron

More in Business