Reported impact
Business outcome
LG U+ reported LG U+ Reduced LLM Vendor Dependency and Cut Costs 36% with Databricks Model Serving, 48% increase in throughput, and Transactions per second improved after adopting Databricks 22% faster responses, improving AI search and voice services with resilient model serving with measurable gains in cost reduction, customer experience, and scalability.
- Cost Reduction
- Customer Experience
- Scalability
Solution
LG U+ uses Databricks Model Serving, AI Gateway, Genie, and Gemini 2.5 Flash to support AI search and voice services with resilient model serving. LG U+ needed to reduce its dependency on external LLM providers because latency, outages, and operating costs were directly affecting AI search and voice experiences for telecom customers. In practice, the implementation governs access and lineage with AI Gateway, runs transformation or AI logic on Gemini 2.5 Flash, and delivers outputs through Databricks Model Serving. Tickets, conversation history, knowledge articles, and operational context are consolidated into a governed cloud data layer; Gemini 2.5 Flash applies analytics or model logic; results are surfaced through Databricks Model Serving. The case study reports LG U+ Reduced LLM Vendor Dependency and Cut Costs 36% with Databricks Model Serving, 48% increase in throughput, and Transactions per second improved after adopting Databricks 22% faster responses, showing measurable...
Data flow
Tickets, conversation history, knowledge articles, and operational context are consolidated into a governed cloud data layer; Gemini 2.5 Flash applies analytics or model logic; results are surfaced through Databricks Model Serving.