Reported impact
Business outcome
With NVIDIA NIM microservices and the surrounding telecom AI stack, Amdocs reduced token use by as much as 60 percent in preprocessing and up to 40 percent in inferencing, while cutting query latency by about 80 percent so end users receive near-real-time responses across commerce, care, and operations.
- Cost Reduction
- Customer Experience
- Productivity Improvement
Solution
Amdocs built its amAIz platform on NVIDIA infrastructure to create telecom-specific generative AI agents for sales, billing, care, and network operations. NVIDIA DGX Cloud and NVIDIA AI Enterprise provide the training and enterprise AI foundation for commercially available and domain-adapted LLMs, while NVIDIA NIM microservices expose optimized inference endpoints and support frameworks such as NVIDIA TensorRT-LLM, vLLM, and SGLang. Amdocs also built an LLMOps pipeline around the NVIDIA AI Blueprint for building data flywheels, combining NVIDIA NeMo microservices for fine-tuning, evaluation, and guardrailing with NVIDIA NIM for deployment. On top of that stack, Amdocs uses NVIDIA Nemotron and Llama Nemotron to power amAIz agents that can autonomously handle multistep telecom journeys and plug into AI factories as reusable production services.
Data flow
Telecom workflow context enters amAIz, DGX Cloud and NeMo-based data-flywheel pipelines adapt and guardrail domain models, NIM serves the resulting models and agents through optimized inference frameworks, and the agents return actions or responses for sales, billing, care, and network operations.