Reported impact
Business outcome
Sarvam reduced time-to-first production inference from weeks to minutes, achieved near-linear scaling across 4,096+ H100 GPUs, delivered multilingual voice feedback and fraud alerts for Aadhaar, and created a reusable sovereign AI platform for public and enterprise services across India.
- Customer Experience
- Scalability
- Speed to Market
Solution
Sarvam built a sovereign AI factory on NVIDIA accelerated computing so it could train, align, and serve models for India's languages and dialects. The stack combines H100 GPUs, NVIDIA Quantum InfiniBand networking, Nemotron datasets, NeMo libraries, NIM microservices, Base Command Platform, TensorRT, and Cloud Functions. During training, the company uses large-scale GPU clusters with Megatron-LM 6D parallelism to keep 100B-plus parameter mixture-of-expert models running efficiently across more than 4,096 GPUs on Yotta. Cloud Functions compress production deployment from weeks to minutes, while NIM and TensorRT support low-latency inference for voice-agentic flows that combine speech recognition, LLM reasoning, and text-to-speech. That unified architecture gives Sarvam a single platform for public-sector deployments such as Aadhaar feedback and for enterprise automation across India.
Data flow
Noisy multilingual text and speech corpora are preprocessed into training datasets, large MoE models are trained across thousands of H100 GPUs, optimized services are deployed through Cloud Functions, and NIM plus TensorRT power low-latency voice-agentic applications for Aadhaar and enterprise users.