Solution
AI Rudder operates a cloud-native Voice AI platform that ingests millions of customer interactions daily across banking, fintech, insurance, e-commerce, and logistics verticals. The microservice architecture deployed on Kubernetes clusters orchestrates Automatic Speech Recognition, Natural Language Understanding, Natural Language Generation, and Sentiment Analysis workloads. Customer interaction data flows through the platform, persisted in relational and NoSQL databases while leveraging Redis caching for real-time response generation. Service Mesh traffic control and unified application monitoring ensure 24/7 availability and performance at scale across 200+ enterprise customers worldwide.
Data flow
Customer voice interactions → ASR/NLU processing → RDS/HBase storage → real-time cache layer (Tair) → personalized response generation → customer channels
Solution architecture
8 components · 5 layers - Compute
- Serverless Kubernetes Auto-scaling container runtime eliminating cluster management overhead for dynamic Voice AI workload demands
- Storage
- ApsaraDB RDS Transactional database for structured customer interaction records and voice bot training data
- Tair High-performance cache for real-time voice bot responses and user session state
- Object Storage Service Raw audio and unstructured data storage for voice interaction analysis
- Orchestration
- Container Service for Kubernetes Managed Kubernetes orchestration for microservice-based Voice AI platform architecture
- Service Mesh Unified traffic management and circuit breaking across Voice AI microservices
- Governance
- Application Real-Time Monitoring Service Real-time observability and performance monitoring of Voice AI application components in production
- Uncategorized
- ApsaraDB for HBase NoSQL database for high-volume time-series voice interaction metrics and analytics
- ARMS for application monitoring
- Microservices on ACK + Serverless Kubernetes (ASK) for auto-scaling, O&M-free clusters
- Polyglot data: ApsaraDB RDS (structured), Tair (cache), OSS (raw), HBase (NoSQL)
- Service Mesh (ASM) for unified traffic management
AI Rudder uses ACK to set up its microservice system on top of Serverless Kubernetes (ASK) clusters, which are O&M-free and support auto scaling based on the workload requirements.
Alibaba Cloud has three world-class local data centers in Indonesia, allowing AI Rudder to serve Indonesian companies in a more secure and responsive manner.
As of 2022, more than 200 companies worldwide use AI Rudder's software as a service (SaaS) platform with an AI voice bot to maximize profits, efficiency, and scalability.
