Solution
FairPrice Group deployed agentic AI assistants across its 'Store of Tomorrow' supermarket to personalize shopping experiences and empower employees. Cloud-connected in-cart tablets run Chirp 2 speech recognition and Gemini multimodal APIs for conversational product recommendations and recipe suggestions. A knowledge agent powered by Vertex AI RAG Engine, Gemini, and Google Search grounding retrieves trusted nutritional and product information. Employees use Gemini Enterprise agents to automate ad creation, wellness consultations via body composition analysis (Tanita API integration), and inventory search using local context. Video and image generation (Veo 3 and Imagen 4) create promotional content.
Data flow
Customer voice input captured by in-cart tablets → Chirp 2 speech-to-text → Gemini API multimodal processing → Vertex AI RAG Engine retrieves product and recipe data → responses return to tablet and optional Veo 3 video generation. Tanita body composition data flows via API → Gemini API for health insights → personalized recommendations. Employees create ads via Gemini Enterprise → Imagen 4 image generation and Veo 3 video generation → marketing publication.
Solution architecture
8 components · 4 layers - Ingest
- Chirp 2 Provides real-time speech recognition for in-cart tablet interactions, enabling customers to speak product queries and preferences conversationally.
- Compute
- Gemini API Powers multimodal conversational agents on in-cart assistants, knowledge agents, and creative ad generation, processing customer requests into personalized recommendations.
- Imagen 4 Generates promotional product images and thematic ad visuals from text prompts for weekly store marketing campaigns.
- Veo 3 Creates high-quality promotional video content from text or image prompts for digital marketing and in-store displays.
- Serving
- Vertex AI RAG Engine Retrieves grounded recipes, nutritional data, and product information from trusted sources for knowledge agents answering customer food pairing and wellness questions.
- Vertex AI Search Enables product catalog search with local context interpretation (e.g., searching 'Orh Nee' for local condiment names), summarizing inventory and availability.
- Gemini Enterprise Provides employee agents for deep research, idea generation, ad creation automation, and custom workflow agents reducing ad creation time by 10x.
- Uncategorized
- Google Agent Development Kit Framework enabling rapid development and deployment of multi-agent architectures across retail operations and employee workflows.
- Agents built using the Google Agent Development Kit (ADK) with open standards including Model Context Protocol
- Cloud-connected shopping carts with integrated tablets running an in-cart conversational agent
- Custom creative agent generating thematic ads using Imagen 4 and Veo 3 on Vertex AI plus Gemini API for ad copy
- Digital wine sommelier using a multi-agent architecture triggered via NFC tap on the product
- Gemini Enterprise integrated with employees' Google Workspace, exposing Google-built agents (Deep Research, Idea Generation), FairPrice-built agents, and a no-code Agent Designer
- In-cart speech agent powered by Chirp 2 speech recognition and the multimodal Gemini API
- Knowledge agent built on Gemini API, Vertex AI RAG Engine, and the Grounding with Google Search API, triggered by scanning a product barcode
- Product catalog and inventory search agent built on Vertex AI Search supporting local-context queries
- Wellness assistant in the Unity pharmacy: data agent calls the Tanita body composition API plus the Gemini API; conversational and search agents drive the workflow
Lets customers converse with in-cart assistants for personalized product recommendations and achieving up to 18% click rate
Reduces ad creation time by 10x while eliminating cost by up to 100x with Google Cloud
The 'Store of Tomorrow' program launched in Q3, 2025, when FairPrice Group opened the doors to its first AI-powered supermarket.
The conversational agent is driven by Chirp 2, the most advanced speech recognition model of Google Cloud, and the multimodal Gemini API.
Using Imagen 4 and Veo 3 models on Vertex AI, and the Gemini API to turn promotional details into ad copy, employees can create ads quickly and seamlessly
Using a knowledge agent built on Gemini API, Vertex AI RAG Engine, and the Grounding with Google Search API, customers can get this information simply by scanning on the product's barcode.
