Deloitte Financial Services Japan

Rakuten Securities

Customer Service Automation

Rakuten Securities needed a more human digital way to guide rapidly growing numbers of first-time investors through complex financial products because it operates as an online brokerage without nationwide branches for in-person advice.

10 million accounts in Japan in 2023
Developed in just two months
More than 90% of the customers who experienced the Investment Consultant AI Avatar demonstration said they were interested in using it in the future.

Reported impact

Business outcome

Rakuten Securities built and demonstrated the avatar in two months at its 2024 New Year Conference, and more than 90% of customers who tried the demonstration said they would be interested in using it in the future, indicating a more engaging digital experience for novice investors.

  • Customer Experience
  • Speed to Market

Solution

Rakuten Securities extended its July 2023 Investment AI Assistant into a richer customer-facing advisory experience by working with Deloitte Japan and NVIDIA on an Investment Consultation AI Avatar. The implementation keeps the client's GenAI assistant as the answer engine, uses NVIDIA Omniverse ACE as the avatar foundation, and places Deloitte's Quartz Frontline AI in front as the conversational interface. Customers can ask basic investment questions, the service generates answers in Japanese text-to-speech, and the avatar returns them with synchronized voice, mouth movement, and gestures to make the exchange feel more human. Rakuten's AI Data & Human Lab led the work so novice investors opening accounts under the new NISA environment could get guidance quickly in a digital-only channel without relying on branch-based interactions.

Data flow

Customers ask basic investment questions through the Investment Consultation AI Avatar, Rakuten Securities' Investment AI Assistant generates the answer, Quartz Frontline AI presents the experience, and NVIDIA Omniverse ACE returns the response as Japanese speech with synchronized mouth movement and gestures.

Solution architecture

4 components · 1 layer
  1. Serving
    • Investment AI Assistant Provides the GenAI-backed investment-answering capability that the avatar experience builds upon.
    • NVIDIA Omniverse ACE Supplies the avatar foundation used to deliver natural-language interaction, speech, and human-like presentation.
    • Quartz Frontline AI Acts as the next-generation user interface that connects Rakuten Securities' assistant to the avatar experience.
    • Investment Consultation AI Avatar Packages the assistant into a customer-facing Japanese conversational avatar with synchronized voice, gestures, and lip movement.

Architecture clues

  • Rakuten Securities AI Data & Human Lab served as the lead organization for solution development.
  • The avatar adds a Japanese text-to-speech capability plus synchronized lip movement and human-like gestures for conversational delivery.
  • The implementation extends the July 2023 Investment AI Assistant rather than replacing it with a net-new advisory backend.

Evidence from the source

A new Japanese Text to Speech (TTS) function enables the avatar to recognize a customer's investment questions and deliver a response.
Developed in just two months, the Investment Consultant AI Avatar made its debut on January 14 as part of the Rakuten Securities New Year Conference 2024.
In July 2023, Rakuten Securities released the GenAI-enabled "Investment AI Assistant" chat service.
More than 90% of the customers who experienced the Investment Consultant AI Avatar demonstration said they were interested in using it in the future.
They collaborated on a new system that would build upon the client's Investment AI Assistant, using NVIDIA's Omniverse ACE (Avatar Cloud Engine) as its foundation and Deloitte's Quartz Frontline AI as the next-generation user interface.
This is accompanied by human-like gestures from the avatar, as well as synchronized mouth movements and voice to facilitate more-realistic conversation-based communication.
Transparency Evidence & methodology 85/100 reference value · 93% confidence · 2 sources

Review how this reference was scored and trace each normalized claim back to its documented source.

01

Scoring methodology

How scores are calculated

Customer Reference Value measures usefulness as a customer reference. Evidence Confidence measures the quality and traceability of available evidence, not independent verification.

Customer reference value85/100
  • Problem clarity20/20
    Measures whether the customer's operational problem is specific enough to compare.
  • Implementation depth20/25
    Rewards named components, data flow, integrations, and architecture detail.
  • Outcome specificity20/20
    Measures whether the reported benefit is concrete rather than a generic claim.
  • Quantified impact15/25
    1 metric describe measurable impact.
  • Deployment scale10/10
    Rewards evidence of a live or scaled deployment and meaningful integration scope.
Evidence confidence93%
  • Source authority20/25
    The main evidence is an official vendor-published customer story.
  • Claim traceability23/25
    11 of 12 key fields link to a named source.
  • Direct evidence20/20
    6 direct source quotes retained.
  • Date provenance10/10
    The publication date comes from the source page or publisher.
  • Source transparency10/10
    2 source references document publisher, URL, authority, retrieval, and supported fields.
  • Implementation specificity10/10
    Rewards source-backed components, data flow, quantified impact, and a specific outcome.
02

Traceability

Sources & provenance

Field coverage shows which facts each source supports. Dates are shown only when documented by the source.

  1. Deloitte

    Investing in a more authentic customer experience | Deloitte Global

    First-party
    https://www.deloitte.com/global/en/what-we-do/case-studies-collection/investing-in-a-more-authentic-customer-experience.html
    Source type
    Vendor-published customer story
    Published
    Sep 8, 2024
    Supports
    • Customer
    • Region
    • Business problem
    • Solution
    • Products
    • Solution components
    • Data flow
    • Business outcome
    • Metrics
    • Architecture
    • evidence quotes
    • Publication date
  2. Rakuten Securities

    会社概要 | 楽天証券について | 楽天証券

    First-party
    https://www.rakuten-sec.co.jp/web/company/profile/

    従業員数 720名 内、日本証券業協会 外務員登録者数672名 内、独立行政法人 情報処理推進機構 情報処理技術者資格取得者550名 (2025年12月現在)

    Source type
    Official company website
    Supports
    • Company size

Date evidence

  • Published on source page Sep 8, 2024 · Deloitte · First-party
    Open date source
Not separately sourced Industry. Treat these normalized attributes as lower-confidence until a dedicated source is added.