Alibaba Cloud Software / SaaS China Translated from Chinese

Shuyao Technology

Risk Management

Shuyao Technology needed to replace a brittle, manually maintained financial risk rule engine. Its decision process spanned 516 nodes and 878 evaluation indicators, with tightly coupled logic, redundant checks, and slow policy updates that could not keep pace with changing fraud patterns. The company wanted a model that could understand the full decision flow, discover latent rules, and keep risk decisions explainable enough for regulated financial use.

48.67% accuracy after SFT
500 cold-start samples
516 decision nodes
7,387 training samples

Reported impact

Business outcome

Shuyao raised critical rule-matching accuracy to 86.83%, reached 98.51% similarity between model reasoning and the original decision path, improved explainability for financial audit and compliance needs, and created a reusable long-context training pattern that led the customer to expand its purchase of AI services and compute capacity.

  • Compliance
  • Productivity Improvement
  • Risk Reduction

Solution

Shuyao Technology and Alibaba Cloud built a financial risk-decision training pipeline around Platform for AI (PAI), Qwen3, and AI Stack. The team first converted BPMN decision flows into structured corpora that captured node topology, rule-package logic, and end-to-end decision paths, then used a staged recipe of continued pretraining, cold start, supervised fine-tuning, and reinforcement learning to turn the base model into a risk specialist. Alibaba also optimized the stack for long-context training by compressing 501K-token source flows into usable 57K-token samples, removing repetitive rule IDs, and applying DeepSpeed ZeRO-3, Liger Kernel, AutoTP, and YARN dynamic RoPE so 64K-context training and 40K+ token reasoning could run without truncating critical cases. The resulting model plugs into Shuyao's risk-control workflow to propose and explain decisions instead of relying only on hand-written rules.

Data flow

Shuyao converts BPMN risk workflows and rule packages into structured training corpora, feeds them into PAI and AI Stack for continued pretraining, cold-start tuning, supervised fine-tuning, and reinforcement learning on Qwen3, and then uses the resulting model to analyze complex financial decision flows, recommend rules, and explain outcomes for lending risk operations.

Solution architecture

3 components · 2 layers
  1. Compute
    • Platform for AI (PAI) Runs the staged CPT, cold-start, supervised fine-tuning, and reinforcement-learning jobs that train Shuyao's risk model.
    • Qwen3 Serves as the base large language model that Shuyao adapts into a financial risk-decision specialist.
  2. Uncategorized
    • AI Stack Provides the long-context model training environment and optimization stack that lets the team process 40K+ token risk workflows.

Architecture clues

  • Dataset restructuring reduced average reasoning traces from 93 steps to 21 steps.
  • DeepSpeed ZeRO-3, Liger Kernel, and AutoTP reduced memory usage enough to support 64K-context training.
  • Training data encoded node topology, branching conditions, and end-to-end decision paths from BPMN workflows.
  • YARN dynamic RoPE extension enabled stable 40K+ token reasoning during reinforcement learning.

Evidence from the source

After two reinforcement-learning iterations, critical rule-matching accuracy jumped to 86.83% and reasoning-step similarity reached 98.51% (original: 经过两轮精细迭代优化(RL 训练总耗时 113 小时),模型的关键规则匹配准确率从初始的不足 30% 跃升至 86.83%,风控推理步骤相似度(LCS)达 98.51%).
At the same cost, the project increased context support by 3.2x and produced a reusable best practice for long-text training in financial risk control (original: 在 APG 利用上实现突破——同等成本下上下文支持能力提升 3.2 倍,训练效率与显存优化成效显著).
The core objective was to let a large model deeply understand complex risk-control logic, automatically mine latent rules, and continuously optimize strategy loops (original: 核心诉求明确:让大模型深度理解复杂的风控决策逻辑,自动挖掘潜在规则,并实现策略的持续优化闭环).
The optimization stack reduced memory usage by 65% and enabled 64K-context training without truncating 40K+ samples (original: 引入 DeepSpeed ZeRO-3 + Liger Kernel + AutoTP 显存优化技术,实现显存占用降低 65%,支持 64K 上下文训练,彻底消除此前对 40K+ 样本的截断问题).
The risk-control decision process contained 516 nodes and 878 evaluation indicators, with tightly coupled logic and redundant checks (original: 其风控决策流程极为复杂,包含 516 个节点、878 项评估指标,规则之间高度耦合,决策流中普遍存在无规律符号、冗余逻辑与重复判断等问题).
Transparency Evidence & methodology 95/100 reference value · 95% confidence · 1 source

Review how this reference was scored and trace each normalized claim back to its documented source.

01

Scoring methodology

How scores are calculated

Customer Reference Value measures usefulness as a customer reference. Evidence Confidence measures the quality and traceability of available evidence, not independent verification.

Customer reference value95/100
  • Problem clarity20/20
    Measures whether the customer's operational problem is specific enough to compare.
  • Implementation depth25/25
    Rewards named components, data flow, integrations, and architecture detail.
  • Outcome specificity20/20
    Measures whether the reported benefit is concrete rather than a generic claim.
  • Quantified impact25/25
    10 metrics describe measurable impact.
  • Deployment scale5/10
    Rewards evidence of a live or scaled deployment and meaningful integration scope.
Evidence confidence95%
  • Source authority20/25
    The main evidence is an official vendor-published customer story.
  • Claim traceability25/25
    12 of 12 key fields link to a named source.
  • Direct evidence20/20
    5 direct source quotes retained.
  • Date provenance10/10
    The publication date comes from the source page or publisher.
  • Source transparency10/10
    1 source reference document publisher, URL, authority, retrieval, and supported fields.
  • Implementation specificity10/10
    Rewards source-backed components, data flow, quantified impact, and a specific outcome.
02

Traceability

Sources & provenance

Field coverage shows which facts each source supports. Dates are shown only when documented by the source.

  1. Alibaba Cloud

    Shuyao builds a financial-grade large-model decision framework on Alibaba PAI

    First-party
    https://www.aliyun.com/customer-stories/financial-services-2025-shuyao
    Source type
    Vendor-published customer story
    Supports
    • Customer
    • Region
    • Company size
    • Business problem
    • Solution
    • Products
    • Solution components
    • Data flow
    • Integrations
    • technical area
    • use case category
    • Business outcome
    • outcome category
    • Metrics
    • Architecture
    • evidence quotes

Date evidence

  • Published on source page Aug 20, 2025 · Alibaba Cloud · First-party
    Open date source
Not separately sourced Industry. Treat these normalized attributes as lower-confidence until a dedicated source is added.