Cathay Property Insurance (国泰产险)

Solution

Cathay Property Insurance standardized its growing LLM estate behind Alibaba Cloud's cloud-native API Gateway so model consumption could be governed as infrastructure rather than as one-off integrations. The gateway gives the insurer a unified protocol surface across more than a dozen model providers and hides each vendor's distinct request and response structure from downstream business teams. It also centralizes API key custody, multi-tenant authentication, and consumer-level access control so different internal or external callers can use approved models without directly handling model-provider credentials. Around that access layer, Cathay connected Alibaba Cloud Content Security for request and response inspection, and enabled AI observability across metrics, logs, and traces so token usage can be attributed by request, model, and consumer. The result is a governed model-access plane that supports customer-service and content workflows while lowering compliance and cost-management risk.

Data flow

Business applications send LLM requests through Cloud-native API Gateway, which normalizes provider protocols, applies authentication and tenant policy, and forwards traffic to the selected model provider. Request and response payloads are scanned by Content Security, while metrics, logs, traces, and token counts are recorded so Cathay can audit usage and control cost after responses are returned.