Solution
SSE Airtricity built the in-house Enhanced Smart Insights (ESI) Energy Advisor on the Databricks Data Intelligence Platform — already on Azure after migrating from Oracle, with Unity Catalog providing centralized governance for both data and AI models and Delta Lake as the storage foundation. Lakeflow Spark Declarative Pipelines ingest billions of rows of smart-meter data nightly (48 readings per meter per day across 65,000+ customers) and feed personalization models that call Anthropic Claude Sonnet 4.5 through Databricks AI Model Serving. An evaluation-first MLflow GenAI framework with custom AI judges defined alongside human feedback automatically rejects and regenerates any insights that fail on length, language, tone, or accuracy before they reach customers. Custom Databricks Apps surface real-time monitoring of cost, model performance, and judge failure rates with automated alerts. The team went from concept to production in four months.
Data flow
Billions of rows of smart-meter readings (48 per meter per day across 65,000+ customers) and customer-survey responses are ingested nightly through Lakeflow Spark Declarative Pipelines into Delta Lake on Databricks (migrated from Oracle), governed by Unity Catalog for both data and AI models. The ESI Energy Advisor calls Anthropic Claude Sonnet 4.5 through Databricks AI Model Serving to generate personalized energy-saving advice. MLflow Traces and an evaluation-first framework — AI judges defined alongside human feedback — automatically reject and regenerate insights that fail on length, language, tone, or accuracy. Databricks Apps host custom monitoring dashboards tracking cost, model performance, and judge failure rates in real time.