Databricks Software / SaaS United States

Refuel.AI

Document Processing · Marketing Personalization · Real-time Analytics

However, data labeling requires considerable resources and time. Manual labeling is costly and vulnerable to human errors.

3 Days to build a model from scratch with Databricks Training
86% Improvement in data label quality using a custom LLM
Feedback cycles can be up to 100 times faster.
It outperforms trained human annotators (80.4%), GPT-3-5-turbo (81.3%), PaLM-2 (82.3%), and Claude (79.3%) across a benchmark of 15 text labeling data sets.

Reported impact

Business outcome

Refuel.AI achieved measurable business impact on Databricks, including 86% Improvement in data label quality using a custom LLM; 3 Days to build a model from scratch with Databricks Training; Feedback cycles can be up to 100 times faster..

  • Cost Reduction
  • Productivity Improvement
  • Scalability

Solution

Access to high-quality, labeled data significantly improves model predictions and enhances context, boosting the performance of data analysis, ML, and AI applications. This produces more relevant results on search engine platforms and improved product recommendations on e-commerce sites. However, data labeling requires considerable resources and time. Manual labeling is costly and vulnerable to human errors. Human-in-the-loop methods only marginally speed up the process and increase accuracy. Large language models (LLMs) can enable vast improvements to this workflow. These challenges were the inspiration for startup Refuel.AI to build a platform for cleaned and labeled data that is powered by LLMs.

Solution architecture

1 components · 1 layer
  1. Compute
    • Agent Bricks Supports agentic or GenAI applications that Refuel.AI uses to automate or accelerate work.

Architecture clues

  • Key product: Agent Bricks
  • Real-time or streaming data processing

Evidence from the source

3 Days to build a model from scratch with Databricks Training
86% Improvement in data label quality using a custom LLM
Feedback cycles can be up to 100 times faster.
It outperforms trained human annotators (80.4%), GPT-3-5-turbo (81.3%), PaLM-2 (82.3%), and Claude (79.3%) across a benchmark of 15 text labeling data sets.
Launched in October 2023, the model was instruction-tuned on more than 5 billion tokens (comprising more than 2,500 unique tasks) on top of a Llama-v2-13b base model.
Transparency Evidence & methodology 85/100 reference value · 87% confidence · 1 source

Review how this reference was scored and trace each normalized claim back to its documented source.

01

Scoring methodology

How scores are calculated

Customer Reference Value measures usefulness as a customer reference. Evidence Confidence measures the quality and traceability of available evidence, not independent verification.

Customer reference value85/100
  • Problem clarity20/20
    Measures whether the customer's operational problem is specific enough to compare.
  • Implementation depth15/25
    Rewards named components, data flow, integrations, and architecture detail.
  • Outcome specificity20/20
    Measures whether the reported benefit is concrete rather than a generic claim.
  • Quantified impact25/25
    4 metrics describe measurable impact.
  • Deployment scale5/10
    Rewards evidence of a live or scaled deployment and meaningful integration scope.
Evidence confidence87%
  • Source authority20/25
    The main evidence is an official vendor-published customer story.
  • Claim traceability21/25
    10 of 12 key fields link to a named source.
  • Direct evidence20/20
    5 direct source quotes retained.
  • Date provenance10/10
    The publication date comes from the source page or publisher.
  • Source transparency8/10
    1 source reference document publisher, URL, authority, retrieval, and supported fields.
  • Implementation specificity8/10
    Rewards source-backed components, data flow, quantified impact, and a specific outcome.
02

Traceability

Sources & provenance

Field coverage shows which facts each source supports. Dates are shown only when documented by the source.

  1. Databricks

    Refuel.AI customer story

    First-party
    https://www.databricks.com/customers/refuelai
    Source type
    Vendor-published customer story
    Published
    Nov 13, 2023
    Supports
    • Customer
    • Business problem
    • Solution
    • Products
    • Solution components
    • Data flow
    • Integrations
    • technical area
    • use case category
    • Business outcome
    • outcome category
    • Metrics
    • Architecture
    • evidence quotes
    • Publication date

Date evidence

  • Published on source page Nov 13, 2023 · Databricks · First-party
    Open date source
Not separately sourced Industry, Region, Company size. Treat these normalized attributes as lower-confidence until a dedicated source is added.