Databricks Software / SaaS United States

Vannevar Labs

Real-time Analytics

Before partnering with Databricks, Vannevar Labs struggled with the limitations of commercial models, such as GPT-4, which delivered suboptimal accuracy and was not cost-effective, especially given the multilingual complexities of their data. However, after using Databricks to integrate a compound AI system, the team successfully fine-tuned and deployed a highly accurate sentiment analysis model within just two weeks, reducing latency by 75% and achieving significant cost savings.

2 weeks to deploy a fully trained sentiment analysis model
75% reduction in model latency
76% model accuracy, compared with 64% using GPT-4
Initially, Punma’s team struggled with the limitations of using GPT-4 and prompt engineering, which did not yield satisfactory results for their specific needs.

Reported impact

Business outcome

Vannevar Labs achieved measurable business impact on Databricks, including 2 weeks to deploy a fully trained sentiment analysis model; 76% model accuracy, compared with 64% using GPT-4; 75% reduction in model latency.

  • Cost Reduction
  • Productivity Improvement
  • Revenue Growth

Solution

Defense-tech startup Vannevar Labs plays a critical role in supporting America’s strategic efforts to deter and de-escalate global conflicts. Operating at the forefront of defense technology, the company leverages advanced software and hardware to support hundreds of mission-focused users across various branches of the U.S. Department of Defense (DoD). Before partnering with Databricks, Vannevar Labs struggled with the limitations of commercial models, such as GPT-4, which delivered suboptimal accuracy and was not cost-effective, especially given the multilingual complexities of their data. However, after using Databricks to integrate a compound AI system, the team successfully fine-tuned and deployed a highly accurate sentiment analysis model within just two weeks, reducing latency by 75% and achieving significant cost savings.

Data flow

Operational, customer, and transactional data lands in Databricks and is transformed into curated datasets

Solution architecture

1 components · 1 layer
  1. Compute
    • Agent Bricks Supports agentic or GenAI applications that Vannevar Labs uses to automate or accelerate work.

Architecture clues

  • Key product: Agent Bricks
  • Real-time or streaming data processing

Evidence from the source

2 weeks to deploy a fully trained sentiment analysis model
75% reduction in model latency
76% model accuracy, compared with 64% using GPT-4
Initially, Punma’s team struggled with the limitations of using GPT-4 and prompt engineering, which did not yield satisfactory results for their specific needs.
“The best results we could get were around 65% accuracy, and it was overall too expensive for us,” Punma added.
Transparency Evidence & methodology 90/100 reference value · 89% confidence · 1 source

Review how this reference was scored and trace each normalized claim back to its documented source.

01

Scoring methodology

How scores are calculated

Customer Reference Value measures usefulness as a customer reference. Evidence Confidence measures the quality and traceability of available evidence, not independent verification.

Customer reference value90/100
  • Problem clarity20/20
    Measures whether the customer's operational problem is specific enough to compare.
  • Implementation depth20/25
    Rewards named components, data flow, integrations, and architecture detail.
  • Outcome specificity20/20
    Measures whether the reported benefit is concrete rather than a generic claim.
  • Quantified impact25/25
    4 metrics describe measurable impact.
  • Deployment scale5/10
    Rewards evidence of a live or scaled deployment and meaningful integration scope.
Evidence confidence89%
  • Source authority20/25
    The main evidence is an official vendor-published customer story.
  • Claim traceability21/25
    10 of 12 key fields link to a named source.
  • Direct evidence20/20
    5 direct source quotes retained.
  • Date provenance10/10
    The publication date comes from the source page or publisher.
  • Source transparency8/10
    1 source reference document publisher, URL, authority, retrieval, and supported fields.
  • Implementation specificity10/10
    Rewards source-backed components, data flow, quantified impact, and a specific outcome.
02

Traceability

Sources & provenance

Field coverage shows which facts each source supports. Dates are shown only when documented by the source.

  1. Databricks

    Vannevar Labs customer story

    First-party
    https://www.databricks.com/customers/vannevar-labs
    Source type
    Vendor-published customer story
    Published
    Sep 4, 2024
    Supports
    • Customer
    • Business problem
    • Solution
    • Products
    • Solution components
    • Data flow
    • Integrations
    • technical area
    • use case category
    • Business outcome
    • outcome category
    • Metrics
    • Architecture
    • evidence quotes
    • Publication date

Date evidence

  • Published on source page Sep 4, 2024 · Databricks · First-party
    Open date source
Not separately sourced Industry, Region, Company size. Treat these normalized attributes as lower-confidence until a dedicated source is added.