OpenAI Software / SaaS Denmark

Be My Eyes

Be My Eyes needed a richer form of visual assistance for blind and low-vision users because basic image recognition could label objects but could not hold a conversation or reason about what information mattered in complex real-world situations.

over 250 million people who are blind or have low vision

Reported impact

Business outcome

Be My Eyes created a more capable accessibility assistant, improved user independence for both physical and online tasks, and opened a broader commercial path for visual accessibility support.

  • Customer Experience
  • Scalability

Solution

Be My Eyes used GPT-4's visual input capabilities to build Virtual Volunteer, a conversational assistant inside its accessibility app. Instead of stopping at basic object labels, the system lets users share images or webpages and ask follow-up questions so the model can describe, interpret, and reason about what matters in context, whether that means identifying ingredients in a fridge, navigating a station, or summarizing cluttered shopping pages. Inputs from a camera, uploaded image, or web page enter the Be My Eyes app, GPT-4 processes both the visual content and the ongoing dialogue, and the resulting explanation is returned as immediately usable guidance for the user. The company beta-tested the GPT-backed assistant internally before broad release and highlighted that the same architecture can work across the physical and digital worlds. That gives Be My Eyes a more scalable accessibility layer than volunteer-only or line-by-line screen-reader experiences alone.

Data flow

Images, screenshots, webpages, and user questions are sent into the Be My Eyes app, GPT-4 interprets the visual scene and conversational context together, and the app returns spoken or textual guidance the user can act on immediately.

Solution architecture

2 components · 2 layers
  1. Compute
    • GPT-4 Interprets images and webpages while supporting follow-up dialogue about what the user sees.
  2. Serving
    • Virtual Volunteer Delivers conversational visual assistance inside the Be My Eyes app for blind and low-vision users.

Architecture clues

  • The assistant was beta-tested internally before wider rollout
  • The same GPT-4 workflow is used for both real-world images and web pages
  • The team emphasizes conversational follow-up rather than one-shot object labeling

Evidence from the source

Be My Eyes began developing a GPT-4 powered Virtual Volunteer within the Be My Eyes app
GPT-4 is able to summarize the search results the way the sighted naturally scan them
GPT-4 technology not only recognizes and names what's in there, but extrapolates and analyzes what you can make with those ingredients
In early February, the company started beta-testing the GPT-backed assistant with a small group of employees
Transparency Evidence & methodology 75/100 reference value · 90% confidence · 2 sources

Review how this reference was scored and trace each normalized claim back to its documented source.

01

Scoring methodology

How scores are calculated

Customer Reference Value measures usefulness as a customer reference. Evidence Confidence measures the quality and traceability of available evidence, not independent verification.

Customer reference value75/100
  • Problem clarity20/20
    Measures whether the customer's operational problem is specific enough to compare.
  • Implementation depth25/25
    Rewards named components, data flow, integrations, and architecture detail.
  • Outcome specificity20/20
    Measures whether the reported benefit is concrete rather than a generic claim.
  • Quantified impact0/25
    0 metrics describe measurable impact.
  • Deployment scale10/10
    Rewards evidence of a live or scaled deployment and meaningful integration scope.
Evidence confidence90%
  • Source authority20/25
    The main evidence is an official vendor-published customer story.
  • Claim traceability23/25
    11 of 12 key fields link to a named source.
  • Direct evidence20/20
    4 direct source quotes retained.
  • Date provenance10/10
    The publication date comes from the source page or publisher.
  • Source transparency9/10
    2 source references document publisher, URL, authority, retrieval, and supported fields.
  • Implementation specificity8/10
    Rewards source-backed components, data flow, quantified impact, and a specific outcome.
02

Traceability

Sources & provenance

Field coverage shows which facts each source supports. Dates are shown only when documented by the source.

  1. OpenAI

    Be My Eyes customer story

    First-party
    https://openai.com/index/be-my-eyes/
    Source type
    Vendor-published customer story
    Published
    Jan 4, 2024
    Supports
    • Customer
    • Business problem
    • Solution
    • Products
    • Solution components
    • Data flow
    • Integrations
    • technical area
    • use case category
    • Business outcome
    • outcome category
    • Metrics
    • Architecture
    • evidence quotes
    • Publication date
  2. LinkedIn

    Be My Eyes | LinkedIn

    Independent secondary
    https://www.linkedin.com/company/be-my-eyes/

    The public Organization JSON-LD for Be My Eyes includes numberOfEmployees value 432; 432 maps to Mid-market under the enrichment thresholds.

    Source type
    Structured company profile
    Supports
    • Company size

Date evidence

  • Published on source page Jan 4, 2024 · OpenAI · First-party
    Open date source
Not separately sourced Industry, Region. Treat these normalized attributes as lower-confidence until a dedicated source is added.