Reported impact
Business outcome
Be My Eyes created a more capable accessibility assistant, improved user independence for both physical and online tasks, and opened a broader commercial path for visual accessibility support.
- Customer Experience
- Scalability
Solution
Be My Eyes used GPT-4's visual input capabilities to build Virtual Volunteer, a conversational assistant inside its accessibility app. Instead of stopping at basic object labels, the system lets users share images or webpages and ask follow-up questions so the model can describe, interpret, and reason about what matters in context, whether that means identifying ingredients in a fridge, navigating a station, or summarizing cluttered shopping pages. Inputs from a camera, uploaded image, or web page enter the Be My Eyes app, GPT-4 processes both the visual content and the ongoing dialogue, and the resulting explanation is returned as immediately usable guidance for the user. The company beta-tested the GPT-backed assistant internally before broad release and highlighted that the same architecture can work across the physical and digital worlds. That gives Be My Eyes a more scalable accessibility layer than volunteer-only or line-by-line screen-reader experiences alone.
Data flow
Images, screenshots, webpages, and user questions are sent into the Be My Eyes app, GPT-4 interprets the visual scene and conversational context together, and the app returns spoken or textual guidance the user can act on immediately.