OA OpenAI Software / SaaS North America

Braintrust

Application Refactoring · IT Operations Automation

Braintrust wanted to respond to customer feature requests faster and run more engineering experiments, but slower coding tools and backlog-driven workflows made it costly to turn feedback into working prototypes in real time.

50% of the Braintrust team moved to Codex in one month
Customer feature requests can be turned into preview branches in minutes

Solution

Braintrust uses Codex with GPT-5.5 as an agentic coding workflow around its observability and eval platform for AI products. Engineers paste live customer feature requests into Codex, point it at the relevant repository, and ask it to generate preview branches they can show back to customers in minutes instead of parking the request in backlog for later prioritization. For harder problems, the team writes a failing test, provisions a sandbox environment, and lets Codex run autonomously in that controlled workspace until it proposes a fix. This combines customer input, tests, and the existing codebase with a fast terminal-native model that can iterate without slowing down, so engineers can ideate with customers in real time, try more experiments, and move more quickly from request to working software.

Data flow

Customer feature requests are pasted into Codex alongside Braintrust's codebase context. For debugging or new ideas, engineers add a test and a sandbox environment, then GPT-5.5 iterates on code until Codex can produce a preview branch. The resulting branch is shown back to customers immediately, tightening the feedback loop before work enters the longer-term roadmap.

Solution architecture

2 components · 2 layers
  1. Compute
    • GPT-5.5 Generates and iterates on code changes quickly enough for real-time customer ideation and sandboxed problem solving.
  2. Orchestration
    • Codex Provides the coding environment where engineers turn customer requests into preview branches and run autonomous code experiments.

Architecture clues

  • Codex operates inside a sandbox environment for controlled experimentation
  • Customer requests are copied directly into Codex for implementation
  • Engineers write a test that demonstrates the problem before autonomous runs
  • Preview branches are used to show working ideas back to customers in real time

Evidence from the source

"Codex unlocked our ability to try out customer feature requests in real time."
"In one month, half of the Braintrust team moved to Codex."
"With Codex, I've shifted to writing a test that demonstrates a problem, creating a sandbox environment, and then letting Codex run in that environment."
"With Codex, its engineers can now take customer feature requests and create preview branches to show working ideas to customers in minutes."