Arena.
Prove an agent works before it touches production.
Arena is the proving ground. Run agents against curated scenario suites before they touch production, real customers, or real code. Replay tests against your own history; Arena tests against the situations you have not hit yet.
Curate, run, gate.
Build scenario suites per vertical, or record real incidents.
Score every agent version against the suite.
Block the deploy until it clears, wired into CI.
What it measures.
The situations you have not hit yet: hostile tickets, malformed repos, adversarial prompts. Each one carries what a correct answer must do, in your words, and that is what gets scored.
Block a release until the agent clears its suite. Wire into CI like any other test.
Record a real incident once, replay it against every future version forever.
Every run versioned. Watch capability rise and regressions appear across versions.
Who reaches for Arena.
- ·Teams shipping their first agent
- ·Operators gating deploys on eval scores
- ·Platforms certifying internal agents
Pairs with the rest of Observe.
Want Arena in your stack?
We're onboarding design partners now. Join the waitlist to be in the Arena cohort.
Just email is required. One email when Arena goes live. Nothing else.