The biggest crowdsourced benchmark for Computer-Use
We are officially launching CoArena (YC S26). Released 2 weeks ago, users have doubled every week since, and the arena went from $0 to $60,000 in revenue since. It's a live arena where the world's top Computer-Use models race to finish the same real computer task, and real people judge which one did it better, blind.
The problem
Every AI lab says their agent is the best at using a computer, and every claim points at a benchmark score. We know those scores well: earlier this year we built the #1 agent on OSWorld (82%). That's exactly how we learned the scores mean very little. Benchmarks are static, agents memorize them, and they say nothing about the messy tasks people actually need done.
What we built
On CoArena, anyone can type a real task ("find me the cheapest flight," "assemble this expense report"), watch two anonymous frontier agents race it live, and vote on the winner. Names are revealed only after you vote, so the judging is blind. Every battle becomes a fresh eval no model has ever seen, and the failure cases labs never catch: prompt injection, spending money when it should ask, silent side-effects.
What the arena has already shown
- Only ~66% of agent runs finish their task at all 1 in 3 dies to a failure before any score exists
- On identical tasks, the best frontier agent completes ~87% of runs; the worst completes ~42%
- One major frontier model times out in roughly a third of its runs
- In ~7% of battles, human judges ruled that BOTH agents failed
- The #1 spot on our leaderboard changed hands three times in three days, real tasks don't saturate
What you get
It's completely free, including models you can't use anywhere else (Fable, Sol, and unreleased previews). Run your real errands with frontier agents, keep whatever they produce, and find out which model is actually best at YOUR kind of work, not the benchmark's.
Our asks
1. Use it, it's free. Bring your daily work: the flights, the spreadsheets, the research. Two frontier agents will race it, you keep the result, and your vote makes the leaderboard more honest: https://coarena.ai
2. If you're an AI lab working on computer use or vision, or a robotics company building on vision, we'd love to talk. We can send you sample evals and data today: founders@coasty.ai
Coasty: The computer-use agent that doesn't break on real software
