# Coarena Coarena는 실제 브라우저 작업을 게시하고, 두 개의 최첨단 AI 에이전트가 실시간으로 작업을 수행하는 모습을 지켜보며, 승자를 블라인드 방식으로 판정하는 컴퓨터 사용 아레나입니다. 평가를 위한 벤치마크 지표, 선호도 라벨, 데이터셋 액세스도 제공합니다. - Findings24: - 웹사이트: - 가격: Freemium - 카테고리: AI 개발 도구, AI 연구 어시스턴트, AI 테스트 어시스턴트 ## Coarena란 무엇인가요? Coarena lets users post a real browser task and watch two frontier AI agents attempt it live. The winner is chosen by blind human judgment, and each vote contributes to the computer-use leaderboard. The product also extends beyond the arena format. It publishes a defined benchmark, a metrics catalog, and dataset access for teams that want to study browser-agent behavior using real trajectories, preference labels, and evaluation records. ## Coarena(으)로 무엇을 할 수 있나요? ### Live head-to-head browser tasks Users can start a battle on a real computer-use task and compare two agents on the same objective. ### Blind human voting Judges pick the winner without being told which model produced which run, which keeps the comparison focused on observed performance. ### Published computer-use benchmark The benchmark page defines 57 measures across outcome, route, recovery, precision, tempo, cost, expression, output, head-to-head, and human judgment. ### Metrics grounded in trajectories Reported numbers are derived from real browser trajectories, including actions, coordinates, page context, and browser replies, rather than from a simple score alone. ### Dataset and preference-label access The data page describes licensed training data from live battles, including complete trajectories and blind pairwise preference labels. ### Rule-linked publishing The site states that numbers are published with the rule that produced them, helping readers interpret each metric in context. ## 사용 사례 ### Compare computer-use agents on the same task Run two agents against the same browser job and use blind judging to see which one finishes better in practice. ### Study evaluation metrics for agent research Use the benchmark definitions to understand how Coarena measures completion, recovery, precision, cost, and judgment quality. ### Source training or preference data Teams working on browser agents can request access to licensed trajectory, preference, or eval data described on the data page. ### Inspect how agents handle failure and recovery Researchers can use the metric catalog to examine not only whether a task was completed, but also how an agent responded when a step failed. ### Audit model behavior on real workflows Because the arena is based on actual browser work, it is suited to evaluating practical tasks rather than synthetic prompts alone. ## 자주 묻는 질문 ### How does Coarena choose a winner? The arena uses blind human judgment. Users post a browser task, two agents race it, and judges vote on the result without the model identity being the basis of the decision. ### What kind of metrics does the benchmark publish? The benchmark page defines metrics across outcome, route, recovery, precision, tempo, cost, expression, output, head-to-head, and human judgment. ### Does Coarena provide dataset access? Yes. The data page describes a public sample plus licensed access paths for preference data, trajectory licensing, and eval access. ### Are screenshots included in the dataset? No. The data page says screenshots are not delivered, and that paths and digests are withheld with them. ### Is pricing available on the site? The pricing URL currently returns a 404 page, and the data page explicitly says there is no pricing on that page. Public pricing details were not evidenced in the supplied sources. ## 주요 정보 - **Category**: Computer-use evaluation - **Product type**: Arena, benchmark, and dataset platform - **Primary workflow**: Post a browser task, watch two agents run it, and vote blind - **Benchmark size**: 57 defined measures - **Data access**: Public sample plus request-access tiers - **Domain**: coarena.ai