Multi-turn

WebArena

Realistic web-task execution across self-hosted Reddit, GitLab, OneStopShop, and a CMS. Measures end-to-end task success in a real browser sandbox.

Top modelClaude Fable 5
Top score58.4
Models scored6
Best score / $DeepSeek V4 Pro

WebArena leaderboard

#ModelProviderScore$/1M outScore / $
1Claude Fable 5Anthropic58.4$50.001.2
2GPT-5.5 ProOpenAI56.7$180.000.3
3Gemini 3.1 ProGoogle54.2$12.004.5
4Claude Opus 4.8Anthropic48.5$25.001.9
5DeepSeek V4 ProDeepSeek43.6$2.2019.8
6GPT-5.5OpenAI41.8$30.001.4

About WebArena

Realistic web-task execution across self-hosted Reddit, GitLab, OneStopShop, and a CMS. Measures end-to-end task success in a real browser sandbox.

Source: https://arxiv.org/abs/2307.13854. Back to all benchmarks.

Last updated: · Source: Pricing dataset · Methodology

Frequently asked questions

How are token costs calculated?

Multiply input tokens by the input rate and output tokens by the output rate, add the two amounts and divide by 1,000,000. A standard request example uses 1,000 input and 500 output tokens. Monthly budgets multiply the result by request volume; taxes, hidden reasoning tokens, tools and tier surcharges can add costs.

Which recorded model has the lowest request cost?

LFM 2.2 6b by Liquid AI costs $0.00002 for the standard request, with $0.01 input and $0.02 output per million tokens. This price ranking does not establish quality equivalence; verify task success and context requirements.

Can cached and batch discounts be combined?

Only recorded rates are used. Cached input can have cache-write or storage charges, while batch rates apply only to eligible asynchronous jobs. We do not automatically stack the discounts or treat an absent rate as zero. Check the linked provider source before budgeting.

How current is the public dataset?

The live pricing table synchronizes stored model records daily; public file snapshots update when the site is rebuilt. Synchronization is not independent provider verification. It contains 1,026 priced models across 124 providers, last updated 2026-10-31. Directory entries are counted separately. A synchronization date is not proof of independent verification.