Qwen: Qwen2.5 VL 72B Instruct

Last synced Aug 1, 2026, 12:19 AM33K context

Human Frontier

59.7

Human-calibrated frontier signal, backed by Arena-style preference evidence and separate from raw AgMoBench benchmark composite scores.

Blended Price

$0.26/M

Input Price

$0.15/M

Output Price

$0.60/M

Speed

—

TTFT

—

Benchmark Scores

Intelligence Index

External Benchmarks

AA-Omniscience Accuracy

How Qwen: Qwen2.5 VL 72B Instruct Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $37.5

AgMoBench Overall≥ 1.8

Providers

ai2ai21-labsalibabaanthropicarceeawsazurebaidu

Show quadrants

anthropic

openai

mistral

azure

cohere

meta

ai21-labs

inclusionai

google

ai2

ibm

alibaba

upstage

nvidia

aws

kimi

nous-research

thinking-machines

minimax

stepfun

tencent

deepseek

zai

multiversecomputing

xiaomi

xai

deepcogito

sarvam

kwaikat

baidu

swiss-ai-initiative

bytedance_seed

inception

reka-ai

arcee

perplexity

Bubble size = Context Window

8191.00

2000000.00

Compare with other models

GPQA Diamond

— / 100

LiveCodeBench

— / 100

Terminal-Bench Hard

— / 100

τ²-Bench

— / 100

AA-Omniscience Hallucination RatePredicted

95.5 / 100

Aider PolyglotPredicted

38.3 / 100

AIMEPredicted

0.3 / 30

AIME 2025Predicted

0.7 / 30

AlpacaEval 2.0 LCPredicted

30.2 / 100

AlpacaEval 2.0 RawPredicted

21.0 / 100

ARC-AGI-1Predicted

61.9 / 100

ARC-AGI-1 Cost per TaskPredicted

0.0

ARC-AGI-2Predicted

0.0 / 100

ARC-AGI-2 Cost per TaskPredicted

0.1

BFCL (Berkeley Function Calling)Predicted

40.8

BigCodeBench CompletePredicted

53.8 / 100

BigCodeBench InstructPredicted

43.9 / 100

AA Intelligence Index (Matrix)Predicted

65.9

AA Long Context Reasoning (Matrix)Predicted

71.3

AIME 2024Predicted

90.3

AIME 2025 (Matrix)Predicted

89.5

Arena-Hard AutoPredicted

67.0

BrowseCompPredicted

61.7

BRUMO 2025Predicted

87.2

CMIMC 2025Predicted

75.0

GPQA Diamond (Matrix)Predicted

68.8

HLE (Matrix)Predicted

15.6

HMMT Feb 2025Predicted

57.5

HMMT Nov 2025Predicted

89.5

HumanEvalPredicted

86.5

IFBench (Matrix)Predicted

39.6

IFEvalPredicted

84.7

IMO 2025Predicted

15.1

LiveCodeBench (Matrix)Predicted

58.6

MATH-500 (Matrix)Predicted

95.0

MathArena Apex 2025Predicted

1.0

MMLU-Pro (Matrix)Predicted

75.6

MMMU-ProPredicted

80.6

MRCR v2Predicted

75.6

OSWorld (Unversioned Matrix Import)Predicted

42.8 / 100

SimpleQAPredicted

27.1

SMT 2025Predicted

81.2

SWE-bench ProPredicted

37.9

Tau-Bench Telecom (Matrix)Predicted

96.0

Terminal-Bench 2.0Predicted

23.1

Terminal-Bench 1.0Predicted

18.2

USAMO 2025Predicted

8.3

Video-MMUPredicted

86.2

browsecompPredicted

59.0

BullshitBenchPredicted

31.0 / 100

Aider PolyglotPredicted

0.0

Apex AgentsPredicted

2.3

Arc Agi 2Predicted

0.0

BIG-Bench HardPredicted

3.0

CAD-EvalPredicted

5.1

Chess PuzzlesPredicted

0.1

CyBenchPredicted

0.1

DeepResearchBenchPredicted

0.3

FictionLiveBenchPredicted

0.4

GSM8K (Epoch)Predicted

4.5

HellaSwagPredicted

2.5

Lech Mazur WritingPredicted

7.4

METR Time HorizonsPredicted

0.8

OTIS Mock AIME 2024–2025Predicted

0.2

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.3

The Agent CompanyPredicted

1.6

TriviaQAPredicted

4.2

WinoGrandePredicted

0.9

FrontierMathPredicted

13.9 / 100

GAIA Level 1Predicted

47.8

GAIA Level 2Predicted

25.0

GAIA Level 3Predicted

1.9

GAIAPredicted

32.3 / 100

GPQA DiamondPredicted

0.6 / 100

HLEPredicted

0.1 / 100

IFBenchPredicted

0.5 / 100

LCRPredicted

0.0 / 100

LegalBenchPredicted

83.5 / 100

LiveBench CodingPredicted

66.5 / 100

LiveBench Data AnalysisPredicted

44.2 / 100

LiveBench LanguagePredicted

54.3 / 100

LiveBench MathPredicted

62.6 / 100

LiveBench OverallPredicted

47.2 / 100

LiveBench ReasoningPredicted

42.1 / 100

LiveCodeBenchPredicted

0.4 / 100

LongBench v2 EasyPredicted

46.5

LongBench v2 HardPredicted

42.3

LongBench v2Predicted

38.3 / 100

MATH-500Predicted

0.9 / 100

MathVistaPredicted

56.3 / 100

MedQA (USMLE)Predicted

83.4

MLE-bench (Original)Predicted

22.9 / 100

MMLU ProPredicted

0.7 / 100

MMTU Table UnderstandingPredicted

54.0 / 100

MT-BenchPredicted

7.9 / 10

NoLiMa (NIAH)Predicted

92.8 / 100

Open LLM AveragePredicted

33.2 / 100

Open LLM: BBHPredicted

61.2 / 100

Open LLM: GPQAPredicted

33.2 / 100

Open LLM: IFEvalPredicted

63.7 / 100

Open LLM: MATH Level 5Predicted

28.0 / 100

Open LLM: MMLU-PROPredicted

45.6 / 100

Open LLM: MUSRPredicted

43.6 / 100

RE-BenchPredicted

4.3

SciCodePredicted

0.3 / 100

SimpleBenchPredicted

29.2 / 100

simpleqaPredicted

26.0

SWE-bench LitePredicted

22.2 / 100

SWE-bench VerifiedPredicted

46.0 / 100

τ²-BenchPredicted

0.1 / 100

tau-bench RetailPredicted

78.6 / 100

Terminal-Bench HardPredicted

0.0 / 100

Vectara Factual ConsistencyPredicted

91.1 / 100

Vectara Hallucination RatePredicted

8.9 / 100

WeirdMLPredicted

31.1 / 100

WildBenchPredicted

49.1

arena_elo_visionchatbot_arena

1122.0

GeoBenchepoch_ai

0.0

OSWorld (Epoch Import, Version Unverified)epoch_ai

4.4 / 100

Spatialviz Benchepoch_ai

7.8e+24

OCRBench v2open-vlm-leaderboard

88.2 / 100

WebArenawebarena

7.1 / 100