Human Frontier
88.3
Human-calibrated frontier signal, backed by Arena-style preference evidence and separate from raw AgMoBench benchmark composite scores.
Blended Price
$2.57/M
Input Price
$1.87/M
Output Price
$4.68/M
Speed
80 tok/s
TTFT
2.12s
Axes
Filters
Providers
v2026.06 · official-100-task · Inkling (max) · harness mini-swe-agent · effort max · 1 attempt · pass@1 · harbor:snorkel-ai/senior-swe-bench-v2026.06 · provider thinkingmachines/Inkling · record thinkingmachines-inkling-mini-swe · run b927c3ef29f49a1dc839e038f8b3cd3b4a201370e95bb0a8d032a9a0e129a40e
{
"taskCount": 100,
"agentGroup": "mini-swe-agent:Inkling",
"basicPassAt1": 3.1578947368421053,
"basicPassAt3": 5.263157894736842,
"datasetPackage": "snorkel-ai/senior-swe-bench-v2026.06",
"publicTaskCount": 50,
"tastefulPassAt1": 0,
"tastefulPassAt3": 0,
"agentDescription": "Thinking Machines Inkling via mini-swe-agent harness (Portkey→Together.ai); reasoning max",
"privateTaskCount": 50,
"upstreamProvider": null,
"upstreamRunCount": 50,
"averageAgentSteps": 51.2,
"averageOutputTokens": 3398.1473684210528,
"averageTotalCostUsd": 0,
"averageOutputCostUsd": 0,
"basicAllThreePassRate": 1.0526315789473684,
"tastefulAllThreePassRate": 0
}Evidence observed 2026-07-23