Human Frontier
89.4
Human-calibrated frontier signal, backed by Arena-style preference evidence and separate from raw AgMoBench benchmark composite scores.
Blended Price
$3.38/M
Input Price
$1.50/M
Output Price
$9.00/M
Speed
241 tok/s
TTFT
8.63s
Axes
Filters
Providers
v2026.06 · official-100-task · Gemini 3.5 Flash (medium) · harness mini-swe-agent · effort medium · 1 attempt · pass@1 · harbor:snorkel-ai/senior-swe-bench-v2026.06 · provider google/gemini-3.5-flash · record gemini-3-5-flash-mini-swe · run 47baaf6e0c18a44b9752a875a974ff5649b1390497d94a2a516eb5cae8047068
{
"taskCount": 100,
"agentGroup": "mini-swe-agent:gemini-3.5-flash",
"basicPassAt1": 20.454545454545457,
"datasetPackage": "snorkel-ai/senior-swe-bench-v2026.06",
"publicTaskCount": 50,
"tastefulPassAt1": 3.4090909090909087,
"agentDescription": "Google Gemini 3.5 Flash via mini-swe-agent harness (Portkey→Google)",
"privateTaskCount": 50,
"upstreamProvider": "google",
"upstreamRunCount": 80,
"averageAgentSteps": 255.1590909090909,
"averageOutputTokens": 84979.35227272728,
"averageTotalCostUsd": 6.14804299909091,
"averageOutputCostUsd": 0.7648141704545455
}Evidence observed 2026-06-30