82.0tok/s
Mean per test case, 55 tok/s over the run
5.9Ktokens
Answer plus reasoning
5.2Ktokens
89% of the output
3.2M
2.3M in, 900.9K out
5h 38m
2m 13s per caseRequest time, summed
$1.80
$0.012 per caseAt the provider's list price
Every test case
One square per test case. Select a square to read the answer.
47Agents8 of 21 passed
60Structured Extraction13 of 21 passed
24Coding4 of 21 passed
62Grounded Answers13 of 21 passed
59Instruction Following11 of 21 passed
57Business Logic12 of 21 passed
71Security & permissions14 of 21 passed
0Diagnosis & investigation0 of 6 passed
Speed and output per test case
One bar per test case. Hover to inspect a case, select it to read the answer.
Peak 322 tok/s
ReasoningAnswer
Test by test
Every answer with its reasoning and the checks it had to pass.
Reproduce this run
The prompts stay private so models can't train on them. The hashes pin the exact suite and config this run used.
OpenRouterHosted
curl https://openrouter.ai/api/v1/chat/completions \
-H "Authorization: Bearer $OPENROUTER_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"xiaomi/mimo-v2.6-pro","provider":{"order":["gmicloud/bf16"],"allow_fallbacks":false},"service_tier":"default","messages":[{"role":"user","content":"Hello"}]}'The request the benchmark sent, pinned to the provider that served it.
Configuration
Where the suite ran, and the token budget each task got.
- Hosted
- OpenRouter
- GMICloud
- BF16
- 1.1M
- 0
- v1.0.0
- 2026-10-09 11:08 UTC
{
"provider": {
"order": [
"gmicloud/bf16"
],
"allow_fallbacks": false
},
"service_tier": "default"
}| Task | Reasoning | Max output per call |
|---|---|---|
| Agents | 4.1Khigh | 12.3K |
| Structured Extraction | 4.1Khigh | 12.3K |
| Coding | 4.1Khigh | 12.3K |
| Grounded Answers | 4.1Khigh | 12.3K |
| Instruction Following | 4.1Khigh | 12.3K |
| Business Logic | 4.1Khigh | 12.3K |
| Security & permissions | 4.1Khigh | 12.3K |
| Diagnosis & investigation | 4.1Khigh | 12.3K |