153.2tok/s
Mean per test case, 135 tok/s over the run
2.3Ktokens
Answer plus reasoning
1.7Ktokens
73% of the output
1.9M
1.5M in, 358.8K out
54m 18s
21.3s per caseRequest time, summed
Not measured
No price recorded
Every test case
One square per test case. Select a square to read the answer.
36Agents5 of 21 passed
48Structured Extraction10 of 21 passed
58Coding10 of 21 passed
33Grounded Answers7 of 21 passed
53Instruction Following10 of 21 passed
24Business Logic5 of 21 passed
30Security & permissions4 of 21 passed
0Diagnosis & investigation0 of 6 passed
Speed and output per test case
One bar per test case. Hover to inspect a case, select it to read the answer.
Peak 260 tok/s
ReasoningAnswer
Test by test
Every answer with its reasoning and the checks it had to pass.
Reproduce this run
The prompts stay private so models can't train on them. The hashes pin the exact suite and config this run used.
OpenRouterHosted
curl https://openrouter.ai/api/v1/chat/completions \
-H "Authorization: Bearer $OPENROUTER_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"minimax/minimax-m3.1-flash:free","provider":{"order":["minimax"],"allow_fallbacks":false},"service_tier":"default","messages":[{"role":"user","content":"Hello"}]}'The request the benchmark sent, pinned to the provider that served it.
Configuration
Where the suite ran, and the token budget each task got.
- Hosted
- OpenRouter
- Minimax
- Provider default
- 1M
- Not set
- v1.0.0
- 2026-10-19 14:09 UTC
{
"provider": {
"order": [
"minimax"
],
"allow_fallbacks": false
},
"service_tier": "default"
}| Task | Reasoning | Max output per call |
|---|---|---|
| Agents | 4.1Khigh | 12.3K |
| Structured Extraction | 4.1Khigh | 12.3K |
| Coding | 4.1Khigh | 12.3K |
| Grounded Answers | 4.1Khigh | 12.3K |
| Instruction Following | 4.1Khigh | 12.3K |
| Business Logic | 4.1Khigh | 12.3K |
| Security & permissions | 4.1Khigh | 12.3K |
| Diagnosis & investigation | 4.1Khigh | 12.3K |