MiMo-V2.6-Pro vs Spark X2.6 4B
Task by task
A score turns orange only when that model wins clearly more of the task's test cases. Under each score, the average time per test case on the machine it ran on. Spark X2.6 4B spends 1.3× as many thinking tokens per test case.
TaskAMiMo-V2.6-ProBSpark X2.6 4B
Overall
482m 13s
151m 3s
Agents
474m 48s
141m 32s
Structured Extraction
601m 26s
1039.5s
Coding
242m 58s
41m 8s
Grounded Answers
621m 9s
1050.2s
Instruction Following
591m 23s
371m 29s
Business Logic
571m 52s
1036.3s
Security & permissions
711m 41s
3154.3s
Diagnosis & investigation
02m 54s
01m 30s
What you'd run
The build behind each score. Orange marks the faster, smaller, cheaper or longer-context side.
SpecAMiMo-V2.6-ProBSpark X2.6 4B
Speed
55 tok/s
136 tok/s
Machine
Hosted
RTX 5090, 32 GB
Memory at 32K
—
9.4 GB
Context
1.1M (better)
605K
Cost per run
$1.80
$1.61 est. (better)
Cost per case
$0.012
$0.011 est. (better)
Time per case
2m 13s
1m 3s (better)
Quantization
BF16
BF16
Harness
openrouter
llama.cpp
The race
Each model's running score as the test cases go by. The dashed line is a perfect run.
Every test case
Each square is one test case, colored by the model that scored higher.
Agents
Structured Extraction
Coding
Grounded Answers
Instruction Following
Business Logic
Security & permissions
Diagnosis & investigation