DeepSeek V4.1 Flash vs Flint
Task by task
A score turns orange only when that model wins clearly more of the task's test cases. Under each score, the average time per test case on the machine it ran on. Flint spends 1.8× as many thinking tokens per test case.
TaskADeepSeek V4.1 FlashBFlint
Overall
643m 35s
211m 17s
Agents
464m 42s
1447.7s
Structured Extraction
862m 8s
291m 17s
Coding
514m 55s
141m 19s
Grounded Answers
762m 17s
2957.7s
Instruction Following
894m 24s
352m 28s
Business Logic
814m 1s
101m 20s
Security & permissions
693m 3s
3552.6s
Diagnosis & investigation
172m 8s
057.0s
What you'd run
The build behind each score. Orange marks the faster, smaller, cheaper or longer-context side.
SpecADeepSeek V4.1 FlashBFlint
Speed
30 tok/s
149 tok/s (better)
Machine
Hosted
Hosted
Memory at 32K
—
—
Context
1M (better)
256K
Cost per run
$0.39
Not measured
Cost per case
$0.0026
Not measured
Time per case
3m 35s
1m 17s (better)
Quantization
FP8
BF16
Harness
openrouter
openrouter
The race
Each model's running score as the test cases go by. The dashed line is a perfect run.
Every test case
Each square is one test case, colored by the model that scored higher.
Agents
Structured Extraction
Coding
Grounded Answers
Instruction Following
Business Logic
Security & permissions
Diagnosis & investigation