DeepSeek V4 Flash 0731

deepseek/deepseek-v4-flash-0731

openrouter1 build benchmarkedbest build deepseek65 tok/s
best build

Scores at a glance

overall53
Tool Calling8520/27
Structured Output3710/27
RAG / Retrieval QA5916/27
Context Recall9417/18
Coding5214/27
Reasoning & Math3610/28
Instruction Following185/28
Classification4513/29
Summarization5216/27
0255075100

0–100 per task · n/m = cases passed (scores credit partial passes) · overall = mean across tasks

best build
config
deployment

deepseek

quantization
harness
openrouter
context
1.0M
memory
throughput
65 tok/s
cost / run
$0.2742
provider
openrouter
run
2026-08-05
run this buildOpenRouterhosted
curl https://openrouter.ai/api/v1/chat/completions \
  -H "Authorization: Bearer $OPENROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"deepseek/deepseek-v4-flash-0731","messages":[{"role":"user","content":"Hello"}]}'

Hosted API — not self-hostable. This is the call the benchmark made; try it live in the Playground.

record
per-test results

Full run record

Per-test scores, full transcripts, and the reproduce recipe.

open the run record →