Qwen3.8 Flash Next

Qwen3.8 Flash Next

qwen/qwen3.8-flash

starter@v1HostedOpenRouterserved by Alibaba1M context2026-10-19 07:21 UTC
Compare
Overall score
42

68 of 153 test cases fully passed

Throughput
74.2tok/s
Mean per test case, 68 tok/s over the run
Output per case
4.1Ktokens
Answer plus reasoning
Reasoning per case
3.3Ktokens
80% of the output
Total tokens
1.8M
1.1M in, 626.8K out
Run time
3h 11m
1m 15s per caseSum of request times
Cost
$0.46
$0.003 per caseAt the provider's list price

Every test case

153 test cases in 8 tasks

One square per test case. Select a square to read the answer.

PassedPartial creditFailed
52Agents9 of 21 passed
50Structured Extraction12 of 21 passed
52Coding7 of 21 passed
51Grounded Answers12 of 21 passed
62Instruction Following12 of 21 passed
25Business Logic7 of 21 passed
45Security & permissions9 of 21 passed
0Diagnosis & investigation0 of 6 passed

Speed and output per test case

One bar per test case. Hover a bar to see its numbers. Select it to read the answer.

ThroughputPeak 120 tok/s
Output tokensReasoningAnswer

Test by test

Every answer with its reasoning and the checks it had to pass.

Reproduce this run

The prompts stay private so models can't train on them. The hashes pin the exact suite and config this run used.

Serve the modelOpenRouterHosted
curl https://openrouter.ai/api/v1/chat/completions \
  -H "Authorization: Bearer $OPENROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"qwen/qwen3.8-flash","provider":{"order":["alibaba"],"allow_fallbacks":false},"service_tier":"default","messages":[{"role":"user","content":"Hello"}]}'

The request the benchmark sent, pinned to the provider that served it.

Record id
e6540ecc-a11d-4d19-bc16-…
Suite hash, starter@v1
b2dd90d6df5fcacbb6dab8f4…
Config hash
ed35122a8f067f286f31b745…

Configuration

Where the suite ran, and the token budget each task got.

Deployment
Hosted
API
OpenRouter
Serving provider
Alibaba
Precision
Provider default
Context window
1M
Temperature
Not set
Bench version
v1.0.0
Ran at
2026-10-19 07:21 UTC
Provider parameters
{
  "provider": {
    "order": [
      "alibaba"
    ],
    "allow_fallbacks": false
  },
  "service_tier": "default"
}
Token budget per task
TaskReasoningMax output per call
Agents4.1K12.3K
Structured Extraction4.1K12.3K
Coding4.1K12.3K
Grounded Answers4.1K12.3K
Instruction Following4.1K12.3K
Business Logic4.1K12.3K
Security & permissions4.1K12.3K
Diagnosis & investigation4.1K12.3K