Qwen3.6 35B A3B

Qwen3.6 35B A3B

qwen/qwen3.6-35b-a3b

starter@v1HostedOpenRouterserved by AkashMLFP8256K context2026-10-30 18:52 UTC
Compare
Overall score
26

37 of 153 test cases fully passed

Throughput
159.9tok/s
Mean per test case, 156 tok/s over the run
Output per case
9.7Ktokens
Answer plus reasoning
Reasoning per case
9.3Ktokens
96% of the output
Total tokens
2.9M
1.4M in, 1.5M out
Run time
2h 45m
1m 5s per caseSum of request times
Cost
$1.47
$0.0096 per caseAt the provider's list price

Every test case

153 test cases in 8 tasks

One square per test case. Select a square to read the answer.

PassedPartial creditFailed
24Agents4 of 21 passed
43Structured Extraction9 of 21 passed
3Coding0 of 21 passed
33Grounded Answers7 of 21 passed
32Instruction Following4 of 21 passed
29Business Logic6 of 21 passed
46Security & permissions7 of 21 passed
0Diagnosis & investigation0 of 6 passed

Speed and output per test case

One bar per test case. Hover a bar to see its numbers. Select it to read the answer.

ThroughputPeak 229 tok/s
Output tokensReasoningAnswer

Test by test

Every answer with its reasoning and the checks it had to pass.

Reproduce this run

The prompts stay private so models can't train on them. The hashes pin the exact suite and config this run used.

Serve the modelOpenRouterHosted
curl https://openrouter.ai/api/v1/chat/completions \
  -H "Authorization: Bearer $OPENROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"qwen/qwen3.6-35b-a3b","provider":{"order":["akashml/fp8"],"allow_fallbacks":false},"service_tier":"default","messages":[{"role":"user","content":"Hello"}]}'

The request the benchmark sent, pinned to the provider that served it.

Record id
00fbc715-986b-41e9-a1bf-…
Suite hash, starter@v1
b2dd90d6df5fcacbb6dab8f4…
Config hash
d9fadd207335a14434f004e7…

Configuration

Where the suite ran, and the token budget each task got.

Deployment
Hosted
API
OpenRouter
Serving provider
AkashML
Precision
FP8
Context window
256K
Temperature
Not set
Bench version
v1.0.0
Ran at
2026-10-30 18:52 UTC
Provider parameters
{
  "provider": {
    "order": [
      "akashml/fp8"
    ],
    "allow_fallbacks": false
  },
  "service_tier": "default"
}
Token budget per task
TaskReasoningMax output per call
Agents4.1K12.3K
Structured Extraction4.1K12.3K
Coding4.1K12.3K
Grounded Answers4.1K12.3K
Instruction Following4.1K12.3K
Business Logic4.1K12.3K
Security & permissions4.1K12.3K
Diagnosis & investigation4.1K12.3K