Qwen3.8 27B
qwen/qwen3.8-27b
starter@v1HostedOpenRouterserved by Near AIFP8256K context2026-10-12 21:50 UTC48
79 of 153 test cases fully passed
209.2tok/s
Mean per test case, 196 tok/s over the run
5.9Ktokens
Answer plus reasoning
5.4Ktokens
91% of the output
2.2M
1.2M in, 909.2K out
1h 24m
33.3s per caseSum of request times
$1.28
$0.0083 per caseAt the provider's list price
Every test case
One square per test case. Select a square to read the answer.
57Agents11 of 21 passed
73Structured Extraction18 of 21 passed
37Coding5 of 21 passed
61Grounded Answers14 of 21 passed
67Instruction Following11 of 21 passed
36Business Logic10 of 21 passed
51Security & permissions10 of 21 passed
0Diagnosis & investigation0 of 6 passed
Speed and output per test case
One bar per test case. Hover a bar to see its numbers. Select it to read the answer.
Peak 265 tok/s
ReasoningAnswer
Test by test
Every answer with its reasoning and the checks it had to pass.
Reproduce this run
The prompts stay private so models can't train on them. The hashes pin the exact suite and config this run used.
OpenRouterHosted
curl https://openrouter.ai/api/v1/chat/completions \
-H "Authorization: Bearer $OPENROUTER_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"qwen/qwen3.8-27b","provider":{"order":["near-ai/fp8"],"allow_fallbacks":false},"service_tier":"default","messages":[{"role":"user","content":"Hello"}]}'The request the benchmark sent, pinned to the provider that served it.
Configuration
Where the suite ran, and the token budget each task got.
- Hosted
- OpenRouter
- Near AI
- FP8
- 256K
- Not set
- v1.0.0
- 2026-10-12 21:50 UTC
{
"provider": {
"order": [
"near-ai/fp8"
],
"allow_fallbacks": false
},
"service_tier": "default"
}| Task | Reasoning | Max output per call |
|---|---|---|
| Agents | 4.1K | 12.3K |
| Structured Extraction | 4.1K | 12.3K |
| Coding | 4.1K | 12.3K |
| Grounded Answers | 4.1K | 12.3K |
| Instruction Following | 4.1K | 12.3K |
| Business Logic | 4.1K | 12.3K |
| Security & permissions | 4.1K | 12.3K |
| Diagnosis & investigation | 4.1K | 12.3K |