Clover 35B A3B Preview

Clover 35B A3B Preview

Clover-35B-A3B-Preview

starter@v1HostedCustom endpointserved by DiffuSpace2026-10-30 08:51 UTC
Compare
Overall score
30

42 of 153 test cases fully passed

Throughput
266.8tok/s
Mean per test case, 252 tok/s over the run
Output per case
8.4Ktokens
Answer plus reasoning
Reasoning per case
8Ktokens
95% of the output
Total tokens
2.7M
1.4M in, 1.3M out
Run time
1h 29m
35.1s per caseSum of request times
Cost
Not measured
No price recorded

Every test case

153 test cases in 8 tasks

One square per test case. Select a square to read the answer.

PassedPartial creditFailed
20Agents1 of 21 passed
43Structured Extraction9 of 21 passed
10Coding2 of 21 passed
48Grounded Answers10 of 21 passed
53Instruction Following8 of 21 passed
19Business Logic4 of 21 passed
47Security & permissions8 of 21 passed
0Diagnosis & investigation0 of 6 passed

Speed and output per test case

One bar per test case. Hover a bar to see its numbers. Select it to read the answer.

ThroughputPeak 464 tok/s
Output tokensReasoningAnswer

Test by test

Every answer with its reasoning and the checks it had to pass.

Reproduce this run

The prompts stay private so models can't train on them. The hashes pin the exact suite and config this run used.

Serve the modelCustom endpointHosted
curl "${OPENAI_BASE_URL:-https://api.openai.com/v1}/chat/completions" \
  -H "Authorization: Bearer $OPENAI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"Clover-35B-A3B-Preview","messages":[{"role":"user","content":"Hello"}]}'

Set OPENAI_BASE_URL when the run used an endpoint other than OpenAI's.

Record id
8594c9c1-7dec-4895-bac5-…
Suite hash, starter@v1
b2dd90d6df5fcacbb6dab8f4…
Config hash
5e67e45c31166632380bf846…

Configuration

Where the suite ran, and the token budget each task got.

Deployment
Hosted
API
Custom endpoint
Serving provider
DiffuSpace
Precision
Provider default
Context window
Not recorded
Temperature
Not set
Bench version
v1.0.0
Ran at
2026-10-30 08:51 UTC
Token budget per task
TaskReasoningMax output per call
Agents4.1K12.3K
Structured Extraction4.1K12.3K
Coding4.1K12.3K
Grounded Answers4.1K12.3K
Instruction Following4.1K12.3K
Business Logic4.1K12.3K
Security & permissions4.1K12.3K
Diagnosis & investigation4.1K12.3K