Flint

Flint

recursive/flint-v1.0:free

starter@v1HostedOpenRouterserved by RecursiveBF16256K context2026-10-22 08:49 UTC
Compare
Overall score
21

33 of 153 test cases fully passed

Throughput
150.6tok/s
Mean per test case, 149 tok/s over the run
Output per test
10.9Ktokens
Answer plus reasoning
Reasoning per test
9.9Ktokens
90% of the output
Total tokens
2.8M
1.1M in, 1.7M out
Run time
3h 15m
1m 17s per caseRequest time, summed
Cost
Not measured
No price recorded

Every test case

153 test cases in 8 tasks

One square per test case. Select a square to read the answer.

PassedPartial creditFailed
14Agents2 of 21 passed
29Structured Extraction6 of 21 passed
14Coding3 of 21 passed
29Grounded Answers6 of 21 passed
35Instruction Following7 of 21 passed
10Business Logic2 of 21 passed
35Security & permissions7 of 21 passed
0Diagnosis & investigation0 of 6 passed

Speed and output per test case

One bar per test case. Hover to inspect a case, select it to read the answer.

ThroughputPeak 177 tok/s
Output tokensReasoningAnswer

Test by test

Every answer with its reasoning and the checks it had to pass.

Reproduce this run

The prompts stay private so models can't train on them. The hashes pin the exact suite and config this run used.

Serve the modelOpenRouterHosted
curl https://openrouter.ai/api/v1/chat/completions \
  -H "Authorization: Bearer $OPENROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"recursive/flint-v1.0:free","provider":{"order":["recursive/bf16"],"allow_fallbacks":false},"service_tier":"default","messages":[{"role":"user","content":"Hello"}]}'

The request the benchmark sent, pinned to the provider that served it.

Record id
6e607e02-d315-4e4d-924b-…
Suite hash, starter@v1
b2dd90d6df5fcacbb6dab8f4…
Config hash
d5a1f28704345e395aa03534…

Configuration

Where the suite ran, and the token budget each task got.

Deployment
Hosted
API
OpenRouter
Serving provider
Recursive
Precision
BF16
Context window
256K
Temperature
Not set
Bench version
v1.0.0
Ran at
2026-10-22 08:49 UTC
Provider parameters
{
  "provider": {
    "order": [
      "recursive/bf16"
    ],
    "allow_fallbacks": false
  },
  "service_tier": "default"
}
Token budget per task
TaskReasoningMax output per call
Agents4.1K12.3K
Structured Extraction4.1K12.3K
Coding4.1K12.3K
Grounded Answers4.1K12.3K
Instruction Following4.1K12.3K
Business Logic4.1K12.3K
Security & permissions4.1K12.3K
Diagnosis & investigation4.1K12.3K