Same model name, different answers.
DeepSeek V4.1 Flash: outside the reference
On DeepSeek V4.1 Flash, 5 of 61 endpoints sit outside the reference: baidu/fp8, open-inference/fp4, near-ai, ionstream/flex, reka. Ranked endpoints run 79 to 88% on exact match.
Exact match, mean over every night listed.
Cite: Bitdepth · bitdepth.dev/m/deepseek-v4.1-flash-1017 · as of Nov 19, 2026
venice/int4, night by night
On gpt-oss-120b, venice/int4 matched the reference on 95% of prompts over its first three nights and 81% over its last three. It now sits outside the reference.
Cite: Bitdepth · bitdepth.dev/charts · as of Nov 19, 2026
Per model, the best price for the right answer.
DeepSeek V4.1 Flash
61 endpointsOn DeepSeek V4.1 Flash, the cheapest endpoint that matches the reference is particle-ai/us/flex at $0.25 per million output tokens. 5 of 61 endpoints sit outside the reference.
- 1particle-ai/us/flex$0.098
- 2deepinfra/fp8/flex$0.14
- 3deepinfra/fp8$0.17
DeepSeek V4 Pro
18 endpointsOn DeepSeek V4 Pro, the cheapest endpoint that matches the reference is relace/fp4 at $1.50 per million output tokens. 4 of 18 endpoints sit outside the reference.
- 1relace/fp4$1.61
- 2streamlake/fp8$1.71
- 3siliconflow/fp8$1.82
gpt-oss-120b
30 endpointsOn gpt-oss-120b, the cheapest endpoint that matches the reference is near-ai/fp4 at $0.15 per million output tokens. 1 of 30 endpoints sit outside the reference.
- 1near-ai/fp4$0.062
- 2coreweave/fp4$0.068
- 3dekallm/bf16$0.070
Mistral Large 4
2 endpointsOn Mistral Large 4, the cheapest endpoint that matches the reference is mistral/zdr at $2.10 per million output tokens. All 2 graded endpoints match it.
- 1mistral/zdr$1.05
- 2mistral/eu$1.16
GLM 5.3 Flash
48 endpointsFirst look at GLM 5.3 Flash: 48 endpoints on OpenRouter, 6 nights measured. Grades start at 7 nights.
- First look, 6 nights. Ranked from 7.
Gemma 4 31B
21 endpointsFirst look at Gemma 4 31B: 21 endpoints on OpenRouter, 6 nights measured. Grades start at 7 nights.
- First look, 6 nights. Ranked from 7.
MiMo V2.6 Pro
5 endpointsFirst look at MiMo V2.6 Pro: 5 endpoints on OpenRouter, 6 nights measured. Grades start at 7 nights.
- First look, 6 nights. Ranked from 7.
Every endpoint, named.
On DeepSeek V4.1 Flash, the cheapest endpoint that matches the reference is particle-ai/us/flex at $0.25 per million output tokens. 5 of 61 endpoints sit outside the reference.
| # | Endpoint | Declared | Exact match | Self-agree | Nights | Drift | $ in / out per M | Quality-adjusted | State |
|---|---|---|---|---|---|---|---|---|---|
| 1 | particle-ai/us/flex | unknown | 86.3% | 83.5% | 15 | stable | $0.030 / $0.25 | $0.098 | Matches reference |
| 2 | deepinfra/fp8/flex | fp8 | 84.9% | 83.6% | 15 | stable | $0.078 / $0.24 | $0.14 | Matches reference |
| 3 | deepinfra/fp8 | fp8 | 85.4% | 83.5% | 15 | stable | $0.098 / $0.29 | $0.17 | Matches reference |
| 4 | wafer/us | mxfp4 | 86.6% | 80.9% | 15 | stable | $0.036 / $0.50 | $0.18 | Matches reference |
| 5 | alibaba | unknown | 85.7% | 82.0% | 15 | stable | $0.090 / $0.36 | $0.18 | Matches reference |
| 6 | particle-ai/us | unknown | 86.4% | 86.3% | 15 | stable | $0.060 / $0.50 | $0.20 | Matches reference |
| 7 | morph/fp8 | fp8 | 86.5% | 85.3% | 15 | stable | $0.059 / $0.52 | $0.20 | Matches reference |
| 8 | wafer/mxfp4 | mxfp4 | 85.5% | 80.4% | 15 | stable | $0.066 / $0.50 | $0.20 | Matches reference |
| 9 | stepfun/fp8 | fp8 | 85.5% | 94.1% | 15 | stable | $0.10 / $0.42 | $0.21 | Matches reference |
| 10 | streamlake/fp8 | fp8 | 82.5% | 85.8% | 15 | stable | $0.11 / $0.44 | $0.24 | Matches reference |
| 11 | primeintellect | unknown | 86.3% | 90.3% | 15 | stable | $0.044 / $0.70 | $0.24 | Matches reference |
| 12 | relace/fp4 | fp4 | 85.8% | 92.4% | 15 | stable | $0.12 / $0.50 | $0.25 | Matches reference |
| 13 | inference-net/fp8 | fp8 | 85.6% | 81.9% | 15 | stable | $0.080 / $0.64 | $0.26 | Matches reference |
| 14 | cloudflare | unknown | 87.7% | 83.5% | 15 | stable | $0.10 / $0.60 | $0.26 | Matches reference |
| 15 | inference-net/us | fp8 | 85.2% | 81.3% | 15 | stable | $0.080 / $0.64 | $0.26 | Matches reference |
| 16 | deepinfra/fp8/priority | fp8 | 85.8% | 83.9% | 15 | stable | $0.15 / $0.44 | $0.26 | Matches reference |
| 17 | river | unknown | 80.7% | 93.6% | 8 | stable | $0.12 / $0.48 | $0.26 | Matches reference |
| 18 | dekallm | unknown | 85.1% | 81.9% | 15 | stable | $0.10 / $0.60 | $0.26 | Matches reference |
| 19 | cohere/fp8 | fp8 | 87.8% | 87.5% | 12 | stable | $0.15 / $0.50 | $0.27 | Matches reference |
| 20 | siliconflow/fp8 | fp8 | 85.9% | 89.6% | 15 | stable | $0.15 / $0.60 | $0.31 | Matches reference |
| 21 | novita/fp8 | fp8 | 85.8% | 84.5% | 15 | stable | $0.17 / $0.66 | $0.34 | Matches reference |
| 22 | modelrun/fp4 | fp4 | 84.9% | 91.5% | 9 | stable | $0.17 / $0.67 | $0.35 | Matches reference |
| 23 | makora/fp8 | fp8 | 86.2% | 84.4% | 15 | stable | $0.15 / $0.80 | $0.36 | Matches reference |
| 24 | gmicloud/fp8 | fp8 | 83.4% | 91.4% | 15 | stable | $0.18 / $0.72 | $0.38 | Matches reference |
| 25 | ionstream | unknown | 79.3% | 85.5% | 15 | stable | $0.21 / $0.62 | $0.39 | Matches reference |
| 26 | digitalocean | unknown | 79.0% | 74.4% | 15 | improving | $0.18 / $0.72 | $0.40 | Matches reference |
| 27 | atlas-cloud/fp8 | fp8 | 85.3% | 84.3% | 15 | stable | $0.20 / $0.78 | $0.40 | Matches reference |
| 28 | fireworks/spot | unknown | 85.6% | 81.8% | 15 | stable | $0.21 / $0.84 | $0.43 | Matches reference |
| 29 | primalabs | unknown | 85.3% | 89.6% | 14 | stable | $0.24 / $0.96 | $0.49 | Matches reference |
| 30 | mistral/fp8 | fp8 | 85.1% | 88.5% | 15 | stable | $0.24 / $0.96 | $0.49 | Matches reference |
| 31 | modal | unknown | 86.8% | 86.9% | 15 | stable | $0.25 / $1.00 | $0.50 | Matches reference |
| 32 | venice/fp8 | fp8 | 86.9% | 87.6% | 15 | stable | $0.30 / $1.20 | $0.60 | Matches reference |
| 33 | fireworks | unknown | 86.6% | 85.1% | 15 | stable | $0.30 / $1.20 | $0.61 | Matches reference |
| 34 | coreweave/fp8 | fp8 | 86.1% | 87.3% | 14 | stable | $0.30 / $1.20 | $0.61 | Matches reference |
| 35 | baseten | unknown | 85.9% | 88.3% | 15 | stable | $0.30 / $1.20 | $0.61 | Matches reference |
| 36 | crusoe/fp8 | fp8 | 84.2% | 83.2% | 15 | stable | $0.29 / $1.20 | $0.61 | Matches reference |
| 37 | parasail/fp8 | fp8 | 85.3% | 85.3% | 15 | stable | $0.30 / $1.20 | $0.62 | Matches reference |
| 38 | together | unknown | 83.9% | 78.5% | 15 | stable | $0.30 / $1.20 | $0.63 | Matches reference |
| 39 | fireworks/us | unknown | 85.1% | 88.1% | 15 | stable | $0.45 / $1.80 | $0.93 | Matches reference |
| 40 | baseten/fast | unknown | 87.5% | 96.9% | 14 | stable | $0.60 / $2.40 | $1.20 | Matches reference |
| 41 | sail-research/fp4/us | fp4 | 86.2% | 85.2% | 14 | stable | n/a / n/a | n/a | Matches reference |
| 42 | nebius/fp8 | fp8 | 85.4% | 83.6% | 13 | stable | n/a / n/a | n/a | Matches reference |
| 43 | sail-research/fp4 | fp4 | 84.1% | 83.9% | 14 | stable | n/a / n/a | n/a | Matches reference |
| First look: fewer than 7 nights, not ranked | |||||||||
| pearl-research/fp8 | fp8 | 88.1% | n/a | 1 | n/a | $0.050 / $0.30 | $0.13 | First look, 1 night | |
| ambient/fp4 | fp4 | 89.6% | 85.9% | 3 | stable | $0.080 / $0.52 | $0.21 | First look, 3 nights | |
| antdigital/fp8 | fp8 | 85.3% | 85.0% | 2 | stable | $0.12 / $0.48 | $0.25 | First look, 2 nights | |
| inceptron/fp4 | fp4 | 84.6% | 90.0% | 2 | stable | $0.10 / $0.60 | $0.27 | First look, 2 nights | |
| nebius/fp4 | fp4 | 78.3% | 85.8% | 2 | stable | $0.18 / $0.72 | $0.40 | First look, 2 nights | |
| morph/fast | fp8 | 85.8% | 83.2% | 5 | stable | $0.60 / $2.40 | $1.22 | First look, 5 nights | |
| fireworks/ultrafast | unknown | 89.4% | n/a | 1 | n/a | n/a / n/a | n/a | First look, 1 night, not listed since Nov 8 | |
| cohere | unknown | 87.7% | 88.3% | 3 | stable | n/a / n/a | n/a | First look, 3 nights, not listed since Nov 6 | |
| relace/fast | fp4 | 85.6% | 86.9% | 5 | stable | n/a / n/a | n/a | First look, 5 nights, not listed since Nov 8 | |
| decart/fp8 | fp8 | 85.2% | 86.6% | 5 | stable | n/a / n/a | n/a | First look, 5 nights, not listed since Nov 10 | |
| phala | unknown | 84.3% | 82.3% | 6 | stable | n/a / n/a | n/a | First look, 6 nights, not listed since Nov 10 | |
| decart/fp4 | fp4 | 76.4% | n/a | 1 | n/a | n/a / n/a | n/a | First look, 1 night, not listed since Nov 4 | |
| deepseek | unknown | n/a | n/a | 15 | n/a | $0.15 / $0.60 | n/a | First look, 15 nights | |
| Outside the reference | |||||||||
| baidu/fp8 | fp8 | 76.0% | 83.1% | 15 | stable | $0.15 / $0.60 | $0.35 | Outside reference | |
| open-inference/fp4 | fp4 | 73.2% | 86.6% | 15 | stable | $0.060 / $0.90 | $0.37 | Outside reference | |
| near-ai | unknown | 74.9% | 67.7% | 15 | stable | $0.30 / $1.20 | $0.70 | Outside reference | |
| ionstream/flex | unknown | 76.5% | 85.6% | 8 | stable | n/a / n/a | n/a | Outside reference | |
| reka | unknown | 76.1% | 80.4% | 11 | stable | n/a / n/a | n/a | Outside reference, not listed since Nov 15 | |
Cite: Bitdepth · bitdepth.dev/m/deepseek-v4.1-flash-1017 · as of Nov 19, 2026
Reference: plurality across all endpoints (fewer than two declare bf16 or fp16). Open the DeepSeek V4.1 Flash page.
On DeepSeek V4 Pro, the cheapest endpoint that matches the reference is relace/fp4 at $1.50 per million output tokens. 4 of 18 endpoints sit outside the reference.
| # | Endpoint | Declared | String match | Self-agree | Nights | Drift | $ in / out per M | Quality-adjusted | State |
|---|---|---|---|---|---|---|---|---|---|
| 1 | relace/fp4 | fp4 | 65.4% | 68.1% | 23 | stable | $0.90 / $1.50 | $1.61 | Matches reference |
| 2 | streamlake/fp8 | fp8 | 62.7% | 66.9% | 23 | stable | $0.86 / $1.71 | $1.71 | Matches reference |
| 3 | siliconflow/fp8 | fp8 | 60.3% | 67.2% | 23 | stable | $0.90 / $1.70 | $1.82 | Matches reference |
| 4 | baidu/fp8 | fp8 | 51.3% | 58.4% | 23 | worsening | $0.86 / $1.72 | $2.09 | Matches reference |
| 5 | digitalocean | unknown | 53.8% | 51.8% | 23 | improving | $1.04 / $2.09 | $2.43 | Matches reference |
| 6 | deepinfra/fp8 | fp8 | 62.4% | 66.4% | 23 | stable | $1.30 / $2.60 | $2.60 | Matches reference |
| 7 | alibaba/fp8 | fp8 | 59.5% | 74.2% | 23 | stable | $1.42 / $2.83 | $2.97 | Matches reference |
| 8 | alibaba/fp8/us-east-1 | fp8 | 59.5% | 74.8% | 23 | stable | $1.56 / $3.12 | $3.28 | Matches reference |
| 9 | venice | unknown | 61.5% | 65.4% | 23 | stable | $1.65 / $3.30 | $3.35 | Matches reference |
| 10 | atlas-cloud/fp4 | fp4 | 55.9% | 68.0% | 23 | stable | $1.68 / $3.38 | $3.77 | Matches reference |
| 11 | azure/us | unknown | 54.0% | 50.7% | 23 | stable | $1.91 / $3.83 | $4.43 | Matches reference |
| First look: fewer than 7 nights, not ranked | |||||||||
| deepinfra/fp8/flex | fp8 | 63.8% | 63.3% | 5 | stable | $1.04 / $2.08 | $2.04 | First look, 5 nights | |
| deepinfra/fp8/priority | fp8 | 63.3% | 63.3% | 5 | stable | $1.95 / $3.90 | $3.85 | First look, 5 nights | |
| nebius/fp8 | fp8 | 63.9% | 71.6% | 5 | stable | n/a / n/a | n/a | First look, 5 nights, not listed since Nov 8 | |
| Outside the reference | |||||||||
| gmicloud/fp8 | fp8 | 29.9% | 67.5% | 23 | stable | $0.96 / $1.91 | $4.00 | Outside reference | |
| novita/fp8 | fp8 | 31.0% | 68.4% | 23 | stable | $1.28 / $2.56 | $5.16 | Outside reference | |
| crusoe/fp8 | fp8 | 35.8% | 73.9% | 8 | stable | n/a / n/a | n/a | Outside reference, not listed since Nov 3 | |
| cloudflare | unknown | 21.2% | 76.8% | 8 | stable | n/a / n/a | n/a | Outside reference, not listed since Nov 3 | |
Cite: Bitdepth · bitdepth.dev/m/deepseek-v4-pro · as of Nov 19, 2026
Reference: plurality across all endpoints (fewer than two declare bf16 or fp16). Open the DeepSeek V4 Pro page.
On gpt-oss-120b, the cheapest endpoint that matches the reference is near-ai/fp4 at $0.15 per million output tokens. 1 of 30 endpoints sit outside the reference.
| # | Endpoint | Declared | Exact match | Self-agree | Nights | Drift | $ in / out per M | Quality-adjusted | State |
|---|---|---|---|---|---|---|---|---|---|
| 1 | near-ai/fp4 | fp4 | 96.2% | 94.4% | 22 | stable | $0.030 / $0.15 | $0.062 | Matches reference |
| 2 | coreweave/fp4 | fp4 | 95.5% | 93.6% | 22 | stable | $0.030 / $0.17 | $0.068 | Matches reference |
| 3 | dekallm/bf16 | bf16 | 96.8% | 94.5% | 22 | stable | $0.030 / $0.18 | $0.070 | Matches reference |
| 4 | deepinfra/bf16 | bf16 | 97.2% | 96.7% | 22 | stable | $0.037 / $0.17 | $0.072 | Matches reference |
| 5 | akashml/fp4 | fp4 | 95.2% | 93.8% | 14 | stable | $0.030 / $0.19 | $0.073 | Matches reference |
| 6 | crusoe/bf16 | bf16 | 97.6% | 95.5% | 22 | stable | $0.050 / $0.25 | $0.10 | Matches reference |
| 7 | sail-research/fp4 | fp4 | 96.4% | 94.6% | 22 | stable | $0.060 / $0.40 | $0.15 | Matches reference |
| 8 | digitalocean | unknown | 92.8% | 90.2% | 22 | stable | $0.060 / $0.42 | $0.16 | Matches reference |
| 9 | google-vertex/global | unknown | 94.2% | 93.2% | 22 | stable | $0.090 / $0.36 | $0.17 | Matches reference |
| 10 | mancer/fp8 | fp8 | 96.2% | 94.4% | 22 | stable | $0.095 / $0.38 | $0.17 | Matches reference |
| 11 | baseten/fp4 | fp4 | 98.0% | 97.7% | 22 | stable | $0.10 / $0.50 | $0.20 | Matches reference |
| 12 | baseten/fp4/us | fp4 | 97.6% | 97.2% | 22 | stable | $0.10 / $0.50 | $0.20 | Matches reference |
| 13 | together | unknown | 97.4% | 97.1% | 22 | stable | $0.15 / $0.60 | $0.27 | Matches reference |
| 14 | groq | unknown | 96.9% | 98.3% | 22 | stable | $0.15 / $0.60 | $0.27 | Matches reference |
| 15 | amazon-bedrock | unknown | 96.4% | 94.4% | 22 | stable | $0.15 / $0.60 | $0.27 | Matches reference |
| 16 | amazon-bedrock/eu-west-1 | unknown | 96.2% | 94.6% | 22 | stable | $0.15 / $0.60 | $0.27 | Matches reference |
| 17 | nebius/fp4 | fp4 | 96.2% | 95.2% | 22 | stable | $0.15 / $0.60 | $0.27 | Matches reference |
| 18 | parasail/fp4 | fp4 | 96.1% | 93.7% | 22 | stable | $0.10 / $0.75 | $0.27 | Matches reference |
| 19 | siliconflow/fp8 | fp8 | 95.9% | 95.3% | 22 | stable | $0.15 / $0.60 | $0.27 | Matches reference |
| 20 | parasail/fast | fp4 | 96.4% | 93.3% | 13 | stable | $0.15 / $0.75 | $0.31 | Matches reference |
| 21 | sambanova | unknown | 97.3% | 96.0% | 22 | stable | $0.14 / $0.95 | $0.35 | Matches reference |
| 22 | cerebras/fp16 | fp16 | 98.2% | 98.2% | 22 | stable | $0.35 / $0.75 | $0.46 | Matches reference |
| 23 | primeintellect/fp4 | fp4 | 96.3% | 95.0% | 17 | stable | $0.35 / $0.75 | $0.47 | Matches reference |
| 24 | deepinfra/fp8 | fp8 | 97.5% | 95.8% | 15 | stable | n/a / n/a | n/a | Matches reference, not listed since Nov 15 |
| 25 | mara | unknown | 97.1% | 96.7% | 9 | stable | n/a / n/a | n/a | Matches reference, not listed since Nov 4 |
| 26 | akashml/bf16 | bf16 | 95.8% | 93.7% | 8 | stable | n/a / n/a | n/a | Matches reference, not listed since Nov 3 |
| 27 | phala | unknown | 93.5% | 92.4% | 13 | stable | n/a / n/a | n/a | Matches reference, not listed since Nov 8 |
| 28 | novita/fp4 | fp4 | 92.6% | 90.6% | 7 | stable | n/a / n/a | n/a | Matches reference, not listed since Nov 2 |
| First look: fewer than 7 nights, not ranked | |||||||||
| io-net/fp4 | fp4 | 97.2% | 95.8% | 4 | stable | n/a / n/a | n/a | First look, 4 nights, not listed since Nov 15 | |
| Outside the reference | |||||||||
| venice/int4 | int4 | 84.2% | 77.6% | 22 | worsening | $0.030 / $0.15 | $0.071 | Outside reference | |
Cite: Bitdepth · bitdepth.dev/m/gpt-oss-120b · as of Nov 19, 2026
Reference: plurality among endpoints declaring bf16 or fp16. Open the gpt-oss-120b page.
On Mistral Large 4, the cheapest endpoint that matches the reference is mistral/zdr at $2.10 per million output tokens. All 2 graded endpoints match it.
| # | Endpoint | Declared | Exact match | Self-agree | Nights | Drift | $ in / out per M | Quality-adjusted | State |
|---|---|---|---|---|---|---|---|---|---|
| 1 | mistral/zdr | unknown | 100.0% | 89.4% | 10 | stable | $0.70 / $2.10 | $1.05 | Matches reference |
| 2 | mistral/eu | unknown | 100.0% | 89.2% | 10 | stable | $0.77 / $2.31 | $1.16 | Matches reference |
Cite: Bitdepth · bitdepth.dev/m/mistral-large-4-0 · as of Nov 19, 2026
Reference: plurality across all endpoints (fewer than two declare bf16 or fp16). Open the Mistral Large 4 page.
First look at GLM 5.3 Flash: 48 endpoints on OpenRouter, 6 nights measured. Grades start at 7 nights.
| # | Endpoint | Declared | Exact match | Self-agree | Nights | Drift | $ in / out per M | Quality-adjusted | State |
|---|---|---|---|---|---|---|---|---|---|
| First look: fewer than 7 nights, not ranked | |||||||||
| relace/fp4 | fp4 | 98.2% | 98.3% | 6 | stable | $0.040 / $0.078 | $0.050 | First look, 6 nights | |
| wafer/us | nvfp4 | 86.8% | 84.4% | 6 | stable | $0.042 / $0.18 | $0.089 | First look, 6 nights | |
| darkbloom/fp4 | fp4 | 98.7% | 99.1% | 6 | stable | $0.065 / $0.18 | $0.095 | First look, 6 nights | |
| particle-ai/nvfp4/flex | nvfp4 | 98.9% | 99.2% | 2 | stable | $0.065 / $0.25 | $0.11 | First look, 2 nights | |
| gmicloud/fp8 | fp8 | 97.5% | 97.8% | 6 | stable | $0.075 / $0.25 | $0.12 | First look, 6 nights | |
| tenstorrent/fp8 | fp8 | 94.6% | 94.0% | 6 | stable | $0.075 / $0.25 | $0.13 | First look, 6 nights | |
| wafer/nvfp4 | nvfp4 | 85.0% | 81.9% | 6 | stable | $0.065 / $0.24 | $0.13 | First look, 6 nights | |
| novita/fp8 | fp8 | 94.7% | 90.0% | 6 | stable | $0.084 / $0.28 | $0.14 | First look, 6 nights | |
| streamlake/fp8 | fp8 | 97.8% | 97.8% | 6 | stable | $0.088 / $0.29 | $0.14 | First look, 6 nights | |
| open-inference/fp4 | fp4 | 97.3% | 97.8% | 6 | stable | $0.050 / $0.45 | $0.15 | First look, 6 nights | |
| makora/fp4 | fp4 | 94.2% | 91.9% | 6 | stable | $0.14 / $0.24 | $0.18 | First look, 6 nights | |
| reka | unknown | 89.7% | 93.8% | 6 | stable | $0.12 / $0.30 | $0.18 | First look, 6 nights | |
| inference-net/fp4 | fp4 | 91.4% | 86.4% | 6 | stable | $0.11 / $0.35 | $0.18 | First look, 6 nights | |
| morph/fp8 | fp8 | 97.3% | 96.4% | 6 | stable | $0.12 / $0.35 | $0.19 | First look, 6 nights | |
| siliconflow/fp8 | fp8 | 94.0% | 92.8% | 6 | stable | $0.10 / $0.40 | $0.19 | First look, 6 nights | |
| inference-net/us | fp4 | 90.2% | 85.6% | 6 | stable | $0.11 / $0.35 | $0.19 | First look, 6 nights | |
| near-ai/fp8 | fp8 | 97.0% | 95.6% | 6 | stable | $0.080 / $0.50 | $0.19 | First look, 6 nights | |
| digitalocean | unknown | 93.2% | 89.2% | 6 | stable | $0.11 / $0.38 | $0.19 | First look, 6 nights | |
| coreweave/nvfp4 | nvfp4 | 95.9% | 95.0% | 6 | stable | $0.12 / $0.38 | $0.19 | First look, 6 nights | |
| river | unknown | 98.1% | 97.8% | 4 | stable | $0.12 / $0.40 | $0.19 | First look, 4 nights | |
| dekallm | unknown | 98.0% | 97.7% | 5 | stable | $0.10 / $0.50 | $0.20 | First look, 5 nights | |
| particle-ai/nvfp4 | nvfp4 | 98.2% | 98.6% | 6 | stable | $0.13 / $0.50 | $0.23 | First look, 6 nights | |
| parasail/fp8 | fp8 | 98.6% | n/a | 1 | n/a | $0.15 / $0.50 | $0.24 | First look, 1 night | |
| deepinfra/fp4 | fp4 | 98.3% | 96.7% | 6 | stable | $0.15 / $0.50 | $0.24 | First look, 6 nights | |
| kt | unknown | 98.2% | 97.2% | 5 | stable | $0.15 / $0.50 | $0.24 | First look, 5 nights | |
| baidu/fp8 | fp8 | 97.9% | n/a | 1 | n/a | $0.15 / $0.50 | $0.24 | First look, 1 night | |
| venice | unknown | 97.8% | 95.8% | 6 | stable | $0.15 / $0.50 | $0.24 | First look, 6 nights | |
| cohere/nvfp4 | nvfp4 | 97.5% | 96.4% | 6 | stable | $0.15 / $0.50 | $0.24 | First look, 6 nights | |
| inceptron/fp8 | fp8 | 97.5% | 95.0% | 6 | stable | $0.15 / $0.50 | $0.24 | First look, 6 nights | |
| friendli | unknown | 96.8% | 94.7% | 6 | stable | $0.15 / $0.50 | $0.25 | First look, 6 nights | |
| nebius/fp4 | fp4 | 96.8% | 97.8% | 6 | stable | $0.15 / $0.50 | $0.25 | First look, 6 nights | |
| crusoe/fp4 | fp4 | 96.4% | 94.4% | 6 | stable | $0.15 / $0.50 | $0.25 | First look, 6 nights | |
| together | unknown | 95.8% | 94.2% | 6 | stable | $0.15 / $0.50 | $0.25 | First look, 6 nights | |
| baseten/fp8 | fp8 | 95.7% | 96.1% | 6 | stable | $0.15 / $0.50 | $0.25 | First look, 6 nights | |
| mistral | unknown | 95.0% | 97.2% | 6 | stable | $0.15 / $0.50 | $0.25 | First look, 6 nights | |
| fireworks | unknown | 94.9% | 94.0% | 6 | stable | $0.15 / $0.50 | $0.25 | First look, 6 nights | |
| modal/fp4 | fp4 | 92.9% | 91.9% | 6 | stable | $0.15 / $0.50 | $0.26 | First look, 6 nights | |
| z-ai/fp8 | fp8 | 92.5% | 88.6% | 6 | stable | $0.15 / $0.50 | $0.26 | First look, 6 nights | |
| sail-research/fp4 | fp4 | 96.9% | 96.6% | 6 | stable | $0.17 / $0.62 | $0.30 | First look, 6 nights | |
| sail-research/us | fp4 | 96.9% | 96.0% | 6 | stable | $0.17 / $0.62 | $0.30 | First look, 6 nights | |
| parasail/fast | fp4 | 97.3% | 94.7% | 6 | stable | $0.19 / $0.62 | $0.31 | First look, 6 nights | |
| fireworks/us | unknown | 94.2% | 93.3% | 3 | stable | $0.23 / $0.75 | $0.38 | First look, 3 nights | |
| primeintellect | unknown | 97.5% | n/a | 3 | stable | n/a / n/a | n/a | First look, 3 nights, not listed since Nov 12 | |
| nextbit/fp4 | fp4 | 97.2% | 96.7% | 5 | stable | n/a / n/a | n/a | First look, 5 nights | |
| parasail/fp4 | fp4 | 97.2% | 96.7% | 5 | stable | n/a / n/a | n/a | First look, 5 nights | |
| atlas-cloud/fp8 | fp8 | 95.0% | 93.7% | 5 | stable | n/a / n/a | n/a | First look, 5 nights | |
| phala/nvfp4 | nvfp4 | 93.8% | n/a | 1 | n/a | n/a / n/a | n/a | First look, 1 night, not listed since Nov 10 | |
| baseten/fp8/us | fp8 | n/a | n/a | 3 | n/a | n/a / n/a | n/a | First look, 3 nights, not listed since Nov 12 | |
Cite: Bitdepth · bitdepth.dev/m/glm-5.3-flash · as of Nov 19, 2026
Reference: plurality across all endpoints (fewer than two declare bf16 or fp16). Open the GLM 5.3 Flash page.
First look at Gemma 4 31B: 21 endpoints on OpenRouter, 6 nights measured. Grades start at 7 nights.
| # | Endpoint | Declared | String match | Self-agree | Nights | Drift | $ in / out per M | Quality-adjusted | State |
|---|---|---|---|---|---|---|---|---|---|
| First look: fewer than 7 nights, not ranked | |||||||||
| coreweave/fp4 | fp4 | 54.2% | 84.7% | 6 | stable | $0.10 / $0.34 | $0.30 | First look, 6 nights | |
| kt | unknown | 53.7% | 92.2% | 5 | stable | $0.10 / $0.34 | $0.30 | First look, 5 nights | |
| nextbit/fp4 | fp4 | 56.7% | 71.4% | 6 | stable | $0.12 / $0.34 | $0.32 | First look, 6 nights | |
| chutes/fp4 | fp4 | 54.2% | 75.3% | 6 | stable | $0.12 / $0.37 | $0.34 | First look, 6 nights | |
| venice/fp4 | fp4 | 53.4% | 76.0% | 6 | stable | $0.12 / $0.36 | $0.34 | First look, 6 nights | |
| novita/bf16 | bf16 | 60.3% | 91.8% | 6 | stable | $0.14 / $0.40 | $0.34 | First look, 6 nights | |
| friendli | unknown | 56.7% | 86.4% | 6 | stable | $0.14 / $0.40 | $0.36 | First look, 6 nights | |
| deepinfra/fp8/flex | fp8 | 55.0% | 91.9% | 6 | stable | $0.16 / $0.32 | $0.36 | First look, 6 nights | |
| primeintellect/fp8 | fp8 | 62.5% | 97.1% | 2 | stable | $0.20 / $0.33 | $0.36 | First look, 2 nights | |
| parasail/fp8 | fp8 | 55.0% | 95.5% | 6 | stable | $0.15 / $0.40 | $0.39 | First look, 6 nights | |
| crusoe/bf16 | bf16 | 50.9% | 97.5% | 6 | stable | $0.14 / $0.40 | $0.40 | First look, 6 nights | |
| deepinfra/turbo | fp4 | 53.4% | 75.0% | 6 | stable | $0.14 / $0.51 | $0.43 | First look, 6 nights | |
| deepinfra/fp8 | fp8 | 55.0% | 93.9% | 6 | stable | $0.20 / $0.40 | $0.45 | First look, 6 nights | |
| modal | unknown | 55.8% | 83.0% | 6 | stable | $0.34 / $0.10 | $0.50 | First look, 6 nights | |
| deepinfra/fp8/priority | fp8 | 55.0% | 92.8% | 6 | stable | $0.30 / $0.60 | $0.68 | First look, 6 nights | |
| sambanova | unknown | 53.4% | 100.0% | 6 | stable | $0.38 / $1.15 | $1.07 | First look, 6 nights | |
| siliconflow/fp8 | fp8 | 56.3% | 91.6% | 6 | stable | $0.75 / $1.00 | $1.44 | First look, 6 nights | |
| modelrun/fp4 | fp4 | 54.2% | 97.5% | 2 | stable | $0.75 / $1.00 | $1.50 | First look, 2 nights | |
| io-net | unknown | 54.2% | n/a | 1 | n/a | n/a / n/a | n/a | First look, 1 night, not listed since Nov 10 | |
| dekallm | unknown | 55.7% | n/a | 4 | stable | n/a / n/a | n/a | First look, 4 nights, not listed since Nov 14 | |
| primeintellect/fp4 | fp4 | 51.4% | 78.3% | 4 | stable | n/a / n/a | n/a | First look, 4 nights, not listed since Nov 14 | |
Cite: Bitdepth · bitdepth.dev/m/gemma-4-31b-it · as of Nov 19, 2026
Reference: plurality among endpoints declaring bf16 or fp16. Open the Gemma 4 31B page.
First look at MiMo V2.6 Pro: 5 endpoints on OpenRouter, 6 nights measured. Grades start at 7 nights.
| # | Endpoint | Declared | String match | Self-agree | Nights | Drift | $ in / out per M | Quality-adjusted | State |
|---|---|---|---|---|---|---|---|---|---|
| First look: fewer than 7 nights, not ranked | |||||||||
| gmicloud/bf16 | bf16 | 62.5% | 71.8% | 6 | stable | $0.33 / $0.65 | $0.65 | First look, 6 nights | |
| deepinfra/fp8 | fp8 | 69.2% | 85.3% | 6 | stable | $0.39 / $0.78 | $0.70 | First look, 6 nights | |
| xiaomi/fp8 | fp8 | 69.4% | 88.0% | 6 | stable | $0.43 / $0.87 | $0.78 | First look, 6 nights | |
| streamlake | unknown | 68.1% | 87.8% | 6 | stable | $0.43 / $0.87 | $0.80 | First look, 6 nights | |
| primalabs/fp8 | fp8 | 64.2% | 90.3% | 6 | stable | $2.64 / $5.28 | $5.14 | First look, 6 nights | |
Cite: Bitdepth · bitdepth.dev/m/mimo-v2.6-pro · as of Nov 19, 2026
Reference: plurality across all endpoints (fewer than two declare bf16 or fp16). Open the MiMo V2.6 Pro page.
How this board is measured.
The reference
For each model, the answer most endpoints declaring full precision (bf16 or fp16) give at temperature zero. Where fewer than two declare it, the plurality answer across all endpoints. Method.
Agreement and self-agreement
Agreement is how often an endpoint gives the reference answer. Self-agreement is how often it gives its own answer twice. An endpoint that agrees with itself far more than with the reference is serving something different.
How rank works
Endpoints that match the reference are ranked by quality-adjusted price: the blended price, (3 × input + output) ÷ 4 per million tokens, divided by agreement. A cheap endpoint that misses the reference is never shown as the cheapest.
First look
An endpoint needs 7 nights before it is ranked. Until then it shows its night count and its numbers, with no rank.
Drift
The mean of the last three nights against the first three. A move of more than 10 points reads as improving or worsening; anything smaller is stable.
How to cite
Every chart and table carries a cite line with the date. Copy it with the figure. Wrong model name or missing endpoint? Tell us.
Get the data
The same figures as JSON, one file per model, rewritten every night.
https://bitdepth.dev/data/v1/index.jsonServe one of these models?
Endpoints that match the reference can carry the Graded by Bitdepth badge, linked to their row. To add an endpoint, correct a listing or ask about grades and data for your routes, write to us.