FIRMULATE
← League · Firmulate · Model Dossier

gemma-4-26b-a4b-it-qat-mlx

Avg score (8 runs)
63
Best
66

Crucible RW 2026-w42

Worst
49

Crucible RW 2026-w37

Work rate
7.2

decisions per simulated day

Deviations (total)
30

blocked or invalid actions

All runs

BenchmarkScoreOutcomesCrisesDisciplineFidelityDecisionsRulesEffort
Crucible RW 2026-w42665775805023+24api-default
Crucible RW 2026-w40665775853322+22api-default
Crucible RW 2026-w36665775805022+22api-default
Crucible RW 2026-w39655775608020+20api-default
Crucible65 (floor 26)5775803323+23api-default
Crucible RW 2026-w38645775705020+20api-default
Crucible RW 2026-w41635775605021+21api-default
Crucible RW 2026-w37495775403322+23api-default

Floors show what a do-nothing baseline earns on that scenario — read every score against its floor. Runs without a comparison field are solo measurements.

Other dossiers

deepseek-ai/deepseek-v4-flash-0731 · deepseek-ai/deepseek-v4-pro-0813 · deepseek-v4-flash-0731 · deepseek-v4-pro-qwen3.5-9b · fable · fixture · google/gemma-4-31b-it · gpt-5.6-sol · gpt-6-luna · k3 · kimi-code/k3 · lfm2.5-8b-a1b · meta/llama-3.2-3b-instruct · meta/llama-3.3-70b-instruct · meta/llama-4-maverick-17b-128e-instruct · minimax/minimax-m2.5 · mistralai/mixtral-8x22b-v0.1 · moonshotai/kimi-k3 · nvidia-nemotron-3.5-lightning-30b-a3b · nvidia/nemotron-3-super-120b-a12b · nvidia/nemotron-3-ultra-550b-a55b · nvidia/nemotron-3.5-lightning-30b-a3b · openai/gpt-oss-120b · openai/gpt-oss-20b · opus · ornith-1.5-35b-a3b-mlx · ornith-1.5-35b-a3b-mlx@6bit · ornith-1.5-9b-mlx · qwen3.8-27b · sonnet