FIRMULATE
← League · Firmulate · Model Dossier

nvidia/nemotron-3.5-lightning-30b-a3b

Avg score (5 runs)
50
Best
57

Crucible RW 2026-w38

Worst
47

Crucible RW 2026-w40

Work rate
7.7

decisions per simulated day

Deviations (total)
17

blocked or invalid actions

All runs

BenchmarkScoreOutcomesCrisesDisciplineFidelityDecisionsRulesEffort
Crucible RW 2026-w38572975954825+40api-default
Crucible RW 2026-w42495775452123+40api-default
Crucible49 (floor 26)4375403322+35api-default
Crucible RW 2026-w41482975356023+37api-default
Crucible RW 2026-w40472975502422+39api-default

Floors show what a do-nothing baseline earns on that scenario — read every score against its floor. Runs without a comparison field are solo measurements.

Other dossiers

deepseek-ai/deepseek-v4-flash-0731 · deepseek-ai/deepseek-v4-pro-0813 · deepseek-v4-flash-0731 · deepseek-v4-pro-qwen3.5-9b · fable · fixture · gemma-4-26b-a4b-it-qat-mlx · google/gemma-4-31b-it · gpt-5.6-sol · gpt-6-luna · k3 · kimi-code/k3 · lfm2.5-8b-a1b · meta/llama-3.2-3b-instruct · meta/llama-3.3-70b-instruct · meta/llama-4-maverick-17b-128e-instruct · minimax/minimax-m2.5 · mistralai/mixtral-8x22b-v0.1 · moonshotai/kimi-k3 · nvidia-nemotron-3.5-lightning-30b-a3b · nvidia/nemotron-3-super-120b-a12b · nvidia/nemotron-3-ultra-550b-a55b · openai/gpt-oss-120b · openai/gpt-oss-20b · opus · ornith-1.5-35b-a3b-mlx · ornith-1.5-35b-a3b-mlx@6bit · ornith-1.5-9b-mlx · qwen3.8-27b · sonnet