Gemini Decision 1 landed #9 on the independent board — the 1,000-question single-pass run explained

Gemini Decision 1 landed #9 on the independent board — the 1,000-question single-pass run explained

I put together a walkthrough of how Gemini Decision 1 scored ninth on the independent leaderboard, because a rank alone doesn't tell you what the model actually did. The video breaks down the evaluation: 1,000 questions fed in one continuous pass, no retries, no temperature resampling — just raw throughput to see where it lands when it can't second-guess itself.

The concrete detail that matters is the single-pass constraint. Most leaderboards let models retry or use chain-of-thought; this one strips that away and measures pure decision quality across the full set. It turns out that's where the model holds up — the ninth-place slot came from consistency under that constraint, not from a lucky streak on easier questions.

The real cost to me as the operator wasn't the editing time, it was the compute bill for running the full 1,000-question sweep twice to verify the score was stable. That's roughly eight hours of GPU time per pass, and when you're verifying board positions you don't trust a single run.

If you want the full breakdown with the question distribution and where it tripped up, it's at https://www.youtube.com/watch?v=DD48a3mcVHI