model-routing

4 entries

Choosing a model when benchmarks can't keep up

By mid-2026, the reference LLM leaderboards have frozen or pivoted, and what stays current is either self-reported by vendors or recopied by unverified aggregators. One independent harness still holds — and it saturates at the top. Result: the source of truth left is your own codebase. Here's how I decide without leaning on numbers nobody can verify anymore.

model-routing benchmarks inference-cost

07/27/2026

Guide

Layering a CLI agent's models under a budget cap

Under a budget-capped subscription like opencode Go, picking a model isn't about token price but requests per 5 hours, the one quality source still alive (vals.ai), and tool-calling reliability — the decisive criterion no benchmark measures. The result: one model per preset, a frontier delegated outside the agent, and tools constrained rather than instructed.

model-routing opencode-go inference-cost

07/26/2026

08/12/2026 TIL : having a budget model review an expensive model's code 07/26/2026 TIL : constraining an agent's tools beats instructing it