Blog
Notes from building a financial instrument for engineers. RSS
Repetitions of the same test case are correlated, and treating them as independent samples inflates your confidence. How ReasonRank tests "is the cheaper model actually worse?" without fooling itself.
ReasonRank Engineering · 2026-07-02
A savings number without a baseline, a sample size, and a detection check is marketing, not measurement. The four places cost-optimization math quietly lies, and what honest numbers require.
ReasonRank Engineering · 2026-07-02
A concrete procedure for finding out what your LLM traffic costs and which agents are overpaying — using a free calculator, your provider dashboard, and one honest question per agent.
ReasonRank Engineering · 2026-07-02