Notes on building and running AI systems in production.https://armandgraaff.comenhttps://armandgraaff.com/notes/measuring-retrieval-honestlyhttps://armandgraaff.com/notes/measuring-retrieval-honestlyMost retrieval benchmarks measure whether the right document was returned. Almost none measure whether you would have noticed if it was not.Fri, 14 Aug 2026 00:00:00 GMTretrievalevaluation