Your agentic RAG loop answers slower and spends more per correct answer. We measured it.
Iterative RAG loops hide their cost in the wrong denominator. Measured per correct answer: 0.58x the tokens and 8.4 s p95 vs 17.5 s, same 12B model.
3 min read
Blog
Notes from the forest
Engineering notes on navigation, ingestion, agent memory and honest benchmarking, written by the people who ran the experiments.
Want the long version?
The paper carries the full architecture, the benchmark tables and the findings that failed their criteria.