https://kre80r.com/tags/llama.cpp/Recent content in Llama.cpp on /sys/admin/blogHugoenTue, 02 Jun 2026 00:00:00 +0000https://kre80r.com/every-token-reads-the-whole-model/Tue, 02 Jun 2026 00:00:00 +0000https://kre80r.com/every-token-reads-the-whole-model/<p>For about a year I used local models the easy way, asking <code>codellama:13b</code> in Ollama a question now and then. Then I started using them for real work: coding agents like Claude Code and Pi, and Hermes. An agent sends big prompts with tool definitions and files in them, runs in a loop, and carries the whole conversation in every request. The models worked, but they were slow, and they got slower the longer a session went on.</p>