September 25, 20262 min read
Resources for Local AI
A running index of tools, papers, and write-ups for running and serving models locally.
InfraLLMs
Read postWriting
A running log of essays on AI engineering, open-source work, and whatever else I think is interesting at the time. Some posts live directly on this site, and others still link out to the canonical version in case you prefer reading in your app of choice.
A running index of tools, papers, and write-ups for running and serving models locally.
Explaining the Mixture-of-Recursions model, starting from kv-cache basics.