I’ve built some projects recently that include integrations with LLMs. Specifically, I’ve found an interest in agentic applications where the LLM has some responsibility over the control flow of the application. Integrating these features into my existing development workflow led me to explore running local LLMs in depth. Why Run an LLM Locally? When I talk about running an LLM locally, I mean that I’m running a temporary instance of a model on my development machine. This is not intended to be ...