I Built an Open Source Offline ChatGPT Alternative in 40MB
— by Raj Guru Yadav
Like many developers, I’ve been fascinated by LLMs. But the moment I asked:
“Can I run a ChatGPT-like assistant offline, fast, and without needing 16GB+ RAM?”
The challenge became too tempting to ignore.The Goal
Build a fully offline, lightweight AI assistant with:< 50MB download sizeNo internet requirementFast responses (under 1 second)Zero telemetryFully local embeddings & inferenceResult: A 40MB offline ChatGPT clone you can run in-browser or on a USB stick.What’s Inside t...
Read more at news.ycombinator.com