News Score: Score the News, Sort the News, Rewrite the Headlines

I Built an Open Source Offline ChatGPT Alternative in 40MB

— by Raj Guru Yadav Like many developers, I’ve been fascinated by LLMs. But the moment I asked: “Can I run a ChatGPT-like assistant offline, fast, and without needing 16GB+ RAM?” The challenge became too tempting to ignore.The Goal Build a fully offline, lightweight AI assistant with:< 50MB download sizeNo internet requirementFast responses (under 1 second)Zero telemetryFully local embeddings & inferenceResult: A 40MB offline ChatGPT clone you can run in-browser or on a USB stick.What’s Inside t...

Read more at news.ycombinator.com

© News Score  score the news, sort the news, rewrite the headlines