"GitHub Launches Secret-Llama: Fully Private, In-Browser LLM Chatbot; No Server Needed, Supports Open Source Models like Mistral, Llama 3"

GitHub - abi/secret-llama: Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.

Secret Llama Entirely-in-browser, fully private LLM chatbot supporting Llama 3, Mistral and other open source models. Fully private = No conversation data ever leaves your computer Runs in the browser = No server needed and no install needed! Works offline Easy-to-use interface on par with ChatGPT, but for open source LLMs Big thanks to the inference engine provided by webllm. System Requirements To run this, you need a modern browser with support for WebGPU. According to caniuse, WebGPU is supp...