llama.cpp guide - Running LLMs locally, on any hardware, from scratch
No LLMs were harmed during creation of this post.so, i started playing with LLMs…#…and it’s pretty fun.
I was very skeptical about the AI/LLM “boom” back when it started.
I thought, like many other people, that they are just mostly making stuff up, and generating uncanny-valley-tier nonsense.
Boy, was i wrong.
I’ve used ChatGPT once or twice, to test the waters - it made a pretty good first impression, despite hallucinating a bit.
That was back when GPT3.5 was the top model. We came a pretty lon...
Read more at steelph0enix.github.io