News Score: Score the News, Sort the News, Rewrite the Headlines

Ask HN: Local RAG with private knowledge base

> expected the more documents we feed the lower the accuracyNot surprising!The LLM itself is the least important bit as long as it’s serviceable.Depending on your goal you need to have a specific RAG strategy.How are you breaking up the documents? Are the documents consistently formatted to make breaking them up uniform? Do you need to do some preprocessing to make them uniform?When you retrieve documents how many do you stuff into your prompt as context?Do you stuff the same top N chunks from a...

Read more at news.ycombinator.com

© News Score  score the news, sort the news, rewrite the headlines