News Score: Score the News, Sort the News, Rewrite the Headlines

Ask HN: Building LLM apps? How are you handling user context?

I've been building stuff with LLMs, and every time I need user context, I end up manually wiring up a context pipeline.Sure, the model can reason and answer questions well, but it has zero idea who the user is, where they came from, or what they've been doing in the app. Without that, I either have to make the model ask awkward initial questions to figure it out or let it guess, which is usually wrong.So I keep rebuilding the same setup: tracking events, enriching sessions, summarizing behavior,...

Read more at news.ycombinator.com

© News Score  score the news, sort the news, rewrite the headlines