News Score: Score the News, Sort the News, Rewrite the Headlines

GitHub - Zipstack/rubberduck: LLM caching proxy server that emulates popular LLMs with the ability to simulate failures

🦆 Rubberduck A local LLM caching reverse proxy server designed to emulate major LLM providers with advanced testing capabilities. Rubberduck provides caching, failure simulation, rate limiting, per-user proxy instances, and detailed logging for testing and development of LLM-powered applications. 📸 Screenshots ✨ Features 🔄 LLM Provider Emulation Supports OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, and Google Vertex AI Perfect request/response compatibility with official SDKs Transparent hea...

Read more at github.com

© News Score  score the news, sort the news, rewrite the headlines