GitHub - Zipstack/rubberduck: LLM caching proxy server that emulates popular LLMs with the ability to simulate failures
🦆 Rubberduck
A local LLM caching reverse proxy server designed to emulate major LLM providers with advanced testing capabilities.
Rubberduck provides caching, failure simulation, rate limiting, per-user proxy instances, and detailed logging for testing and development of LLM-powered applications.
📸 Screenshots
✨ Features
🔄 LLM Provider Emulation
Supports OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, and Google Vertex AI
Perfect request/response compatibility with official SDKs
Transparent hea...
Read more at github.com