GitHub - fiddlecube/fiddlecube-sdk: Generate ideal question-answers for testing RAG
FiddleCube - Generate ideal question-answers for testing RAG
FiddleCube generates an ideal question-answer dataset for testing your LLM. Run tests on this dataset before pushing any prompt or RAG upgrades.
Quickstart
Install FiddleCube
API Key
Get the API key here.
Usage
from fiddlecube import FiddleCube
fc = FiddleCube(api_key="<api-key>")
dataset = fc.generate(
[
"Wheat is mainly grown in the midlands and highlands of Ethiopia.",
"Wheat covers most of the country's agricultural land next to te...
Read more at github.com