Every Way To Get Structured Output From LLMs
By Sam Lijin - @sxlijinThis post will be interesting to you if:
you're trying to get structured output from an LLM,
you've tried response_format: "json" and function calling and been disappointed by the results,
you're tired of stacking regex on regex on regex to extract JSON from an LLM,
you're trying to figure out what your options are.
Everyone using LLMs in production runs into this problem sooner or later: what
we really want is a magical black box that returns JSON in exactly the format we...
Read more at boundaryml.com