https://nalar.dev/tags/structured-output/ Recent content in Structured Output on Nalar Hugo en-us Sun, 06 Sep 2026 00:00:00 +0700 https://nalar.dev/constrain-llm-output-with-grammar-guided-decoding/ Sun, 06 Sep 2026 00:00:00 +0700 https://nalar.dev/constrain-llm-output-with-grammar-guided-decoding/ <p>Asking a language model to return JSON, SQL, or another structured format creates a failure mode that ordinary prompting cannot remove: the model can understand the requested format and still generate a token that makes the output syntactically invalid.</p> <p>For applications that immediately parse model output, one missing quote or delimiter can turn an otherwise useful answer into an error. Retrying helps, but it spends more inference time without guaranteeing that the next attempt will parse.</p>