Changelog
Struct 0.1.4
- Fixed handling of quote constraints and conditional schemas.
- Corrected policy checks and clarified error reporting when request allowances are exhausted.
- Improved request isolation when a request is rejected.
Struct 0.1.3
Improved recovery after execution failures. Affected waiting requests now receive a failure promptly instead of continuing to wait.
Struct 0.1.2
Removed a fixed limit that could stop extraction of longer source excerpts. Quote requests that exceed their execution allowance now report the limit more clearly.
Documented quote, input, context and execution bounds still apply.
Exact source quoting
Extract exact source text with x-runtime.quote, including Unicode passages, date expressions and part codes. The annotation supports nullable strings and bounded extraction arrays.
Struct 0.1.0 - initial release
Initial release of Struct for JSON Schema constrained generation, schema registration, candidate probabilities and optional OPA policy enforcement.
Schema reuse
Reuse registered schemas across requests, with separate input, state and policy for each request.
Usage accounting
Count input tokens independently of the model and report inference work as logical decisions.
Request isolation
Return distinct errors for policy failures, exhausted search and execution limits, keeping policy and constraint failures scoped to the affected request.
Fair scheduling
Schedule waiting work fairly between customers.