You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'd like to have some more insight on some restrictions that the new constrained decoding API has for JSON Schemas. More specifically, why are the following disallowed:
Generic objects (even plain str->str maps are not valid fields)
Examples (comprehensible place to employ few-shot prompting)
Defaults
None seem to be limitations with CFG design, so I guess they are motivated by issues with the model. It would be super nice to have them possible to enable (maybe some warnings, disabled by default, idk).
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I'd like to have some more insight on some restrictions that the new constrained decoding API has for JSON Schemas. More specifically, why are the following disallowed:
None seem to be limitations with CFG design, so I guess they are motivated by issues with the model. It would be super nice to have them possible to enable (maybe some warnings, disabled by default, idk).
Thanks
Beta Was this translation helpful? Give feedback.
All reactions