Constrained decoding effects depend on the constraint type
Across eleven open-source models, apparent losses mostly came from mismatched prompts and formats rather than decoder masking.
1 stories, newest first · one card per story
Across eleven open-source models, apparent losses mostly came from mismatched prompts and formats rather than decoder masking.
Today 1.6K readers · 2.4K views · 774 reads · all time 189K views