Discussion about this post

User's avatar
Nan Deng's avatar

Handing the decision back as a typed value instead of prose is the part that changes the economics, because the parse-and-normalize step was where most of the silent failures lived — the model says 'approved' in a shape the code doesn't expect, and something downstream guesses. My question is what happens at the boundary when the model is wrong but well-typed: a confident typed output is harder to second-guess than free text, so does the integration point still need a confidence or abstain path, or is the type itself supposed to carry that?

Vesko Pavlov's avatar

Being 100 to 500 times cheaper changes where you'd put a classifier. You could run one on every form submit or every log line without a budget meeting

3 more comments...

Ready for more?