AI Blog

Tagged: structured-outputs

← Back to AI Blog

10 min read

Pydantic AI vs OpenAI Agents SDK vs LangChain vs Claude Agent SDK

All four hand you a typed object, and all four disagree about what happens when the model's answer does not fit it. Pydantic AI feeds the validation error back and retries on a budget; the OpenAI Agents SDK raises by default; and in LangChain's create_agent the retry handler applies to ToolStrategy, while a bare Pydantic model auto-selects the provider path that does not retry — so the most ergonomic declaration is the one that gives up. Which default you inherited decides whether your bad-output tail lands in an exception handler, on your token bill, or in front of a user.

13 min read

Jev and its fast followers sell a probability nobody has measured

Jev, OpenAI Decisions, Cloudflare Clef and Perplexity's pplx-decider all guarantee a valid answer — so does constrained decoding — which leaves the calibrated probability as the only new thing they sell. As of October 2026 no vendor has published calibration on the job these models are sold for, and the threshold you set from your own labels decides both the error rate and the bill.

14 min read

Ollama vs LM Studio vs llama.cpp vs MLX: the tool call is the whole difference

Four local runtimes, the same weights, four different prompts going in and four different answers to whether a tool call comes back parsed. None of that is throughput, and throughput is the only axis anyone compares.

9 min read

Outlines vs XGrammar vs llguidance vs Instructor: Valid JSON Was Never the Hard Part

Three of these four constrain the sampler so invalid output cannot be produced, and the choice between them collapses to one question: do your schemas repeat? The fourth does something categorically different, and it is the only one that can enforce the rules that actually break agents — because a grammar guarantees the enum is one of five values and says nothing about which.