Jev-style models still shift answers when options are shuffled
On 1,700 questions, Jev accuracy barely changes, but its cumulative failure set grows 27-29% versus the original order.
On 1,700 questions, Jev accuracy barely changes, but its cumulative failure set grows 27-29% versus the original order.
The note calls Jev a cheap classifier that can still be wrong, and says open-weight rivals beat it on cost.
Handa says latency fell to about 100–180 ms, while public indexes still rank dedicated models higher.
Clairic is in preview on Workers AI, with open weights planned, and returns named fields plus a confidence score.
Vercel says Typesafe AI’s Jev reached 35% of paid teams in two weeks, its fastest model adoption.
Decision models from TypeSafe, OpenAI, and Cribl offer scored answers aimed at SOC alert triage.
HiddenLayer finds TypeSafe's Jev 'System One' model vulnerable to TokenBreak and prompt injection attacks that traditional LLMs typically resist.
HiddenLayer shows TypeSafe AI's Jev decision model can still be steered by indirect prompt injection.
Datadog tests whether prompt injection can steer TypeSafe’s Jev and bypass LangChain tool-risk gating.
ProbabilityBench gives exact class probabilities so researchers can measure model calibration and Bayes-error estimates.
TypeSafe AI raised $870 million at a $7.5 billion valuation weeks after launching decision model Jev.
Cloudflare released open-weight Clef-omni, a decision model for text, image, audio, and video.
GraphDecide benchmarks Jev and other choice-based models on graph decision tasks.
A single colon raised LLM judge Jev's false acceptance of wrong answers from about 1% to 26%.
EmDash now screens plugin listings with Cloudflare's Clef model before they appear in its catalog.
Decision model Jev diagnoses simple HVAC faults from physical features but not context-heavy faults, and stays calibrated under shift.
Strands Labs released Strands Decider 2B, a 2-billion-parameter open decision model fine-tuned from Qwen3.5-2B.
Musubi released PolicyLM-1.7B, an open-weights model for real-time content moderation under 50 milliseconds.
BOTTLED benchmarks whether LLM agents can convert large repetitive workloads into cheaper reusable solutions.
A survey of 139 semantic decision-engine families finds almost none prove they meet network control-loop deadlines.
Meta Muse, OpenAI Dots, and Uber's driver assistant push proactive messages, raising when agents should interrupt.
TypeSafe's Jev and rivals return calibrated choices and scores instead of text, at much lower cost and latency.
Cloudflare launched open-weight Clef and Clef-flash decision models so AI agents can act without a human in the loop.
Cloudflare released Clef (27B) and Clef-flash (9B), Apache 2.0 decision models that return typed probabilities.
OpenAI previewed a Decisions API resembling TypeSafe's Jev for fast, cheap classification of agent actions.
TypeSafe AI's Jev holds recommendation quality while latency grows more slowly than pointwise Qwen rerankers.
Jev matches strong recommendation rerankers with slower latency growth than pointwise Qwen models.
Chinese-Jev, a lightweight encoder-only decision model, beats closed-source Jev on Chinese tasks with up to 20x speedup.
About 670 lookalike Jev domains appeared days after launch, with fake shops marking up API access.
Pre-registered tests show raw turns selected by Jev match extracted agent memory at far lower cost.
Sys1Cal-v1 finds Jev hides an unknown probability in binary choices, and recovering it improves calibration.
Evaluations show agent-security judges can miss attack groups they confidently call safe, limiting automatic decisions.
Supersonic Labs released Julia 1, a 144.3M-parameter Apache 2.0 decision model that picks among supplied answers on CPU.
Ollaya is an open-source local runtime for fast Jev-style decision models, compatible with TypeSafe.
Latent Space outlined business changes and recapped claimed frontier model releases, benchmarks, and a TypeSafe fundraise.
Natural context additions flip Jev and peer decision models onto high-confidence wrong choices.
Check Point shows TypeSafe AI's Jev decision model can be prompt-injected into flipping verdicts for about 50 cents.
Contrastive-LM released CLM-8B, an open model that scores agent actions up to 9× faster than Jev.
Study of 2,170 GitHub projects maps how the Jev decision model is used across domains.
Jev detects ten alignment failures zero-shot, with a median AUROC of 0.886 on RLCDAlignBench.
Entities are extracted by the model from each article. First seen , last mentioned . Watching keeps it in this browser only (no account); the watchlist page and dashboard alerts use it.
Today 708 readers · 883 views · 422 reads · all time 168K views