All media
Wavera Field Note 01 · Model systems

Specialized decisions,
frontier reasoning.

A 2,000-case study of why the next generation AI EHR will not ask one model to do every job.

The most capable AI system is not always the one with the largest model at every step. In healthcare, where speed, predictability, and restraint matter alongside intelligence, architecture matters just as much as model capability.

Editor's note

This is a systems benchmark, not a clinical evaluation. It tests one bounded decision layer with synthetic requests. We are publishing it because architectural choices are often hidden behind end-to-end demos, even though they shape speed, cost, and controllability.

In one lineA purpose-built decision model routed requests more accurately, 3.5× faster, and at 83% lower measured cost than our general-purpose generative baseline.

Why Jev is getting attention

TypeSafe AI introduced Jev in September 2026 as its first public “System One” model: a model designed to return typed probabilistic decisions rather than generate open-ended strings. The proposition is unusually concrete. Define the available choices, send unstructured state, receive a decision plus a probability distribution and confidence that ordinary software can use.

It is easy to see why that launch generated enthusiasm. Model builders have spent years making language models broader; TypeSafe is asking what happens when a model gives up prose generation and specializes in the smaller decisions that make software move. The company makes ambitious claims about speed and economics. Those claims deserve independent workload-specific testing—which is why we ran our own benchmark rather than simply repeat the launch numbers.

Background: TypeSafe’s Jev announcement and current model documentation. Our run pinned jev-1.13.0; aliases can move when new releases ship.

A different question than “which model is smartest?”

Modern EHR intelligence has at least two kinds of work. Some tasks require broad synthesis: reading a longitudinal record, weighing evidence, or explaining a recommendation. Frontier generative models are remarkable at that work. Other tasks are narrow decisions: identify the kind of request, choose the right destination, and know when confidence is too low to proceed.

We tested whether a model built specifically for structured decisions could improve that second layer. The comparison pinned jev-1.13.0, TypeSafe's decision model, against the general-purpose generative model already serving as our production routing baseline. This was not a clinical-judgment evaluation, and neither model was allowed to execute an action.

Figure 1. Held-out exact routing accuracy
General-purpose baseline84.6%
Jev decision model96.1%

1,000 held-out cases. Exact means the selected destination matched the full expected route.

The study

We assembled 100 hand-written request patterns spanning ten broad kinds of work that an AI-native clinical system may need to distinguish. Each pattern was expressed in 20 surface forms, creating 2,000 cases. Half were reserved for held-out evaluation. The dataset was balanced by design, used no patient data, and measured only whether the system selected the expected destination.

2,000total cases
1,000held out
10task families
4,000successful model calls

Jev reached 96.1% exact-route accuracy on the held-out set. The general-purpose baseline reached 84.6%. Because the surface variants share semantic roots, we also resampled by the underlying request pattern; the direction of the advantage remained positive under that more conservative analysis.

Results at a glance

Held-out set · n=1,000
MeasureGeneral-purposeJevDifference
Exact-route accuracy84.6%96.1%+11.5 pp
Incorrect routes15439115 fewer
Median latency592.6 ms168.1 ms3.5× faster
95th-percentile latency780.4 ms212.7 ms3.7× faster
Cost / 1,000 decisions$0.328$0.05583.1% lower

The useful statistic is not only the 11.5-point accuracy lift. The baseline made 154 incorrect routing decisions; Jev made 39. That is 115 fewer errors, or a 74.7% relative reduction in this held-out sample. Relative error reduction is sensitive to the benchmark's balanced composition, so we report it alongside—not instead of—the raw counts.

Figure 2. Observed median latency
593 msBaseline
168 msJev
Figure 3. Measured cost / 1,000 decisions
$0.328Baseline
$0.055Jev

Speed and cost are clinical design constraints

A routing decision sits at the beginning of an interaction. Every extra fraction of a second compounds the feeling that an assistant is “thinking” before it can begin useful work. In our observed run, median latency was 168 milliseconds for Jev and 593 milliseconds for the general-purpose baseline. Measured token cost was about $0.055 versus $0.328 per 1,000 decisions.

Those numbers are workload-specific, not universal price claims. But the pattern matters: assigning a narrow decision to a narrow model can reserve frontier reasoning for the places where its breadth creates value.

3.7×faster at p95
212.7 vs. 780.4 ms
83.1%lower measured cost
$0.055 vs. $0.328 / 1k
100%successful calls
4,000 of 4,000
Figure 4. A conservative confidence gate
0.00.50.60.70.80.9
Jev coverageAccuracy when acceptedBeta gate

At 0.90 confidence, Jev handled 80% of held-out requests and was exact on all 800 accepted cases. Lower-confidence requests can be escalated to a larger model or human review.

Confidence is part of the architecture

A healthcare AI system should not turn uncertainty into confidence theater. Jev returns a confidence score with its choice. At a conservative 0.90 threshold, the model accepted 80% of held-out cases and was correct on all accepted cases in this study. The remaining 20% can fall back to a more capable model, request clarification, or wait for human review.

That does not make the complete system perfect. A fallback is only as good as the model receiving it. The lesson is to expose uncertainty and design the escalation path deliberately, rather than hide it inside a single opaque generation.

What happens when the models work together

We also measured a simple cascade: Jev decides first, and requests below the 0.90 confidence gate move to the general-purpose model. On the held-out set, 20% of requests fell back. The combined path reached 97.5% exact-route accuracy, with a 175 millisecond median and an estimated cost of $0.120 per 1,000 decisions.

Jev accepted80%800 requests · 100% exact in sample
Escalated20%200 requests · general-purpose fallback
Combined97.5%exact-route accuracy · 975 / 1,000

The cascade's 95th-percentile latency rose to 835 milliseconds because the slowest requests paid for two sequential model calls. That tradeoff is instructive: confidence gating improved overall accuracy and average economics, but it did not improve every latency statistic. Production architecture is a set of negotiated constraints, not a single leaderboard number.

The future EHR will not be powered by one model. It will be an orchestrated system that knows when to decide quickly, when to reason deeply, and when to stop.

What this means for an AI-native EHR

We are building Wavera around a simple principle: use frontier intelligence where medicine needs context and synthesis, and use specialized models where software needs a fast, typed decision. Keep deterministic controls around consequential actions. Make uncertainty visible. Measure the whole system, not just a model in isolation.

This study is an early engineering result, not a clinical validation claim. The next step is careful shadow evaluation on representative, de-identified traffic and continued review of the boundaries between informational and consequential requests.

Methods and limitations

Results come from a synthetic, balanced dataset and do not estimate real-world request prevalence. The 1,000 held-out cases represent 50 unseen semantic seeds expressed in 20 variants each, not 1,000 fully independent intents. The tested TypeSafe model was pinned to jev-1.13.0. Latency was observed from one workstation under concurrent load. Cost used provider-reported token counts and public list prices at the time of the run. No patient data was used and no EHR action was executed.

Wavera Field Notes

See what we test next.

Research and product notes from the team building an AI-native oncology platform.