AI engineering · Field notes
Jev belongs between code and LLMs
Jev is not a Chief of Staff or a replacement for Claude and GPT. It is a constrained decision layer for routing, review, and bounded agent work.
- Written
Picture a customer writing: “I got charged twice. Fix this today or I am done.” A business needs more than one kind of AI to handle that well.
Your ordinary software should follow hard rules. It checks whether the customer has an account. It checks whether there were two charges. It never sends money because an AI sounded sure.
Claude or ChatGPT can read the messy message, understand the frustration, ask what is missing, and write a helpful reply. That is what language models are good at.
Jev sits between those jobs. It does not write the reply. It makes a fast choice from options the software gives it: billing, technical support, sales, or human review. Think of it as AI that can make a smart choice, but only from buttons you put in front of it.
That is why I am paying attention. Most agent software is built with two extremes: ordinary code that follows exact rules, and chat models that can understand almost anything but can also surprise you. Jev is a possible middle layer for the small judgment calls in between.[1][2]
The stack has three layers
First comes deterministic software. That is a technical way of saying the same facts should produce the same action. If a customer is not authorized, they cannot export customer data. If a job is cancelled, it does not quietly restart. If a refund is above your limit, it waits for approval.
Keep permissions, budgets, account boundaries, approval requirements, and irreversible actions here. This is not where we want AI judgment. We want a boring answer that can be tested, audited, and reversed.
Third comes the LLM, meaning a language model like Claude or GPT. It can understand an owner saying, “I need to stop losing leads after events.” It can ask what counts as a lead, inspect the current process, research options, draft a workflow, and explain the tradeoff.
The middle layer is constrained judgment. Jev is not deterministic. It can still be wrong. What is limited is its answer: you define the possible answers, and it returns one of them with the probability distribution your software can inspect.
That makes it closer to a smart if-statement than a chatbot. It helps when ordinary rules are too stiff, but asking a full chatbot is too slow, expensive, or likely to wander.[3][4]
One message, many decisions
Jev has three basic moves. Choice picks from named options. Score places something on an ordered scale. Noul answers a yes-or-no question with a probability. Choice and Score also include a confidence value derived from their probability distribution.
The useful part is not one fancy label. It is asking several narrow, independent questions about the same message at once. For the double-charge complaint: Is this billing, technical support, or sales? Is a refund requested? Is the customer likely to leave? Do they ask for a human? Is the situation urgent?
Then code decides what that recognition permits. A closed ticket gets no action. A human request goes to a person. A high-confidence, low-risk billing case goes to the right queue. A low-confidence answer triggers clarification or a stronger model. No probability should authorize a refund by itself.
That matters for old work too. If a business can cheaply inspect thousands of old emails, calls, documents, or support tickets, it can find missed leads, recurring complaints, churn signals, and follow-ups that were too expensive to look for before. The reported wins in this space are still early developer examples, not guarantees. But the capability is real enough to test.[5][6]
The Chief of Staff is still an LLM
Do not replace the Chief of Staff with Jev. A Chief of Staff has to understand an ambiguous goal, notice missing information, break work into parts, change the plan after a failure, and explain the tradeoff back to the owner. Those are language-model jobs.
The better architecture is a Chief of Staff LLM with a decision layer beside it. The Chief of Staff turns “build me a follow-up system for event leads” into work orders. Jev can help classify those jobs, decide whether the context is complete, select from approved worker lanes, flag uncertainty, and check whether the result is likely complete or blocked.
But routing policy cannot live entirely in Jev. Code should hard-route image work to a vision-capable worker. Current-events research should require retrieval and citations. Publishing, spending, deleting, trading, and production changes should stop for explicit approval. Jev does not get to negotiate those boundaries.
This is already becoming a concrete pattern. LiteLLM documents a Jev Auto Router that chooses across configured model tiers, then dispatches to the selected completion model. That is useful plumbing. It is not proof that the router understands your business or will save money on every workload.[7][8]
Where it breaks
Do arithmetic, counts, date math, and hard comparisons in ordinary code. Ask Jev direct, narrow questions. Retrieve the relevant evidence instead of dumping an entire noisy archive into one request. If a question depends on the answer to an earlier question, let code make that first decision before asking the next one.
Treat outside text as potentially hostile. A customer message, webpage, or document can contain instructions meant to influence a model. Test prompt-injection cases before using Jev as a safety gate. Do not let one Jev answer trigger an irreversible action.
Jev also cannot write an email, generate code, explain why it made a choice, see an image, or hear audio. It is not an LLM replacement. It is one narrow part of a larger system.[9][10]
Test it before you trust it
Do not install a router because a YouTuber got excited. Pick one repeated decision with a known good answer and a cheap human review path: support routing, intake completeness, task-finish verification, or choosing from a small list of approved model tiers.
Build a labeled set from real historical work. Record the task, available context, allowed routes, actual outcome, human correction, latency, and cost. Compare ordinary rules, the current frontier-model path, and Jev with LLM escalation. Measure accepted outcomes, not confident answers.
Cheaper language judgment may eventually make intelligence feel ambient inside ordinary software. That is the opportunity. But the winning architecture is still simple: keep hard rules hard, use language models for ambiguity, use constrained decisions for repeated judgment calls, and keep humans responsible for consequences.