How Jev works
We have implemented TypeSafe's Jev in our Coworkies platform to evaluate coworking space profiles, job ads and blog posts. Each content type has clear scoring criteria. Jev gives us signals about which records meet those criteria and which need attention. We then use Gemini to create improvement proposals.
That experience has made us interested in a wider question: where could this approach help the people running coworking spaces? Jev is one option for the job. Putting a comment, a ticket or a page into a category is a much older practice, and for some of this work a small trained classifier, or an open model you run yourself, will fit better. The rest of this piece is how we would tell the difference.
TypeSafe calls Jev a System One model, built for fast, focused judgments inside software. The name draws on the idea of fast, intuitive thinking popularized by Daniel Kahneman. Jev reads the context an application supplies and returns structured evaluations that the application can act on. TypeSafe's System One introduction explains the approach.
There are two parts to a request. First, the context: a listing, job description, support message or account record. Second, the questions and criteria: what you want evaluated and what each possible answer means.
Jev supports three question types:
- Choice: select from categories you define, such as billing, facilities or sales, with probabilities for the options.
- Score: assess something against levels you describe, such as how clearly a job ad explains the responsibilities.
- Noul: return a probability between zero and one for a yes-or-no question, such as whether a message requests a cancellation. The application applies a threshold to turn that result into a boolean flag, with uncertain cases sent for review.
Several questions can evaluate the same record independently in one request. The application can then sort the results, apply thresholds or send selected records for further work. TypeSafe documents Choice, Score and Noul separately.
The criteria deserve care. For example, a job-ad clarity score could distinguish between a vague role description, some useful responsibilities and a clear account of the work. That gives the score a meaning the team can review. A general instruction to judge whether an ad is "good" leaves too much unspecified.
Why Jev is useful for repeated evaluations
Repeated evaluations need clear criteria and results that software can use consistently. These are the features we would assess when considering Jev.
No free-form text. Each answer arrives as a defined value the application can store, compare and sort. A content review queue can use the score directly, without extracting a verdict from a written response.
Probabilities and confidence signals. Choice and Score answers include probabilities and a confidence value summarizing how concentrated those probabilities are. That helps a team route ambiguous records for review. Thresholds still need checking against your own examples. Outside benchmarks have found those confidence figures running ahead of the hit rate, so a threshold that looks safe on a dashboard still needs a check against reviewed records before it triggers an automatic action. TypeSafe explains confidence here.
Speed for repeated checks. Jev evaluates independent questions about the same record in parallel. Clarity, relevance and completeness can be assessed in one request. MindStudio's benchmark describes a related property: about 30 questions on the same input returned in roughly the same time as one question, near 150 milliseconds, because the call batches them. A classifier trained separately for each category pays for every new category on its own. Response times still have to be measured in the actual application, next to a local model where you have one.
Low evaluation costs. As of September 2026, TypeSafe lists direct API pricing at $0.042 per million input tokens, with output tokens free. This makes repeated scoring worth considering across a content library. The full workflow budget should also include Gemini proposals, integration maintenance and staff review. See TypeSafe's model pricing.
Verdicts stay within the defined options. Jev selects from the supplied categories or returns a score along the defined scale. That avoids invented verdict labels and unexpected output formats. It can still select the wrong category or assign an unsuitable score, so the team should review accuracy against real examples.
How we use Jev and Gemini at Coworkies
Our workflow has two stages: Jev evaluates space profiles, job ads and blog posts against the criteria for each content type; Gemini creates proposals for improving them. The evaluations give that improvement work a defined starting point.
The useful part is having a repeatable way to identify content that needs attention. The criteria still require editorial judgment, and proposed changes still need review. We reached for Jev because we wanted those criteria applied across a content library without training a separate classifier for profiles, job ads and posts.
Classifying text came before Jev
The workflows below are classification problems. A cancellation note, a ticket, a review or a landing page goes in, and a category, a score or a yes-or-no probability comes out. Coworking teams already do versions of this with required reason fields, inbox rules and someone reading the comment. In software the same job has a longer record: regular expressions, logistic regression on word frequencies through the 2000s, and, since 2018, fine-tuned BERT-style encoders that turn a passage into class probabilities in one pass. Jev is a hosted way to ask the question when you do not yet have those labels. The decision is whether your volume, and how stable your categories are, justify that call.
Jack Rudenko made a related point in September 2026, in an essay on how Jev is being benchmarked. Public demos often time Jev against a large chat model. TypeSafe's headline figures, 193 times faster and 444 times cheaper, compare it with the average of GPT-6 Astra and Fable 5.1 on four internal workflows. That comparison is against a model that writes prose. The comparison that changes a buying decision is a classifier built for the task. On a single request, Rudenko puts an unoptimized BERT-base near 100 milliseconds on a CPU, a distilled model near 60, and an optimized one under 10, with Jev at 70 to 500 milliseconds once the network hop is included. Batch that encoder on a GPU and the time per item falls well under a millisecond. Jev's $0.042 per million input tokens is inexpensive beside a general model that bills for generated text. A classifier on hardware you already run has no per-token fee, and at high volume Rudenko puts the cost per million predictions under a cent.
MindStudio's write-up of an independent benchmark is the short accuracy comparison. It ran Jev, trained BERT-style classifiers and older zero-shot pipelines on Banking77, Yelp reviews, an emotion set and a phishing-email set. A 22-million-parameter encoder with a logistic-regression head reached 93.2% on Banking77 and answered in 8 milliseconds on CPU, ahead of every zero-shot method in the test. Jev, with no labeled examples, reached 80.1%, ahead of a classic zero-shot baseline at 48.8% and a newer one at 66.7%. MindStudio reports that the trained classifier also won by a wide margin on emotion and on phishing. Yelp star ratings went the other way: Jev at 67.2%, the trained classifier at 51.9%. On Banking77, Jev's reported confidence averaged 88% while accuracy sat near 80%, and temperature scaling cut that calibration error by about two-thirds. The practical rule matches what we would tell an operator. Solid labels and a stable task favor the small local model on accuracy and on cost. No labels, and a question that still changes, favor Jev over a zero-shot pipeline that has been around since 2019.
Rudenko also separates speed from judgment, using figures he attributes to TypeSafe's own dashboard. Across four workflows he cites 67.8% agreement with the reference for Jev and 74.1% for Opus 5 in workflow mode; on invoice processing, 61.8% and 79.1%. He cites Parallel, a team that runs ranking and classification at very high volume: Jev matched one of their custom rerankers zero-shot, their internal models won on topic classification and on query freshness, and Jev cost more per document than the models they host. The sequence we would use is the one he lands on. Use a zero-shot model while the categories are still being named. Once staff have corrected enough labels and the list stops moving, those corrections are the training set for a model you can run yourself.
Where Jev could add value for operators
Coworking management platforms already provide strong reporting. Nexudus Explore includes CRM loss reasons, contract cancellation reasons, booking activity and help-desk performance. OfficeRnD Flex Data Hub covers revenue, occupancy, retention, bookings and support-ticket trends.
We would use those reports first. Dates, balances, utilization, attendance changes and follow-up deadlines can all be handled through existing data and rules.
Jev becomes relevant where staff repeatedly read text to assign a category or check for a specific meaning. The opportunity depends on how much of that work remains manual after using the platform's existing features. The following are workflows we would test; our firsthand implementation is the Coworkies content workflow described above.
1. Classify written cancellation reasons and sales objections
Input: cancellation comments or notes attached to a lost sales opportunity. Review each against its own criteria: why an existing member left and why a prospect declined are different questions.
Jev's task: use Choice to assign the reason explicitly described in the text to an agreed category. Cancellation categories could include cost, changed workspace needs, location, service issues and business closure, with options for other reasons, multiple reasons and insufficient information. For lost opportunities, use the sales team's existing objection categories.
How the team would use it: review suggested labels for records with missing or overly broad reason fields, then compare the approved categories by location, membership type or period in the reporting tool.
This is useful when meaningful detail sits in comments that staff would otherwise have to read individually. Where reasons are already captured consistently, use those fields. A complaint elsewhere in an account's history is insufficient evidence to label it as the reason for departure.
2. Add useful detail to support tickets
Input: a ticket's message thread and its existing category.
Jev's task: classify the issue at a level that helps the team act. An IT category could be refined into Wi-Fi connectivity, meeting-room video equipment, printing or other. A separate Noul check could ask whether the member explicitly says the issue persists after an attempted fix.
How the team would use it: route unclassified tickets to the appropriate queue, flag reports of unsuccessful fixes for staff review, and analyze recurring issue types across ticket history. Count distinct tickets so a long conversation does not inflate the number of incidents.
Nexudus already supports help-desk departments with assigned managers. Additional classification earns its place when the existing categories leave staff with substantial sorting or reading work. The useful measure is time saved and fewer missed follow-ups.
3. Flag explicit membership requests in messages
Input: member emails or account conversations received outside a structured request form.
Jev's task: run separate Noul checks for specific requests: does the member ask to cancel, ask for a smaller workspace, or ask about additional space? Define each check around what the member actually requests. A general question about notice periods should remain distinguishable from an instruction to cancel.
How the team would use it: create a review flag linked to the original message and account. Staff confirm the request and handle it through the usual membership process. Any contract or billing change follows that confirmation.
This could help a team managing a shared inbox with enough volume for requests to be overlooked or manually forwarded. Requests submitted through an existing cancellation or expansion form already have a clear type and can follow ordinary routing rules. The value here is recognizing the request in free text.
How this would fit with Nexudus or OfficeRnD
Both platforms provide APIs for building integrations. The Nexudus API reference includes CRM, coworker notes and help-desk resources. OfficeRnD's developer documentation describes data access and event-driven workflows. The exact records, fields and permissions needed for a chosen workflow require checking during implementation.
An integration would retrieve the relevant text, send it to Jev with defined questions, and store the suggested labels or flags alongside a link to the source. Existing reporting or a separate analysis tool can then aggregate approved labels. Messages held in an external inbox would need access through that service as well.
A developer would need to build and maintain this integration for the chosen workflow.
Understanding our position in the market
The same approach could help us review evidence outside the management platform. Competitor websites, published offers, public reviews and search queries all contain information relevant to commercial decisions. Jev could make that material easier to compare by applying the same questions across it.
We would start with a defined set of comparable local spaces and retain the source and collection date for every record. A separate tool or manual process would collect the material for Jev to evaluate.
Compare competitor positioning
Input: our location pages and the equivalent pages or marketplace listings for nearby competitors.
Jev's task: classify the audience each page explicitly addresses, such as independent professionals, small teams or larger businesses, allowing for mixed or unclear positioning. Separate Noul checks could identify whether the copy emphasizes price, flexibility, privacy, hospitality or community.
How the team would use it: compare the promises a prospect encounters and review how clearly our own offer stands out. These labels describe what each business advertises. Enquiries and sales results would help us assess which promises attract customers.
Compare published offers and pricing
Input: published descriptions, prices and terms for comparable products in the same local market.
Jev's task: classify the offer type and check whether the description explicitly includes meeting-room credits, round-the-clock access or a minimum commitment. Record missing terms as unknown; an omitted benefit may still be available.
How the team would use it: assemble a comparison for commercial review. Staff verify the prices and terms, and a spreadsheet handles calculations using consistent billing periods, taxes and inclusions. Keep advertised starting prices separate from confirmed quotes. Jev helps interpret the offer descriptions; pricing decisions also need our costs, demand and sales evidence.
Compare what reviewers praise and criticize
Input: recent public reviews of our locations and a comparable set of competitors, using the same review sources and time period where possible.
Jev's task: identify mentions of specific topics, such as noise, staff responsiveness, cleanliness, connectivity or value, then classify the experience expressed about each. A review can contain praise for one aspect and criticism of another.
How the team would use it: identify recurring service issues and strengths that customers describe in their own words. Compare topic frequencies with review counts visible and keep links to the original comments. This can inform service improvements and marketing claims, while recognizing that reviewers are a self-selected group.
Check whether marketing supports the commercial brief
Input: ads, landing pages and directory listings, together with the intended audience, offer and next step.
Jev's task: check each element separately. Does the copy address the intended audience? Does it explain the product being promoted? Does the call to action match the campaign? A Score question could assess how specifically the copy supports its main benefit, with levels ranging from an unsupported claim to concrete, relevant detail.
How the team would use it: prioritize content for editorial review, then prepare improvements using approved product information. This is the closest extension of our Coworkies workflow. Conversion tracking would show whether the changes improve results. For a small set of pages, direct editorial review may take less effort.
Match search intent to page content
Input: search queries and their associated landing pages from Search Console, alongside the text of those pages. Google's Search Console guide explains how to review query and page performance, including impressions and clicks.
Jev's task: group queries by the need they express, such as a day pass, private office or meeting room, keeping ambiguous queries separate. Then assess whether the landing page addresses that need using defined criteria for product information, location and booking details.
How the team would use it: combine those assessments with search performance to prioritize pages for improvement. Jev supplies a content assessment; Search Console tracks visibility and traffic, and crawling tools handle technical SEO checks. The comparison can reveal content gaps on pages already appearing in search, with ranking and conversion changes measured after editing.
Open-source alternatives to evaluate
A team with someone technical can ask the same kind of question without sending every record to TypeSafe. We would score any of these on our own sample before using one on member messages.
Laya, from ConvAI Innovations, supports choice, score and yes-or-no probability questions. The weights are on Hugging Face under Apache 2.0, so a team can run them on its own infrastructure. The model card reports about 33 milliseconds for a single question on the multilingual checkpoint using a T4 GPU. That is the developer's benchmark. What you see in production depends on the hardware, the checkpoint and the volume. Once a pilot has produced corrected labels, fine-tuning a local model such as Laya is the comparison we would cost against the API.
SemIf, formerly OpenJev, is an independent research project, unaffiliated with TypeSafe. It reproduces the interface, passing a state, a question and the options you allow, and reads probabilities for those options from an open model in one forward pass. It does not reproduce Jev's model or training, and your code does not have to parse an answer sentence. The browser demo keeps the weights in the browser cache, and the page states that inputs stay on that page. The implementation is on GitHub under the MIT license.
On SemIf's published ladder of native checkpoints, Qwen3.5 4B reached 81.3% balanced accuracy on the project's authored decisions and 84.5% agreement on a 102-row public subset. Published Jev is listed at 88.3% agreement on that same subset. SemIf's authors say they took that Jev figure from TypeSafe's published records and did not call a live endpoint. MiniCPM5 2B sits at 68.6% on the authored set, and Qwen3 0.6B at 44.0%. The browser demo uses quantized builds, which can change both accuracy and speed. For an operator, the figure that matters is agreement with your own staff on your own tickets, measured before a probability becomes a routing decision.
Self-hosting still needs a machine and a person to keep it running. We would score Jev, Laya and SemIf on the same records, then keep the option that is accurate enough, and operable enough, for the team that has to live with it.
Where we would start in a coworking business
We would start with one recurring review that already takes staff time and informs a decision. That might be categorizing cancellation comments, comparing competitor offers or reviewing landing pages against a campaign brief. First check whether existing fields, reports or a straightforward manual review would cover the need.
Agree on the questions and criteria, then have an experienced team member evaluate a sample independently. Test Jev against those decisions, examine disagreements and refine the criteria. Include incomplete descriptions and ambiguous records. Keep a separate sample for checking the revised approach.
Then run alongside the current process, with staff reviewing the results. Measure accuracy and total staff time, including corrections. For message routing, track missed requests and unnecessary flags; for market reviews, check whether the comparisons are useful in commercial decisions. Save the criteria and model version so changes in labels remain traceable. Limit shared data to what the evaluation needs and check the provider's data-use terms before sending member messages.
MindStudio's strongest pattern for a harder judgment was to split the question. Asking whether an email was phishing scored near 60%. Eight concrete indicator questions, passed to a small downstream classifier, reached 94%. A cancellation comment can be handled the same way: separate checks for price, a move, a service failure and closure, with a rule or a small model combining them, and staff reviewing the uncertain rows. Once those reviewed labels are numerous and the category list has stopped changing, price a trained local model against the API on a sample you held back.
For us, Jev's strongest case is repeated reading where we lack a trained classifier and the output is specific: a reason category, a request flag, a comparable offer attribute or a content score. We would keep the hosted model where it reduces that work reliably. Where the categories settle and the volume grows, we would expect a small model trained on the labels staff already corrected to take over the job.
Update: OpenAI announced the Decisions API in preview at DevDay 2026. A major competition to Jev, integrated into their ecosystem of models and workflows. Powered by the Luna model, it supports visual inputs and lets developers define fixed answer options, enabling fast classification and routing decisions instead of open-ended text generation. The API returns structured responses with confidence scores in hundreds of milliseconds.
