> ## Content Index > Fetch the complete content index at: https://www.implicator.ai/llms.txt > Use this file to discover other available public pages before exploring further. # Microsoft Launches Decision-1 as H2O.ai Challenges Its Speed Comparison - URL: https://www.implicator.ai/microsoft-decision-1-speed-comparison-h2o/ - Published: 2026-10-12T01:36:22.000Z - Updated: 2026-10-12T01:36:22.000Z - Description: Microsoft's Decision-1 scores fixed choices at $0.042 per million input tokens. H2O.ai disputes its speed comparison, and JevBench records a different Azure response time. The tests measure different kinds of delay, leaving developers to check which figure applies to their workloads. - Author: Marcus Schuler - Tags: AI News Microsoft [launched Microsoft-Decision-1](https://commandline.microsoft.com/microsoft-decision-1-model-foundry/?ref=implicator.ai) on October 9, with a self-reported median response time of 85 milliseconds and a speed comparison that rival H2O.ai disputes. The model assigns probabilities to fixed answer options in a single pass instead of generating text. It is intended to reduce delay in tasks such as routing support requests and checking an agent’s proposed action. What Changed - Microsoft launched Decision-1 on October 9 to score fixed answer options, using Alibaba's Qwen3.5-9B with additional training. - Input costs $0.042 per million tokens, with output free. The model is available through Microsoft Foundry and OpenRouter. - H2O.ai disputes Microsoft's use of adjusted latency figures for self-hosted rivals; local GPU timings exclude network delay. - JevBench recorded a 459-millisecond Foundry median across 124 requests, without reproducing Microsoft's original 85-millisecond test setup. AI-generated summary, reviewed by an editor. [More on our AI guidelines](https://www.implicator.ai/about/). ## Fixed-option scoring Decision-1 is built on Alibaba’s Qwen3.5-9B, with additional training by Microsoft. Developers supply the input, a question and possible answers. The [Foundry catalog](https://ai.azure.com/catalog/models/Microsoft-Decision-1?ref=implicator.ai) lists uses including routing support requests and grading an agent’s proposed action against supplied criteria. The model is available through Microsoft Foundry and OpenRouter. At launch, input costs $0.042 per million tokens, with output free. Applications can use the returned probabilities to set thresholds for automatic action or human review, and include a “cannot tell” option when evidence is insufficient. ## The disputed speed comparison Microsoft’s launch comparison put Decision-1’s median response time at 85 milliseconds, against 210 milliseconds for H2O-Lightning-4B. Its chart footnote identifies its own result as a same-region Foundry measurement and rivals’ results as adjusted JevBench medians checked October 7\. Microsoft also claimed it was 35 times faster than GPT-6 Sol in its own benchmarking. H2O.ai, the developer of a competing decision model, [challenges the treatment of self-hosted rivals](https://huggingface.co/h2oai/h2o-lightning-4b?ref=implicator.ai). It says Microsoft used JevBench’s network-adjusted estimate rather than raw local execution time. JevBench measured H2O-Lightning-4B v1.1 at about 29 milliseconds locally; doubling that median and adding 150 milliseconds produces approximately the figure in Microsoft’s chart. JevBench times hosted APIs from its measuring host through the network and back. Self-hosted models are timed on-GPU, without network delay. Their raw measurements cannot be directly compared with API response times. FREE AI BRIEFING · WEEKDAYS Follow the model benchmarks that get contested. Get the AI stories shaping the day, with concise context from San Francisco. The briefing takes about five minutes and arrives at 4:45 a.m. Pacific, 7:45 a.m. Eastern. Email address Keep me informed Check your inbox for the confirmation link. Free. No hype. Unsubscribe anytime. JevBench applies the same estimate to every self-hosted row. The adjustment is an assumption, rather than a measured network cost or hardware normalization. Its method notes also describe a planned calibration of the network allowance against real end-to-end measurements. ## An independent Foundry measurement On [October 10, JevBench](https://benchmarkheaven.com/jev-models?ref=implicator.ai) recorded a native Azure Foundry median of 459 milliseconds for Decision-1 across a 124-request speed subset. JevBench timed a network-inclusive API round trip, while Microsoft measured within the same Foundry region. The independent measurement does not reproduce Microsoft’s original serving setup or its full benchmark suite. ## Microsoft’s quality results In its launch evaluation, Microsoft reported the highest accuracy across 36 benchmarks covering nearly 150,000 questions, ahead of models including Jev, Quyet-1.0-Large and H2O-Lightning-4B. The company says those benchmarks were kept blind from training and covered tasks including routing, long-context decisions and safety. Know someone who'd find this useful? [✉️ Email it to a friend in one click](mailto:?subject=A%20newsletter%20I%20think%20you%27d%20like&body=This%20is%20one%20of%20maybe%20three%20newsletters%20I%20actually%20read.%20The%20rest%20just%20pile%20up%2C%20unread%2C%20judging%20me.%0A%0AAnd%20yes%2C%20this%20email%20mostly%20wrote%20itself%2C%20which%20is%20a%20little%20on%20the%20nose%20for%20an%20AI%20newsletter.%20Doesn%27t%20make%20it%20wrong.%20implicator.ai%20is%20good.%0A%0ASubscribe%20free%3A%20https%3A%2F%2Fwww.implicator.ai%2Fsubscribe%2F%3Futm%5Fsource%3Dnewsletter%26utm%5Fmedium%3Dforward%26utm%5Fcampaign%3Demail%5Fforward), or they can [subscribe free here](https://www.implicator.ai/subscribe/?utm%5Fsource=newsletter&utm%5Fmedium=forward&utm%5Fcampaign=forward%5Fto%5Fcolleague). JevBench’s independent evaluation uses its own observations and scoring method, so it does not verify Microsoft’s claim to lead that separate comparison. Microsoft also reported an internal Xbox Research trial that sorted more than 10,000 pieces of player feedback and reviews into themes defined by researchers. In that trial, the company reported quality competitive with GPT-6 Sol while running more than 14 times faster. ## Limits and future versions Decision-1 provides no written rationale for its scores. The catalog excludes using it as the sole automated decision-maker for consequential personal decisions, including credit, employment and healthcare. Confidence calibration is strongest on familiar task types, and wording or option order can change scores. Microsoft’s [deployment guidance](https://learn.microsoft.com/en-us/azure/foundry/foundry-models/how-to/use-foundry-models-microsoft-decision?ref=implicator.ai) calls for testing representative workloads and validating confidence thresholds on labeled examples before automating decisions. It also advises placing Foundry resources near applications and users to reduce network delay. Microsoft says it plans to soon rebase this model on other model families, including its own MAI models and OpenAI models. Frequently Asked Questions What does Microsoft-Decision-1 do? It assigns probabilities to fixed answer options instead of generating text. Developers supply the input, a question and possible answers. Uses include routing support requests and grading an agent's proposed action. It provides no written rationale for its scores. How much does Decision-1 cost? At launch, Microsoft lists input at $0.042 per million tokens, with output free. The model is available through Microsoft Foundry and OpenRouter. Why does H2O.ai dispute the speed comparison? H2O.ai says Microsoft used JevBench's network-adjusted estimate for self-hosted rivals. JevBench measured H2O-Lightning-4B v1.1 at about 29 milliseconds locally; doubling that time and adding 150 milliseconds produces roughly the 210 milliseconds in Microsoft's chart. Local timing excludes network delay and cannot be directly compared with API timing. What did JevBench independently measure? Its October 10 revision records a native Azure Foundry median of 459 milliseconds for Decision-1 across 124 speed-test requests. That does not reproduce Microsoft's original serving setup or full benchmark suite, so it is not a like-for-like test of Microsoft's 85-millisecond claim. Can Decision-1 make consequential decisions about people? Microsoft's catalog excludes using it as the sole automated decision-maker for consequential personal decisions, including credit, employment and healthcare. Its deployment guidance calls for testing representative workloads and validating confidence thresholds on labeled examples before automating decisions. AI-generated summary, reviewed by an editor. [More on our AI guidelines](https://www.implicator.ai/about/). [Musk Plans to Use Claude Opus 5.5 and Other Services in Grok BotElon Musk announced on October 7 plans for SpaceXAI's Grok Bot to use external AI providers to handle work for customers. The product would select a provider by task, with Claude Opus 5.5 and outside The Implicator![](https://www.implicator.ai/content/images/2026/10/20261007-092308-grok_claude_routing.webp)](https://www.implicator.ai/grok-bot-claude-model-routing/) [Reflection AI Unveils Beam, an Open-Weight Model It Says Matches China's GLM-5.2“DeepSeek and Qwen and all these models are our wake-up call because if we don't do anything about it, then effectively, the global standard of intelligence will be built by someone else,” Misha LaskiThe Implicator![](https://www.implicator.ai/content/images/2026/10/20261005-163805-reflection_beam_crate.webp)](https://www.implicator.ai/reflection-ai-beam-open-weight-model-glm-5-2/) [The plumbing war: How enterprises are building the routing layer for multi-model AIThe Implicator![](https://www.implicator.ai/content/images/2025/12/2025-12-08-18.21.04-the_plumbin_war@2x.webp)](https://www.implicator.ai/the-plumbing-war-how-enterprises-are-building-the-routing-layer-for-multi-model-ai/)