Microsoft’s new model helps AI agents judge their next move

Microsoft-Decision-1 is a small decision-scoring model. Given a situation, a question and a fixed set of answer options, it returns a calibrated probability for each option.

“This model is designed for routing, classification, prioritization, verification, and workflow control, making it easier to incorporate decision intelligence into existing applications, agents, and workflows in a secure, trusted environment,” Achint Srivastava, VP of Software Engineering in Microsoft’s Office of the CTO, explained.

How Microsoft-Decision-1 works

Microsoft said it evaluated the model across 36 benchmarks covering nearly 150,000 questions, with the benchmarks kept blind from training. In the company’s benchmarking, Microsoft-Decision-1 was 2.5 times faster than H2O-Lightning-4B v1.1, the runner-up on speed, and about 35 times faster than GPT-6 Sol in median latency.

Accuracy, latency and calibration, side by side (Source: Microsoft)

The probability scores indicate the model’s confidence in each answer and can help an application decide whether to act, defer a decision or request a review. Microsoft advises developers to validate the model and confidence thresholds on examples representative of their intended use.