Introducing ai_decide: make fast decisions on your governed data

Today, we’re launching a new Databricks AI Function ai_decide that makes fast decisions over your governed data.

We see a lot of teams use LLMs for tasks that do not require complex reasoning and text generation. Which category does this support ticket belong to? Does this document need human review? Which model should handle this prompt?

These questions power many of our customer’s high-scale enterprise workflows from processing millions of documents to controlling real-time app logic. However, using LLMs for these smaller, structured decisions means paying for additional latency and cost that compounds at enterprise scale. A decision model like TypeSafe AI's Jev closes that gap: instead of generating text, it takes unstructured input and a set of questions and returns decisions and their probabilities directly.

ai_decide is a new Databricks AI Function powered by a decision model. It evaluates one or more questions against text in a fraction of a second, and for each question, it returns either a probability, a choice from named criteria, or a score on an ordered scale. Because ai_decide is optimized for fast decisions, it yields lower latency and cost than an LLM on similar tasks.