Databricks has unveiled new tools to help enterprises scale AI agents in high-value, mission-critical applications while ensuring accuracy, governance, and ease of use.
"Many enterprises still struggle to deploy AI agents in high-value use cases due to concerns around accuracy, governance, and security. For these organisations, it's confidence, not just technology, that presents the biggest hurdle to extracting the full data intelligence benefits of Generative AI," said Craig Wiley, senior director of Product for AI, Databricks. "The new tools address these challenges head-on, enabling businesses to move beyond pilots and into full-scale production with AI agents they can trust."
New tools
The new tools includethe Mosaic AI Gateway, which provides unified governance, monitoring, and integration across both OSS models and proprietary AI models. This tool ensures that AI models are used in a controlled and monitored environment, enhancing trust and reliability.
The AI/BI Genie Conversational API suite allows developers to embed natural language-based chatbots directly into custom-built apps or popular productivity tools, improving user experience and engagement.
The upgraded Agent Evaluation Review App empowers domain experts to provide targeted feedback, send traces for labelling, and customise evaluation criteria, enhancing the quality of AI models.
It also provides a tool that offers a new way to run batch inference with Mosaic AI using a single SQL query.
"Batch AI with AI Functions is streamlining our AI workflows. It's allowing us to integrate large-scale AI inference with a simple SQL query—no infrastructure management needed. This will directly integrate into our pipelines, cutting costs and reducing configuration burden. Since adopting it, we've seen a dramatic acceleration in our developer velocity when combining traditional ETL and data pipelining with AI inference workloads," said Ian Cadieu, CTO of Altana, a customer of Databricks.
Mosaic AI Gateway, Genie Conversation API suite, Agent Evaluation Review App, and Batch AI are now available in Public Preview.
