TruEra, which provides a suite of AI Quality management solutions for managing model performance, explainability, and societal impact, launched TruEra Diagnostics 2.0, a major update to its TruEra Diagnostics solution, incorporating the first-ever automated test harness for AI models that includes root cause analysis. The new systematic testing features in TruEra Diagnostics 2.0 help enterprises to get models into production faster by providing comprehensive model evaluation that promotes quality and transparency, accelerating model development and approval.
TruEra Diagnostics 2.0 allows enterprises deploying AI models to:
- Ensure high-quality models via systematic testing
- Identify high-impact problems and then debug and optimize models quickly
- Achieve model transparency with best-in-class explainability, to gain buy-in from key stakeholders more quickly and easily
Each year, billions of dollars are spent on the development of AI and ML models globally but most never make it to production due to quality concerns or lack of explainability. A rapidly growing number of models are in development, yet it is challenging for data scientists and ML engineers to track their experiments, evaluate them, and retrain models quickly and effectively. Model development is often siloed across departments with varying testing methodology that involves a lot of trial and error guesswork for the same use case. Until now, no general automated test harness has existed for ML.
“We are seeing huge demand from enterprises for comprehensive AI Quality management solutions,” said Will Uppington, co-founder and CEO of TruEra. “AI development is where enterprise software was in the early days of its adoption, before automated testing was ubiquitous. We strongly believe that better testing and monitoring for AI models will increase their impact and accelerate their adoption, just as it sped the adoption of enterprise software years ago. There’s a clear need for better and more systematic AI model testing and debugging, and we’re proud to be first to market with these capabilities.”
HaystaqDNA, a TruEra Diagnostics customer, pioneered the use of predictive analytics in political campaigns, helping the Obama presidential campaign achieve a historic victory in 2008, and its team has nearly two decades of experience helping companies and political campaigns accurately target their communications and marketing. HaystaqDNA also has many enterprise clients, helping Fortune 500 and Global 1000 companies achieve new market and customer insights that help to reach new customers and grow ROI.
“HaystaqDNA customers rely upon our ML models for critical market decisions that can determine the outcomes of elections or the success of a major marketing initiative,” said Blake Silberberg, Vice President of Media Analytics at HaystaqDNA. “TruEra Diagnostics helps us to ensure that our models are accurate, robust, and high performing, as well as fair. We work with a large number of high volume models, so having automated testing to ensure model quality across all of our models is of critical importance to us.”
The new major capabilities in TruEra Diagnostics 2.0 include:
- Automated Test Harness
Systemic testing for evaluating models across a broad array of critical model metrics - Automated Error Analysis
Ability to evaluate certain segments of a model with high error issues - Model Leaderboard and Model Summary Dashboards
The cross-model leaderboard quickly shows status across multiple models. The detailed model summary dashboard provides critical details about model performance of an individual model. - Enhanced Data Quality Analytics
Tool that analyzes data inputs to check for data integrity weaknesses that might be impacting the model
Sign up for the free insideBIGDATA newsletter.
Join us on Twitter: https://twitter.com/InsideBigData1
Join us on LinkedIn: https://www.linkedin.com/company/insidebigdata/
Join us on Facebook: https://www.facebook.com/insideBIGDATANOW
Speak Your Mind