• About
  • Subscribe
  • Contact
Friday, June 6, 2025
    Login
  • Management Leadership
    • Growth Strategies
    • Finance
    • Operations
    • Sales and Marketing
    • Careers
  • Technology
    • Infrastructure and Platforms
    • Business Applications and Databases
    • Big Data, Analytics and Intelligence
    • Security
  • Industry Verticals
    • Finance and Insurance
    • Manufacturing
    • Logistics and Transportation
    • Retail and Wholesale
    • Hospitality and Tourism
    • Government and Public Services
    • Utilities
    • Media and Telecommunications
  • Resources
    • Whitepapers
    • PodChats
    • Videos
  • Events
No Result
View All Result
  • Management Leadership
    • Growth Strategies
    • Finance
    • Operations
    • Sales and Marketing
    • Careers
  • Technology
    • Infrastructure and Platforms
    • Business Applications and Databases
    • Big Data, Analytics and Intelligence
    • Security
  • Industry Verticals
    • Finance and Insurance
    • Manufacturing
    • Logistics and Transportation
    • Retail and Wholesale
    • Hospitality and Tourism
    • Government and Public Services
    • Utilities
    • Media and Telecommunications
  • Resources
    • Whitepapers
    • PodChats
    • Videos
  • Events
No Result
View All Result
No Result
View All Result
Home Technology Big Data, Analytics & Intelligence

How far can you trust your AI?

Avivah Litan by Avivah Litan
August 10, 2021
Photo by Tara Winstead from Pexels: https://www.pexels.com/photo/an-artificial-intelligence-illustration-on-the-wall-8849295/

Photo by Tara Winstead from Pexels: https://www.pexels.com/photo/an-artificial-intelligence-illustration-on-the-wall-8849295/

Artificial Intelligence is a broad and murky subject to many observers. Gartner analyst Bern Elliot and several colleagues just published Applying AI — A Framework for the Enterprise to try and bring clarity to the various dimensions of this topic. Figure 1 shows the five main areas of Gartner coverage, one of which is AI Governance and Risk Management, likely the murkiest area amongst the lot.

Figure 1: Applying AI – A Framework for the Enterprise

“AI trust, risk, and security management pose new operational requirements that are not well understood. Conventional controls and organizational processes do not sufficiently ensure AI’s trustworthiness, reliability, and security.”

3 primary reasons why AI risks are not adequately addressed in most organizations

Organizational fragmentation — Ownership of this domain is spread across functions such as legal, compliance, AI development, enterprise architecture, privacy, and security.

Production-first mentality — Most enterprises struggle to get their AI models into production; building trust and risk management into AI life cycles is an afterthought.

Enterprises are not convinced it’s needed — Typically, there is no readily available proof of benign mistakes or adversarial attacks causing suboptimal or ineffective AI model performance. Most enterprises are not actively managing and monitoring AI models after deployments, so they don’t even know if these issues exist.

See Applying AI — Governance and Risk Management

Industry report confirmation

In fact, our conclusions are borne out by a recent report from FICO and Corinium – “The State of Responsible AI”  – that finds most companies deploy AI at significant risk. Amongst their findings:

  • 65% of respondents’ companies can’t explain how specific AI model decisions or predictions are made
  • 73% have struggled to get executive support for prioritizing AI ethics and Responsible AI practices
  • Only one-fifth (20%) actively monitor their models in production for fairness and ethics

Market Guide for AI TRiSM

We are about to publish our first Market Guide for AI Trust Risk and Security Management (AI TRiSM). The Market Guide covers solutions that help ensure reliable effective model performance, and which mitigate substantial business risks that exist when adequate management is lacking.  These solutions implement the MOST measures in our MOST framework, as depicted below:

Figure 2: MOST Framework

However, before solutions are implemented, organizations must organize to undertake the requisite AI TRiSM activities. This is a difficult undertaking since ownership of the domain is spread across multiple functions.

But that doesn’t make it any less important or urgent. If anything, the converse is true.

“Diffuse management responsibilities generally means that a lot of issues are already falling through the organizational cracks – i.e., no one is paying attention to them.”

It doesn’t have to be this way, nor should it. Our future depends on the reliability and trustworthiness of AI. Hopefully, we will all start to take it more seriously.

First published on Gartner Blog Network

Related:  Govt IT spend to focus on legacy modernisation and better access
Tags: CoriniumFICOGartner
Avivah Litan

Avivah Litan

Avivah Litan is a Vice President and Distinguished Analyst in Gartner Research. She is currently managing the Gartner research agenda for blockchain, as part of the newly formed ITL Application Innovation team covering blockchain, AI and IoT. She covers blockchain innovation, technology, use cases, market dynamics and market participants.

No Result
View All Result

Recent Posts

  • Indosat and GoTo launch a new 70 billion parameter model with a multilingual chat service
  • Mainframes: Powering Asia’s business-critical industries in 2025
  • Canva taps Snowflake AI Data Cloud to accelerate growth
  • Tech and startup platform e27 announces the return of Echelon Singapore 2025
  • MERaLiON Version 2 unveiled with enhanced multilingual processing and emotional intelligence

Live Poll

Categories

  • Big Data, Analytics & Intelligence
  • Business Applications & Databases
  • Business-IT Alignment
  • Careers
  • Case Studies
  • CISO
  • CISO strategies
  • Cloud, Virtualization, Operating Environments and Middleware
  • Computer, Storage, Networks, Connectivity
  • Corporate Social Responsibility
  • Customer Experience / Engagement
  • Cyber risk management
  • Cyberattacks and data breaches
  • Cybersecurity careers
  • Cybersecurity operations
  • Education
  • Education
  • Finance
  • Finance & Insurance
  • FutureCISO
  • General
  • Governance, Risk and Compliance
  • Government and Public Services
  • Growth Strategies
  • Hospitality & Tourism
  • HR, education and Training
  • Industry Verticals
  • Infrastructure & Platforms
  • Insider threats
  • Latest Stories
  • Logistics & Transportation
  • Management Leadership
  • Manufacturing
  • Media and Telecommunications
  • News Stories
  • Operations
  • Opinion
  • Opinions
  • People
  • Process
  • Remote work
  • Retail & Wholesale
  • Sales & Marketing
  • Security
  • Tactics and Strategies
  • Technology
  • Utilities
  • Videos
  • Vulnerabilities and threats
  • White Papers
Show More

Strategic Insights for Chief Information Officers

FutureCIO is about enabling the CIO, his team, the leadership and the enterprise through shared expertise, know-how and experience - through a community of shared interests and goals. It is also about discovering unknown best practices that will help realize new business models.

Quick Links

  • Videos
  • Resources
  • Subscribe
  • Contact

Cxociety Media Brands

  • FutureIoT
  • FutureCFO
  • FutureCIO

Categories

Select Category
    • Privacy Policy
    • Terms of Use
    • Cookie Policy

    Copyright © 2022 Cxociety Pte Ltd | Designed by Pixl

    Login to your account below

    or

    Not a member yet? Register here

    Forgotten Password?

    Fill the forms bellow to register

    All fields are required. Log In

    Retrieve your password

    Please enter your username or email address to reset your password.

    Log In
    No Result
    View All Result
    • Management Leadership
      • Growth Strategies
      • Finance
      • Operations
      • Sales and Marketing
      • Careers
    • Technology
      • Infrastructure and Platforms
      • Business Applications and Databases
      • Big Data, Analytics and Intelligence
      • Security
    • Industry Verticals
      • Finance and Insurance
      • Manufacturing
      • Logistics and Transportation
      • Retail and Wholesale
      • Hospitality and Tourism
      • Government and Public Services
      • Utilities
      • Media and Telecommunications
    • Resources
      • Whitepapers
      • PodChats
      • Videos
    • Events
    Login

    Copyright © 2022 Cxociety Pte Ltd | Designed by Pixl

    Subscribe