當AI失靈時：監管系統中的推理可見性與治理：2026年金融服務與醫療保健案例研究

Info: Zenodo’s user support line is staffed on regular business days between Dec 22 and Jan 4. Response times may be slightly longer than normal.

When AI Fails: Reasoning Visibility and Governance in Regulated Systems: 2026 Case Studies in Financial Services and Healthcare

Creators

Description

As artificial intelligence systems are increasingly deployed in regulated domains such as financial services and healthcare, failures are no longer exceptional events but routine operational risks. Governance quality is therefore judged not by whether AI systems avoid error, but by whether organizations can inspect, attribute, and respond to failures after they occur.

This paper presents two realistic 2026 case studies involving AI-mediated representations: one in financial services product communication and one in healthcare symptom triage. In both cases, harm arises not from overt malfunction but from reasonable-sounding language, normative framing, and omission of material context. Internal model reasoning remains inaccessible, yet responsibility attaches to the deploying organization.

The paper examines how reasoning visibility artifacts, implemented via the AIVO Standard, function during post-incident investigation, pattern detection, remediation, and audit. It makes explicit what such artifacts enable and what they do not. Reasoning visibility does not prove correctness, fairness, or safety, nor does it resolve ethical or causal questions. Instead, it provides inspectable, time-indexed evidence of AI-mediated claims that supports accountability, regulatory defensibility, and assurance processes.

The analysis maps these case studies to emerging regulatory and standards expectations, including post-market monitoring obligations under the EU AI Act and the management-system approach of ISO/IEC 42001. It concludes that reasoning visibility should be understood as a governance primitive rather than a complete governance solution, and that its primary value lies in preventing AI failures from becoming indefensible systemic liabilities.

Files

When AI Fails- Reasoning Visibility and Governance in Regulated Systems 2026 Case Studies in Financial Services and Healthcare.pdf

Files

     (174.0 kB)

Total views

Total downloads

Total data volume

More info on how stats are collected....

Versions

External resources

Communities

Keywords and subjects

Keywords

Details

Markdown

reStructuredText

HTML

Image URL

Target URL

Rights

Citation

Export

Technical metadata

About

Blog

Help

Developers

Contribute

Funded by

Powered by
CERN Data Centre & InvenioRDM

This site uses cookies. Find out more on how we use cookies