Vol. 1 No. 2 (2021): Journal of AI-Assisted Scientific Discovery
Articles

The Age of Explainable AI: Improving trust and transparency in AI models.

Sarbaree Mishra
Program Manager at Molina Healthcare Inc., USA
COver

Published 01-10-2021

Keywords

  • Explainable AI,
  • Trust

How to Cite

[1]
Sarbaree Mishra, “The Age of Explainable AI: Improving trust and transparency in AI models”., Journal of AI-Assisted Scientific Discovery, vol. 1, no. 2, pp. 212–235, Oct. 2021, Accessed: Dec. 23, 2024. [Online]. Available: https://scienceacadpress.com/index.php/jaasd/article/view/235

Abstract

Artificial Intelligence (AI) is transforming healthcare, finance, and law enforcement industries, driving efficiency and innovation while enabling data-driven decision-making. However, the increasing complexity of AI models often results in opaque decision-making processes, which undermine trust, accountability, and ethical adoption. Explainable AI (XAI) has emerged to address these concerns by making AI systems more interpretable and transparent, helping users understand how and why specific decisions are made. XAI bridges the gap between sophisticated algorithms and human understanding, employing techniques like feature importance analysis, model-agnostic approaches, interpretable models, and visualization tools to unravel AI’s decision logic. These methods ensure that critical applications—such as diagnosing diseases, approving financial loans, & detecting bias in law enforcement algorithms—are accurate but also fair and understandable. By providing clear, actionable insights, XAI empowers stakeholders, including non-technical users, to confidently make informed decisions. Despite its promise, implementing XAI poses significant challenges, including balancing interpretability with model accuracy, safeguarding sensitive data while maintaining transparency, and designing explanations that are accessible and meaningful to diverse audiences. Furthermore, achieving universal standards for explainability is complex due to variations in industry requirements and ethical considerations. This paper examines the foundations of XAI, exploring essential techniques, applications, and the challenges it must overcome to meet its potential. By enhancing the interpretability of AI models, XAI builds trust in AI systems, encouraging wider adoption & fostering accountability in critical sectors. As AI advances, explainability will be crucial for addressing ethical concerns, reducing bias, and ensuring compliance with regulatory frameworks, ultimately enabling more responsible and sustainable use of AI technologies.

Downloads

Download data is not yet available.

References

  1. Adadi, A., & Berrada, M. (2018). Peeking inside the black-box: a survey on explainable artificial intelligence (XAI). IEEE access, 6, 52138-52160.
  2. Felzmann, H., Villaronga, E. F., Lutz, C., & Tamò-Larrieux, A. (2019). Transparency you can trust: Transparency requirements for artificial intelligence between legal norms and contextual concerns. Big Data & Society, 6(1), 2053951719860542.
  3. Samek, W. (2017). Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. arXiv preprint arXiv:1708.08296.
  4. Khedkar, S., Subramanian, V., Shinde, G., & Gandhi, P. (2019). Explainable AI in healthcare. In Healthcare (april 8, 2019). 2nd international conference on advances in science & technology (icast).
  5. Hagras, H. (2018). Toward human-understandable, explainable AI. Computer, 51(9), 28-36.
  6. Wang, D., Yang, Q., Abdul, A., & Lim, B. Y. (2019, May). Designing theory-driven user-centric explainable AI. In Proceedings of the 2019 CHI conference on human factors in computing systems (pp. 1-15).
  7. Fox, M., Long, D., & Magazzeni, D. (2017). Explainable planning. arXiv preprint arXiv:1709.10256.
  8. Arnold, M., Bellamy, R. K., Hind, M., Houde, S., Mehta, S., Mojsilović, A., ... & Varshney, K. R. (2019). FactSheets: Increasing trust in AI services through supplier's declarations of conformity. IBM Journal of Research and Development, 63(4/5), 6-1.
  9. Anjomshoae, S., Najjar, A., Calvaresi, D., & Främling, K. (2019). Explainable agents and robots: Results from a systematic literature review. In 18th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2019), Montreal, Canada, May 13–17, 2019 (pp. 1078-1088). International Foundation for Autonomous Agents and Multiagent Systems.
  10. Hoffman, R. R., Mueller, S. T., Klein, G., & Litman, J. (2018). Metrics for explainable AI: Challenges and prospects. arXiv preprint arXiv:1812.04608.
  11. Fellous, J. M., Sapiro, G., Rossi, A., Mayberg, H., & Ferrante, M. (2019). Explainable artificial intelligence for neuroscience: behavioral neurostimulation. Frontiers in neuroscience, 13, 1346.
  12. Preece, A. (2018). Asking ‘Why’in AI: Explainability of intelligent systems–perspectives and challenges. Intelligent Systems in Accounting, Finance and Management, 25(2), 63-72.
  13. Papenmeier, A., Englebienne, G., & Seifert, C. (2019). How model accuracy and explanation fidelity influence user trust. arXiv preprint arXiv:1907.12652.
  14. Ahmad, M. A., Eckert, C., & Teredesai, A. (2019). The challenge of imputation in explainable artificial intelligence models. arXiv preprint arXiv:1907.12669.
  15. Mueller, S. T., Hoffman, R. R., Clancey, W., Emrey, A., & Klein, G. (2019). Explanation in human-AI systems: A literature meta-review, synopsis of key ideas and publications, and bibliography for explainable AI. arXiv preprint arXiv:1902.01876.
  16. Gade, K. R. (2017). Integrations: ETL vs. ELT: Comparative analysis and best practices. Innovative Computer Sciences Journal, 3(1).
  17. Gade, K. R. (2019). Data Migration Strategies for Large-Scale Projects in the Cloud for Fintech. Innovative Computer Sciences Journal, 5(1).
  18. Komandla, V. Enhancing Security and Fraud Prevention in Fintech: Comprehensive Strategies for Secure Online Account Opening.
  19. Komandla, V. Transforming Financial Interactions: Best Practices for Mobile Banking App Design and Functionality to Boost User Engagement and Satisfaction.
  20. Gade, K. R. (2018). Real-Time Analytics: Challenges and Opportunities. Innovative Computer Sciences Journal, 4(1).