Correspondence: Jiangshan.Zhu@hdu.edu.cn
DOI: https://doi.org/10.55976/dma.42026159087-99
Show More
[1]Goodfellow I, Bengio Y, Courville A. Deep learning. Cambridge (MA): MIT Press; 2016.
[2]Ali S, Abuhmed T, El-Sappagh S, Muhammad K, Alonso-Moral JM, Confalonieri R, et al. Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustworthy Artificial Intelligence. Information fusion. 2023;99:101805. doi:10.1016/j.inffus.2023.101805.
[3]Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-CAM: visual explanations from deep networks via gradient-based localization. International journal of computer vision. 2020;128(2):336-359. doi:10.1007/s11263-019-01228-7.
[4]Miller T. Explanation in artificial intelligence: Insights from the social sciences. Artificial intelligence. 2019;267:1-38. doi:10.1016/j.artint.2018.07.007.
[5]Murdoch WJ, Singh C, Kumbier K, Abbasi-Asl R, Yu B. Definitions, methods, and applications in interpretable machine learning. Proceedings of the National Academy of Sciences. 2019;116(44):22071-22080. doi:10.1073/pnas.1900654116.
[6]Rudin C. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature machine intelligence. 2019;1(5):206-215. doi:10.1038/s42256-019-0048-x.
[7]Adadi A, Berrada M. Peeking inside the black-box: a survey on explainable artificial intelligence (XAI). IEEE Access. 2018;6:52138-52160. doi:10.1109/ACCESS.2018.2870052.
[8]Gunning D, Vorm E, Wang JY, Turek M. DARPA's explainable AI (XAI) program: A retrospective. Applied AI Letters. 2021;2(4):e61. doi:10.1002/ail2.61.
[9]Saeed W, Omlin C. Explainable AI (XAI): A systematic meta-survey of current challenges and future opportunities. Knowledge-based Systems. 2023;263:110273. doi:10.1016/j.knosys.2023.110273.
[10]Zhao H, Chen H, Yang F, Liu N, Deng H, Cai H, et al. Explainability for large language models: A survey. ACM Transactions on Intelligent Systems and Technology. 2024;15(2): 20. doi:10.1145/3639372.
[11]Schneider J. Explainable Generative AI (GenXAI): a survey, conceptualization, and research agenda. Artificial Intelligence Review. 2024;57(11):289. doi:10.1007/s10462-024-10916-x.
[12]Blei DM, Ng AY, Jordan MI. Latent Dirichlet allocation. Journal of machine Learning research. 2003;3: 993-1022.
[13]Griffiths TL, Steyvers M. Finding scientific topics. Proceedings of the National academy of Sciences. 2004;101(suppl_1):5228-5235. doi:10.1073/pnas.0307752101.
[14]Mimno D, Wallach H, Talley E, Leenders M, McCallum A. Optimizing semantic coherence in topic models. In: Proceedings of the 2011 conference on empirical methods in natural language processing; 2011 Jul 27-31; Edinburgh, UK. p. 262-272.
[15]Newman D, Lau JH, Grieser K, Baldwin T. Automatic evaluation of topic coherence. In: Human language technologies: The 2010 annual conference of the North American chapter of the association for computational linguistics; 2010 Jun 1-6; Los Angeles, California, USA. p. 100-108.
[16]Roder M, Both A, Hinneburg A. Exploring the space of topic coherence measures. In: Proceedings of the eighth ACM international conference on Web search and data mining; 2015 Feb 2-6; New York, USA. p. 399-408. doi:10.1145/2684822.2685324.
[17]Cao J, Xia T, Li J, Zhang Y, Tang S. A density-based method for adaptive LDA model selection. Neurocomputing. 2009;72(7-9):1775-1781. doi:10.1016/j.neucom.2008.06.011.
[18]Sievert C, Shirley K. LDAvis: a method for visualizing and interpreting topics. In: Proceedings of the workshop on interactive language learning, visualization, and interfaces; 2014 Jun 27; Baltimore, MD, USA. p. 63-70. doi:10.3115/v1/W14-3110.
[19]Nauta M, Trienes J, Pathak S, Nguyen E, Peters M, Schmitt Y, et al. From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI. ACM Computing Surveys. 2023;55(13s):1-42. doi:10.1145/3583558.
[20]Yeh CK, Hsieh CY, Suggala A, Inouye DI, Ravikumar PK. On the (in)fidelity and sensitivity of explanations. In: Advances in Neural Information Processing Systems 32 (NeurIPS 2019); 2019 Dec 8-14; Vancouver, Canada. p. 10965-10976.
[21]Adebayo J, Gilmer J, Muelly M, Goodfellow I, Hardt M, Kim B. Sanity checks for saliency maps. In: Advances in Neural Information Processing Systems 31 (NeurIPS 2018); 2018 Dec 3-8; Montreal, Canada. p. 9505-9515.
[22]Lipton ZC. The mythos of model interpretability. Queue. 2018;16(3):31-57. doi:10.1145/3236386.3241340.
[23]Lou Y, Caruana R, Gehrke J, Hooker G. Accurate intelligible models with pairwise interactions. In: Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining. New York: Association for Computing Machinery; 2013. p. 623-631. doi:10.1145/2487575.2487579.
[24]Ravikumar P, Lafferty J, Liu H, Wasserman L. Sparse additive models. Journal of the Royal Statistical Society Series B: Statistical Methodology. 2009;71(5):1009-1030. doi:10.1111/j.1467-9868.2009.00718.x.
[25]Breiman L, Friedman JH, Olshen RA, Stone CJ. Classification and regression trees. Belmont (CA): Wadsworth; 1984.
[26]Sagi O, Rokach L. Explainable decision forest: transforming a decision forest into an interpretable tree. Information Fusion. 2020;61:124-138. doi:10.1016/j.inffus.2020.03.013.
[27]Letham B, Rudin C, McCormick TH, Madigan D. Interpretable classifiers using rules and bayesian analysis: Building a better stroke prediction model. Annals of Applied Statistics. 2015;9(3):1350-1371. doi:10.1214/15-AOAS848.
[28]Cohen WW. Fast effective rule induction. In: Proceedings of the 12th International Conference on Machine Learning. San Francisco: Morgan Kaufmann; 1995. p. 115-123. doi:10.1016/b978-1-55860-377-6.50023-2.
[29]Clark P, Niblett T. The CN2 induction algorithm. Machine learning. 1989;3(4):261-283. doi:10.1007/BF00116835.
[30]Lakkaraju H, Bach SH, Leskovec J. Interpretable decision sets: A joint framework for description and prediction. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York: Association for Computing Machinery; 2016. p. 1675-1684. doi:10.1145/2939672.2939874.
[31]Kim B, Khanna R, Koyejo OO. Examples are not enough, learn to criticize! Criticism for interpretability. In: Advances in Neural Information Processing Systems 29. Red Hook, NY: Curran Associates; 2016. p. 2288-2296.
[32]Koh PW, Liang P. Understanding black-box predictions via influence functions. In: Proceedings of the 34th International Conference on Machine Learning. Sydney, Australia: Proceedings of Machine Learning Research; 2017. p. 1885-1894.
[33]Lundberg SM, Lee SI. A unified approach to interpreting model predictions. In: Advances in Neural Information Processing Systems 30. Red Hook, NY: Curran Associates; 2017. p. 4765-4774. doi:10.48550/arXiv.1705.07874.
[34]Ribeiro MT, Singh S, Guestrin C. "Why should I trust you?" Explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York: Association for Computing Machinery; 2016. p. 1135-1144. doi:10.1145/2939672.2939778.
[35]Wachter S, Mittelstadt B, Russell C. Counterfactual explanations without opening the black box: automated decisions and the GDPR. Harvard Journal of Law & Technology. 2017;31(2):841-887.
[36]Mothilal RK, Sharma A, Tan C. Explaining machine learning classifiers through diverse counterfactual explanations. In: Proceedings of the Conference on Fairness, Accountability, and Transparency. New York: Association for Computing Machinery; 2020. p. 607-617. doi:10.1145/3351095.3372850.
[37]Karimi AH, Scholkopf B, Valera I. Algorithmic recourse: from counterfactual explanations to interventions. In: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. New York: Association for Computing Machinery; 2021. p. 353-362. doi:10.1145/3442188.3445899.
[38]Bordes A, Usunier N, Garcia-Duran A, Weston J, Yakhnenko O. Translating embeddings for modeling multi-relational data. In: Advances in Neural Information Processing Systems 26. Red Hook, NY: Curran Associates; 2013. p. 2787-2795.
[39]Sundararajan M, Taly A, Yan Q. Axiomatic attribution for deep networks. In: Proceedings of the 34th International Conference on Machine Learning. Sydney, Australia: Proceedings of Machine Learning Research; 2017. p. 3319-3328.
[40]Kim B, Wattenberg M, Gilmer J, Cai C, Wexler J, Viegas F, et al. Interpretability beyond feature attribution: quantitative testing with concept activation vectors (TCAV). In: Proceedings of the 35th International Conference on Machine Learning. Stockholm, Sweden: Proceedings of Machine Learning Research; 2018. p. 2668-2677.
[41]Koh PW, Nguyen T, Tang YS, Mussmann S, Pierson E, Kim B, et al. Concept bottleneck models. In: Proceedings of the 37th International Conference on Machine Learning. Virtual Event: Proceedings of Machine Learning Research; 2020. p. 5338-5348.
[42]Slack D, Hilgard S, Jia E, Singh S, Lakkaraju H. Fooling lime and shap: Adversarial attacks on post hoc explanation methods. In: Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society. New York: Association for Computing Machinery; 2020. p. 180-186. doi:10.1145/3375627.3375830.
[43]Chen H, Mason CM. Explainable AI (XAI) for Constructing a Lexicon for Classifying Green Energy Jobs: A Comparative Analysis of Occupation, Industry, and Location Composition With Traditional Energy Jobs. IEEE Access. 2024;12:142709-142720. doi:10.1109/ACCESS.2024.3430317.
[44]Machlev R, Heistrene L, Perl M, Levy KY, Belikov J, Mannor S, et al. Explainable Artificial Intelligence (XAI) techniques for energy and power systems: Review, challenges and opportunities. Energy and AI. 2022;9:100169. doi:10.1016/j.egyai.2022.100169.
[45]Khosravi H, Shum SB, Chen G, Conati C, Tsai YS, Kay J, et al. Explainable Artificial Intelligence in education. Computers and Education: Artificial Intelligence. 2022;3:100074. doi:10.1016/j.caeai.2022.100074.
[46]Rachha A, Seyam M. Explainable AI in education: Current trends, challenges, and opportunities. In: Proceedings of the 2023 IEEE SoutheastCon. Piscataway (NJ): IEEE; 2023. p. 232-239. doi:10.1109/SOUTHEASTCON51012.2023.10115140.
[47]Rjoub G, Bentahar J, Abdel Wahab O, Mizouni R, Song A, Cohen R, et al. A survey on explainable artificial intelligence for cybersecurity. IEEE Transactions on Network and Service Management. 2023;20(4):5115-5140. doi:10.1109/TNSM.2023.3282740.
[48]Hariharan S, Robinson RRR, Prasad RR, Thomas C, Balakrishnan N. XAI for intrusion detection system: comparing explanations based on global and local scope. Journal of Computer Virology and Hacking Techniques. 2023;19(2):217-239. doi:10.1007/s11416-022-00441-2.
[49]Sarcevic A, Pintar D, Vranic M, Krajna A. Cybersecurity Knowledge Extraction Using XAI. Applied Sciences. 2022;12(17):8669. doi:10.3390/app12178669.
[50]Weber P, Carl KV, Hinz O. Applications of Explainable Artificial Intelligence in Finance—a systematic review of Finance, Information Systems, and Computer Science literature. Management Review Quarterly. 2024;74(2):867-907. doi:10.1007/s11301-023-00320-0.
[51]Awosika T, Shukla RM, Pranggono B. Transparency and privacy: the role of explainable AI and federated learning in financial fraud detection. IEEE Access. 2024;12:64551-64560. doi:10.1109/ACCESS.2024.3394528.
[52]Bussmann N, Giudici P, Marinelli D, Papenbrock J. Explainable AI in fintech risk management. Frontiers in Artificial Intelligence. 2020;3:26. doi:10.3389/frai.2020.00026.
[53]Hacker P, Krestel R, Grundmann S, Naumann F. Explainable AI under contract and tort law: legal incentives and technical challenges. Artificial Intelligence and Law. 2020;28(4):415-439. doi:10.1007/s10506-020-09260-6.
[54]Richmond KM, Muddamsetty SM, Gammeltoft-Hansen T, Olsen HP, Moeslund TB. Explainable AI and Law: An Evidential Survey. Digital Society. 2024;3(1):1. doi:10.1007/s44206-023-00081-z.
[55]Vale D, El-Sharif A, Ali M. Explainable artificial intelligence (XAI) post-hoc explainability methods: risks and limitations in non-discrimination law. AI and Ethics. 2022;2(4):815-826. doi:10.1007/s43681-022-00142-y.
[56]Ryo M. Explainable artificial intelligence and interpretable machine learning for agricultural data analysis. Artificial Intelligence in Agriculture. 2022;6:257-265. doi:10.1016/j.aiia.2022.11.003.
[57]Saraswat D, Bhattacharya P, Verma A, Prasad VK, Tanwar S, Sharma G, et al. Explainable AI for healthcare 5.0: opportunities and challenges. IEEE Access. 2022;10:84486-84517. doi:10.1109/ACCESS.2022.3197671.
[58]Sadeghi Z, Alizadehsani R, Cifci MA, Kausar S, Rehman R, Mahanta P, et al. A review of explainable artificial intelligence in healthcare. Computers and Electrical Engineering. 2024;118:109370. doi:10.1016/j.compeleceng.2024.109370.
[59]Okada Y, Ning Y, Ong MEH. Explainable artificial intelligence in emergency medicine: an overview. Clinical and experimental emergency medicine. 2023;10(4):354-362. doi:10.15441/ceem.23.145.
[60]Ghassemi M, Oakden-Rayner L, Beam AL. The false hope of current approaches to explainable artificial intelligence in health care. The lancet digital health. 2021;3(11):e745-e750. doi:10.1016/S2589-7500(21)00208-9.
[61]Ahmed S, Kaiser MS, Hossain MS, Andersson K. A comparative analysis of LIME and SHAP interpreters with explainable ML-based diabetes predictions. IEEE Access. 2025;13:37370-37388. doi:10.1109/ACCESS.2024.3422319.
[62]Turpin M, Michael J, Perez E, Bowman S. Language models don't always say what they think: unfaithful explanations in chain-of-thought prompting. In: Advances in Neural Information Processing Systems 36. Red Hook, NY: Curran Associates; 2023. p. 74952-74965.
[63]Raji ID, Smart A, White RN, Mitchell M, Gebru T, Hutchinson B, et al. Closing the AI accountability gap: defining an end-to-end framework for internal algorithmic auditing. In: Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. New York: Association for Computing Machinery; 2020. p. 33-44. doi:10.1145/3351095.3372873.
[64]Wang Z, Samsten I, Miliou I, Mochaourab R, Papapetrou P. Glacier: guided locally constrained counterfactual explanations for time series classification. Machine Learning. 2024;113(7):4639-4669. doi:10.1007/s10994-023-06502-x.
[65]Prenkaj B, Villaizán-Vallelado M, Leemann T, Kasneci G. Adapting to change: robust counterfactual explanations in dynamic data landscapes. In: Meo R, Silvestri F. (eds) Machine Learning and Principles and Practice of Knowledge Discovery in Databases: ECML PKDD 2023. Cham: Springer; 2025. p. 1-15. doi:10.1007/978-3-031-74630-7_22.
[66]Jiang J, Leofante F, Rago A, Toni F. Formalising the robustness of counterfactual explanations for neural networks. In: Proceedings of the AAAI Conference on Artificial Intelligence. Washington, DC: AAAI Press; 2023;37(12):14901-14909. doi:10.1609/aaai.v37i12.26740.
[67]Suresh H, Gomez SR, Nam KK, Satyanarayan A. Beyond expertise and roles: A framework to characterize the stakeholders of interpretable machine learning and their needs. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. New York: Association for Computing Machinery; 2021. p. 1-16. doi:10.1145/3411764.3445088.
[68]Leichtmann B, Humer C, Hinterreiter A, Streit M, Mara M. Effects of explainable artificial intelligence on trust and human behavior in a high-risk decision task. Computers in Human Behavior. 2023;139:107539. doi:10.1016/j.chb.2022.107539.
[69]Nannini L. Habemus a right to an explanation: so what? A framework on transparency-explainability functionality and tensions in the EU AI Act. In: Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society. New York: Association for Computing Machinery; 2024;7(1):1023-1035. doi:10.1609/aies.v7i1.31700.
[70]Zhang H, Yang YF, Song XL, Hu HJ, Yang YY, Zhu X, et al. An interpretable artificial intelligence model based on CT for prognosis of intracerebral hemorrhage: a multicenter study. BMC Medical Imaging. 2024;24:170. doi:10.1186/s12880-024-01352-y.
[71]Torres-Martos Á, Anguita-Ruiz A, Bustos-Aibar M, Ramírez-Mena A, Arteaga M, Bueno G, et al. Multiomics and explainable artificial intelligence for decision support in insulin resistance early diagnosis: a pediatric population-based longitudinal study. Artificial Intelligence in Medicine. 2024;156:102962. doi:10.1016/j.artmed.2024.102962.
[72]Casiraghi E, Malchiodi D, Trucco G, Frasca M, Cappelletti L, Fontana T, et al. Explainable machine learning for early assessment of COVID-19 risk prediction in emergency departments. IEEE Access. 2020;8:196299-196325. doi:10.1109/ACCESS.2020.3034032.
[73]Moosavi S, Farajzadeh-Zanjani M, Razavi-Far R, Palade V, Saif M. Explainable AI in manufacturing and industrial cyber–physical systems: A survey. Electronics. 2024;13(17):3497. doi:10.3390/electronics13173497.
[74]Capuano N, Fenza G, Loia V, Stanzione C. Explainable artificial intelligence in cybersecurity: a survey. IEEE Access. 2022;10:93575-93600. doi:10.1109/ACCESS.2022.3204171.
[75]Neupane S, Ables J, Anderson W, Mittal S, Rahimi S, Banicescu I, et al. Explainable intrusion detection systems (X-IDS): a survey of current methods, challenges, and opportunities. IEEE Access. 2022;10:112392-112415. doi:10.1109/ACCESS.2022.3216617.
[76]Guidotti R. Counterfactual explanations and how to find them: literature review and benchmarking. Data Mining and Knowledge Discovery. 2024;38(5):2770-2824. doi:10.1007/s10618-022-00831-6.
[77]De Toni G, Lepri B, Passerini A. Synthesizing explainable counterfactual policies for algorithmic recourse with program synthesis. Machine Learning. 2023;112(4):1389-1409. doi:10.1007/s10994-022-06293-7.
[78]Lamy JB, Sekar B, Guezennec G, Bouaud J, Seroussi B. Explainable artificial intelligence for breast cancer: a visual case-based reasoning approach. Artificial Intelligence in Medicine. 2019;94:42-53. doi:10.1016/j.artmed.2019.01.001.
[79]Patrício C, Neves JC, Teixeira LF. Explainable deep learning methods in medical image classification: A survey. ACM Computing Surveys. 2024;56(4):1-41. doi:10.1145/3625287.
[80]Abdullakutty F, Akbari Y, Al-Maadeed S, Bouridane A, Talaat IM, Hamoudi R. Histopathology in focus: a review on explainable multi-modal approaches for breast cancer diagnosis. Frontiers in Medicine. 2024;11:1450103. doi:10.3389/fmed.2024.1450103.
[81]Rosenbacke R, Melhus Å, McKee M, Stuckler D. How explainable artificial intelligence can increase or decrease clinicians' trust in AI applications in health care: systematic review. JMIR AI. 2024;3:e53207. doi:10.2196/53207.
[82]Pierce RL, Van Biesen W, Van Cauwenberge D, Decruyenaere J, Sterckx S. Explainability in medicine in an era of AI-based clinical decision support systems. Frontiers in Genetics. 2022;13:903600. doi:10.3389/fgene.2022.903600.
[83]Rong Y, Leemann T, Nguyen TT, Fiedler L, Qian P, Unhelkar V, et al. Towards human-centered explainable AI: a survey of user studies for model explanations. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(4):2104-2122. doi:10.1109/TPAMI.2023.3331846.
[84]Kim J, Maathuis H, Sent D. Human-centered evaluation of explainable AI applications: a systematic review. Frontiers in Artificial Intelligence. 2024;7:1456486. doi:10.3389/frai.2024.1456486.
[85]Senoner J, Schallmoser S, Kratzwald B, Feuerriegel S, Netland T. Explainable AI improves task performance in human-AI collaboration. Scientific Reports. 2024;14(1):31150. doi:10.1038/s41598-024-82501-9.
Copyright © 2026 Jiangshan Zhu

This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright licenses detail the rights for publication, distribution, and use of research. Open Access articles published by Luminescience do not require transfer of copyright, as the copyright remains with the author. In opting for open access, the author(s) should agree to publish the article under the CC BY license (Creative Commons Attribution 4.0 International License). The CC BY license allows for maximum dissemination and re-use of open access materials and is preferred by many research funding bodies. Under this license, users are free to share (copy, distribute and transmit) and remix (adapt) the contribution, including for commercial purposes, providing they attribute the contribution in the manner specified by the author or licensor.

Luminescience press is based in Hong Kong with offices in Wuhan, China.
E-mail: publisher@luminescience.cn