The integration of artificial intelligence (AI) in medicine is transforming clinical decision-making and the doctor-patient relationship. While AI promises enhanced diagnostic accuracy and efficiency, it also raises concerns about physicians’ vulnerability, particularly regarding decision-making autonomy and the relational dimension of care. This study explores the perceived vulnerabilities associated with AI adoption in medical practice, focusing on decision-making and relational dynamics. Using a qualitative methodology, we conducted 20 semi-structured interviews with physicians from various specialties (radiology, genetics, internal medicine, oncology, etc.), analyzing their perceptions of AI through an interpretative phenomenological analysis (IPA). Our findings reveal two key forms of vulnerability: Decision-making vulnerability—Physicians express concerns about potential loss of clinical autonomy due to AI’s increasing influence over medical judgments. Many fear that AI could lead to over-standardization of medical practice, diminish their expertise, and foster excessive reliance on algorithmic recommendations. Relational vulnerability—This form of vulnerability concerns the process of interaction within the doctor–patient relationship. The delegation of diagnostic or communicative tasks to AI is perceived as potentially dehumanizing, reducing empathy and emotional engagement, and eroding trust between physician and patient. Therapeutic vulnerability—In contrast, therapeutic vulnerability relates to patient outcomes and experiences of care. Patients may feel disoriented or excluded from decision-making processes, especially when confronted with opaque algorithmic recommendations. Such experiences can lead to disengagement from care, passive adherence, and a weakening of the therapeutic alliance. These findings highlight the paradox of AI in healthcare: while it enhances precision and efficiency, it also generates resistance due to its perceived threats to physicians’ roles and medical humanism. The study underscores the need for a balanced AI integration strategy that preserves medical autonomy and safeguards the fundamental relational aspects of healthcare.
Topol, E.J. (2019) High-Performance Medicine: The Convergence of Human and Artificial Intelligence. Nature Medicine , 25, 44-56. https://doi.org/10.1038/s41591-018-0300-7
Rajkomar, A., Dean, J. and Kohane, I. (2019) Machine Learning in Medicine. New England Journal of Medicine , 380, 1347-1358. https://doi.org/10.1056/nejmra1814259
Davenport, T. and Kalakota, R. (2019) The Potential for Artificial Intelligence in Healthcare. Future Healthcare Journal , 6, 94-98. https://doi.org/10.7861/futurehosp.6-2-94
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., et al. (2019) A Guide to Deep Learning in Healthcare. Nature Medicine , 25, 24-29. https://doi.org/10.1038/s41591-018-0316-z
Miotto, R., Wang, F., Wang, S., Jiang, X. and Dudley, J.T. (2018) Deep Learning for Healthcare: Review, Opportunities and Challenges. Briefings in Bioinformatics , 19, 1236-1246. https://doi.org/10.1093/bib/bbx044
Jiang, Y., Qiu, B., Xu, C. and Li, C. (2017) The Research of Clinical Decision Support System Based on Three-Layer Knowledge Base Model. Journal of Healthcare Engineering , 2017, Article ID: 6535286. https://doi.org/10.1155/2017/6535286
de Margerie-Mellon, C. and Chassagnon, G. (2023) Artificial Intelligence: A Critical Review of Applications for Lung Nodule and Lung Cancer. Diagnostic and Interventional Imaging , 104, 11-17. https://doi.org/10.1016/j.diii.2022.11.007
Sasseville, M., et al. (2023) Risk of Bias Mitigation for Vulnerable and Diverse Groups in Community-Based Primary Health Care Artificial Intelligence Models: Protocol for a Rapid Review. JMIR Research Protocols , 12, e46684.
Pellegrini, E., Ballerini, L., Hernandez, M.d.C.V., Chappell, F.M., González‐Castro, V., Anblagan, D., et al. (2018) Machine Learning of Neuroimaging for Assisted Diagnosis of Cognitive Impairment and Dementia: A Systematic Review. Alzheimer ’ s & Dementia : Diagnosis , Assessment & Disease Monitoring , 10, 519-535. https://doi.org/10.1016/j.dadm.2018.07.004
McKinney, S.M., et al. (2020) International Evaluation of an AI System for Breast Cancer Screening. Nature , 577, 89-94.
Siau, K. and Wang, W. (2020) Artificial Intelligence (AI) Ethics: Ethics of AI and ethical AI. Journal of Database Management , 31, 74-87. https://doi.org/10.4018/jdm.2020040105
Longoni, C., Bonezzi, A. and Morewedge, C.K. (2019) Resistance to Medical Artificial Intelligence. Journal of Consumer Research , 46, 629-650. https://doi.org/10.1093/jcr/ucz013
Healthcare Management
Cahan, E.M., Hernandez-Boussard, T., Thadaney-Israni, S. and Rubin, D.L. (2019) Putting the Data before the Algorithm in Big Data Addressing Personalized Healthcare. npj Digital Medicine , 2, Article No. 78. https://doi.org/10.1038/s41746-019-0157-2
Lee, S.M. and Trimi, S. (2021) Convergence Innovation in the Digital Age and in the COVID-19 Pandemic Crisis. Journal of Business Research , 123, 14-22. https://doi.org/10.1016/j.jbusres.2020.09.041
Obermeyer, Z. and Emanuel, E.J. (2016) Predicting the Future—Big Data, Machine Learning, and Clinical Medicine. New England Journal of Medicine , 375, 1216-1219. https://doi.org/10.1056/nejmp1606181
Baker, S.M., Gentry, J.W. and Rittenburg, T.L. (2005) Building Understanding of the Domain of Consumer Vulnerability. Journal of Macromarketing , 25, 128-139. https://doi.org/10.1177/0276146705280622
Fogel, A.L. and Kvedar, J.C. (2018) Artificial Intelligence Powers Digital Medicine. npj Digital Medicine , 1, Article No. 5. https://doi.org/10.1038/s41746-017-0012-2
Zhang, K., Liu, X., Shen, J., Li, Z., Sang, Y., Wu, X., et al. (2020) Clinically Applicable AI System for Accurate Diagnosis, Quantitative Measurements, and Prognosis of COVID-19 Pneumonia Using Computed Tomography. Cell , 181, 1423-1433.E11. https://doi.org/10.1016/j.cell.2020.04.045
Char, D.S., Shah, N.H. and Magnus, D. (2018) Implementing Machine Learning in Health Care—Addressing Ethical Challenges. New England Journal of Medicine , 378, 981-983. https://doi.org/10.1056/nejmp1714229
Verghese, A., Shah, N.H. and Harrington, R.A. (2019) What This Computer Needs Is a Physician. JAMA , 319, 19-20. https://doi.org/10.1001/jama.2017.19198
Bankins, S. and Formosa, P. (2023) The Ethical Implications of Artificial Intelligence (AI) for Meaningful Work. Journal of Business Ethics , 185, 725-740. https://doi.org/10.1007/s10551-023-05339-7
Walsh, T., Levy, N., Bell, G., Elliott, A., Maclaurin, J., Mareels, I.M.Y. and Wood, F.M. (2019) The Effective and Ethical Development of Artificial Intelligence: An Opportunity to Improve Our Wellbeing. Report for the Australian Council of Learned Academies. https://acola.org/wp-content/uploads/2019/07/hs4_artificial-intelligence-report.pdf
Berner, E.S. and Graber, M.L. (2008) Overconfidence as a Cause of Diagnostic Error in Medicine. The American Journal of Medicine , 121, S2-S23. https://doi.org/10.1016/j.amjmed.2008.01.001
Harris, A. (2020) COVID-19—School Leadership in Crisis? Journal of Professional Capital and Community , 5, 321-326. https://doi.org/10.1108/jpcc-06-2020-0045
Gerke, S., Minssen, T. and Cohen, G. (2020) Ethical and Legal Challenges of Artificial Intelligence-Driven Healthcare. In: Bohr, A. and Memarzadeh, K., Eds., Artificial In telligence in Healthcare , Elsevier, 295-336. https://doi.org/10.1016/b978-0-12-818438-7.00012-5 https://ssrn.com/abstract=3570129
Afm Recherche et Applications en Marketing. Recherche et Applications en Marketing , 32, No. 3. https://www.jstor.org/stable/26375584
Weiner, E.B., Dankwa-Mullan, I., Nelson, W.A. and Hassanpour, S. (2025) Ethical Challenges and Evolving Strategies in the Integration of Artificial Intelligence into Clinical Practice. PLOS Digital Health , 4, e0000810. https://doi.org/10.1371/journal.pdig.0000810
Markus, A.F., Kors, J.A. and Rijnbeek, P.R. (2021) The Role of Explainability in Creating Trustworthy Artificial Intelligence for Health Care: A Comprehensive Survey of the Terminology, Design Choices, and Evaluation Strategies. Journal of Biomedical Informatics , 113, Article 103655. https://doi.org/10.1016/j.jbi.2020.103655
Holzinger, A., Biemann, C., Pattichis, C.S. and Kell, D.B. (2017) What Do We Need to Build Explainable AI Systems for the Medical Domain? ArXiv Prepr.
Schelenz, L., Segal, A. and Gal, K. (2020) Applying Transparency in Artificial Intelligence Based Personalization Systems. ArXiv Prepr.
Yu, L. and Li, Y. (2022) Artificial Intelligence Decision-Making Transparency and Employees’ Trust: The Parallel Multiple Mediating Effect of Effectiveness and Discomfort. Behavioral Sciences , 12, Article 127. https://doi.org/10.3390/bs12050127
Shin, D. (2020) User Perceptions of Algorithmic Decisions in the Personalized AI System:perceptual Evaluation of Fairness, Accountability, Transparency, and Explainability. Journal of Broadcasting & Electronic Media , 64, 541-565. https://doi.org/10.1080/08838151.2020.1843357
Platt, J., Nong, P., Carmona, G. and Kardia, S. (2024) Public Attitudes toward Notification of Use of Artificial Intelligence in Health Care. JAMA Network Open , 7, e2450102. https://doi.org/10.1001/jamanetworkopen.2024.50102
Quinn, T.P., Jacobs, S., Senadeera, M., Le, V. and Coghlan, S. (2022) The Three Ghosts of Medical AI: Can the Black-Box Present Deliver? Artificial Intelligence in Medicine , 124, Article 102158. https://doi.org/10.1016/j.artmed.2021.102158
Xuereb, F. and Portelli, D.J.L. (2024) The Knowledge and Perception of Patients in Malta Towards Artificial Intelligence in Medical Imaging. Journal of Medical Imaging and Radiation Sciences , 55, Article 101743. https://doi.org/10.1016/j.jmir.2024.101743
Rudin, C. (2019) Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead. Nature Machine Intelligence , 1, 206-215. https://doi.org/10.1038/s42256-019-0048-x
van Leersum, C.M. and Maathuis, C. (2025) Human Centred Explainable AI Decision-Making in Healthcare. Journal of Responsible Technology , 21, Article 100108. https://doi.org/10.1016/j.jrt.2025.100108
Hoyt, G.M. (2009) Nudge: Improving Decisions about Health, Wealth, and Happiness. International Review of Economics Education , 8, 158-159. https://doi.org/10.1016/s1477-3880(15)30073-6
Smith, J.A. and Osborn, M. (2014) Interpretative Phenomenological Analysis as a Useful Methodology for Research on the Lived Experience of Pain. British Journal of Pain , 9, 41-42. https://doi.org/10.1177/2049463714541642