Backg round: A significant challenge in developing AI assistants, such as chatbots as mentors or coaches for leaders, is the Uncanny Valley effect. This phenomenon describes the discomfort leaders feel when AI-chatbots appear almost human-like but not quite perfect, causing a sense of eeriness. To avoid this, a chatbot-design should focus on creating distinctive features rather than overly human-like ones and balance human-likeness with chat-elements to maintain user comfort. Emphasizing functional and straightforward designs that prioritize leaders’ interaction with the chatbot and usability over appearance. Method: This study employed a qualitative research method, utilizing a qualitative content analysis to explore the extent of the Uncanny Valley effect in the interaction between AI chatbots and leaders. Data was collected through an online survey involving 82 leaders, of which 62 completed the entire questionnaire. Participants were shown video excerpts from an existing AI-based chatbot named “KI.m” and participated in semi-structured interviews to provide insights into their perceptions and emotional responses. Results: Key findings indicate that leader’s expectation, voice quality, emotional expression, and social presence significantly influence user discomfort. Participants preferred more natural and human-like voices, suggesting that developers refine pronunciation and intonation. Emotional responses were often perceived as forced and insincere, highlighting the need for contextually relevant and genuine emotional expressions. Social interactions were seen as too mechanical, suggesting a balance between professional, supportive communication and subtle empathy. Personalization and accessibility through customizable settings and multilingual support were emphasized. Users preferred concise, clear answers. Conclusion: This study identified key themes influencing user discomfort with AI chatbots, including voice quality, emotional expression, social presence, and the need for aligning AI’s cognitive abilities with user expectations. Enhancing personalization and accessibility in AI tools was also emphasized as crucial for improving user satisfaction and practical utility. The findings highlight the potential of AI mentoring tools to support leadership development, provided that key discomforts related to the Uncanny Valley effect are addressed. Future research should focus on refining AI attributes and exploring long-term impacts, cultural differences, and ethical considerations to enhance the design and implementation of AI mentoring systems.
KeywordsUncanny Valley EffectAI ChatbotsLeadership Mentoring
Abasaheb, S. A., & Subashini, R. (2023). Maneuvering of Digital Transformation: Role of Artificial Intelligence in Empowering Leadership—An Empirical Overview. International Journal of Professional Business Review, 8, e01838. https://typeset.io/papers/maneuvering-of-digital-transformation-role-of-artificial-2vl1j0hu?utm_source=chatgpt
Aktaş, B. N. (2024). Artificial Intelligence: A New Paradigm for Leadersh. In F. Mızrak (Ed.), Trends, Challenges, and Practices in Contemporary Strategic Management (PP. 33-50). IGI Global. https://doi.org/10.4018/979-8-3693-1155-4.ch002
An, M., Lin, J., & Luo, X. (2024). The Impact of Human AI Skills on Organizational Innovation: The Moderating Role of Digital Organizational Culture. Journal of Business Research, 182, Article ID: 114786. https://doi.org/10.1016/j.jbusres.2024.114786
Arakawa, R., & Yakura, H. (2024). Coaching Copilot: Blended Form of an LLM-Powered Chatbot and a Human Coach to Effectively Support Self-Reflection for Leadership Growth. In ACM Conversational User Interfaces 2024 (pp. 1-14). ACM. https://doi.org/10.1145/3640794.3665549
Asfahani, A. M. (2022). The Impact of Artificial Intelligence on Industrial-Organizational Psychology: A Systematic Review. The Journal of Behavioral Science, 17, 125-139. https://www.researchgate.net/publication/364421222_The_Impact_of_Artificial_Intelligence_on_Industrial-Organizational_Psychology_A_Systematic_Review
Bankins, S., Ocampo, A. C., Marrone, M., Restubog, S. L. D., & Woo, S. E. (2024). A Multilevel Review of Artificial Intelligence in Organizations: Implications for Organizational Behavior Research and Practice. Journal of Organizational Behavior, 45, 159-182. https://doi.org/10.1002/job.2735
Banks, G. C., Dionne, S. D., Mast, M. S., & Sayama, H. (2022). Leadership in the Digital Era: A Review of Who, What, When, Where, and Why. The Leadership Quarterly, 33, Article ID: 101634. https://doi.org/10.1016/j.leaqua.2022.101634
Barriball, K. L., & While, A. (1994). Collecting Data Using a Semi-Structured Interview: A Discussion Paper. Journal of Advanced Nursing, 19, 328-335. https://doi.org/10.1111/j.1365-2648.1994.tb01088.x
Bengtsson, M. (2016). How to Plan and Perform a Qualitative Study Using Content Analysis. NursingPlus Open, 2, 8-14. https://doi.org/10.1016/j.npls.2016.01.001
Betriana, F., Osaka, K., Matsumoto, K., Tanioka, T., & Locsin, R. C. (2021). Relating Mori’s Uncanny Valley in Generating Conversations with Artificial Affective Communication and Natural Language Processing. Nursing Philosophy, 22, e12322. https://doi.org/10.1111/nup.12322
Chatflow Design Strategies
Blut, M., Wang, C., & Schoefer, K. (2021). This Meta-Analysis Clarifies That the Impact of Anthropomorphism on Customer Intentions to Use Service Robots Depends on Robot and Service Types. Journal of Service Research, 24, 3-20.
Brown, P., Levinson, S. C., & Gumperz, J. J. (1987). Politeness: Some Universals in Language Usage. Cambridge University Press. https://doi.org/10.1017/cbo9780511813085
Bryman, A. (2017). Social Research Methods (5th ed.). Oxford University Press.
Bryman, A., Bresnen, M., Beardsworth, A., & Keil, T. (1988). Qualitative Research and the Study of Leadership. Human Relations, 41, 13-29. https://doi.org/10.1177/001872678804100102
Bryman, A., Stephens, M., & Campo, C. (1996). The Importance of Context: Qualitative Research and the Study of Leadership. Leadership & Organization Development Journal, 17, 36-45.
Burgess, T. F. (2001). Guide to the Design of Questionnaires. University of Leeds.
Clark, L., Ofemile, A., & Cowan, B. R. (2021). Exploring Verbal Uncanny Valley Effects with Vague Language in Computer Speech. In B. Weiss, J. Trouvain, M. Barkat-Defradas, & J. J. Ohala (Eds.), Voice Attractiveness (pp. 317-330). Springer. https://doi.org/10.1007/978-981-15-6627-1_17
Clark, L., Ofemile, A., Adolphs, S., & Rodden, T. (2016). A Multimodal Approach to Assessing User Experiences with Agent Helpers. ACM Transactions on Interactive Intelligent Systems, 6, 1-31. https://doi.org/10.1145/2983926
Conger, J. A. (1998). Qualitative Research as the Cornerstone Methodology for Understanding Leadership. The Leadership Quarterly, 9, 107-121. https://doi.org/10.1016/s1048-9843(98)90044-3
Cowan, B. R., Branigan, H. P., Obregón, M., Bugis, E., & Beale, R. (2015). Voice Anthropomorphism, Interlocutor Modelling and Alignment Effects on Syntactic Choices in Human−computer Dialogue. International Journal of Human-Computer Studies, 83, 27-42. https://doi.org/10.1016/j.ijhcs.2015.05.008
Creasey, M. C., & Vázquez Anido, A. (2020). Virtual Influencing: Uncharted Frontier in the Uncanny Valley. Lund University. https://lup.lub.lu.se/luur/download?func=downloadFile&recordOId=9015731&fileOId=9015749
Cui, T., Wang, X., & Qi, J. (2021). Designing Anthropomorphic Therapeutic Conversational Agents: An Uncanny Valley Perspective. ECIS.
Davenport, T. H., & Foutty, J. (2022). AI-Driven Leadership. MIT Sloan Management Review. https://sloanreview.mit.edu/article/ai-driven-leadership/
Diel, V., MacDorman, K. F., & Bhatt, S. (2022). This Meta-Analysis Provides a Comprehensive Model of Factors Influencing the Uncanny Valley Effect. Journal of Robotics Research, 41, 723-742.
Doğan Erdinç, E., & Uzunçarşılı Soydaş, A. (2024). Tekinsiz Vadi Teorisi Bağlamında Yapay Zeka Etkileyicileri. Selçuk İletişim , 17 , 1-38. https://doi.org/10.18094/josc.1390778
Ekkelenkamp, J. (2021). The Uncanny Valley: The Effects of Human-Likeness and Gender of E-Commerce Chatbots on Perceived Expertise and Recommendation Adherence. Master’s Thesis, Tilburg University.
Fenzl, T., & Mayring, P. (2017). Qualitative Content Analysis. In U. Flick (Ed.), The SAGE Handbook of Qualitative Data Analysis (pp. 214-228). SAGE Publications.
He, G., Liu, P., Zheng, X., Zheng, L., Hewlin, P. F., & Yuan, L. (2023). Being Proactive in the Age of AI: Exploring the Effectiveness of Leaders’ AI Symbolization in Stimulating Employee Job Crafting. Management Decision, 61, 2896-2919. https://typeset.io/papers/being-proactive-in-the-age-of-ai-exploring-the-effectiveness-24t04zf8?utm_source=chatgpt
Ho, C., & MacDorman, K. F. (2017). Measuring the Uncanny Valley Effect: Refinements to Indices for Perceived Humanness, Attractiveness, and Eeriness. International Journal of Social Robotics, 9, 129-139. https://doi.org/10.1007/s12369-016-0380-9
Insch, G. S., Moore, J. E., & Murphy, L. D. (1997). Content Analysis in Leadership Research: Examples, Procedures, and Suggestions for Future Use. The Leadership Quarterly, 8, 1-25. https://doi.org/10.1016/s1048-9843(97)90028-x
Kaggwa, S., Eleogu, T. F., Okonkwo, F., Farayola, O. A., Uwaoma, P. U., & Akinoso, A. (2024). AI in Decision Making: Transforming Business Strategies. International Journal of Research and Scientific Innovation, X, 423-444. https://doi.org/10.51244/ijrsi.2023.1012032
Kasunic, M. (2005). Designing an Effective Survey. Carnegie Mellon University.
Katz, J. (2015). A Theory of Qualitative Methodology: The Social System of Analytic Fieldwork. Méthod (e)s: African Review of Social Sciences Methodology, 1, 131-146. https://doi.org/10.1080/23754745.2015.1017282
Kitto, S. C., Chesters, J., & Grbich, C. (2008). Quality in Qualitative Research. Medical Journal of Australia, 188, 243-246. https://doi.org/10.5694/j.1326-5377.2008.tb01595.x
Kivunja, C. (2018). Distinguishing between Theory, Theoretical Framework, and Conceptual Framework: A Systematic Review of Lessons from the Field. International Journal of Higher Education, 7, 44-53. https://doi.org/10.5430/ijhe.v7n6p44
Klenke, K. (2008). Qualitative Research in the Study of Leadership. Emerald Group Publishing.
Lay, S. (2015). The Uncanny Valley Effect. PhD Thesis, Open University (United Kingdom).
Levitt, H. M. (2021). Qualitative Generalization, Not to the Population but to the Phenomenon: Reconceptualizing Variation in Qualitative Research. Qualitative Psychology, 8, 95-110. https://doi.org/10.1037/qup0000184
Lincoln, Y. S., Guba, E. G., & Pilotta, J. J. (1985). Naturalistic Inquiry. International Journal of Intercultural Relations, 9, 438-439. https://doi.org/10.1016/0147-1767(85)90062-8
Lu, E. M. (2021). Behind the Uncanny Valley of Mind: Investigating the Effects of Agency and Experience in Chatbot Interactions (Identity No. 1282271). Master’s Thesis. Eindhoven University of Technology. https://research.tue.nl/en/studentTheses/behind-the-uncanny-valley-of-mind
Lumsden, J., & Morgan, W. (2005). Online-Questionnaire Design: Establishing Guidelines and Evaluating Existing Support. In 16th Annual Information Resources Management Association International Conferenc e (pp. 407-410). IGI Global.
Mäkäräinen, M., Saari, T., & Takala, T. (2015). This Study Contradicts the Traditional View of the Uncanny Valley by Showing That Strangeness Can Be Associated with Positive Emotional Reactions. Journal of Experimental Psychology, 11, 341-357.
Mathur, M. B., & Reichling, D. B. (2020). Does Mind Perception Explain the Uncanny Valley? A Meta-Regression. Journal of Experimental Social Psychology, 85, Article ID: 103855.
Mayring, P. (2004). 5.12 Qualitative Content Analysis. In U. Flick, E. von Kardoff, & I. Steinke (Eds.), A Companion to Qualitative Research (pp. 266-269). SAGE Publications Ltd.
Mayring, P. (2015). Qualitative Content Analysis: Theoretical Background and Procedures. In A. Bikner-Ahsbahs, C. Knipping, & N. Presmeg (Eds.), Approaches to Qualitative Research in Mathematics Education (pp. 365-380). Springer. https://doi.org/10.1007/978-94-017-9181-6_13
Mayring, P. (2021). Qualitative Content Analysis: A Step-by-Step Guide. SAGE Publications Ltd.
Mays, N., & Pope, C. (2020). Quality in Qualitative Research. In C. Pope, & N. Mays (Eds.), Qualitative Research in Health Care (pp. 211-233). Wiley-Blackwell.
McGuire, J., & De Cremer, D. (2023). Algorithms, Leadership, and Morality: Why a Mere Human Effect Drives the Preference for Human over Algorithmic Leadership. AI and Ethics, 3, 601-618. https://doi.org/10.1007/s43681-022-00192-2
McGuire, J., De Cremer, D., Hesselbarth, Y., De Schutter, L., Mai, K. M., & Van Hiel, A. (2023). The Reputational and Ethical Consequences of Deceptive Chatbot Use. Scientific Reports, 13, Article No. 16246. https://doi.org/10.1038/s41598-023-41692-3
Merriam, S. B. (2002). Introduction to Qualitative Research. Qualitative Research in Practice: Examples for Discussion and Analysis, 1, 1-17.
Merriam, S. B., & Grenier, R. S. (2019). Qualitative Research in Practice: Examples for Discussion and Analysis . John Wiley & Sons.
Mihai, R., & Creţu, A. (2019). Leadership in the Digital Era. Valahian Journal of Economic Studies, 10, 65-72. https://doi.org/10.2478/vjes-2019-0006
Mozafari, N., Hammerschmidt, M., & Weiger, W. (2021). That’s So Embarrassing! When Not to Design for Social Presence in Human-Chatbot Interactions. In Proceedings of the International Conference on Information Systems . https://ssrn.com/abstract=4305288
Myers, M. (2000). Qualitative Research and the Generalizability Question: Standing Firm with Proteus. The Qualitative Report, 4 , 1-9. https://doi.org/10.46743/2160-3715/2000.2925
Nguyen, T., & van der Lee, P. (2021). The Uncanny Valley Effects: Influence of E n hancing the Human-Likeness of E-Commerce Chatbot on Perceived Social Presence and Patronage Intention.
Onwuegbuzie, A. J., & Collins, K. M. (2007). A Typology of Mixed Methods Sampling Designs in Social Science Research. Qualitative Report, 12 , 281-316.
Pagnozzi, F., Renkema, M., & Antonelli, G. (2024). Help-Seeking Practices and Behaviours in Organizations and Ai-Driven Chatbot: A Scoping Review. puntOorg International Journal, 1 . https://doi.org/10.19245/25.05.of.13.06.24.1
Paudel, R. (2024). The Impact of Automation and Artificial Intelligence (AI) on Leadership and the Workforce. Indonesian Journal of Banking and Financial Technology, 2, 109-124. https://doi.org/10.55927/fintech.v2i2.8904
Pavlidou, P. (2021). The Uncanny Valley: The Human-Likeness of Chatbots and Its Paradoxical Impact on Consumers ’ Purchase Intention in E-Commerce. Master’s Thesis, Tilburg University.
Petrat, D., Yenice, I., Bier, L., & Subtil, I. (2022). Acceptance of Artificial Intelligence as Organizational Leadership: A Survey. TATuP , 31 , 64-69.
Primasatya, R. D., Labbaik, M., Mujtaba, M. I. E., Wahono, R. D., & Wahono, R. D. (2024). Self-Leadership Dalam Menyikapi Perkembangan Teknologi Chatbots AI di Dunia Pendidikan Akuntansi: Tinjauan Perspektif Adaptive Leadership. Owner, 8, 1944-1955. https://doi.org/10.33395/owner.v8i2.2313
Rajaobelina, L., Prom Tep, S., Arcand, M., & Ricard, L. (2021). Creepiness: Its Antecedents and Impact on Loyalty When Interacting with a Chatbot. Psychology & Marketing, 38, 2339-2356. https://doi.org/10.1002/mar.21548
Rapp, A., Curti, L., & Boldi, A. (2021). The Human Side of Human-Chatbot Interaction: A Systematic Literature Review of Ten Years of Research on Text-Based Chatbots. International Journal of Human-Computer Studies, 151, Article ID: 102630. https://doi.org/10.1016/j.ijhcs.2021.102630
Reja, U., Manfreda, K. L., Hlebec, V., & Vehovar, V. (2003). Open-Ended vs. Close-Ended Questions in Web Questionnaires. Developments in Applied Statistics, 19 , 159-177.
Ressem, V. (2023). Implementing AI in Organizations: The Role of Leaders and Its Impact on Leadership. Master’s Thesis, Norwegian University of Science and Technology.
Roller, M. R. (2019). A Quality Approach to Qualitative Content Analysis: Similarities and Differences Compared to Other Qualitative Methods. Forum Qualitative Sozialforschung Forum: Qualitative Social Research, 20 .
Schafheitle, S., Weibel, A., & Rickert, A. (2021). The Bermuda Triangle of Leadership in the AI Era? Emerging Trust Implications from “Two-Leader-Situations” in the Eyes of Employees. In Proceedings of the Annual Hawaii International Conference on System Sciences (p. 5473). Hawaii International Conference on System Sciences. https://doi.org/10.24251/hicss.2021.665
Shick, M., Johnson, N., & Fan, Y. (2023). Artificial Intelligence and the End of Bounded Rationality: A New Era in Organizational Decision Making. Development and Learning in Organizations: An International Journal, 38, 1-3. https://doi.org/10.1108/dlo-02-2023-0048
Shoydin, M., & Pazoev, Y. (2022). The Study Highlights the Importance of Avoiding the Uncanny Valley Effect When Compressing and Transmitting Complex Holographic Images. Journal of Holographic Imaging, 34, 123-138.
Skjuve, M., Haugstveit, I. M., Følstad, A., & Brandtzaeg, P. B. (2019). Help! Is My Chatbot Falling into the Uncanny Valley? An Empirical Study of User Experience in Human-Chatbot Interaction. Human Technology, 15 , 30-54. https://doi.org/10.17011/ht/urn.201902201607
Song, S. W., & Shin, M. (2022). Uncanny Valley Effects on Chatbot Trust, Purchase Intention, and Adoption Intention in the Context of E-Commerce: The Moderating Role of Avatar Familiarity. International Journal of Human - Computer Interaction, 40, 441-456. https://doi.org/10.1080/10447318.2022.2121038
Stenfors, T., Kajamaa, A., & Bennett, D. (2020). How to… Assess the Quality of Qualitative Research. The Clinical Teacher, 17, 596-599. https://doi.org/10.1111/tct.13242
Stepp Jr., D. C. (2022). Investigating Variables to Reduce the Uncanny Valley Effect in Human-Robot Interaction: A Systematic Literature Review . Ph.D. Thesis, University of Arizona Global Campus.
Strange, J. (2022). Human-Robot Collaboration: A Multilevel and Integrated Leadership Framework. Leadership Quarterly, 33 , Article ID: 101594.
Strong, N., & Terblanche, N. (2020). Chatbots as an Instance of an Artificial Intelligence Coach. In R. Wegener (Ed.), Coaching im digitalen Wandel (pp. 51-62). Vandenhoeck & Ruprecht. https://doi.org/10.13109/9783666407420.51
Tîrnăcop, A. B. (2023). Leadership in the Digital Era: Exploring the AI-EI Nexus. Cactus, 5, 45-52. https://doi.org/10.24818/cts/5/2023/1.05
Tschöpe, N., Reiser, J. E., & Oehl, M. (2017). Exploring the Uncanny Valley Effect in Social Robotics. In Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (pp. 307-308). ACM. https://doi.org/10.1145/3029798.3038319
Tu, T., Cheng, H., & Chu, Y. (2020). This Research Shows That Older Adults Do Not Experience the Uncanny Valley Effect as Younger and Middle-Aged Adults Do. Journal of Geriatric Robotics, 5, 65-78.
Van Lierop, T. (2021). The Uncanny Valley: The Paradoxical Effects of Enhancing the Human-Likeness of Customer Support Chatbots on Perceived Trust and Satisfaction.
Van Quaquebeke, N., & Gerpott, F. H. (2023). The Now, New, and Next of Digital Leadership: How Artificial Intelligence (AI) Will Take over and Change Leadership as We Know It. Journal of Leadership & Organizational Studies, 30, 265-275. https://doi.org/10.1177/15480518231181731
Varpio, L., Paradis, E., Uijtdehaage, S., & Young, M. (2020). The Distinctions between Theory, Theoretical Framework, and Conceptual Framework. Academic Medicine, 95, 989-994. https://doi.org/10.1097/acm.0000000000003075
Wald, R., Heijselaar, E., & Bosse, T. (2021). Make Your Own: The Potential of Chatbot Customization for the Development of User Trust. In Adjunct Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization (pp. 382-387). ACM. https://doi.org/10.1145/3450614.3463600
Wang, P., & Shao, J. (2022). Escaping Loneliness through Tourist-Chatbot Interactions. In J. L. Stienmetz, B. Ferrer-Rosell, & D. Massimo, (Eds.), Information and Communication Technologies in Tourism 2022 pp. (473-485). Springer. https://doi.org/10.1007/978-3-030-94751-4_44
Watson, G. J., Desouza, K. C., Ribiere, V. M., & Lindič, J. (2021). Will AI Ever Sit at the C-Suite Table? The Future of Senior Leadership. Business Horizons, 64, 465-474. https://doi.org/10.1016/j.bushor.2021.02.011
Waugh, W. L., & Streib, G. (2006). Collaboration and Leadership for Effective Emergency Management. Public Administration Review, 66, 131-140. https://doi.org/10.1111/j.1540-6210.2006.00673.x
Zhang, G., Chong, L., Kotovsky, K., & Cagan, J. (2023). Trust in an AI versus a Human Teammate: The Effects of Teammate Identity and Performance on Human-AI Cooperation. Computers in Human Behavior, 139, Article ID: 107536. https://doi.org/10.1016/j.chb.2022.107536