A Quality Evaluation System for Dissertation Based on Fuzzy Analytic Hierarchy Process — Oak Academic Publishing
Research ArticleOpen AccessGoogle Scholar indexed
A Quality Evaluation System for Dissertation Based on Fuzzy Analytic Hierarchy Process
School of Basic Medical Sciences, Capital Medical University, Beijing, China
,
Beijing Key Laboratory of Pre-Clinical Research and Evaluation for Cardiovascular Implant Materials, State Key Laboratory of Cardiovascular Disease, National Center for Cardiovascular Diseases, Animal Experimental Center, Fuwai Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
,
Beijing Key Laboratory of Pre-Clinical Research and Evaluation for Cardiovascular Implant Materials, State Key Laboratory of Cardiovascular Disease, National Center for Cardiovascular Diseases, Animal Experimental Center, Fuwai Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
,
Beijing Key Laboratory of Pre-Clinical Research and Evaluation for Cardiovascular Implant Materials, State Key Laboratory of Cardiovascular Disease, National Center for Cardiovascular Diseases, Animal Experimental Center, Fuwai Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
,
Beijing Key Laboratory of Pre-Clinical Research and Evaluation for Cardiovascular Implant Materials, State Key Laboratory of Cardiovascular Disease, National Center for Cardiovascular Diseases, Animal Experimental Center, Fuwai Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
,
Department of Endocrine, Suqian First Hospital, Suqian, China
,
Beijing Key Laboratory of Pre-Clinical Research and Evaluation for Cardiovascular Implant Materials, State Key Laboratory of Cardiovascular Disease, National Center for Cardiovascular Diseases, Animal Experimental Center, Fuwai Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
1 School of Basic Medical Sciences, Capital Medical University, Beijing, China
2 Beijing Key Laboratory of Pre-Clinical Research and Evaluation for Cardiovascular Implant Materials, State Key Laboratory of Cardiovascular Disease, National Center for Cardiovascular Diseases, Animal Experimental Center, Fuwai Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
3 Beijing Key Laboratory of Pre-Clinical Research and Evaluation for Cardiovascular Implant Materials, State Key Laboratory of Cardiovascular Disease, National Center for Cardiovascular Diseases, Animal Experimental Center, Fuwai Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
4 Beijing Key Laboratory of Pre-Clinical Research and Evaluation for Cardiovascular Implant Materials, State Key Laboratory of Cardiovascular Disease, National Center for Cardiovascular Diseases, Animal Experimental Center, Fuwai Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
5 Beijing Key Laboratory of Pre-Clinical Research and Evaluation for Cardiovascular Implant Materials, State Key Laboratory of Cardiovascular Disease, National Center for Cardiovascular Diseases, Animal Experimental Center, Fuwai Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
6 Department of Endocrine, Suqian First Hospital, Suqian, China
7 Beijing Key Laboratory of Pre-Clinical Research and Evaluation for Cardiovascular Implant Materials, State Key Laboratory of Cardiovascular Disease, National Center for Cardiovascular Diseases, Animal Experimental Center, Fuwai Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
A dissertation is a research report or scientific paper written by an author to obtain a certain degree. It reflects postgraduates’ research achievements and the educational quality of an institute, even a country. To construct an optimized quality evaluation system for postgraduate dissertation (QESPD), we summarized the influencing factors and invited 10 experienced specialists to rate and prioritize them based on fuzzy analytic hierarchy process. Four primary indicators (innovation, integrity, scientificity and normativity) and 16 sub-indicators were selected to form the evaluation system. The order of primary indicators by weight, was innovation (0.4269), scientificity (0.2807), integrity (0.1728) and normativity (0.1196). The top five sub-dimensions were theoretical originality, scientific value, data reliability, design rationality and evidence credibility. To demonstrate the effectiveness of the proposed system, a case study was performed. In the case study, it was demonstrated that the established two-index-hierarchy QESPD in this study was a more scientific and reasonable evaluation system worthy of promotion and application.
KeywordsDissertationQuality EvaluationIndicator SystemFuzzy Analytic Hierarchy ProcessCase Study
Blackmur, D. (2005) An Evaluation of the South African Model of MBA Accreditation. Quality in Higher Education , 11, 87-102. https://doi.org/10.1080/13538320500175001
Bertolin, J. and Leite, D. (2008) Quality Evaluation of the Brazilian Higher Education System: Relevance, Diversity, Equity and Effectiveness. Quality in Higher Ed u cation , 14, 121-133. https://doi.org/10.1080/13538320802279980
Bloxham, S. (2012) ‘You Can See the Quality in Front of Your Eyes’: Grounding Academic Standards between Rationality and Interpretation. Quality in Higher Education , 18, 185-204. https://doi.org/10.1080/13538322.2012.711071
Min, Z. and Lizhen, Z. (2017) Reflections on the Quality Assurance System of Full-Time Master’s Degree Dissertation. China Adult Education , No. 21, 86-88.
Alexander, F.K. (2000) The Changing Face of Accountability. The Journal of Higher Education , 71, 411-431. https://doi.org/10.1080/00221546.2000.11778843
Altbach, P.G. (2009) The Giants Awake: The Present and Future of Higher Education Systems in China and India. In: Altbach, P.G., Ed., Higher Education to 2030, Volume 2, Globalisation , OECD Publishing, 179-204. https://doi.org/10.1787/9789264075375-8-en
Bazargan, A. (2007) Problems of Organising and Reporting Internal and External Evaluation in Developing Countries: The Case of Iran. Quality in Higher Education , 13, 207-214. https://doi.org/10.1080/13538320701800126
UNESCO-UIS (2012) International Standard Classification of Education ISCED 2011.
Min, L. and Hongjie, C. (2017) Typical Characteristics of Unqualified Academic Master’s Degree dissertations—An Analysis Based on the Expert Review of Dissertation Sampling. Degree and Postgraduate Education , 6, 61-67.
UNESCO (2008) Global Initiative for Quality Assurance Capacity (GIAC). UNESCO, Paris.
Altbach, P.G., Reisberg, L. and Rumbley, L.E. (2010) Trends in Global Higher Education. BRILL. https://doi.org/10.1163/9789004406155
Fabra, M.E. and Camisón, C. (2009) Direct and Indirect Effects of Education on Job Satisfaction: A Structural Equation Model for the Spanish Case. Economics of Ed u cation Review , 28, 600-610. https://doi.org/10.1016/j.econedurev.2008.12.002
OECD (2019) Education at a Glance 2019. OECD Publisher. https://doi.org/10.1787/f8d7880d-en
Tsui, C. (2009) Quality Assurance in Higher Education: A Hong Kong Perspective. Ph.D. Dissertation, University College London.
Cui, Y., Luo, F., Yang, B., Li, B., Zhang, Q., Das, G., et al . (2019) Construction and Application of Service Quality Evaluation System in the Preclinical Research on Cardiovascular Implant Devices. BMC Medical Informatics and Decision Making , 19, Article No. 37. https://doi.org/10.1186/s12911-019-0773-4
OECD (2015) ISCED 2011 Operational Manual: Guidelines for Classifying National Education Programmes and Related Qualifications. OECD Publishing.
Beland, L. and Murphy, R. (2016) Ill Communication: Technology, Distraction & Student Performance. Labour Economics , 41, 61-76. https://doi.org/10.1016/j.labeco.2016.04.004
Hung, Y.H., Huang, M.L. and Chen, K.S. (2003) Service Quality Evaluation by Service Quality Performance Matrix. Total Quality Management & Business Exce l lence , 14, 79-89. https://doi.org/10.1080/14783360309706
Dagger, T.S., Sweeney, J.C. and Johnson, L.W. (2007) A Hierarchical Model of Health Service Quality. Journal of Service Research , 10, 123-142. https://doi.org/10.1177/1094670507309594
Chen, L., Chen, S. and Su, C. (2017) An Innovative Service Quality Evaluation and Improvement Model. The Service Industries Journal , 38, 228-249. https://doi.org/10.1080/02642069.2017.1389907
Yu, K. and Shen, C. (2011) Service Quality Management by Expanded Traditional Importance-Performance Analysis. Journal of the Chinese Institute of Industrial Engineers , 28, 146-154. https://doi.org/10.1080/10170669.2010.546557
Azzopardi, E. and Nash, R. (2013) A Critical Evaluation of Importance-Performance Analysis. Tourism Management , 35, 222-233. https://doi.org/10.1016/j.tourman.2012.07.007
Feng, M., Mangan, J., Wong, C., Xu, M. and Lalwani, C. (2014) Investigating the Different Approaches to Importance-Performance Analysis. The Service Industries Journal , 34, 1021-1041. https://doi.org/10.1080/02642069.2014.915949
Lai, I.K.W. and Hitchcock, M. (2015) A Consideration of Normality in Importance-Performance Analysis. Current Issues in Tourism , 18, 979-1000. https://doi.org/10.1080/13683500.2014.990423
Sever, I. (2015) Importance-Performance Analysis: A Valid Management Tool? Tourism Management , 48, 43-53. https://doi.org/10.1016/j.tourman.2014.10.022
Cronin, J.J. and Taylor, S.A. (1994) Servperf versus Servqual: Reconciling Performance-Based and Perceptions-Minus-Expectations Measurement of Service Quality. Journal of Marketing , 58, 125-131. https://doi.org/10.1177/002224299405800110
Tong, S., Li, X. and Liu, R. (2010) Research on Ways to Enhancing Undergraduate Dissertation Quality. Shanxi Finance and Economics University , 9, 45-53.
Ivan, L. (2013) Criteria for Evaluating Masters and Doctoral Theses. https://scientificlanguage.com/methodology/thesiscriteria7
Alstete, J.W. (1995) Benchmarking in Higher Education: Adapting Best Practices to Improve Quality. ERIC Digest, 1-6.
Westerheijden, D.F., Hulpiau, V. and Waeytens, K. (2006) Lines of Change in the Discourse on Quality Assurance: An Overview of Some Studies into What Impacts Improvement. EAIR 28th Annual Forum 2006, Rome, 30 August-1 September 2006, 1-19.
El-Khawas, E. (2007) Accountability and Quality Assurance: New Issues for Academic Inquiry. In: Forest, J.J.F. and Altbach, P.G., Eds., International Handbook of Higher Education , Springer, 23-37. https://doi.org/10.1007/978-1-4020-4012-2_3
Prince, M. and Stella, A. (2007) External Quality Assurance in Higher Education: Making Choices. International Institute for Educational Planning.
Martin, M. (2007) Cross-Border Higher Education: Regulation, Quality Assurance and Impact. International Institute for Educational Planning.
Bamber, V. and Anderson, S. (2012) Evaluating Learning and Teaching: Institutional Needs and Individual Practices. International Journal for Academic Develo p ment , 17, 5-18. https://doi.org/10.1080/1360144x.2011.586459
Jin, Z., Li, S. and Xu, J. (2014) Quality Evaluation of Undergraduate Thesis as the Goal of Applied Talent’s Cultivation—Based on the Self-Assessment Analysis of Accounting Major Theses. Proceedings of the 2014 International Conference on Education Reform and Modern Management , Phuket, 11 January 2014, 151-154. https://doi.org/10.2991/ermm-14.2014.42
Gao, Y., Chen, H.J., Shen, W.Q. and Li, M. (2017) Disciplinary Differences in the Quality of Academic Master’s Dissertation-Quantitative Analysis Based on the Results of X Province Dissertation Sampling Inspection. Academic Degrees & Grad u ate Education , No. 2, 54-61.
Shafii, M., Rafiei, S., Abooee, F., Bahrami, M.A., Nouhi, M., Lotfi, F., et al . (2016) Assessment of Service Quality in Teaching Hospitals of Yazd University of Medical Sciences: Using Multi-Criteria Decision Making Techniques. Osong Public Health and Research Perspectives , 7, 239-247. https://doi.org/10.1016/j.phrp.2016.05.001
Chang, C., Liang, C., Shu, K. and Tsai, C. (2015) Key Successful Factors of Knowledge Management for University Students Using E‐Portfolios: Approach of Fuzzy Delphi and Fuzzy AHP. Computer Applications in Engineering Education , 23, 673-681. https://doi.org/10.1002/cae.21640
Ma, Z., Shao, C., Ma, S. and Ye, Z. (2011) Constructing Road Safety Performance Indicators Using Fuzzy Delphi Method and Grey Delphi Method. Expert Systems with Applications , 38, 1509-1514. https://doi.org/10.1016/j.eswa.2010.07.062
Gustafsson, F. and Rogers, J.G. (2017) Left Ventricular Assist Device Therapy in Advanced Heart Failure: Patient Selection and Outcomes. European Journal of Heart Failure , 19, 595-602. https://doi.org/10.1002/ejhf.779
OECD (2018) OECD Handbook for Internationally Comparative Education Statistics 2018: Concepts, Standards, Definitions and Classifications. OECD Publishing.