Research ArticleOpen AccessGoogle Scholar indexed
Development of Answer Validation System Using Responders’ Attributes and Crowd Ranking
Department of Computer Science, Federal University of Technology, Akure, Nigeria
Department of Information Systems, Federal University of Technology, Akure, Nigeria
Department of Computer Science, Federal University of Technology, Akure, Nigeria
Department of Computer Science, Federal University of Technology, Akure, Nigeria
Department of Information Technology, Federal University of Technology, Akure, Nigeria
- 1 Department of Computer Science, Federal University of Technology, Akure, Nigeria
- 2 Department of Information Systems, Federal University of Technology, Akure, Nigeria
- 3 Department of Computer Science, Federal University of Technology, Akure, Nigeria
- 4 Department of Computer Science, Federal University of Technology, Akure, Nigeria
- 5 Department of Information Technology, Federal University of Technology, Akure, Nigeria
Journal of Service Science and Management·Volume 14 (2021)·Pages 382–398·Published 11 May 2021·DOI10.4236/jssm.2021.143024
Copy link · social · email
Abstract
Crowdsourcing has found a wide range of application in Community Question Answering (CQA). However, one of its biggest challenges is the need to address the quality of crowd answers contributions. Therefore, this work proposed a system that seeks to validate answers to questions provided by respondents using responders’ attributes and crowd ranking technique. Weights were assigned to respondent answers based on their academic records, experience and understanding of the question to obtain valid answers. Thereafter, valid answers were ranked by the crowd using Borda Count algorithm. The proposed system was evaluated using Usability and User experience (UX) measurement. The result obtained demonstrated the effectiveness of the applied technique.
KeywordsAskersAnswerersCommunity Question Answering (CQA)Question Answering (QA)Crowd SourcingAnswer Validation
- Anderson, A., Huttenlocher, D., Kleinberg, J., & Leskovec, J. (2012). Discovering Value from Community Activity on Focused Question Answering Sites: A Case Study of Stack Overflow. Proceedings the 18th ACM International Conference on Knowledge Discovery and Data Mining, Beijing, 12-16 August 2012, 850-858. https://doi.org/10.1145/2339530.2339665
- Aydin, B., Yilmaz, Y., Li, Y., Li, Q., Gao, J., & Demirbas, M. (2014). Crowdsourcing for Multiple-Choice Question Answering. Proceedings the 26th Annual Conference on Innovative Applications of Artificial Intelligence, Québec, 29-31 July 2014, 1-12.
- Chandra, A., Reddy, O., & Madhavi, K. (2017). A Survey on Types of Question Answering System. IOSR Journal of Computer Engineering, 19, 19-23.
- Cimiano, P., Unger, C., & McCrae, J. (2014). Ontology-Based Interpretation of Natural Language. San Rafael, CA: Morgan & Claypool Publishers. https://doi.org/10.2200/S00561ED1V01Y201401HLT024
- Dobšovič, R., Grznar, M., Harinek, J., Molnar, S., Palenik, P., Poizl, D., & Zbell, P. (2014). Askalot: An Educational Community Question Answering System. Unpublished PhD Thesis, Bratislava: Slovak University of Technology.
- Fan, H., Ma, Z., Li, H., Wang, D., & Liu, J. (2019). Enhanced Answer Selection in CQA Using Multi-Dimensional Features Combination. Tsinghua Science and Technology, 24, 346-359. https://doi.org/10.26599/TST.2018.9010050
- Harper, F., Raban, D., Rafaeli, S., & Konstan, J. (2008). Predictors of Answer Quality in Online Q&A Sites. Proceedings of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems, Florence, 5-10 April 2008, 865-874. https://doi.org/10.1145/1357054.1357191
- Howe, J. (2006). Crowdsourcing: A Definition. Wired Blog Network: Crowdsourcing. http://crowdsourcing.typepad.com/cs/2006/06/crowdsourcing_a.html
- Hung, N., Thang, D., Tam, N., Weidlich, M., Aberer, K., Yin, H., & Zhou, X. (2017). Answer Validation for Generic Crowdsourcing Tasks with Minimal Efforts. The VLDB Journal, 26, 855-880. https://doi.org/10.1007/s00778-017-0484-3
- Hung, N., Thang, D., Weidlich, M., & Aberer, K. (2015). Minimizing Efforts in Validating Crowd Answers. Proceedings of the Association for Computer Machinery’s Special Interest Group on Management of Data, Melbourne, May 2015, 999-1014. https://doi.org/10.1145/2723372.2723731
- Ishikawa, D., Kando, N., & Sakai, T. (2011). What Makes a Good Answer in Community Question Answering? An Analysis of Assessors’ Criteria. The Fourth International Workshop on Evaluating Information Access, Tokyo, December 2011, 169-181.