A Statistical Analysis of Textual E-Commerce Reviews Using Tree-Based Methods
- 1 Department of Statistics, Universidade Federal Fluminense, Niterói, Brazil
- 2 Department of Statistics, Universidade Federal Fluminense, Niterói, Brazil
- 3 Department of Statistics, Universidade Federal Fluminense, Niterói, Brazil
Abstract
With the increasing interest in e-commerce shopping, customer reviews have become one of the most important elements that determine customer satisfaction regarding products. This demonstrates the importance of working with Text Mining. This study is based on The Women ’ s Clothing E-Com merce Reviews database, which consists of reviews written by real customers. The aim of this paper is to conduct a Text Mining approach on a set of customer reviews. Each review was classified as either a positive or negative re view by employing a classification method. Four tree-based methods were ap plied to solve the classification problem, namely Classification Tree, Random Forest, Gradient Boosting and XGBoost. The dataset was categorized into training and test sets. The results indicate that the Random Forest method displays an overfitting, XGBoost displays an overfitting if the number of trees is too high, Classification Tree is good at detecting negative reviews and bad at detecting positive reviews and the Gradient Boosting shows stable values and quality measures above 77% for the test dataset. A consensus between the applied methods is noted for important classification terms.
- Medhat, W., Hassan, A. and Korashy, H. (2014) Sentiment Analysis Algorithms and Applications: A Survey. Ain Shams Engineering Journal, 5, 1093-1113. https://doi.org/10.1016/j.asej.2014.04.011
- Aung, K.Z. and Myo, N.N. (2017) Sentiment Analysis of Students’ Comment Using Lexicon Based Approach. 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS), Wuhan, 24-26 May 2017, 149-154.
- Palanisamy, P., Yadav, V. and Elchuri, H. (2013) Serendio: Simple and Practical Lexicon Based Approach to Sentiment Analysis. Second Joint Conference on Lexical and Computational Semantics (*SEM), Volume 2, 543-548.
- Onan, A. (2021) Sentiment Analysis on Massive Open Online Course Evaluations: A Text Mining and Deep Learning Approach. Computer Applications in Engineering Education, 29, 572-589. https://doi.org/10.1002/cae.22253
- Ko, Y. and Seo, J. (2000) Automatic Text Categorization by Unsupervised Learning. COLING 2000: The 18th International Conference on Computational Linguistics, Volume 1, 453-459.
- Alrehili, A. and Albalawi, K. (2019) Sentiment Analysis of Customer Reviews Using Ensemble Method. 2019 International Conference on Computer and Information Sciences (ICCIS), Sakaka, 3-4 April 2019, 1-6. https://doi.org/10.1109/ICCISci.2019.8716454
- Shah, K., Patel, H., Sanghvi, D. and Shah, M. (2020) A Comparative Analysis of Logistic Regression, Random Forest and KNN Models for the Text Classification. Augmented Human Research, 5, 1-16. https://doi.org/10.1007/s41133-020-00032-0
- Lin, X.X. (2020) Sentiment Analysis of e-Commerce Customer Reviews Based on Natural Language Processing. Proceedings of the 2020 2nd International Conference on Big Data and Artificial Intelligence, Johannesburg, 28-30 April 2020, 32-36.
- Tan, A.-H., et al. (1999) Text Mining: The State of the Art and the Challenges. Proceedings of the PAKDD 1999 Workshop on Knowledge Discovery from Advanced Databases, Volume 8, 65-70.
- Toman, M., Tesar, R. and Jezek, K. (2006) Influence of Word Normalization on Text Classification. Proceedings of InSciT, Vol. 4, 354-358.
- Luhn, H.P. (1958) The Automatic Creation of Literature Abstracts. IMB Journal, 2, 159-165. https://doi.org/10.1147/rd.22.0159
- Loh, W.-Y. (2011) Classification and Regression Trees. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 1, 14-23. https://doi.org/10.1002/widm.8