The Role of Rare Terms in Enhancing the Performance of Polynomial Networks Based Text Categorization
- 1 Department of Computer Information Systems, Faculty of Information Technology, Al-Ahliyya Amman University, Amman, Jordan.
Abstract
In this paper, the role of rare or infrequent terms in enhancing the accuracy of English Text Categorization using Polynomial Networks (PNs) is investigated. To study the impact of rare terms in enhancing the accuracy of PNs-based text categorization, different term reduction criteria as well as different term weighting schemes were experimented on the Reuters Corpus using PNs. Each term weighting scheme on each reduced term set was tested once keeping the rare terms and another time removing them. All the experiments conducted in this research show that keeping rare terms substantially improves the performance of Polynomial Networks in Text Categorization, regardless of the term reduction method, the number of terms used in classification, or the term weighting scheme adopted.
- M. M. AL-Tahrawi and R. Abu Zitar, “Polynomial Networks versus Other Techniques in Text Categorization,” International Journal of Pattern Recognition and Artificial Intelligence, Vol. 22, No. 2, 2008, pp. 295-322. doi:10.1142/S0218001408006247
- R. Bekkerman, “Distributional Clustering of Words for Text Categorization,” M.S. Thesis, Israel Institute of Technology, Haifa, 2003.
- D. Koller and M. Sahami, “Hierarchically Classifying Documents Using Very Few Words,” The 14th International Conference on Machine Learning (ICML’97), Nashville, July 1997, pp. 170-178.
- D. Wang and H. Zhang, “Inverse-Category-Frequency based Supervised Term Weighting Scheme for Text Categorization,” Journal of Information Science and Engineering, 2010.
- C. Deisy, M. Gowri, S. Baskar, S. M. A. Kalaiarasi and N. Ramraj, “A Novel Term Weighting Scheme MIDF for Text Categorization,” Journal of Engineering Science and Technology, Vol. 5, No. 1, 2010, pp. 94-107.
- P. Schonhofen and A. A. Benczur, “Exploiting Extremely Rare Terms in Text Categorization,” Lecture Notes in Computer Science, Vol. 4212, 2006, pp. 759-766.
- K. Fukunaga, “Introduction to Statistical Pattern Recognition,” Academic Press, Cambridge, 1990.
- W. M. Campbell, K. T. Assaleh and C. C. Broun, “A Novel Algorithm for Training Polynomial Networks,” International NAISO Symposium on Information Science Innovations ISI’2001, Dubai, March 2001.
- K. T. Assaleh and M. AL Rousan, “A New Method for Arabic Sign Language Recognition,” Personal Communications, 2004.
- W. M. Campbell and C. C. Boun, “Using Polynomial Networks for Speech Recognition,” Personal Communications, 2004.
- W. M. Campbell and K. T. Assaleh, “Polynomial Classifier Techniques for Speaker verification,” Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Phoenix, 15-19 March 1999, pp. 321 324.
- K. T. Assaleh and W. M. Campbell, “Speaker Identification Using a Polynomial-Based Classifier,” International Symposium on Signal Processing and Its Applications, Brisbane, 22-25 August 1999, pp. 115-118.
- G. H. Golub and C. F. Van Loan, “Matrix Computations,” John Hopkins, Washington DC, 1989.
- Ana Site for Data Sets Suitable for Single-Label Text Categorization. http://www.gia.ist.utl.pt/~acardoso/datasets/