Performance Evaluation of a Genetic Neuro-Fuzzy Intrusion Detection System across Multiple Datasets
- 1 Telecommunication Department, Higher Institute for Applied Science and Technology (HIAST), Damascus, Syria
- 2 Telecommunication Department, Higher Institute for Applied Science and Technology (HIAST), Damascus, Syria
- 3 Information Department, Higher Institute for Applied Science and Technology (HIAST), Damascus, Syria
Abstract
The paper introduces an IDS that combines a genetic-algorithm feature selector with an Adaptive Neuro-Fuzzy Inference System classifier. A genetic algorithm, one of the most prominent heuristic optimization methods, is utilized to select a set of optimal features to serve as inputs to the IDS. The performance of this hybrid approach is rigorously compared with the widely adopted open-source Snort system using several standard benchmark datasets, including KDDCup99, NSL-KDD, UNSW-NB15, Bot-IoT, and CSE-CIC-IDS2018. The primary objective is to create a system capable of learning and detecting previously unknown attacks by harnessing the strengths of neural networks and fuzzy logic, thereby minimizing erroneous classifications—whether considering benign data as malicious or vice versa. The model is trained and tested on five public datasets and benchmarked against Snort. Across all datasets the GA-ANFIS variant attains higher accuracy (≈99%) and markedly lower false-positive rates (<0.3%) than Snort, implying better adaptability to diverse attack patterns. The empirical results demonstrate that the proposed system exhibits substantial potential in enhancing detection accuracy and adaptability to emerging threats.
- Patil, R., Dudeja, H. and Modi, C. (2019) Designing an Efficient Security Framework for Detecting Intrusions in Virtual Network of Cloud Computing. Computers & Security , 85, 402-422. https://doi.org/10.1016/j.cose.2019.05.016
- Tsai, C., Hsu, Y., Lin, C. and Lin, W. (2009) Intrusion Detection by Machine Learning: A Review. Expert Systems with Applications , 36, 11994-12000. https://doi.org/10.1016/j.eswa.2009.05.029
- Tait, K.A., et al . (2021) Intrusion Detection Using Machine Learning Techniques: An Experimental Comparison. arXiv: 2105.13435.
- Guyon, I. and Elisseeff, A. (2003) An Introduction to Variable and Feature Selection. Journal of Machine Learning Research , 3, 1157-1182.
- Aljanabi, M. and Ismail, M.A. (2021) Improved Intrusion Detection Algorithm Based on TLBO and GA Algorithms. The International Arab Journal of Information Technology , 18.
- Ishaque, M., Johar, M.G.M., Khatibi, A. and Yamin, M. (2023) A Novel Hybrid Technique Using Fuzzy Logic, Neural Networks and Genetic Algorithm for Intrusion Detection System. Measurement : Sensors , 30, Article ID: 100933. https://doi.org/10.1016/j.measen.2023.100933
- Saxena, N., Roy, S. and Kim, H. (2017) Machine Learning for Intrusion Detection: A Comprehensive Overview. IEEE Communications Surveys & Tutorials , 18, 1155-1176.
- Sokolova, M., Japkowicz, N. and Szpakowicz, S. (2006) Beyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation. In: Sattar, A. and Kang, B., Eds., AI 2006: Advances in Artificial Intelligence , Springer, 1015-1021. https://doi.org/10.1007/11941439_114
- Tavallaee, M., Bagheri, E., Lu, W. and Ghorbani, A.A. (2009) A Detailed Analysis of the KDD CUP 99 Data Set. 2009 IEEE Symposium on Computational Intelligence for Security and Defense Applications , Ottawa, 8-10 July 2009, 1-6. https://doi.org/10.1109/cisda.2009.5356528
- Sharafaldin, I., Habibi Lashkari, A. and Ghorbani, A.A. (2018) Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization. Proceedings of the 4 th International Conference on Information Systems Security and Privacy , Funchal, 22-24 January 2018, 108-116. https://doi.org/10.5220/0006639801080116
- Moustafa, N. and Slay, J. (2016) The Evaluation of Network Anomaly Detection Systems: Statistical Analysis of the UNSW-NB15 Data Set and the Comparison with the KDD99 Data Set. Information Security Journal : A Global Perspective , 25, 18-31. https://doi.org/10.1080/19393555.2015.1125974