Diabetic Retinopathy Severity Classification Using Data Fusion and Ensemble Transfer Learning

Abstract

Diabetic retinopathy is a serious concern for people dealing with diabetes. Detecting diabetic retinopathy poses significant challenges, requiring skilled professionals, extensive manual image processing, and considerable time investment. Fortunately, the integration of deep learning and transfer learning offers invaluable assistance to medical practitioners. This study introduces an ensemble classification framework to detect and grade diabetic retinopathy into 5 classes leveraging the concepts of transfer learning and data fusion. It utilizes three benchmark datasets on diabetic retinopathy: APTOS 2019, IDRiD, and Messidor-2. Initially, these datasets are merged, resulting in a total of 5922 fundus images. Then this fused dataset undergoes pre-processing. Firstly, the images are cropped to remove unwanted regions. Then, Contrast Limited Adaptive Histogram Equalization is applied to improve image quality and fine details. To tackle class imbalance issues, Synthetic Minority Over Sampling technique is employed. Additionally, data augmentation techniques such as flipping, rotation, and zooming are used to increase dataset diversity. The dataset is split into training, validation, and testing sets at a ratio of 70:10:20. For classification, three pre-trained CNN models, EfficientNetB2, DenseNet121, and ResNet50, are fine-tuned. After these models are trained, an ensemble model is constructed by averaging the predictions of each model. Results show that the ensemble model achieved the highest test accuracy of 96.96% in grading diabetic retinopathy into 5 classes outperforming the individual pre-trained models. Furthermore, the ensemble model’s performance is compared with previously published approaches where this model demonstrated superior result.