Abstract
Diabetic retinopathy (DR) is a leading cause of preventable blindness caused by damaged blood vessels in the eye, if not treated early on. The aim of this research work was to develop a method for the automatic detection of Diabetic Retinopathy and proposing a model for deciding the progression/severity using fundus images. The method was developed so that DR can be detected in an effective and efficient manner before causing damage to the eye, without the presence of an ophthalmologist. The manual screening requires the presence of an ophthalmologist and the resource of time. Detecting exudates is important for the diagnosis of DR. The approach adopted was two-fold: i. extracting features of interest from the images i.e. the blood vessels, optic disc (OD), exudates and microaneurysms by using morphological operations and ii. classifying its progression/severity as either mild or moderate by using the support vector machine (SVM) classifier for helping Ophthalmologists. The performance of the proposed method has been assessed by an ophthalmologist and approved. This paper contributes towards the field of automatic detection of anomalous structures and their severity.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
Diabetic Retinopathy (DR) is caused when the insulin production in the body is not sufficient and the increased glucose level causes the blood vessels in the eye to swell leading to leakage in the retina. There are two types of Diabetic Retinopathy (DR) i. Non–Proliferative Diabetic Retinopathy (NPDR) and ii. Proliferative Diabetic Retinopathy (PDR). In NPDR the blood vessels get damaged and leak fluid and small amount of blood while, in PDR the abnormal blood vessels start growing on the retina and stop the flow of blood to the retina. DR is diagnosed in patients that have been suffering from diabetes for ten to fifteen years and have no symptoms until the loss of vision [4], deciding whether the patient suffers from DR is difficult for the Ophthalmologist which makes identifying the progression of the disease difficult too. It is one of the major causes of blindness in adults suffering from diabetes, research suggests that early detection, regular examination and cure can decrease DR by 95% [29]. Automated detection of DR using fundus image of the retina has made the detection of retinal diseases much easier and less time consuming for ophthalmologists. The main cause of the formation of exudates and microaneurysms is the leakage of proteins and lipids from the blood vessels into the retina. This paper focuses on extracting exudates and microaneurysms for detecting DR, where it can detect both at an early stage. An automated method for the detection of DR using fundus retinal images is outlined in this paper in Section 3. Morphological operations were used for the detection of exudates and microaneurysms and Support Vector Machine (SVM) was used for the detection of the progression/severity of the disease.
It is important to carry out mass screening of people suffering from diabetes for the early diagnosis of diabetic retinopathy towards which systems using imaging techniques can prove to be very useful and effective. Early diagnosis of the disease can prove to be difficult but it is possible while the progression of the symptoms and disease can be monitored through such systems effectively. Decision regarding the treatment and course of action can be based on systems as proposed by ophthalmologists. The proposed method can be used on the detection of defects in manufactured items, naturally occurring tissues or any problem that requires extracting features of interest and severity detection.
This paper is outlined as follows: Section 2 discusses the related literature for the automatic detection of diabetic retinopathy. The Proposed methodology is outlined in Section 3 with the help of experimental results, Section 4 gives the conclusion of the proposed work and the future work is given in Section 5. An example of a fundus retinal image with exudates is given in Fig. 1.
2 Related work
Many studies have been carried out on the automatic detection and classification of diabetic retinopathy using various techniques in the recent years. These can be divided into the following categories: i. morphological operations, ii. color, iii. Deep learning and iv. other methods used for automatically identifying DR.
2.1 Morphological operations
Gandhi et al. [10] have proposed a method for the automatic detection and classification of abnormalities in Diabetic Retinopathy using morphological operations for the extraction of blood vessels, the Canny edge detector was used for the elimination of optic disc and SVM classifier was used for the classification of the disease. Priya et al. [21] have presented a method to classify diabetic retinopathic abnormalities to extract the features of retinal image and then to analyze the progression of the disease by using neural networks and SVM classifier. Aquino et al. [3] have outlineded a morphological and edge recognition method for the optic disc localization. Kuruvilla et al. [15] have proposed a method in which blood vessels were detected by morphological operations, optic disc by segmentation and microaneurysms and haemorrhages were detected by using the moat operator. Kande et al. [16] have proposed a mathematical morphology method for recognition of haemorrhages and microaneurysms. Raja et al. [24] have addressed the problem of detecting optic disc and blood vessels in retinal images by using the binary morphological operation for blood vessel detection and anisotropic diffusion filters were used for segmenting the optic disc. Nayak et al. [19] have detected exudates and blood vessels using Morphological operations, texture analysis, and for the identification of the progression of the disease they used artificial neural network (ANN).
2.2 Color
According to Abbadi et al. [8] claim that exudates can be found in fundus image by using specific color channels and then eliminating these from the fundus image as these are the main cause of blindness. Oktoeberza et al. have proposed a method using the red channel of the fundus image for the segmentation of the optic disc, where further operations are performed on the extracted channel [20].
2.3 Deep learning
Gulshan et al. [12] used a deep convolutional neural network or the automatic detection of DR and diabetic macular edema where the results were verified by ophthalmologist. Gargeya et al. [11] proposed a deep learning algorithm for the automatic detection of DR by using color fundus images by classifying the images as healthy or not healthy. Ting et al. [26] evaluate the performance of a deep learning system for detecting DR and related eye diseases against human evaluators. Doshi et al. [7] diagnose the severity (five stages) of DR using deep learning by using a GPU.
2.4 Other methods
Kumari et al. [17] proposed a method in which optic disc is extracted using propagation through the radii process and template matching is used to detect exudates. Dehghani et al. [5] used histogram specification for identifying the optic disc. Walter et al. [28] use morphological filtering and watershed transformation to detect the optic disk while, exudates are detected using high grey level variation ad the contours detected by using morphological reconstruction.
The method proposed in this paper uses various morphological operators on the red and green channels of the fundus images for extracting the morphological features while using a SVM classifier for assessing the progression/severity of diabetic retinopathy. The method is computationally inexpensive and is implemented using simple techniques using a non-invasive method. This method will help ophthalmologists to identify the disease quickly.
3 Detection and grading of diabetic retinopathy
The proposed methodology for the detection and grading of Diabetic Retinopathy (DR) is outlined in this section. Figure 2 gives the diagrammatic overview of the proposed methodology for the automatic detection and classification of DR using the fundus image database (diaretdb1_v_1_1 [6]) while Fig. 10 outlines an example for DR detection and severity classification, using the steps highlighted in Fig. 2. The fundus images are acquired from the publically available database for DR called the calibration level 1 fundus images. These images are pre-processed by inverting the green channel from the input image. The Canny edge detector is applied to the image for the detection of the different morphological features in the fundus image. Morphological operations such as dilation (Eq. 1) and erosion (Eq. 2) are applied to the resultant images for the detection and elimination of the exudates and microaneurysms.
The next step is to grade the detected abnormalities in the retinal images and decide whether the disease can be classified as mild or moderate using SVM.
3.1 Image acquisition
In this paper, the retinal fundus images used to examine and emulate the performance of the automatic detection system were retrieved from the open access database diaretdb1_v_1_1 [6]. The database consists of 84 colored fundus images in which 5 images are without any signs of abnormality and the rest of the images are affected by DR.
3.2 Contrast enhancement
Histogram equalization [30] has been used for the contrast enhancement of the retinal fundus images. This was done in order to regulate the image intensities and to improve disparity of light intensity. Black shades show higher intensity and white shades show low intensity in the binary image.
3.3 Feature extraction
In order to detect exudates and microaneurysms it is important to extract the blood vessels and optic disc. Exudates and the optic disc have a similar bright yellow color while, microaneursyms are similar to blood vessels resulting in the ophthalmologists not being able to effectively identify the disease and its progression.
3.3.1 Exudate detection
Exudate can be detected through the extraction of the optic disc. The optic disc has properties similar to those used as follows. The contrast of the input image is enhanced by inverting the green channel. The edges are detected using the Canny edge detector. The closing morphological operation was performed for enhancing the region of interest. Thresholding was performed for the segmentation of background. After segmentation of background gaps of exudate and optic disc are filled up and edges can be detected by using Canny edge detection. Then the (xy) axis mask is applied to the optic disk. Finally the optic disk is extracted and the exudates are detected as shown in Fig. 3.
3.3.2 Microaneurysms detection
Microaneurysms can be detected through the extraction of blood vessels by using the following method. The contrast of the fundus image is enhanced by inverting the green channel. Canny edge detection is performed on the red channel of the fundus image as this channel has a small dynamic range and the optic disc is the brightest part of the fundus image. Morphological operations are used to fill holes in the image and outline the boundaries of the different components of the fundus image. It is difficult to differentiate between microaneurysms and blood vessels’ boundary due to similar structures. The image boundary is subtracted from the Canny edge detected image, the resultant image would be without the boundary. Microaneurysms and undesirable relics can be obtained by the subtraction of unfilled gaps image from the image where the gaps have been filled and blood vessels can be detected by the subtraction of dilated image from the histogram image. After the detection of blood vessels Canny edge detection can be applied on the thresholded blood vessels. The Canny edge detected blood vessels image is subtracted from the without boundary image and the holes are filled. Finally, microaneurysms can be detected by the subtraction of microaneurysms and undesirable relic image from the image where the holes have been filled. Figure 4 outlines the steps for the detection of microaneurysms.
3.3.3 Addition of exudate and microaneurysms detection images
The images in which exudates and microaneurysms were detected are now added for the classification of the disease. Figure 5 shows the exudates and microaneurysms image.
3.4 Classification for grading DR
The exudates and microaneurysms image is used as an input to the support vector machine (SVM) classifier for the classification of the disease. SVM classifies the data by choosing the best separation line (hyperplane) that isolates data of one class from the data of the alternative class. SVM classifier labels the diseased and healthy part of the image by different values where −1 indicates the healthy part and + 1 indicates the diseased part. The classifier is used to evaluate training data to find the best way to identify the progression of DR, abnormality of a retinal fundus image as mild or moderate.
The classification results are shown in the Figs. 6, 7 and 8. These results have been confirmed by an Ophthalmologist. Figure 6 shows the fundus image of moderate NPDR along with the detected result, Fig. 7 shows the fundus image of mild NPDR along with the detected result, Fig. 8 shows the fundus image of a healthy retina along with the results using the proposed method.
After classification of the image the following result is obtained in which represents the healthy training data, represents the healthy classified data, the represents the abnormal training data, the represents the abnormal classified data and the support vector represent the data points that are nearest to the separating line; these data points are on the border of the block. Figure 9 shows the classification results.
4 Conclusions
The proposed method clearly distinguished the exudates and microaneurysms, from the optic disc and blood vessels. As the optic disc and blood vessels have similar properties in terms of intensity levels as that of microaneurysms and exudates, they are completely eliminated for the detection of diabetic retinopathy. The morphological operations of dilation and erosion along with Canny edge detector was used to detect the diabetic retinopathy effectively. The results of the detection of DR were used to identify the progression/severity of the disease by using the SVM classifier. The classifier was used to classify the retinal fundus image as i. healthy, ii. mild or iii. moderate case of DR helping the Ophthalmologists to decide the course of action to be taken for dealing with DR. The system further increases the clarity of the diagnosis of Diabetic Retinopathy in assisting the Ophthalmologists (Fig. 10).
In Table 1 TP denotes the true positives, TN denotes true negatives, FP denotes false positives, P denotes positive samples, N denotes negative samples and FN denotes false negatives. Using the formula given in Eqs. 3 and 4 the specificity and sensitivity are computed.
In the images 1 and 3 (Table 1) the sensitivity and specificity is 100%t that is in both of these images no abnormal areas were detected. In the image 2 the sensitivity is 57.2% and the specificity is 85.8%, so 57.2% area is detected as abnormal and 85.8% area is detected to be normal. Figure 6. (a) shows the original image of moderate NPDR and its corresponding result for the detection of NPDR using the proposed methodology is given in Fig.6. (b). In the image 6 the sensitivity is 53.3% and the specificity is 88.8% the results show that the disease is moderate as 7.2% area is detected as abnormal and 85.8% area is detected to be normal. Figure 7. (a) shows the original image for mild NPDR and its corresponding result for the detection of NPDR using the proposed methodology is given in Fig. 7. (b). Figure 8. (a) shows the original image of healthy eye and its corresponding result for the detection of NPDR using the proposed methodology is given in Fig. 8. (b). As shown in Table 2 the proposed method has outperformed all the other methods on the dataset [6] used for testing the proposed method of this paper.
The proposed method is applicable to the detection anomalies in manufactured items, naturally occurring tissues or any problem that requires extracting features of interest and severity detection of the anomalous nature of the detected features.
5 Future work
This research work will be used as a basis for formulating an automated system that would be implemented on hardware, in terms of a device which would be able to detect retinopathy by placing it on the eye. The device would be able to capture fundus images and process them according to the proposed work. The results would be communicated to the user through a change of status of indicator lights on the user panel if a case of retinopathy is detected and otherwise. The system that has been proposed would be cost effective so that health practitioners can identify cases of retinopathy more effectively and quickly. The aspect of confidentiality needs to be considered while designing the system, as the data might be shared over insecure networks and the possibility of breach of confidentiality of a patient needs to be tackled with methods as proposed by [2, 13] for securing the data while, the method proposed in [14] can be used to authenticate the images and their owners.
References
Akram UM, Khan SA (2012) Automated detection of dark and bright lesions in retinal images for early detection of diabetic retinopathy. J Med Syst 36(5):3151–3162
Alassaf N, Gutub A, Parah SA, Al Ghamdi M (2018) Enhancing speed of SIMON: a light-weight-cryptographic algorithm for IoT applications. Multimed Tools Appl 2018:1–25
Aquino A, Gegúndez-Arias ME, Marín D (2010) Detecting the optic disc boundary in digital fundus images using morphological, edge detection, and feature extraction techniques. IEEE Trans Med Imaging 29(11):1860–1869
Centers for Disease Control and Prevention, US Department of Health and Human Services (2011) National diabetes fact sheet: national estimates and general information on diabetes and prediabetes in the United States. Available from Accessed. 2012 Jul;3
Dehghani A, Moghaddam HA, Moin MS (2012) Optic disc localization in retinal images using histogram matching. EURASIP J Image Video Process 2012(1):19
DIARETDB1 (2016) Standard diabetic retinopathy database calibration level , Available at: “www2.it.lut.fi/project/imageret/diaretdb1/.” Accessed: 03- May- 2016.
Doshi D, Shenoy A, Sidhpura D, Gharpure P (2016) Diabetic retinopathy detection using deep convolutional neural networks. In 2016 International Conference on Computing, Analytics and Security Trends (CAST) 2016 Dec 19 (pp. 261-266). IEEE.
El Abbadi NK, Al-Saadi EH (2013) Automatic detection of exudates in retinal images. International Journal of Computer Science Issues (IJCSI) 10(2):237–242
Fleming AD, Philip S, Goatman KA, Williams GJ, Olson JA, Sharp PF (2007) Automated detection of exudates for diabetic retinopathy screening. Phys Med Biol 52(24):7385
Gandhi M, Dhanasekaran R. (2013) Diagnosis of diabetic retinopathy using morphological process and SVM classifier. In Communications and Signal Processing (ICCSP), International Conference on 2013 Apr 3 (pp. 873-877). IEEE
Gargeya R, Leng T (2017) Automated identification of diabetic retinopathy using deep learning. Ophthalmology. 124(7):962–969
Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, Venugopalan S, Widner K, Madams T, Cuadros J, Kim R, Raman R, Nelson PC, Mega JL, Webster DR (2016) Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA. 316(22):2402–2410
Gutub A, Al-Ghamdi M (2019) Image based steganography to facilitate improving counting-based secret sharing. 3D Res 10(1):6
Gutub A, Al-Juaid N (2018) Multi-bits stego-system for hiding text in multimedia images based on user security priority. Journal of Computer Hardware Engineering (JCHE) 1(2):1–9
Jose J, Kuruvilla J (2014) Detection of red lesions and hard exudates in color fundus images. Int J Eng Comput Sci 3(10):8583–8588
Kande GB, Savithri TS, Subbaiah PV (2010) Automatic detection of microaneurysms and hemorrhages in digital fundus images. J Digit Imaging 23(4):430–437
Kumari VV, SuriyaNarayanan N (2010) Diabetic retinopathy-early detection using Im-age processing techniques. Int J Comput Sci Eng 2(02):357–361
Li H, Chutatape O (2003, October) model-based approach for automated feature extraction in fundus images. In null (p. 394). IEEE
Nayak J, Bhat PS, Acharya R, Lim CM, Kagathi M (2008) Automated identification of diabetic retinopathy stages using digital fundus images. J Med Syst 32(2):107–115
Oktoeberza KW, Nugroho HA, Adji TB (2015) Optic disc segmentation based on red channel retinal fundus images. In: International Conference on Soft Computing, Intelligence Systems, and Information Technology 2015 Mar 11. Springer, Berlin, Heidelberg, pp 348–359
Priya R, Aruna P (2012) SVM and neural network based diagnosis of diabetic retinopathy. Int J Comput Appl 41(1)
Sanchez, C.I., Mayo, A., Garcia, M., Lopez, M.I. and Hornero, R., 2006. Automatic image processing algorithm to detect hard exudates based on mixture models. In 2006 International Conference of the IEEE Engineering in Medicine and Biology Society (pp. 4453-4456). IEEE
Sinthanayothin C, Boyce JF, Williamson TH, Cook HL, Mensah E, Lal S, Usher D (2002) Automated detection of diabetic retinopathy on digital fundus images. Diabet Med 19(2):105–112
Siva Sundhara Raja D, Vasuki S (2015) Automatic detection of blood vessels in retinal images for diabetic retinopathy diagnosis. Computational and Mathematical Methods in Medicine, 2015.
Sopharak A, Nwe KT, Moe YA, Dailey MN, Uyyanonvara B (2008) Automatic exudate detection with a naive Bayes classifier. In International Conference on Embedded Systems and Intelligent Technology (pp. 139-142)
Ting DS, Cheung CY, Lim G, Tan GS, Quang ND, Gan A, Hamzah H, Garcia-Franco R, San Yeo IY, Lee SY, Wong EY (2017) Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA 318(22):2211–2223
Tripathi S, Singh KK, Singh BK, Mehrotra A (2013) Automatic detection of exudates in retinal fundus images using differential morphological profile. Int J Eng Technol 5(3):2024–2029
Walter T, Klein JC, Massin P, Erginay A (2002) A contribution of image processing to the diagnosis of diabetic retinopathy-detection of exudates in color fundus images of the human retina. IEEE Trans Med Imaging 21(10):1236–1243
Yanoff M, Cameron D (2012) Diseases of the visual system. In Goldman-Cecil Medicine. 25th ed. Philadelphia, PA: Elsevier Saunders.
Zhu Y, Huang C (2012) An adaptive histogram equalization algorithm on the image gray level mapping. Phys Procedia 25:601–608
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Saman, G., Gohar, N., Noor, S. et al. Automatic detection and severity classification of diabetic retinopathy. Multimed Tools Appl 79, 31803–31817 (2020). https://doi.org/10.1007/s11042-020-09118-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-020-09118-8