Abstract
Automated image classification is an essential task of the computer vision field. The tagging of images into a set of predefined groups is referred to as image classification. The implementation of computer vision to automate image classification would be beneficial because manual image evaluation and identification can be time-consuming, particularly when there are many images of different classes. Deep learning approaches are proven to overperform existing machine learning techniques in many fields in recent years, and computer vision is one of the most notable examples. The very deep neural network (VDCNN) is a powerful deep learning model for image classification, and this paper examines it briefly using MNIST handwritten digit dataset. This dataset is used to prove the efficacy of very deep neural networks over other deep learning models. The proposed study aims to comprehend the very deep neural network architecture used to accomplish a handwritten digit recognition task. The feasibility of the proposed model is evaluated using mean accuracy, validation accuracy, and standard deviation. The study results of the very deep neural network model are compared to a convolutional neural network and convolutional neural network with batch normalization. According to the results of the comparison study, very deep neural networks achieve high accuracy of 99.1% for a handwritten dataset. The outcome of the proposed work is used to interpret how well a very deep neural network performs when compared to the other two models of deep neural networks. This proposed architecture may be used to automate the classification of handwritten digits dataset.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Lu D, Weng Q (2007) A survey of image classification methods and techniques for improving classification performance. Int J Remote Sens 28(5):823–870
Ahlawat S, Choudhary A, Nayyar A, Singh S, Yoon B (2020) Improved handwritten digit recognition using convolutional neural networks (CNN). Sensors 20(12):3344
ElAdel A, Ejbali R, Zaied M, Amar CB (2015) Deep learning with shallow architecture for image classification. In: 2015 international conference on high performance computing and simulation (HPCS), IEEE, pp 408–412
Basha SS, Dubey SR, Pulabaigari V, Mukherjee S (2020) Impact of fully connected layers on performance of convolutional neural networks for image classification. Neurocomputing 378:112–119
Wang P, Fan E, Wang P (2021) Comparative analysis of image classification algorithms based on traditional machine learning and deep learning. Pattern Recogn Lett 141:61–67
Shamsuddin MR, Abdul-Rahman S, Mohamed A (2018) Exploratory analysis of MNIST handwritten digit for machine learning modelling. In: International conference on soft computing in data science. Springer, Singapore, pp 134–145
Palvanov A, Im Cho Y (2018) Comparisons of deep learning algorithms for MNIST in real-time environment. Int J Fuzzy Logic Intell Syst 18(2):126–134
LeCun Y, Cortes C, Burges JC (2010) MNIST handwritten digit database. AT&T Labs [Online]. Available: http://yann.lecun.com/exdb/mnist 2 (2010)
Potdar K, Pardawala TS, Pai CD (2017) A comparative study of categorical variable encoding techniques for neural network classifiers. Int J Comput Appl 175(4):7–9
Hackeling G (2017) Mastering machine learning with scikit-learn. Packt Publishing Ltd.
Han J, Kamber M, Pei J (2012) Data mining: concepts and techniques, Waltham MA. Morgan Kaufman Publishers 10:978–981
O’Shea K, Nash R (2015) An introduction to convolutional neural networks. arXiv preprint arXiv:1511.08458
Ciresan DC, Meier U, Gambardella LM, Schmidhuber J (2011) Convolutional neural network committees for handwritten character classification. In: 2011 International conference on document analysis and recognition, IEEE, pp 1135–1139
Simard PY, LeCun YA, Denker JS, Victorri B (1998) Transformation invariance in pattern recognition—tangent distance and tangent propagation. In: Neural networks: tricks of the trade. Springer, Berlin, Heidelberg, pp 239–274
Yang J, Yang G (2018) Modified convolutional neural network based on dropout and the stochastic gradient descent optimizer. Algorithms 11(3):28
Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International conference on machine learning. PMLR, pp 448–456
Santurkar S, Tsipras D, Ilyas A, Mądry A (2018) How does batch normalization help optimization? In: Proceedings of the 32nd international conference on neural information processing systems, pp. 2488–2498
Wang J, Li S, An Z, Jiang X, Qian W, Ji S (2019) Batch-normalized deep neural networks for achieving fast intelligent fault diagnosis of machines. Neurocomputing 329:53–65
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556
Hassannejad H, Matrella G, Ciampolini P, De Munari I, Mordonini M, Cagnoni S (2016) Food image recognition using very deep convolutional networks. In: Proceedings of the 2nd international workshop on multimedia assisted dietary management, pp 41–49
Wong TT, Yeh PY (2019) Reliable accuracy estimates from k-fold cross validation. IEEE Trans Knowl Data Eng 32(8):1586–1594
Xu G, Liu M, Jiang Z, Söffker D, Shen W (2019) Bearing fault diagnosis method based on deep convolutional neural network and random forest ensemble learning. Sensors 19(5):1088
Chugh A, Sharma VK, Kumar S, Nayyar A, Qureshi B, Bhatia MK, Jain C (2021) Spider monkey crow optimization algorithm with deep learning for sentiment classification and information retrieval. IEEE Access 9:24249–24262
Shekhawat SS, Sharma H, Kumar S, Nayyar A, Qureshi B (2021) bSSA: binary salp swarm algorithm with hybrid data transformation for feature selection. IEEE Access 9:14867–14882
Kayed M, Anter A, Mohamed H (2020) Classification of garments from fashion MNIST dataset using CNN LeNet-5 architecture. In: 2020 International conference on innovative trends in communication and computer engineering (ITCE), IEEE, pp 238–243
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Fathima, M.D., Hariharan, R., Ammal, M.S.S.R. (2022). Handwritten Digit Recognition Using Very Deep Convolutional Neural Network. In: Saraswat, M., Sharma, H., Balachandran, K., Kim, J.H., Bansal, J.C. (eds) Congress on Intelligent Systems. Lecture Notes on Data Engineering and Communications Technologies, vol 111. Springer, Singapore. https://doi.org/10.1007/978-981-16-9113-3_44
Download citation
DOI: https://doi.org/10.1007/978-981-16-9113-3_44
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-9112-6
Online ISBN: 978-981-16-9113-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)