Abstract
Diet management is a key factor for the prevention and treatment of diet-related chronic diseases. Computer vision systems aim to provide automated food intake assessment using meal images. We propose a method for the recognition of already segmented food items in meal images. The method uses a 6-layer deep convolutional neural network to classify food image patches. For each food item, overlapping patches are extracted and classified and the class with the majority of votes is assigned to it. Experiments on a manually annotated dataset with 573 food items justified the choice of the involved components and proved the effectiveness of the proposed system yielding an overall accuracy of 84.9%.
Chapter PDF
Similar content being viewed by others
References
Chen, M., Dhingra, K., Wu, W., Yang, L., Sukthankar, R.,Yang, J.: PFID: Pittsburgh fast-food image dataset. In: 16th IEEE International Conference on Image Processing (2009)
Anthimopoulos, M., Dehais, J., Diem, P., Mougiakakou, S.: Segmentation and recognition of multi-food meal images for carbohydrate counting. In: IEEE BIBE (2013)
Aizawa, K., Maruyama, Y., He, L., Morikawa, C.: Food Balance Estimation by Using Personal Dietary Tendencies in a Multimedia Food Log. IEEE Transactions on Multimedia 15(8), 2176–2185 (2013)
Fengqing, Z., Bosch, M., Khanna, N., Boushey, C.J., Delp, E.J.: Multiple Hypotheses Image Segmentation and Classification With Application to Dietary Assessment. IEEE Journal of Biomedical and Health Informatics 19(1), 377–388 (2015)
Oliveira, L., Costa, V., Neves, G., Oliveira, T., Jorge, E., Lizarraga, M.: A mobile, lightweight, poll-based food identification system. Pattern Recognition 47, 1941–1952 (2014)
Chen, M.Y., Yang, Y.H., Ho, C.J., Wang, S.H., Liu, S.M., Chang, E., Yeh, C.H., Ouhyoung, M.: Automatic chinese food identification and quantity estimation. In: SIGGRAPH Asia 2012 (2012)
Matsuda, Y., Hoashi, H., Yanai, K.: Recognition of multiple-food images by detecting candidate regions. In: IEEE International Conference on Multimedia and Expo (2012)
Puri, M., Zhu, Z., Yu, Q., Divakaran, A., Sawhney, H.: Recognition and volume estimation of food intake using a mobile device. In: IEEE WACV, pp. 1–8 (2009)
Anthimopoulos, M.M., Gianola, L., Scarnato, L., Diem, P., Mougiakakou, S.G.: A Food Recognition System for Diabetic Patients Based on an Optimized Bag-of-Features Model. IEEE Journal of Biomedical and Health Informatics 18(4), 1261–1271 (2014)
Bettadapura, V., Thomaz, E., Parnami, A., Abowd, G.D., Essa, I.A.: Leveraging context to support automated food recognition in restaurants. In: WACV 2015, pp. 580−587 (2015)
Kawano, Y., Yanai, K.: Food image recognition with deep convolutional features. In: ACM UbiComp Workshop on Cooking and Eating Activities (CEA) (2014)
Beijbom, O., Joshi, N., Morris, D., Saponas, S., Khullar, S.: Menu-match: restaurant-specific food logging from images. In: 2015 IEEE Winter Conference on Applications of Computer Vision, pp. 844−851 (2015)
Kawano, Y., Yanai, K.: FoodCam: A real-time food recognition system on a smartphone. Multimedia Tools and Applications (2014)
Farinella, G.M., Moltisanti, M., Battiato, S.: Classifying food images represented as bag of textons. In: IEEE International Conference on Image Processing (ICIP), pp. 5212−5216 (2014)
Yang, S., Chen, M., Pomerleau, D., Sukthankar, R.: Food recognition using statistics of pairwise local features. In: CVPR 2010 (2010)
Nguyen, D.T., Zong, Z., Ogunbona, P., Probst, Y.C., Li, W.: Food image classification using local appearance and global structural information. Neurocomputing 140, 242–251 (2014)
Bossard, L., Guillaumin, M., Van Gool, L.: Food-101 – Mining discriminative components with random forests. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part VI. LNCS, vol. 8694, pp. 446–461. Springer, Heidelberg (2014)
Krizhevsky, A., Sutskever, I., Hinton, G.: ImageNet classification with deep convolutional neural networks. In: NIPS 2012 (2012)
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A.C., Fei-Fei, L.: ImageNet Large Scale Visual Recognition Challenge (2014)
Kagaya, H., Aizawa, K., Ogawa, K.: Food Detection and Recognition Using Convolutional Neural Network. ACM Multimedia, 1085−1088 (2014)
Hinton, G., Srivastava, N., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Improving neural networks by preventing co-adaptation of feature detectors. http://arxiv.org/abs/1207.0580
Yangqing, J.: Caffe: An open source convolutional architecture for fast feature embedding (2013). http://caffe.berkeleyvision.org
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Christodoulidis, S., Anthimopoulos, M., Mougiakakou, S. (2015). Food Recognition for Dietary Assessment Using Deep Convolutional Neural Networks. In: Murino, V., Puppo, E., Sona, D., Cristani, M., Sansone, C. (eds) New Trends in Image Analysis and Processing -- ICIAP 2015 Workshops. ICIAP 2015. Lecture Notes in Computer Science(), vol 9281. Springer, Cham. https://doi.org/10.1007/978-3-319-23222-5_56
Download citation
DOI: https://doi.org/10.1007/978-3-319-23222-5_56
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-23221-8
Online ISBN: 978-3-319-23222-5
eBook Packages: Computer ScienceComputer Science (R0)