Grading Methods for Fruit Freshness Based on Deep Learning
Tóm tắt
Fruit freshness grading is an innate ability of humans. However, there was not much work focusing on creating a fruit grading system based on digital images in deep learning. The algorithm proposed in this article has the potentiality to be employed so as to avoid wasting fruits or save fruits from throwing away. In this article, we present a comprehensive analysis of freshness grading scheme using computer vision and deep learning. Our scheme for grading is based on visual analysis of digital images. Numerous deep learning methods are exploited in this project, including ResNet, VGG, and GoogLeNet. AlexNet is selected as the base network, and YOLO is employed for extracting the region of interest (ROI) from digital images. Therefore, we construct a novel neural network model for fruit detection and freshness grading regarding multiclass fruit classification. The fruit images are fed into our model for training, AlexNet took the leading position; meanwhile, VGG scheme performed the best in the validation.
Tài liệu tham khảo
Akinmusire O. Fungal species associated with the spoilage of some edible fruits in Maiduguri Northern Eastern Nigeria. Adv Environ Biol. 2011;5:157–62.
Rawat S. Food spoilage: microorganisms and their prevention. Asian J Plant Sci Res. 2015;5(4):47–56.
Tournas VH, Katsoudas E. Mould and yeast flora in fresh berries, grapes and citrus fruits. Int J Food Microbiol. 2005;105(1):11–7.
Sindhi K, Pandya J, Vegad S. Quality evaluation of apple fruit: a survey. Int J Comput Appl. 2016;975:8887.
Shukla AK. Electron spin resonance in food science. Cambridge: Academic Press; 2016.
Bhargava A, Bansal A. Fruits and vegetables quality evaluation using computer vision: a review. J King Saud Univ-Comput Inf Sci. 2018. https://doi.org/10.1016/j.jksuci.2018.06.002.
Pandey R, Naik S, Marfatia R. Image processing and machine learning for automated fruit grading system: a technical review. Int J Comput Appl. 2013;81(16):29–39.
Cunha JB (2003) Application of image processing techniques in the characterisation of plant leafs. In: IEEE International Symposium on Industrial Electronics, pp 612–616
Fu Y. Fruit freshness grading using deep learning (Master’s Thesis). New Zealand: Auckland University of Technology; 2020.
Koumpouros Y, Mahaman BD, Maliappis M, Passam HC, Sideridis AB, Zorkadis V. Image processing for distance diagnosis in pest management. Comput Electron Agric. 2004;44(2):121–31.
Brosnan T, Sun DW. Inspection and grading of agricultural and food products by computer vision systems—a review. Comput Electron Agric. 2002;36(2–3):193–213.
Tewari VK, Arudra AK, Kumar SP, Pandey V, Chandel NS. Estimation of plant nitrogen content using digital image processing. Agric Eng Int CIGR J. 2013;15(2):78–86.
Ozyildiz E, Krahnstöver N, Sharma R. Adaptive texture and color segmentation for tracking moving objects. Pattern Recogn. 2002;35(10):2013–29.
Tripathi MK, Maktedar DD. A role of computer vision in fruits and vegetables among various horticulture products of agriculture fields: a survey. Inf Process Agric. 2019;7:183.
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556
Krizhevsky A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural networks. Adv Neural Inf Process Syst. 2012;25:1097–105.
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, pp 770–778.
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Rabinovich A (2015) Going deeper with convolutions. In: IEEE Conference on Computer Vision and Pattern Recognition, pp 1–9.
Moallem P, Serajoddin A, Pourghassem H. Computer vision-based apple grading for golden delicious apples based on surface features. Inf Process Agric. 2017;4(1):33–40.
Arakeri MP. Computer vision based fruit grading system for quality evaluation of tomato in agriculture industry. Procedia Comput Sci. 2016;79:426–33.
Zawbaa HM, Abbass M, Hazman M, Hassenian AE (2014) Automatic fruit image recognition system based on shape and colour features. In: International Conference on Advanced Machine Learning Technologies and Applications, pp 278–290.
Iqbal Z, Khan MA, Sharif M, Shah JH, Rehman MH, Javed K. An automated detection and classification of citrus plant diseases using image processing techniques: a review. Comput Electron Agric. 2018;153:12–32.
Bresilla K, Perulli GD, Boini A, Morandi B, Grappadelli LC, Manfrini L. Single-shot convolution neural networks for real-time fruit detection within the tree. Front Plant Sci. 2019. https://doi.org/10.3389/fpls.2019.00611.
Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788.
Zeng G (2017) Fruit and vegetables classification system using image saliency and convolutional neural network. In: IEEE Information Technology and Mechatronics Engineering Conference (ITOEC), pp 613–617.
Mureşan H, Oltean M. Fruit recognition from images using deep learning. Acta Univ Sapientiae Inf. 2018;10(1):26–42.
Nashat AA, Hassan NH. Automatic segmentation and classification of olive fruits batches based on discrete wavelet transform and visual perceptual texture features. Int J Wavelets Multiresolut Inf Process. 2018;16(01):1850003.
Al-Sarayreha M, Reis M, Yan W, Klette R. Potential of deep learning and snapshot hyperspectral imaging for classification of species in meat. Food Science. 2020. https://doi.org/10.1016/j.foodcont.2020.107332.
Gómez-Sanchis J, Gómez-Chova L, Aleixos N, Camps-Valls G, Montesinos-Herrero C, Moltó E, Blasco J. Hyperspectral system for early detection of rottenness caused by Penicillium digitatum in Mandarins. J Food Eng. 2008;89(1):80–6.
Knee M. Anthocyanin, carotenoid, and chlorophyll changes in the peel of Cox’s Orange Pippin apples during ripening on and off the tree. J Exp Bot. 1972;23:184–96.
Davey MW, Stals E, Ngoh-Newilah G, Tomekpe K, Lusty C, Markham R, Keulemans J. Sampling strategies and variability in fruit pulp micronutrient contents of west and central African bananas and plantains (Musa species). J Agric Food Chem. 2007;55(7):2633–44.
Bampidis VA, Robinson PH. Citrus by-products as ruminant feeds: a review. Anim Feed Sci Technol. 2006;128(3–4):175–217.
Zheng Y, Yu C, Cheng YS, Zhang R, Jenkins B, VanderGheynst JS. Effects of ensilage on storage and enzymatic degradability of sugar beet pulp. Biores Technol. 2011;102(2):1489–95.
Herbach KM, Stintzing FC, Carle R. Betalain stability and degradation—structural and chromatic aspects. J Food Sci. 2006;71(4):R41–50.
Schwartz SJ, Von Elbe JH. Kinetics of chlorophyll degradation to pyropheophytin in vegetables. J Food Sci. 1983;48(4):1303–6.
Haeberli P, Voorhies D. Image processing by linear interpolation and extrapolation. IRIS Univ Mag. 1994;28:8–9.
Zhong Z, Zheng L, Kang G, Li S, Yang Y (2017) Random erasing data augmentation. arXiv:1708.04896
Everingham M, Van Gool L, Williams CK, Winn J, Zisserman A. The pascal visual object classes (VOC) challenge. Int J Comput Vision. 2010;88(2):303–38.
Redmon J, Farhadi A (2018) YOLOv3: an incremental improvement. arXiv:1804.02767.
Karakaya D, Ulucan O, Turkan M (2019) A comparative analysis on fruit freshness classification. In: Innovations in Intelligent Systems and Applications Conference
Yan W. Computational methods for deep learning: theoretic, practice and applications. Berlin: Springer; 2021.