Deep learning – Method overview and review of use for fruit detection and yield estimation

Computers and Electronics in Agriculture - Tập 162 - Trang 219-234 - 2019
Anand Koirala1, Kerry B. Walsh1, Zhenglin Wang1, Cheryl McCarthy2
1Central Queensland University, Rockhampton, Australia
2University of Southern Queensland, Toowoomba, Australia

Tóm tắt

Từ khóa


Tài liệu tham khảo

Annamalai, 2004, Burks TF Color vision system for estimating citrus yield in real-time, 1

Bargoti, S., Underwood, J., 2017a. Deep fruit detection in orchards. In: Proceedings – IEEE International Conference on Robotics and Automation, pp. 3626–3633. https://doi.org/10.1109/ICRA.2017.7989417.

Bargoti, 2017, Image segmentation for fruit detection and yield estimation in apple orchards, J. Field Rob., 34, 1039, 10.1002/rob.21699

Bay, 2006, Surf: speeded up robust features, 404

Chen, 2017, Counting apples and oranges with deep learning: a data-driven approach, IEEE Rob. Autom. Lett., 2, 781, 10.1109/LRA.2017.2651944

Cheng, 2017, Early yield prediction using image analysis of apple fruit and tree canopy features with neural networks, J. Imaging, 3, 6, 10.3390/jimaging3010006

Choi, 2015, Machine vision system for early yield estimation of citrus in a site-specific manner, 1

Chollet, F., 2017. Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258.

Cortes, 1995, Support-vector networks, Mach. Learn., 20, 273, 10.1007/BF00994018

Črtomir, 2012, Application of neural networks and image visualization for early forecast of apple yield, Erwerbs-Obstbau, 54, 69, 10.1007/s10341-012-0162-y

Dalal, N., Triggs, B., 2005. Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), 2005. pp. 886–893. https://doi.org/10.1109/CVPR.2005.177.

Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L., 2009. Imagenet: A large-scale hierarchical image database. In: Proceedings – IEE conference on Computer Vision and Pattern Recognition, pp. 248–255. https://doi.org/10.1109/CVPR.2009.5206848.

Everingham, 2010, The pascal visual object classes (voc) challenge, Int. J. Comput. Vision, 88, 303, 10.1007/s11263-009-0275-4

Girshick, R., 2015. Fast R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision. pp. 1440-1448. https://doi.org/10.1109/ICCV.2015.169.

Girshick, 2014, Rich feature hierarchies for accurate object detection and semantic segmentation, 580

Gongal, 2015, Sensors and systems for fruit detection and localization: a review, Comput. Electron. Agric., 116, 8, 10.1016/j.compag.2015.05.021

Habaragamuwa, 2018, Detecting greenhouse strawberries (mature and immature), using deep convolutional neural network, Eng. Agric. Environ. Food, 11, 127, 10.1016/j.eaef.2018.03.001

He, K., Gkioxari, G., Dollar, P., Girshick, R., 2017. Mask R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2980–2988. https://doi.org/10.1109/ICCV.2017.322.

He, 2014, Spatial pyramid pooling in deep convolutional networks for visual recognition, 346

He, 2015, Delving deep into rectifiers: surpassing human-level performance on ImageNet classification, 1026

He, 2016, Deep residual learning for image recognition, 770

Hu, J., Shen, L., Sun, G., 2017. Squeeze-and-excitation networks. arXiv preprint 7.

Hung, 2015, A feature learning based approach for automated fruit yield estimation, 485

Jiang, Z., Liu, C., Hendricks, N.P., Ganapathysubramanian, B., Hayes, D.J., Sarkar, S., 2018. Predicting County Level Corn Yields Using Deep Long Short Term Memory Models. arXiv preprint .

Kadir, 2015, Automatic mango detection using texture analysis and randomised hough transform, Appl. Math. Sci., 9, 6427

Kamilaris, 2018, Deep learning in agriculture: a survey, Comput. Electron. Agric., 147, 70, 10.1016/j.compag.2018.02.016

Kestur, 2019, MangoNet: a deep semantic segmentation architecture for a method to detect and count mangoes in an open orchard, Eng. Appl. Artif. Intell., 77, 59, 10.1016/j.engappai.2018.09.011

Koirala, 2019, Deep learning for real-time fruit detection and orchard fruit load estimation: benchmarking of 'MangoYOLO', Precis. Agric., 10.1007/s11119-019-09642-0

Krizhevsky, A., Sutskever, I., Hinton, G.E., 2012. ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105.

Kurtulmus, 2011, Green citrus detection using ‘eigenfruit’, color and circular Gabor texture features under natural outdoor conditions, Comput. Electron. Agric., 78, 140, 10.1016/j.compag.2011.07.001

Kuwata, 2015, Estimating crop yields with deep learning and remotely sensed data, 858

LeCun, 1998, Gradient-based learning applied to document recognition, Proc. IEEE, 86, 2278, 10.1109/5.726791

Liakos, 2018, Machine learning in agriculture: a review, Sensors, 18, 2674, 10.3390/s18082674

Liang, 2018, A real-time detection framework for on-tree mango based on SSD network, 423

Lin, 2014, Microsoft coco: common objects in context, 740

Lin, 2017, Focal loss for dense object detection, 2999

Liu, 2016, Ssd: Single shot multibox detector, 21

Liu, X., Chen, S.W., Aditya, S., Sivakumar, N., Dcunha, S., Qu, C., Taylor, C.J., Das, J., Kumar, V., 2018. Robust Fruit Counting: Combining Deep Learning, Tracking, and Structure from Motion. arXiv preprint .

Long, 2015, Fully convolutional networks for semantic segmentation, 3431

Lowe, 1999, Object recognition from local scale-invariant features, 1150

McCool, 2016, Upcroft B Visual detection of occluded crop: for automated harvesting, 2506

Mitchell, 1986, Pear fruit growth and the use of diameter to estimate fruit volume and weight, HortScience, 21, 1003, 10.21273/HORTSCI.21.4.1003

Moonrinta, J., Chaivivatrakul, S., Dailey, M.N., Ekpanyapong, M., 2010. Fruit detection, tracking, and 3D reconstruction for crop mapping and yield estimation. In: 11th International Conference on Control Automation Robotics & Vision, pp. 1181–1186. https://doi.org/10.1109/ICARCV.2010.5707436.

Mureşan, 2018, Fruit recognition from images using deep learning Acta Universitatis Sapientiae, Informatica, 10, 26

Naik, 2017, Machine vision based fruit classification and grading – a review, Int. J. Comput. Appl., 170, 22

Nanaa, 2014, Aziz AZA Detecting mango fruits by using randomized hough transform and backpropagation neural network, 388

Norris, 1996, History of NIR, J. Near Infrared Spectrosc., 4, 31, 10.1255/jnirs.941

Ojala, 1996, A comparative study of texture measures with classification based on featured distributions, Pattern Recogn., 29, 51, 10.1016/0031-3203(95)00067-4

Payne, 2013, Estimation of mango crop yield using image analysis–segmentation method, Comput. Electron. Agric., 91, 57, 10.1016/j.compag.2012.11.009

Peng, 2018, General improved SSD model for picking object recognition of multiple fruits in natural environment, Trans. Chin. Soc. Agric. Eng., 34, 155

Pothen, 2016, Texture-based fruit detection via images using the smooth patterns on the fruit, 5171

Rahman, 2018, Exploring the potential of high resolution worldview-3 imagery for estimating yield of mango, Remote Sens., 10, 1866, 10.3390/rs10121866

Rahnemoonfar, 2017, Deep count: fruit counting based on deep simulated learning, Sensors, 17, 10.3390/s17040905

Redmon, 2016, You only look once: unified, real-time object detection, 779

Redmon, J., Farhadi, A., 2017. YOLO9000: Better, Faster, Stronger. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7263–7271. https://doi.org/10.1109/CVPR.2017.690.

Redmon, J., Farhadi, A., 2018. YOLOv3: An Incremental Improvement. arXiv preprint .

Ren, S., He, K., Girshick, R., Sun, J., 2015. Faster R-CNN: Towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99.

Sa, 2016, Deepfruits: a fruit detection system using deep neural networks, Sensors, 16, 10.3390/s16081222

Sa, 2015, Perez T On visual detection of highly-occluded objects for harvesting automation in horticulture

Selvaraju, 2017, Grad-CAM: visual explanations from deep networks via gradient-based localization, 618

Sengupta, 2014, Identification and determination of the number of immature green citrus fruit in a canopy under different ambient light conditions, Biosyst. Eng., 117, 51, 10.1016/j.biosystemseng.2013.07.007

Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., LeCun, Y., 2013. Overfeat: Integrated recognition, localization and detection using convolutional networks. arXiv preprint .

Simonyan, K., Zisserman, A., 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint .

Song, 2014, Automatic fruit recognition and counting from multiple images, Biosyst. Eng., 118, 203, 10.1016/j.biosystemseng.2013.12.008

Stajnko, 2005, Modelling of apple fruit growth by application of image analysis, Agric. Conspectus Sci., 70, 59

Stajnko, 2009, Modelling apple fruit yield using image analysis for fruit colour, shape and texture, Eur. J. Horticult. Sci., 74, 260

Stein, 2016, Image based mango fruit detection, localisation and yield estimation using multiple view geometry, Sensors, 16, 10.3390/s16111915

Syal, 2013, A survey of computer vision methods for counting fruits and yield prediction, Int. J. Comput. Sci. Eng., 2, 346

Szegedy, 2015, Going deeper with convolutions, 1

Szegedy, C., Reed, S., Erhan, D., Anguelov, D., Ioffe, S., 2014. Scalable, high-quality object detection. arXiv preprint .

Tao, Y., Zhou, J., Wang, K., Shen, W., 2018. Rapid detection of fruits in orchard scene based on deep neural network. In: ASABE 2018 Annual International Meeting. https://doi.org/10.13031/aim.201801055.

Turk, 1991, Eigenfaces for recognition, J. Cognit. Neurosci., 3, 71, 10.1162/jocn.1991.3.1.71

Uijlings, 2013, Selective search for object recognition, Int. J. Comput. Vision, 104, 154, 10.1007/s11263-013-0620-5

Viola, 2001, Rapid object detection using a boosted cascade of simple features

Wachs, 2009, Bet-Dagan I Apple detection in natural tree canopies from multimodal images, 293

Wang, 2013, Automated crop yield estimation for apple orchards, vol. 88, 745

Wang, 2017, On-tree mango fruit size estimation using RGB-D images, Sensors, 17, 10.3390/s17122738

Xiong, 2018, Visual detection technology of green citrus under natural environment, Nongye Jixie Xuebao/Trans. Chin. Soc. Agric. Mach., 49, 45

You, 2017, Deep gaussian process for crop yield prediction based on remote sensing data, 4559

Zeiler, 2014, vol. 8689

Zeng, 2018, Crafting gbd-net for object detection, IEEE Trans. Pattern Anal. Mach. Intell., 40, 2109, 10.1109/TPAMI.2017.2745563

Zhao, 2016, Detecting tomatoes in greenhouse scenes by combining AdaBoost classifier and colour analysis, Biosyst. Eng., 148, 127, 10.1016/j.biosystemseng.2016.05.001

Zhou, 2012, Using colour features of cv. ‘Gala’apple fruits in an orchard in image processing to predict yield, Precis. Agric., 13, 568, 10.1007/s11119-012-9269-2