A procedure for estimating the number of green mature apples in night-time orchard images using light distribution and its application to yield estimation

Springer Science and Business Media LLC - Tập 18 - Trang 59-75 - 2016
Raphael Linker1
1Faculty of Civil and Environmental Engineering, Technion – Israel Institute of Technology, Haifa, Israel

Tóm tắt

A procedure for estimating the number of mature apples in orchard images captured at night-time with artificial illumination was developed and its potential for estimating yield was investigated. The procedure was tested using four datasets totaling more than 800 images taken with cameras positioned at three heights. The procedure for detecting apples was based on the observation that the light distribution on apples follows a simple pattern in which the perceived light intensity decreases with the distance from a local maximum due to specular reflection. Accordingly, apple detection was achieved by detecting concentric circles (or parts of circles) in binary images obtained via threshold operations. For each dataset, after calibration of the procedure using 12 images, the estimates of the number of apples were within a few percent of the number of apples counted by visual inspection. Yield estimations were obtained via multi-linear models that used between two and six images per tree. The results obtained using all three cameras were only slightly better than those obtained using only two cameras. Using images from only one side of the tree did not worsen the results significantly. Overall, the yield estimated by the best models was within $$\pm$$ 10 % of the actual yield. However, the standard deviation of the yield estimation errors corresponded to ~26–37 % of the average tree yield, indicating that improvements are still needed in order to achieve accurate yield estimation at the single-tree level.

Tài liệu tham khảo

Atherton, T. J., & Kerbyson, D. J. (1999). Size invariant circle detection. Image and Vision Computing, 17, 795–803.

Cohen, O., Linker, R., Payne, A. & Walsh, K. (2014). Detection of fruit in canopy night-time images: Two case studies with apple and mango. In: Proceedings of the 12th International Conference on Precision Agriculture. ISPA, Monticello, IL, USA, Paper 1420. https://www.ispag.org/icpa/Proceedings

Gongal, A., Amatya, S., Karkee, M., Zhang, Q., & Lewis, K. (2015). Sensors and systems for fruit detection and localization: a review. Computers and Electronics in Agriculture, 116, 8–19.

Jiménez, A. R., Ceres, R., & Pons, J. L. (2000). A survey of computer vision methods for locating fruit on trees. Transactions of the ASAE, 43, 1911–1920.

Kapach, K., Barnea, E., Mairon, R., Edan, Y., & Ben Shahar, O. (2012). Computer vision for fruit harvesting robots—state of the art and challenges ahead. International Journal of Computer Vision and Robotics, 3, 4–34.

Kurtulmus, F., Lee, W. S., & Vardar, A. (2011). Green citrus detection using ‘eigenfruit’, color and circular gabor texture features under natural outdoor conditions. Computer and Electronics in Agriculture, 78, 140–149.

Linker, R., Cohen, O., & Naor, A. (2012). Determination of the number of green apples in RGB images recorded in orchards. Computers and Electronics in Agriculture, 81, 45–57.

Linker, R., & Kelman, E. (2015). Apple detection in nighttime tree images using the geometry of light patches around highlights. Computers and Electronics in Agriculture, 114, 154–162.

Linker, R., Kelman, E., & Cohen, O. (2015). Estimation of apple orchard yield using night time imaging. In Proceedings of the 10th European Conference on Precision Agriculture, 12–16 July 2015, Beit Dagan, Israel.

Payne, A., Walsh, K. B., Subedi, P., & Jarvis, D. (2013). Estimation of mango crop yield using image analysis–segmentation method. Computers and Electronics in Agriculture, 91, 57–64.

Payne, A., Walsh, K. B., Subedi, P., & Jarvis, D. (2014). Estimating mango crop yield using image analysis using fruit at ‘stone hardening’ stage and night time imaging. Computers and Electronics in Agriculture, 100, 160–167.

Pla, F., Juste, F., & Ferri, F. (1993). Feature extraction of spherical objects in image analysis: an application to robotic citrus harvesting. Computers and Electronics in Agriculture, 8, 57–72.

Silwal, A., Gongal, A., & Karkee, M. (2014). Apple identification in field environment with over-the- row machine vision system. Agriculture Engineering International: CIGR Journal, 6, 66–75.

Sites, A. & Delwiche, M.J. (1988). Computer vision to locate fruit on a tree. Paper No. 85-3039, ASAE, St Joseph, MI, USA.

Stajnko, D., Lakota, K., & Hocevar, M. (2004). Estimation of number and diameter of apple fruits in an orchard during the growing season by thermal imaging. Computers and Electronics in Agriculture, 42, 31–42.

Wang, Q., Nuske, S., Bergerman, M. & Singh, S. (2012). Automated crop yield estimation for apple orchards. In: Proceedings of the 13th International Symposium on Experimental Robotics. Quebec City, Canada.In: Desai, J.P., Dudek, G., Khatib, O., Kumar, V(Eds). pp: 745–758

Zhao, J., Tow, J. & Katupitiya, J. (2005). On-tree fruit recognition using texture properties and color data. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, (pp. 263–268).

Zhou, R., Damerow, L., Sun, Y., & Blanke, M. M. (2012). Using colour features of cv. ‘Gala’ apple fruits in an orchard in image processing to predict yield. Precision Agriculture, 13, 568–580.

Thông tin
Thông tin xuất bản

Springer Science and Business Media LLC

Tập 18

59-75

Thông tin tác giả