Computer vision technology in agricultural automation —A review

Calabi-Floody M, Medina J, Rumpel C, et al. Smart fertilizers as a strategy for sustainable agriculture 2018;147: 119–57. Wang, 2019, A review on weed detection using ground-based machine vision and image processing techniques, Comput Electron Agric, 158, 226, 10.1016/j.compag.2019.02.005 Patrício, 2018, Computer vision and artificial intelligence in precision agriculture for grain crops: a systematic review, Comput Electron Agric, 153, 69, 10.1016/j.compag.2018.08.001 Ray, 2017, Internet of things for smart agriculture: technologies, practices and future direction, AIS, 9, 395, 10.3233/AIS-170440 Liakos, 2018, Machine learning in agriculture: a review, Sensors, 18, 1, 10.3390/s18082674 Bochtis, 2014, Advances in agricultural machinery management: a review, Biosyst Eng, 126, 69, 10.1016/j.biosystemseng.2014.07.012 Seema, Kumar A, Gill GS. Automatic fruit grading and classification system using computer vision: a review 2015;15:598–603. Rico-Fernández, 2019, A contextualized approach for segmentation of foliage in different crop species, Comput Electron Agric, 156, 378, 10.1016/j.compag.2018.11.033 Gomes, 2012, Applications of computer vision techniques in the agriculture and food industry: a review, Eur Food Res Technol, 235, 989, 10.1007/s00217-012-1844-2 Foglia, 2006, Agricultural robot for radicchio harvesting, J Field Rob, 23, 363, 10.1002/rob.20131 Mochida, 2019, Computer vision-based phenotyping for improvement of plant productivity: a machine learning perspective, GigaScience, 8, 1, 10.1093/gigascience/giy153 Vazquez-Arellano, 2016, 3-D imaging systems for agricultural applications – a review, Sensors, 16, 1, 10.3390/s16050618 Li, 2019, Underwater video mosaicing using topology and superpixel-based pairwise stitching, Expert Syst Appl, 119, 171, 10.1016/j.eswa.2018.10.041 Rehman, 2019, Current and future applications of statistical machine learning algorithms for agricultural machine vision systems, Comput Electron Agric, 156, 585, 10.1016/j.compag.2018.12.006 Daoliang, 2018, Agric 4.0 – the coming age of intelligent agriculture, J Agron, 42 Culman MA, Gomez JA, Talavera J, et al. A novel application for identification of nutrient deficiencies in oil palm using the internet of things 2017;32:169–172. Li, 2019, A far-red-emitting NaMgLaTeO6:Mn4+ phosphor with perovskite structure for indoor plant growth, Dyes Pigm, 162, 214, 10.1016/j.dyepig.2018.09.084 Choudhury SD, Goswami S, Bashyam S, et al. Automated stem angle determination for temporal plant phenotyping analysis 2017;237:2022–29. Farago, 2018, PlantSize offers an affordable, non-destructive method to measure plant size and color in vitro, Front Plant Sci, 9, 219, 10.3389/fpls.2018.00219 Pérez-Zavala, 2018, A pattern recognition strategy for visual grape bunch detection in vineyards, Comput Electron Agric, 151, 136, 10.1016/j.compag.2018.05.019 Fahmi, 2018, Image processing analysis of geospatial uav orthophotos for palm oil plantation monitoring, J Phys Conf Ser, 978, 012064, 10.1088/1742-6596/978/1/012064 Bordoni, 2017, Ancient wheat and health: a legend or the reality? A review on KAMUT khorasan wheat, Int J Food Sci Nutr, 68, 278, 10.1080/09637486.2016.1247434 Sun, 2018, Utilization of machine vision to monitor the dynamic responses of rice leaf morphology and colour to nitrogen, phosphorus, and potassium deficiencies, J Spectroscopy, 2018, 1, 10.1155/2018/1469314 Zhu, 2016, In-field automatic observation of wheat heading stage using computer vision, Biosyst Eng, 143, 28, 10.1016/j.biosystemseng.2015.12.015 Sadeghi-Tehran, 2017, Automated method to determine two critical growth stages of wheat: heading and flowering, Front Plant Sci, 8, 252, 10.3389/fpls.2017.00252 Ma, 2019, A segmentation method for processing greenhouse vegetable foliar disease symptom images, Inform Process Agric, 6, 216 Ip, 2018, Big data and machine learning for crop protection, Comput Electron Agric, 151, 376, 10.1016/j.compag.2018.06.008 Ramcharan, 2019, A mobile-based deep learning model for cassava disease diagnosis, Front Plant Sci, 10, 1, 10.3389/fpls.2019.00272 Akram, 2017, Towards real-time crops surveillance for disease classification: exploiting parallelism in computer vision, Comput Electr Eng, 59, 15, 10.1016/j.compeleceng.2017.02.020 Maharlooei, 2017, Detection of soybean aphids in a greenhouse using an image processing technique, Comput Electron Agric, 132, 63, 10.1016/j.compag.2016.11.019 Liu, 2018, A multispectral machine vision system for invertebrate detection on green leaves, Comput Electron Agric, 150, 279, 10.1016/j.compag.2018.05.002 Zhong, 2018, A vision-based counting and recognition system for flying insects in intelligent agriculture, Sensors, 18, 1, 10.3390/s18051489 Xiaolong, 2017, Development of automatic counting system for urediospores of wheat stripe rust based on image processing, Int J Agric Biol Eng, 10, 134, 10.25165/j.ijabe.20171005.3084 Wang, 2017, Automatic image-based plant disease severity estimation using deep learning, Comput Intell Neurosci, 2017, 2917536, 10.1155/2017/2917536 Toseef, 2018, An intelligent mobile application for diagnosis of crop diseases in Pakistan using fuzzy inference system, Comput Electron Agric, 153, 1, 10.1016/j.compag.2018.07.034 Sabzi, 2018, A fast and accurate expert system for weed identification in potato crops using metaheuristic algorithms, Comput Ind, 98, 80, 10.1016/j.compind.2018.03.001 Zhai, 2018, A mission planning approach for precision farming systems based on multi-objective optimization, Sensors, 18, 1, 10.3390/s18061795 Chang, 2018, Smart agricultural machine with a computer vision-based weeding and variable-rate irrigation scheme, Robotics, 7, 38, 10.3390/robotics7030038 Khan, 2018, Modern trends in hyperspectral image analysis: a review, IEEE Access, 6, 14118, 10.1109/ACCESS.2018.2812999 Ramin Shamshiri, 2018, Research and development in agricultural robotics: a perspective of digital farming, Int J Agric Biol Eng, 11, 1 Noble, 1997, Influence of mushroom strains and population density on the performance of a robotic harvester, J agric Engng Res, 68, 215, 10.1006/jaer.1997.0195 Chen Guizhen, 2015, Application of computer vision and pattern recognition technology in agricultural production, Jiangsu Agric Sci, 43, 409 Yuan Ting, 2009, Information acquisition of cucumber fruit in greenhouse environment based on nearing infrared image, Spectrosc Spect Anal, 29, 2054 Zhang, 2017, Cherry recognition in natural environment based on the vision of picking robot, IOP Conf Ser: Earth Environ Sci, 61, 012021, 10.1088/1755-1315/61/1/012021 Christopher McCool IS, Feras Dayoub, Christopher Lehnert, Tristan Perez, and Ben Upcroft. Visual detection of occluded crop: for automated harvesting. In: International conference on robotics and automation (ICRA) 2016;2506–12. Zhu, 2018, Design oApple-Picking End Effector, Strojniški vestnik – J Mech Eng, 4, 216 Joseph, 2016, Proof-of-concept of a robotic apple harvester, 952 Ji Wei, 2018, A nighttime image enhancement method based on Retinex and guided filter for object recognition of apple harvesting robot, Res Art, 1 Tejada, 2017, Proof-of-concept robot platform for exploring automated harvesting of sugar snap peas, Precis Agric, 18, 952, 10.1007/s11119-017-9538-1 Pereira, 2017, Recent advances in image processing techniques for automated harvesting purposes: a review, Intell Syst Conf, 566 Gongal, 2015, Sensors and systems for fruit detection and localization: a review, Comput Electron Agric, 116, 8, 10.1016/j.compag.2015.05.021 Hossain, 2019, Automatic fruit classification using deep learning for industrial applications, IEEE Trans Ind Inf, 15, 1027, 10.1109/TII.2018.2875149 Kuang, 2015, Multi-class fruit detection based on multiple color channels, 1 Mohammadi Baneh, 2018, Mechatronic components in apple sorting machines with computer vision, J Food Meas Charact, 12, 1135, 10.1007/s11694-018-9728-1 Mahajan, 2015, Image acquisition techniques for assessment of legume quality, Trends Food Sci Technol, 42, 116, 10.1016/j.tifs.2015.01.001 Deng HD, 2017, A carrot sorting system using machine vision technique, Appl Eng Agric, 33, 149, 10.13031/aea.11549 Firouzjaei, 2018, Sweet lemon mechanical damage detection using image processing technique and UV radiation, J Food Meas Charact, 12, 1513, 10.1007/s11694-018-9766-8 Kim MS, Chao K, Chin BA, et al. Nondestructive and rapid detection of potato black heart based on machine vision technology. 2016;9864:98640T. Iraji, 2018, Comparison between soft computing methods for tomato quality grading using machine vision, J Food Meas Charact, 13, 1, 10.1007/s11694-018-9913-2 Wang, 2018, SeeFruits: design and evaluation of a cloud-based ultra-portable NIRS system for sweet cherry quality detection, Comput Electron Agric, 152, 302, 10.1016/j.compag.2018.07.017 Wang, 2018, Application of deep learning architectures for accurate and rapid detection of internal mechanical damage of blueberry using hyperspectral transmittance data, Sensors, 18, 1 Su, 2018, Potato quality grading based on machine vision and 3D shape analysis, Comput Electron Agric, 152, 261, 10.1016/j.compag.2018.07.012 Kamilaris, 2018, A review of the use of convolutional neural networks in agriculture, J Agric Sci, 156, 312, 10.1017/S0021859618000436 Kim, 2016, The study of MP-MAS utilization to support decision-making for climate-smart agriculture in rice farming, Korean J Agric Forest Meteorol, 18, 378, 10.5532/KJAFM.2016.18.4.378 Demattê, 2018, Geospatial Soil Sensing System (GEOS3): a powerful data mining procedure to retrieve soil spectral reflectance from satellite images, Remote Sens Environ, 212, 161, 10.1016/j.rse.2018.04.047 Sudarsan, 2016, Microscope-based computer vision to characterize soil texture and soil organic matter, Biosyst Eng, 152, 41, 10.1016/j.biosystemseng.2016.06.006 Koech, 2018, Improving irrigation water use efficiency: a review of advances, challenges and opportunities in the Australian context, Water, 10, 1771, 10.3390/w10121771 González-Esquiva, 2017, Development of a visual monitoring system for water balance estimation of horticultural crops using low cost cameras, Comput Electron Agric, 141, 15, 10.1016/j.compag.2017.07.001 Ranjan, 2019, Irrigated pinto bean crop stress and yield assessment using ground based low altitude remote sensing technology, Inform Process Agric, 6, 502 Michael Halstead, 2018, Fruit quantity and ripeness estimation using a robotic vision system, IEEE Robot Automat Lett, 2995, 10.1109/LRA.2018.2849514 Wan, 2018, A methodology for fresh tomato maturity detection using computer vision, Comput Electron Agric, 146, 43, 10.1016/j.compag.2018.01.011 Maldonado, 2016, Automatic green fruit counting in orange trees using digital images, Comput Electron Agric, 127, 572, 10.1016/j.compag.2016.07.023 Gutiérrez, 2019, Ground based hyperspectral imaging for extensive mango yield estimation, Comput Electron Agric, 157, 126, 10.1016/j.compag.2018.12.041 Radcliffe, 2018, Machine vision for orchard navigation, Comput Ind, 98, 165, 10.1016/j.compind.2018.03.008 Bhange, 2015, Smart farming: pomegranate disease detection using image processing, Procedia Comput Sci, 58, 280, 10.1016/j.procs.2015.08.022 JiJingChun, 2019, Application progress of unmanned aerial vehicle remote sensing in farmland information monitoring, J Soil, 56, 773 Yonah, 2018, Unmanned aerial vehicle-based remote sensing in monitoring smallholder, heterogeneous crop fields in Tanzania, Int J Remote Sens, 39, 5453, 10.1080/01431161.2018.1455241 Yao, 2019, Unmanned aerial vehicle for remote sensing applications—a review, Remote Sens, 11, 1443, 10.3390/rs11121443 Wei, 2019, Spatial-spectral fusion based on conditional random fields for the fine classification of crops in UAV-borne hyperspectral remote sensing imagery, Remote Sens, 11, 780, 10.3390/rs11070780 Zheng, 2019, Technology adoption among farmers in Jilin Province, China, China Agric Econ Rev, 11, 206, 10.1108/CAER-11-2017-0216 Watanabe, 2017, High-throughput phenotyping of sorghum plant height using an unmanned aerial vehicle and its application to genomic prediction modeling, Front Plant Sci, 8, 1, 10.3389/fpls.2017.00421 Tucci, 2019, Multi-sensor UAV application for thermal analysis on a dry-stone terraced vineyard in rural tuscany landscape, ISPRS Int J Geo-Inf, 8, 87, 10.3390/ijgi8020087 Teske, 2018, Prediction of aerial spray release from UAVs, Trans ASABE, 61, 909, 10.13031/trans.12701 Sanches, 2018, The potential for RGB images obtained using unmanned aerial vehicle to assess and predict yield in sugarcane fields, Int J Remote Sens, 39, 5402, 10.1080/01431161.2018.1448484 Rueda-Ayala, 2019, Comparing UAV-based technologies and RGB-D reconstruction methods for plant height and biomass monitoring on grass ley, Sensors, 19, 1, 10.3390/s19030535 Han, 2019, Modeling maize above-ground biomass based on machine learning approaches using UAV remote-sensing data, Plant Methods, 15, 10, 10.1186/s13007-019-0394-z Niu, 2019, Estimating above-ground biomass of maize using features derived from UAV-based RGB imagery, Remote Sens, 11, 1261, 10.3390/rs11111261 Chebrolu, 2018, Robust long-term registration of UAV images of crop fields for precision agriculture, IEEE Rob Autom Lett, 3, 3097, 10.1109/LRA.2018.2849603 Sa, 2018, WeedMap: a large-scale semantic weed mapping framework using aerial multispectral imaging and deep neural network for precision farming, Remote Sens, 10, 1423, 10.3390/rs10091423 Saldana Ochoa, 2019, A framework for the management of agricultural resources with automated aerial imagery detection, Comput Electron Agric, 162, 53, 10.1016/j.compag.2019.03.028 Liu, 2019, Development of a positioning system using UAV-based computer vision for an airboat navigation in paddy field, Comput Electron Agric, 162, 126, 10.1016/j.compag.2019.04.009 Hunt, 2017, What good are unmanned aircraft systems for agricultural remote sensing and precision agriculture?, Int J Remote Sens, 39, 5345, 10.1080/01431161.2017.1410300 Marques, 2019, UAV-based automatic detection and monitoring of chestnut trees, Remote Sens, 11, 855, 10.3390/rs11070855 Enciso, 2019, Validation of agronomic UAV and field measurements for tomato varieties, Comput Electron Agric, 158, 278, 10.1016/j.compag.2019.02.011 Souza, 2017, Mapping skips in sugarcane fields using object-based analysis of unmanned aerial vehicle (UAV) images, Comput Electron Agric, 143, 49, 10.1016/j.compag.2017.10.006 Shi, 2019, Decision support system for variable rate irrigation based on UAV multispectral remote sensing, Sensors, 19, 1, 10.3390/s19132880 Nhamo, 2018, Improving the accuracy of remotely sensed irrigated areas using post-classification enhancement through UAV capability, Remote Sens, 10, 712, 10.3390/rs10050712 Ouyang, 2019, Automatic delivery and recovery system of Wireless Sensor Networks (WSN) nodes based on UAV for agricultural applications, Comput Electron Agric, 162, 31, 10.1016/j.compag.2019.03.025 Kattenborn, 2019, UAV data as alternative to field sampling to map woody invasive species based on combined Sentinel-1 and Sentinel-2 data, Remote Sens Environ, 227, 61, 10.1016/j.rse.2019.03.025 Adão, 2017, Hyperspectral imaging: a review on UAV-based sensors, data processing and applications for agriculture and forestry, Remote Sens, 9, 1110, 10.3390/rs9111110 Sharif, 2018, Detection and classification of citrus diseases in agriculture based on optimized weighted segmentation and feature selection, Comput Electron Agric, 150, 220, 10.1016/j.compag.2018.04.023 Yi Un, 2018, Reflections on the construction of grass-roots young agricultural talents in the process of agricultural modernization, Modern Rural Sci Technol, 9, 1 Shaozhong, 2018, Foresight of disruptive technologies in agricultural engineering, Chinese J Eng Sci, 20, 57, 10.15302/J-SSCAE-2018.06.009 Mingyang, 2018, Discussion on computer vision technology in agricultural automation, J Agric Mech Res, 1 Wenying, 2018, Application of computer vision technology in agriculture, Modern Rural Sci Technol, 3, 1 Gomiero, 2018, Agriculture and degrowth: state of the art and assessment of organic and biotech-based agriculture from a degrowth perspective, J Cleaner Prod, 197, 1823, 10.1016/j.jclepro.2017.03.237 Ding, 2018, Model predictive control and its application in agriculture: a review, Comput Electron Agric, 151, 104, 10.1016/j.compag.2018.06.004 Colantoni, 2018, Smart machines, remote sensing, precision farming, processes, mechatronic, materials and policies for safety and health aspects, Agriculture, 8, 47, 10.3390/agriculture8040047 Ampatzidis, 2017, iPathology: robotic applications and management of plants and plant diseases, Sustainability, 9, 1010, 10.3390/su9061010 Shi, 2019, General review of intelligent agriculture development in China, China Agric Econ Rev, 11, 39, 10.1108/CAER-05-2017-0093 Chen, 2018, Significance of cultivation of new agricultural management subjects for the development goal of modern agriculture: a perspective review, IOP Conf Ser: Earth Environ Sci, 185, 012030, 10.1088/1755-1315/185/1/012030 Yang, 2017, Botanical internet of things: toward smart indoor farming by connecting people, plant, data and clouds, Mobile Netw Appl, 23, 188, 10.1007/s11036-017-0930-x Jessica Lindblom, 2016, Promoting sustainable intensification in precision agriculture: review of decision support systems development and strategies, Precis Agric, 1 Singh, 2018, Deep learning for plant stress phenotyping: trends and future perspectives, Trends Plant Sci, 23, 883, 10.1016/j.tplants.2018.07.004