Multi-feature machine learning model for automatic segmentation of green fractional vegetation cover for high-throughput field phenotyping
Tóm tắt
Accurately segmenting vegetation from the background within digital images is both a fundamental and a challenging task in phenotyping. The performance of traditional methods is satisfactory in homogeneous environments, however, performance decreases when applied to images acquired in dynamic field environments. In this paper, a multi-feature learning method is proposed to quantify vegetation growth in outdoor field conditions. The introduced technique is compared with the state-of the-art and other learning methods on digital images. All methods are compared and evaluated with different environmental conditions and the following criteria: (1) comparison with ground-truth images, (2) variation along a day with changes in ambient illumination, (3) comparison with manual measurements and (4) an estimation of performance along the full life cycle of a wheat canopy. The method described is capable of coping with the environmental challenges faced in field conditions, with high levels of adaptiveness and without the need for adjusting a threshold for each digital image. The proposed method is also an ideal candidate to process a time series of phenotypic information throughout the crop growth acquired in the field. Moreover, the introduced method has an advantage that it is not limited to growth measurements only but can be applied on other applications such as identifying weeds, diseases, stress, etc.
Tài liệu tham khảo
Araus JL, Li J, Parry MA, Wang J. Phenotyping and other breeding approaches for a New Green Revolution. J Integr Plant Biol. 2014;56(5):422–4.
Bai X, Cao Z, Wang Y, Yu Z, Hu Z, Zhang X, Li C. Vegetation segmentation robust to illumination variations based on clustering and morphology modelling. Biosyst Eng. 2014;125:80–97.
Bai XD, Cao ZG, Wang Y, Yu ZH, Zhang XF, Li CN. Crop segmentation from images by morphology modeling in the CIE L*a*b* color space. Comput Electron Agric. 2013;99:21–34.
Bergman L, Verikas A, Bacauskiene M. Unsupervised colour image segmentation applied to printing quality assessment. Image Vis Comput. 2005;23(4):417–25.
Bradski G. The OpenCV Library. Dr Dobb’s J Softw Tools Prof Program. 2000;25(11):120–3.
Casadesús J, Villegas D. Conventional digital cameras as a tool for assessing leaf area index and biomass for cereal breeding. J Integr Plant Biol. 2014;56(1):7–14.
Casadesus J, Kaya Y, Bort J, Nachit MM, Araus JL, Amor S, Ferrazzano G, Maalouf F, Maccaferri M, Martos V, Ouabbou H, Villegas D. Using vegetation indices derived from conventional digital cameras as selection criteria for wheat breeding in water-limited environments. Ann Appl Biol. 2007;150(2):227–36.
Coy A, Rankine D, Taylor M, Nielsen D, Cohen J. Increasing the accuracy and automation of fractional vegetation cover estimation from digital photographs. Remote Sens. 2016;8(7):474.
Elazab A, Bort J, Zhou B, Serret MD, Nieto-Taladriz MT, Araus JL. The combined use of vegetation indices and stable isotopes to predict durum wheat grain yield under contrasting water conditions. Agric Water Manag. 2015;158:196–208.
Fiala AC, Garman SL, Gray AN. Comparison of five canopy cover estimation techniques in the western Oregon Cascades. For Ecol Manag. 2006;232(1):188–97.
Gitelson AA, Kaufman YJ, Stark R, Rundquist D. Novel algorithms for remote estimation of vegetation fraction. Remote Sens Environ. 2002;80(1):76–87.
Guo W, Rage UK, Ninomiya S. Illumination invariant segmentation of vegetation for time series wheat images based on decision tree model. Comput Electron Agric. 2013;96:58.
Hamuda E, Glavin M, Jones E. A survey of image processing techniques for plant extraction and segmentation in the field. Comput Electron Agric. 2016;125:184–99.
Ho TK. The random subspace method for constructing decision forests. In: 2009 International conference on information and financial engineering (1998)
Hötter M. Object-oriented analysis–synthesis coding based on moving two-dimensional objects. Signal Process Image Commun. 1990;2(4):409–28.
Hunt ER Jr, Cavigelli M, Daughtry CST, Mcmurtrey JE III, Walthall CL. Evaluation of digital photography from model aircraft for remote sensing of crop biomass and nitrogen status. Precis Agric. 2005;6(4):359–78.
Jay S, Rabatel G, Hadoux X, Moura D, Gorretta N. In-field crop row phenotyping from 3D modeling performed using Structure from Motion. Comput Electron Agric. 2015;110:70–7.
Kataoka T, Kaneko T, Okamoto H. Crop growth estimation system using machine vision. Intell Mechatron. 2003;2:1079–83.
Lee KJ, Lee BW. Estimation of rice growth and nitrogen nutrition status using color digital camera image analysis. Eur J Agron. 2013;48:57–65.
Li Y, Chen D, Walker CN, Angus JF. Estimating the nitrogen status of crops using a digital camera. Field Crops Res. 2010;118(3):221–7.
Liu J, Pattey E. Retrieval of leaf area index from top-of-canopy digital photography over agricultural crops. Agric For Meteorol. 2010;150(11):1485–90.
Liu Y, Mu X, Wang H, Yan G. A novel method for extracting green fractional vegetation cover from digital images. J Veg Sci. 2012;23(3):406.
Meyer GE. Machine vision identification of plants. In: Recent trends for enhancing the diversity and quality of soybean products. Rijeka: InTech; 2011.
Meyer GE, Neto JC. Verification of color vegetation indices for automated crop imaging applications. Comput Electron Agric. 2008;63(2):282–93.
Meyer GE, Camargo Neto J, Jones DD, Hindman TW. Intensified fuzzy clusters for classifying plant, soil, and residue regions of interest from color images. Comput Electron Agric. 2004;42(3):161–80.
Otsu N. A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern. 1979;9(1):62–6.
Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E. Scikit-learn: machine learning in Python. J Mach Learn Res. 2011;12:2825–30.
Ray DK, Ramankutty N, Mueller ND, West PC, Foley JA. Recent patterns of crop yield growth and stagnation. Nat Commun. 2012;3:1293.
Song W, Mu X, Yan G, Huang S. Extracting the green fractional vegetation cover from digital images using a shadow-resistant algorithm (SHAR-LABFVC). Remote Sens. 2015;7(8):10,425–43.
Tian LF, Slaughter DC. Environmentally adaptive segmentation algorithm for outdoor image segmentation. Comput Electron Agric. 1998;21(3):153–68.
Virlet N, Sabermanesh K, Sadeghi-Tehran P, Hawkesford M. Field scanalyzer: an automated robotic field phenotyping platform for detailed crop monitoring. Funct Plant Biol. 2017;44(1):143–53.
Wang Y, Wang D, Zhang G, Wang J. Estimating nitrogen status of rice using the image segmentation of GR thresholding method. Field Crops Res. 2013;149:33–9.
Williamson SJ. Light and color in nature and art. Am J Phys. 1984;52(2):186.
Woebbecke DM, Woebbecke DM, Meyer GE, Bargen KV, Meyer GE, Mortensen DA, Von Bargen K. Color indices for weed identification under various soil, residue, and lighting conditions. Trans ASAE. 1995;38(1):259–69.
Yousfi S, Kellas N, Saidi L, Benlakehal Z, Chaou L, Siad D, Herda F, Karrou M, Vergara O, Gracia A, Araus JL, Serret MD. Comparative performance of remote sensing methods in assessing wheat performance under Mediterranean conditions. Agric Water Manag. 2016;164:137–47.
Yu K, Kirchgessner N, Grieder C, Walter A, Hund A. An image analysis pipeline for automated classification of imaging light conditions and for quantification of wheat canopy cover time series in field phenotyping. Plant Methods. 2017;13(1):635.
Zheng L, Shi D, Zhang J. Segmentation of green vegetation of crop canopy images based on mean shift and fisher linear discriminant. Pattern Recognit Lett. 2010;31:920.
Zhou B, Elazab A, Bort J, Vergara O, Serret MD, Araus JL. Low-cost assessment of wheat resistance to yellow rust through conventional RGB images. Comput Electron Agric. 2015;116:20–9.