Deep Learning Techniques in Leaf Image Segmentation and Leaf Species Classification: A Survey

Beikmohammadi, A., Faez, K., & Motallebi, A. (2022). SWP-LeafNET: A novel multistage approach for plant leaf identification based on deep CNN. Expert Systems with Applications, 202, 117470. https://doi.org/10.1016/j.eswa.2022.117470 Bell, J., Dee, H. M. (2019). Leaf segmentation through the classification of edges. Bhagat, S., Kokare, M., Haswani, V., et al. (2022). Ecological Informatics Eff-UNet ++: A novel architecture for plant leaf segmentation and counting. Ecological Informatics, 68, 101583. https://doi.org/10.1016/j.ecoinf.2022.101583 Cao, L., Li, H., Yu, H., et al. (2021). Plant leaf segmentation and phenotypic analysis based on fully convolutional neural network. Applied Engineering in Agriculture, 37, 929–940. https://doi.org/10.13031/AEA.14495 Cao, L., Li, H., Yu, H., et al. (2021). Plant leaf segmentation and phenotypic analysis based on fully convolutional neural network. Applied Engineering in Agriculture, 37, 929–940. https://doi.org/10.13031/AEA.14495 Carranza-Rojas, J., Gonzalez-Villanueva, R., Jimenez-Morales, K., et al. (2022). Extreme automatic plant identification under constrained resources. In CEUR workshop proceeding (vol. 3180, pp.2014–2024). Chen, D. H., Zhang, Z. W., Chang, T. R. (2019). Leaf segmentation and 3D reconstruction of ARAFIDOPSIS based on MASK R-CNN. In Proceedings–2019 8th international congress on advanced applied informatics IIAI-AAI (pp. 1073–1074). https://doi.org/10.1109/IIAI-AAI.2019.00232 Dudi, B., & Rajesh, V. (2022). A computer aided plant leaf classification based on optimal feature selection and enhanced recurrent neural network. Journal of Experimental & Theoretical Artificial Intelligence, 35, 1–35. https://doi.org/10.1080/0952813X.2022.2046178 Dudi, B., & Rajesh, V. (2022). Optimized threshold-based convolutional neural network for plant leaf classification: A challenge towards untrained data. Journal of Combinatorial Optimization, 43, 312–349. https://doi.org/10.1007/s10878-021-00770-w Espejo-Garcia, B., Mylonas, N., Athanasakos, L., et al. (2020). Towards weeds identification assistance through transfer learning. Computers and Electronics in Agriculture, 171, 105306. https://doi.org/10.1016/j.compag.2020.105306 Espejo-Garcia, B., Mylonas, N., Athanasakos, L., et al. (2021). Combining generative adversarial networks and agricultural transfer learning for weeds identification. Biosystems Engineering, 204, 79–89. https://doi.org/10.1016/j.biosystemseng.2021.01.014 Fawakherji, M., Youssef, A., Bloisi, D., et al. (2019). Crop and weeds classification for precision agriculture using context-independent pixel-wise segmentation. In 2019 3rd IEEE international conference on robotic computing (pp. 146–152). https://doi.org/10.1109/IRC.2019.00029 Giselsson, T. M., Jørgensen, R. N., Jensen, P. K., et al. (2017). A public image database for benchmark of plant seedling classification algorithms. Gogul, I., Kumar, V. S. (2017). Flower species recognition system using convolution neural networks and transfer learning. In 2017 4th international conference on signal processing, communication and networking (ICSCN) (pp. 1–6). https://doi.org/10.1109/ICSCN.2017.8085675 Goodfellow, I., Pouget-Abadie, J., Mirza, M., et al. (2020). Generative adversarial networks. Communications of the ACM, 63, 139–144. https://doi.org/10.1145/3422622 Guldenring, R., Boukas, E., Ravn, O., Nalpantidis, L. (2021). Few-leaf Learning: Weed segmentation in grasslands (pp. 3248–3254). https://doi.org/10.1109/iros51168.2021.9636770 Habiba, S. U., Islam, M. K., Ahsan, S. M. M. (2019). Bangladeshi plant recognition using deep learning based leaf classification. In 5th International conference on computer, communication, chemical, materials and electronic engineering IC4ME2 2019 (pp. 11–12). https://doi.org/10.1109/IC4ME247184.2019.9036515 He, K., Zhang, X., Ren, S., Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition. Heusel, M., Ramsauer, H., Unterthiner, T., et al. (2017). GANs trained by a two time-scale update rule converge to a local Nash equilibrium. Advances in neural information processing systems, 2017, 6627–6638. Hu, J., Chen, Z., Yang, M., et al. (2018). A multiscale fusion convolutional neural network for plant leaf recognition. IEEE Signal Processing Letters, 25, 853–857. https://doi.org/10.1109/LSP.2018.2809688 Hu, G., Yang, X., Zhang, Y., & Wan, M. (2019). Identification of tea leaf diseases by using an improved deep convolutional neural network. Sustainable Computing: Informatics and Systems, 24, 100353. https://doi.org/10.1016/j.suscom.2019.100353 Jasitha, P., DIleep, M. R., DIvya, M. (2019). Venation based plant leaves classification using GoogLeNet and VGG. In 2019 4th IEEE international conference on recent trends on electronics, information, communication & technology RTEICT 2019–Proceeding (pp. 715–719). https://doi.org/10.1109/RTEICT46194.2019.9016966 Kan, J., Gu, Z., Ma, C., Wang, Q. (2021). Leaf segmentation algorithm based on improved U-shaped network under complex background. In IMCEC 2021–IEEE 4th advanced information management, communicates, electronic and automation control conference 2021 (pp. 87–92). https://doi.org/10.1109/IMCEC51613.2021.9482382 Kumar, V., Arora, H., Sisodia, J. (2020). ResNet-based approach for detection and classification of plant leaf diseases. In Proceedings international conference on electronics and sustainable communication systems ICESC 2020 (pp. 495–502). https://doi.org/10.1109/ICESC48915.2020.9155585 Kumar, N., Belhumeur, P. N., Biswas, A., et al. (2012) Leafsnap: A Computer vision system for automatic plant species identification BT–computer vision. In ECCV 2012: 12th European Conference on Computer Vision, Florence, Italy, October 7–13, 2012, Proceedings, Part II (vol. 7573, pp. 502–516). https://doi.org/10.1007/978-3-642-33709-3_36 Lecun, Y., Aurelio, M., Google, R. (2013). Deep learning tutorial. In ICML. Lee, S. H., Chan, C. S., Wilkin, P., et al. (2015). Deep-plant: Plant identification with convolutional neural networks (pp. 452–456). Kingston University. Li, P., Gong, X., Hu, X., et al. (2019). Plant identification based on multi-branch convolutional neural network with attention. Communications in Computer and Information Science, 1043, 472–481. https://doi.org/10.1007/978-981-13-9917-6_45 Li, Y., Wen, W., Miao, T., et al. (2022). Automatic organ-level point cloud segmentation of maize shoots by integrating high-throughput data acquisition and deep learning. Computers and Electronics in Agriculture, 193, 106702. https://doi.org/10.1016/j.compag.2022.106702 Litjens, G., Sánchez, C. I., Timofeeva, N., et al. (2016). Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis. Science and Reports, 6, 1–11. https://doi.org/10.1038/srep26286 Liu, B., Tan, C., Li, S., et al. (2020). A data augmentation method based on generative adversarial networks for grape leaf disease identification. IEEE Access, 8, 102188–102198. https://doi.org/10.1109/ACCESS.2020.2998839 Madsen, S. L., Dyrmann, M., Jørgensen, R. N., & Karstoft, H. (2019). Generating artificial images of plant seedlings using generative adversarial networks. Biosystems Engineering, 187, 147–159. https://doi.org/10.1016/j.biosystemseng.2019.09.005 Malik, O. A., Ismail, N., Hussein, B. R., & Yahya, U. (2022). Automated real-time identification of medicinal plants species in natural environment using deep learning models—a case study from borneo region. Plants, 11, 1952. https://doi.org/10.3390/plants11151952 Morris, D. (2018). A pyramid CNN for dense-leaves segmentation. In Proceedings–2018 15th conference on computer and robot vision CRV 2018 (pp. 238–245). https://doi.org/10.1109/CRV.2018.00041 Muneer, A., & Fati, S. M. (2020). Efficient and automated herbs classification approach based on shape and texture features using deep learning. IEEE Access, 8, 196747–196764. https://doi.org/10.1109/ACCESS.2020.3034033 Ndikumana, E., Minh, D. H. T., Baghdadi, N., et al. (2018). Deep recurrent neural network for agricultural classification using multitemporal SAR Sentinel-1 for Camargue, France. Remote Sensing, 10, 1–16. https://doi.org/10.3390/rs10081217 Ngugi, L. C., Abelwahab, M., & Abo-Zahhad, M. (2020). Tomato leaf segmentation algorithms for mobile phone applications using deep learning. Computers and Electronics in Agriculture, 178, 105788. https://doi.org/10.1016/j.compag.2020.105788 Nikbakhsh, N., Baleghi, Y., & Agahi, H. (2021). A novel approach for unsupervised image segmentation fusion of plant leaves based on G-mutual information. Machine Vision and Applications, 32, 1–12. https://doi.org/10.1007/s00138-020-01130-0 Pan, S. J., & Yang, Q. (2010). A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22, 1345–1359. https://doi.org/10.1109/TKDE.2009.191 Praveen Kumar, J., & Dominic, S. (2020). Rosette plant segmentation with leaf count using orthogonal transform and deep convolutional neural network. Machine Vision and Applications, 31, 1–14. https://doi.org/10.1007/s00138-019-01056-2 Praveen Kumar, J., & Domnic, S. (2019). Image based leaf segmentation and counting in rosette plants. Information Processing in Agriculture, 6, 233–246. https://doi.org/10.1016/j.inpa.2018.09.005 Purbaya, M. E., Setiawan, N. A., Adji, T. B. (2018). Leaves image synthesis using generative adversarial networks with regularization improvement. In 2018 International conference on information and communications technology ICOIACT 2018-Janua (pp. 360–365). https://doi.org/10.1109/ICOIACT.2018.8350780 Sachar, S., & Kumar, A. (2021). Survey of feature extraction and classification techniques to identify plant through leaves. Expert Systems with Applications, 167, 114181. Shi, W., van de Zedde, R., Jiang, H., & Kootstra, G. (2019). Plant-part segmentation using deep learning and multi-view vision. Biosystems Engineering, 187, 81–95. https://doi.org/10.1016/j.biosystemseng.2019.08.014 Söderkvist, O. J. O. (2001). Computer vision classification of leaves from swedish trees (pp. 74). Sun, J., Zhao, J., Ding, Z. (2021). ULeaf-Net: Leaf segmentation network based on U-shaped symmetric encoder-decoder architecture (pp. 109–113). https://doi.org/10.1109/iscsic54682.2021.00030 Tan, J. W., Chang, S. W., Abdul-Kareem, S., et al. (2020). Deep learning for plant species classification using leaf vein morphometric. IEEE/ACM Trans Comput Biol Bioinforma, 17, 82–90. https://doi.org/10.1109/TCBB.2018.2848653 Tavakoli, H., Alirezazadeh, P., Hedayatipour, A., et al. (2021). Leaf image-based classification of some common bean cultivars using discriminative convolutional neural networks. Computers and Electronics in Agriculture, 181, 105935. https://doi.org/10.1016/j.compag.2020.105935 Triki, A., Bouaziz, B., Gaikwad, J., & Mahdi, W. (2021). Deep eaf: Mask R-CNN based leaf detection and segmentation from digitized herbarium specimen images. Pattern Recognition Letters, 150, 76–83. https://doi.org/10.1016/j.patrec.2021.07.003 Trivedi, M., & Gupta, A. (2021). Automatic monitoring of the growth of plants using deep learning-based leaf segmentation. International Journal of Applied Science and Engineering, 18, 1–9. https://doi.org/10.6703/IJASE.202106_18(2).003 Wäldchen, J., & Mäder, P. (2018). Plant species identification using computer vision techniques: A systematic literature review. Archives of Computational Methods in Engineering, 25, 507–543. https://doi.org/10.1007/s11831-016-9206-z Wang, B., & Wang, D. (2019). Plant leaves classification: A few-shot learning method based on siamese network. IEEE Access, 7, 151754–151763. https://doi.org/10.1109/ACCESS.2019.2947510 Ward, D., Moghadam, P., Hudson, N. (2019). Deep leaf segmentation using synthetic data. Weyler, J., Magistri, F., Seitz, P., et al. (2022). In-field phenotyping based on crop leaf and plant instance segmentation (pp. 2725–2734). Wu, S. G., Bao, F. S., Xu, E. Y., et al. (2007). A leaf recognition algorithm for plant classification using probabilistic neural network. In ISSPIT 2007–IEEE international symposium on signal processing and information technology (pp. 11–16). https://doi.org/10.1109/ISSPIT.2007.4458016 Wu, Q., Chen, Y., & Meng, J. (2020). Dcgan-based data augmentation for tomato leaf disease identification. IEEE Access, 8, 98716–98728. https://doi.org/10.1109/ACCESS.2020.2997001 Xiong, J., Yu, D., Liu, S., et al. (2021). A review of plant phenotypic image recognition technology based on deep learning. Electron, 10, 1–19. https://doi.org/10.3390/electronics10010081 Xu, L., Li, Y., Sun, Y., et al. (2018). Leaf instance segmentation and counting based on deep object detection and segmentation networks. In 2018 Joint 10th international conference on soft computing and intelligent systems (SCIS) and 19th international symposium on advanced intelligent systems SCIS-ISIS (pp. 180–185). https://doi.org/10.1109/SCIS-ISIS.2018.00038 Yang, K., Zhong, W., & Li, F. (2020). Leaf segmentation and classification with a complicated background using deep learning. Agronomy, 10, 1721. https://doi.org/10.3390/agronomy10111721 Zhu, Y., Aoun, M., Krijn, M., & Vanschoren, J. (2018). Data augmentation using conditional generative adversarial networks for leaf counting in arabidopsis plants. BMVC, 2018, 121–125. Zhu, W., Xie, L., Han, J., & Guo, X. (2020). The application of deep learning in cancer prognosis prediction. Cancers (Basel), 12, 1–19. https://doi.org/10.3390/cancers12030603