nach oben

Wireless Personal Communications

Erschienen in:

22.02.2024

Deep Learning Techniques in Leaf Image Segmentation and Leaf Species Classification: A Survey

verfasst von: Anuj Kumar, Silky Sachar

Erschienen in: Wireless Personal Communications | Ausgabe 4/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Plants have elemental importance for all life forms. The research areas in the field of plant sciences for botanists and agriculturists include the identification of plant species, classification of weeds from crops, detection of various diseases that hamper the growth of plant, and monitoring the growth and its semantic interpretation. Trained botanists can easily identify plant species based on the leaf shape, texture, structure or arrangement of leaves, however, the recent trend in smart agriculture demands the use of intelligent systems for the same task. Last decade has seen an enormous rise in the use of deep learning in the field of automatic plant species recognition based on the leaf images. In this work, we have surveyed various state-of-the-art deep learning techniques (Convolutional Neural Networks, Mask RCNN, Recurrent Neural Networks, Generative Adversarial Networks) that have been applied in the field of leaf image segmentation (separation of leaf from the whole image) and classification of leaves into various species. This contribution will help the new researchers in the field to get a foundation on the trends being employed in deep learning for generation of synthetic leaf images, segmentation and classification of leaves into various species. Various difficulties and future scope have also been presented.

Vorheriger Artikel Optimum Piezo-Electric Based Energy Harvesting for Low-Power Wireless Networks with Power Complexity Considerations

Nächster Artikel Performance Comparison of 2 × 120 OAM Polarized Hybrid Multiplexed FSO System in Heavy Rain and Wet-Snow Weather Conditions

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Beikmohammadi, A., Faez, K., & Motallebi, A. (2022). SWP-LeafNET: A novel multistage approach for plant leaf identification based on deep CNN. Expert Systems with Applications, 202, 117470. https://doi.org/10.1016/j.eswa.2022.117470CrossRef

Bell, J., Dee, H. M. (2019). Leaf segmentation through the classification of edges.

Bhagat, S., Kokare, M., Haswani, V., et al. (2022). Ecological Informatics Eff-UNet ++: A novel architecture for plant leaf segmentation and counting. Ecological Informatics, 68, 101583. https://doi.org/10.1016/j.ecoinf.2022.101583CrossRef

Cao, L., Li, H., Yu, H., et al. (2021). Plant leaf segmentation and phenotypic analysis based on fully convolutional neural network. Applied Engineering in Agriculture, 37, 929–940. https://doi.org/10.13031/AEA.14495CrossRef

Carranza-Rojas, J., Gonzalez-Villanueva, R., Jimenez-Morales, K., et al. (2022). Extreme automatic plant identification under constrained resources. In CEUR workshop proceeding (vol. 3180, pp.2014–2024).

Chen, D. H., Zhang, Z. W., Chang, T. R. (2019). Leaf segmentation and 3D reconstruction of ARAFIDOPSIS based on MASK R-CNN. In Proceedings–2019 8th international congress on advanced applied informatics IIAI-AAI (pp. 1073–1074). https://doi.org/10.1109/IIAI-AAI.2019.00232

Dudi, B., & Rajesh, V. (2022). A computer aided plant leaf classification based on optimal feature selection and enhanced recurrent neural network. Journal of Experimental & Theoretical Artificial Intelligence, 35, 1–35. https://doi.org/10.1080/0952813X.2022.2046178CrossRef

Dudi, B., & Rajesh, V. (2022). Optimized threshold-based convolutional neural network for plant leaf classification: A challenge towards untrained data. Journal of Combinatorial Optimization, 43, 312–349. https://doi.org/10.1007/s10878-021-00770-wMathSciNetCrossRef

10.

Espejo-Garcia, B., Mylonas, N., Athanasakos, L., et al. (2020). Towards weeds identification assistance through transfer learning. Computers and Electronics in Agriculture, 171, 105306. https://doi.org/10.1016/j.compag.2020.105306CrossRef

11.

Espejo-Garcia, B., Mylonas, N., Athanasakos, L., et al. (2021). Combining generative adversarial networks and agricultural transfer learning for weeds identification. Biosystems Engineering, 204, 79–89. https://doi.org/10.1016/j.biosystemseng.2021.01.014CrossRef

12.

Fawakherji, M., Youssef, A., Bloisi, D., et al. (2019). Crop and weeds classification for precision agriculture using context-independent pixel-wise segmentation. In 2019 3rd IEEE international conference on robotic computing (pp. 146–152). https://doi.org/10.1109/IRC.2019.00029

13.

Giselsson, T. M., Jørgensen, R. N., Jensen, P. K., et al. (2017). A public image database for benchmark of plant seedling classification algorithms.

14.

Gogul, I., Kumar, V. S. (2017). Flower species recognition system using convolution neural networks and transfer learning. In 2017 4th international conference on signal processing, communication and networking (ICSCN) (pp. 1–6). https://doi.org/10.1109/ICSCN.2017.8085675

15.

Goodfellow, I., Pouget-Abadie, J., Mirza, M., et al. (2020). Generative adversarial networks. Communications of the ACM, 63, 139–144. https://doi.org/10.1145/3422622CrossRef

16.

Guldenring, R., Boukas, E., Ravn, O., Nalpantidis, L. (2021). Few-leaf Learning: Weed segmentation in grasslands (pp. 3248–3254). https://doi.org/10.1109/iros51168.2021.9636770

17.

Habiba, S. U., Islam, M. K., Ahsan, S. M. M. (2019). Bangladeshi plant recognition using deep learning based leaf classification. In 5th International conference on computer, communication, chemical, materials and electronic engineering IC4ME2 2019 (pp. 11–12). https://doi.org/10.1109/IC4ME247184.2019.9036515

18.

He, K., Zhang, X., Ren, S., Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition.

19.

Heusel, M., Ramsauer, H., Unterthiner, T., et al. (2017). GANs trained by a two time-scale update rule converge to a local Nash equilibrium. Advances in neural information processing systems, 2017, 6627–6638.

20.

Hu, J., Chen, Z., Yang, M., et al. (2018). A multiscale fusion convolutional neural network for plant leaf recognition. IEEE Signal Processing Letters, 25, 853–857. https://doi.org/10.1109/LSP.2018.2809688CrossRef

21.

Hu, G., Yang, X., Zhang, Y., & Wan, M. (2019). Identification of tea leaf diseases by using an improved deep convolutional neural network. Sustainable Computing: Informatics and Systems, 24, 100353. https://doi.org/10.1016/j.suscom.2019.100353CrossRef

22.

Jasitha, P., DIleep, M. R., DIvya, M. (2019). Venation based plant leaves classification using GoogLeNet and VGG. In 2019 4th IEEE international conference on recent trends on electronics, information, communication & technology RTEICT 2019–Proceeding (pp. 715–719). https://doi.org/10.1109/RTEICT46194.2019.9016966

23.

Kan, J., Gu, Z., Ma, C., Wang, Q. (2021). Leaf segmentation algorithm based on improved U-shaped network under complex background. In IMCEC 2021–IEEE 4th advanced information management, communicates, electronic and automation control conference 2021 (pp. 87–92). https://doi.org/10.1109/IMCEC51613.2021.9482382

24.

Kumar, V., Arora, H., Sisodia, J. (2020). ResNet-based approach for detection and classification of plant leaf diseases. In Proceedings international conference on electronics and sustainable communication systems ICESC 2020 (pp. 495–502). https://doi.org/10.1109/ICESC48915.2020.9155585

25.

Kumar, N., Belhumeur, P. N., Biswas, A., et al. (2012) Leafsnap: A Computer vision system for automatic plant species identification BT–computer vision. In ECCV 2012: 12th European Conference on Computer Vision, Florence, Italy, October 7–13, 2012, Proceedings, Part II (vol. 7573, pp. 502–516). https://doi.org/10.1007/978-3-642-33709-3_36

26.

Lecun, Y., Aurelio, M., Google, R. (2013). Deep learning tutorial. In ICML.

27.

Lee, S. H., Chan, C. S., Wilkin, P., et al. (2015). Deep-plant: Plant identification with convolutional neural networks (pp. 452–456). Kingston University.

28.

Li, P., Gong, X., Hu, X., et al. (2019). Plant identification based on multi-branch convolutional neural network with attention. Communications in Computer and Information Science, 1043, 472–481. https://doi.org/10.1007/978-981-13-9917-6_45CrossRef

29.

Li, Y., Wen, W., Miao, T., et al. (2022). Automatic organ-level point cloud segmentation of maize shoots by integrating high-throughput data acquisition and deep learning. Computers and Electronics in Agriculture, 193, 106702. https://doi.org/10.1016/j.compag.2022.106702CrossRef

30.

Litjens, G., Sánchez, C. I., Timofeeva, N., et al. (2016). Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis. Science and Reports, 6, 1–11. https://doi.org/10.1038/srep26286CrossRef

31.

Liu, B., Tan, C., Li, S., et al. (2020). A data augmentation method based on generative adversarial networks for grape leaf disease identification. IEEE Access, 8, 102188–102198. https://doi.org/10.1109/ACCESS.2020.2998839CrossRef

32.

Madsen, S. L., Dyrmann, M., Jørgensen, R. N., & Karstoft, H. (2019). Generating artificial images of plant seedlings using generative adversarial networks. Biosystems Engineering, 187, 147–159. https://doi.org/10.1016/j.biosystemseng.2019.09.005CrossRef

33.

Malik, O. A., Ismail, N., Hussein, B. R., & Yahya, U. (2022). Automated real-time identification of medicinal plants species in natural environment using deep learning models—a case study from borneo region. Plants, 11, 1952. https://doi.org/10.3390/plants11151952CrossRefPubMedPubMedCentral

34.

Morris, D. (2018). A pyramid CNN for dense-leaves segmentation. In Proceedings–2018 15th conference on computer and robot vision CRV 2018 (pp. 238–245). https://doi.org/10.1109/CRV.2018.00041

35.

Muneer, A., & Fati, S. M. (2020). Efficient and automated herbs classification approach based on shape and texture features using deep learning. IEEE Access, 8, 196747–196764. https://doi.org/10.1109/ACCESS.2020.3034033CrossRef

36.

Ndikumana, E., Minh, D. H. T., Baghdadi, N., et al. (2018). Deep recurrent neural network for agricultural classification using multitemporal SAR Sentinel-1 for Camargue, France. Remote Sensing, 10, 1–16. https://doi.org/10.3390/rs10081217CrossRef

37.

Ngugi, L. C., Abelwahab, M., & Abo-Zahhad, M. (2020). Tomato leaf segmentation algorithms for mobile phone applications using deep learning. Computers and Electronics in Agriculture, 178, 105788. https://doi.org/10.1016/j.compag.2020.105788CrossRef

38.

Nikbakhsh, N., Baleghi, Y., & Agahi, H. (2021). A novel approach for unsupervised image segmentation fusion of plant leaves based on G-mutual information. Machine Vision and Applications, 32, 1–12. https://doi.org/10.1007/s00138-020-01130-0CrossRef

39.

Pan, S. J., & Yang, Q. (2010). A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22, 1345–1359. https://doi.org/10.1109/TKDE.2009.191CrossRef

40.

Praveen Kumar, J., & Dominic, S. (2020). Rosette plant segmentation with leaf count using orthogonal transform and deep convolutional neural network. Machine Vision and Applications, 31, 1–14. https://doi.org/10.1007/s00138-019-01056-2CrossRef

41.

Praveen Kumar, J., & Domnic, S. (2019). Image based leaf segmentation and counting in rosette plants. Information Processing in Agriculture, 6, 233–246. https://doi.org/10.1016/j.inpa.2018.09.005CrossRef

42.

Purbaya, M. E., Setiawan, N. A., Adji, T. B. (2018). Leaves image synthesis using generative adversarial networks with regularization improvement. In 2018 International conference on information and communications technology ICOIACT 2018-Janua (pp. 360–365). https://doi.org/10.1109/ICOIACT.2018.8350780

43.

Sachar, S., & Kumar, A. (2021). Survey of feature extraction and classification techniques to identify plant through leaves. Expert Systems with Applications, 167, 114181.

44.

Shi, W., van de Zedde, R., Jiang, H., & Kootstra, G. (2019). Plant-part segmentation using deep learning and multi-view vision. Biosystems Engineering, 187, 81–95. https://doi.org/10.1016/j.biosystemseng.2019.08.014CrossRef

45.

Söderkvist, O. J. O. (2001). Computer vision classification of leaves from swedish trees (pp. 74).

46.

Sun, J., Zhao, J., Ding, Z. (2021). ULeaf-Net: Leaf segmentation network based on U-shaped symmetric encoder-decoder architecture (pp. 109–113). https://doi.org/10.1109/iscsic54682.2021.00030

47.

Tan, J. W., Chang, S. W., Abdul-Kareem, S., et al. (2020). Deep learning for plant species classification using leaf vein morphometric. IEEE/ACM Trans Comput Biol Bioinforma, 17, 82–90. https://doi.org/10.1109/TCBB.2018.2848653CrossRef

48.

Tavakoli, H., Alirezazadeh, P., Hedayatipour, A., et al. (2021). Leaf image-based classification of some common bean cultivars using discriminative convolutional neural networks. Computers and Electronics in Agriculture, 181, 105935. https://doi.org/10.1016/j.compag.2020.105935CrossRef

49.

Triki, A., Bouaziz, B., Gaikwad, J., & Mahdi, W. (2021). Deep eaf: Mask R-CNN based leaf detection and segmentation from digitized herbarium specimen images. Pattern Recognition Letters, 150, 76–83. https://doi.org/10.1016/j.patrec.2021.07.003CrossRef

50.

Trivedi, M., & Gupta, A. (2021). Automatic monitoring of the growth of plants using deep learning-based leaf segmentation. International Journal of Applied Science and Engineering, 18, 1–9. https://doi.org/10.6703/IJASE.202106_18(2).003CrossRef

51.

Wäldchen, J., & Mäder, P. (2018). Plant species identification using computer vision techniques: A systematic literature review. Archives of Computational Methods in Engineering, 25, 507–543. https://doi.org/10.1007/s11831-016-9206-zMathSciNetCrossRefPubMed

52.

Wang, B., & Wang, D. (2019). Plant leaves classification: A few-shot learning method based on siamese network. IEEE Access, 7, 151754–151763. https://doi.org/10.1109/ACCESS.2019.2947510CrossRef

53.

Ward, D., Moghadam, P., Hudson, N. (2019). Deep leaf segmentation using synthetic data.

54.

Weyler, J., Magistri, F., Seitz, P., et al. (2022). In-field phenotyping based on crop leaf and plant instance segmentation (pp. 2725–2734).

55.

Wu, S. G., Bao, F. S., Xu, E. Y., et al. (2007). A leaf recognition algorithm for plant classification using probabilistic neural network. In ISSPIT 2007–IEEE international symposium on signal processing and information technology (pp. 11–16). https://doi.org/10.1109/ISSPIT.2007.4458016

56.

Wu, Q., Chen, Y., & Meng, J. (2020). Dcgan-based data augmentation for tomato leaf disease identification. IEEE Access, 8, 98716–98728. https://doi.org/10.1109/ACCESS.2020.2997001CrossRef

57.

Xiong, J., Yu, D., Liu, S., et al. (2021). A review of plant phenotypic image recognition technology based on deep learning. Electron, 10, 1–19. https://doi.org/10.3390/electronics10010081CrossRef

58.

Xu, L., Li, Y., Sun, Y., et al. (2018). Leaf instance segmentation and counting based on deep object detection and segmentation networks. In 2018 Joint 10th international conference on soft computing and intelligent systems (SCIS) and 19th international symposium on advanced intelligent systems SCIS-ISIS (pp. 180–185). https://doi.org/10.1109/SCIS-ISIS.2018.00038

59.

Yang, K., Zhong, W., & Li, F. (2020). Leaf segmentation and classification with a complicated background using deep learning. Agronomy, 10, 1721. https://doi.org/10.3390/agronomy10111721CrossRef

60.

Zhu, Y., Aoun, M., Krijn, M., & Vanschoren, J. (2018). Data augmentation using conditional generative adversarial networks for leaf counting in arabidopsis plants. BMVC, 2018, 121–125.

61.

Zhu, W., Xie, L., Han, J., & Guo, X. (2020). The application of deep learning in cancer prognosis prediction. Cancers (Basel), 12, 1–19. https://doi.org/10.3390/cancers12030603CrossRef

Titel: Deep Learning Techniques in Leaf Image Segmentation and Leaf Species Classification: A Survey
verfasst von: Anuj Kumar
Silky Sachar
Publikationsdatum: 22.02.2024
Verlag: Springer US
Erschienen in: Wireless Personal Communications / Ausgabe 4/2023
Print ISSN: 0929-6212
Elektronische ISSN: 1572-834X
DOI: https://doi.org/10.1007/s11277-024-10873-2

Neuer Inhalt

Bildnachweise

VDI-Icon, Profil Icon, inhalt2, Springer Professional Modul/© Springer Fachmedien Wiesbaden GmbH, Internationaler Motorenkongress/© [M] ATZlive | Chisnikov / Fotolia.com, Search Icon, Banner Hanser, Benedikt Bonnmann von Adesso/© Adesso, Teilzeit/© Fokussiert / stock.adobe.com, Hans-Joachim Lefeld/© Lucht Probst Associates GmbH, Zeitschrift Wissensmanagement Cover, PatentFit-Logo/© Springer Fachmedien Wiesbaden GmbH, 2023_Antrieb/© supervisuell, ATZ-Webinar: Prototypenfreie Entwicklung durch Offline- und Driver-in-the-Loop-HiL-Tests /© (c) VI-grade, chassis.tech plus 2023/© [M] ATZlive / TÜV SÜD PRODUCT SERVICE GMBH

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Weitere Artikel der Ausgabe 4/2023

Circular Microstrip Antenna Backed by Rectangular Slots Cut Ground Plane for Enhanced Antenna Characteristics

Expert System for Smart Virtual Facial Emotion Detection Using Convolutional Neural Network

Traditional and Blockchain Based IoT and IIoT Security in the Context of Agriculture: A Survey

Two-Way SWIPT Relaying Networks with Nonlinear Power Splitting, Digital Network Coding and Selection Combining

Enhanced Performance Analysis of Multibeam FSO by Incorporating Carrier Supressed Return to Zero (CSRZ)

Reducing the PAPR of OTFS Modulation Using Hybrid PAPR Algorithms

Neuer Inhalt

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.