Skip to main content
Erschienen in: Neural Computing and Applications 6/2024

25.11.2023 | Original Article

Visual regenerative fusion network for pest recognition

verfasst von: C. Nandhini, M. Brindha

Erschienen in: Neural Computing and Applications | Ausgabe 6/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Automatic pest detection from agricultural crops is a challenging agricultural application. It has been observed that many farmers lose crop yields mainly due to pests that spread rapidly. An intelligent pest recognition system (IPRS) is an innovative application that assists farmers in increasing agricultural productivity by accurately detecting pests that may cause crop damage. It allows one to identify the type of pest and apply the appropriate pesticides in a timely manner. There is a large deviation in deep neural network (DNN) performance on clean images and naturally degraded images. This article proposes a novel data augmentation techniques and feature fusion techniques to improve the accuracy as well as the desired robustness. The proposed visual regenerative fusion network (VRFNet) fuses the multiscale features from global feature extraction (GFE) network and the visual regeneration (VR) network to capture the semantic details for identifying pests from the distorted images which improves the accuracy. The proposed patch-based augmentation approach can effectively simulate the environment in which the leaves can partially conceal the insects and helps in improving the robustness. The proposed model achieves an accuracy of 99.12 and 68.34 on the publicly available D0 and IP102 datasets, respectively. These results clearly demonstrate that the proposed fusion method achieved a high success rate for distorted and occluded images captured from the agriculture farms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Nandhini C, Brindha M (2022) Deep learning solutions for pest detection. Princ Appl Object Detect Deep Learn Mod Nandhini C, Brindha M (2022) Deep learning solutions for pest detection. Princ Appl Object Detect Deep Learn Mod
2.
Zurück zum Zitat Camargo A, Smith J (2009) An image-processing based algorithm to automatically identify plant disease visual symptoms. Biosyst Eng 102(1):9–21CrossRef Camargo A, Smith J (2009) An image-processing based algorithm to automatically identify plant disease visual symptoms. Biosyst Eng 102(1):9–21CrossRef
3.
Zurück zum Zitat Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700–4708 Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700–4708
4.
Zurück zum Zitat Tan M, Le Q (2019) Efficientnet: Rethinking model scaling for convolutional neural networks. In: International conference on machine learning, PMLR, pp 6105–6114 Tan M, Le Q (2019) Efficientnet: Rethinking model scaling for convolutional neural networks. In: International conference on machine learning, PMLR, pp 6105–6114
5.
Zurück zum Zitat Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:​1704.​04861
6.
Zurück zum Zitat Haralick RM, Shanmugam K, Dinstein IH (1973) Textural features for image classification. IEEE Trans Syst Man Cybern 6:610–621CrossRef Haralick RM, Shanmugam K, Dinstein IH (1973) Textural features for image classification. IEEE Trans Syst Man Cybern 6:610–621CrossRef
7.
Zurück zum Zitat Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60:91–110CrossRef Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60:91–110CrossRef
8.
Zurück zum Zitat Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol. 1, IEEE, pp 886–893 Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol. 1, IEEE, pp 886–893
9.
Zurück zum Zitat Cheng X, Zhang Y, Chen Y, Wu Y, Yue Y (2017) Pest identification via deep residual learning in complex background. Comput Electron Agric 141:351–356CrossRef Cheng X, Zhang Y, Chen Y, Wu Y, Yue Y (2017) Pest identification via deep residual learning in complex background. Comput Electron Agric 141:351–356CrossRef
10.
Zurück zum Zitat Atole RR, Park D (2018) A multiclass deep convolutional neural network classifier for detection of common rice plant anomalies. Int J Adv Comput Sci Appl 9(1) Atole RR, Park D (2018) A multiclass deep convolutional neural network classifier for detection of common rice plant anomalies. Int J Adv Comput Sci Appl 9(1)
11.
Zurück zum Zitat Ayan E, Erbay H, Varçın F (2020) Crop pest classification with a genetic algorithm-based weighted ensemble of deep convolutional neural networks. Comput Electron Agric 179:105809CrossRef Ayan E, Erbay H, Varçın F (2020) Crop pest classification with a genetic algorithm-based weighted ensemble of deep convolutional neural networks. Comput Electron Agric 179:105809CrossRef
12.
Zurück zum Zitat Thenmozhi K, Reddy US (2019) Crop pest classification based on deep convolutional neural network and transfer learning. Comput Electron Agric 164:104906CrossRef Thenmozhi K, Reddy US (2019) Crop pest classification based on deep convolutional neural network and transfer learning. Comput Electron Agric 164:104906CrossRef
13.
Zurück zum Zitat Nanni L, Maguolo G, Pancino F (2020) Insect pest image detection and recognition based on bio-inspired methods. Ecolog Inform 57:101089CrossRef Nanni L, Maguolo G, Pancino F (2020) Insect pest image detection and recognition based on bio-inspired methods. Ecolog Inform 57:101089CrossRef
14.
Zurück zum Zitat Chakraborty SK, Chandel NS, Jat D, Tiwari MK, Rajwade YA, Subeesh A (2022) Deep learning approaches and interventions for futuristic engineering in agriculture. Neural Comput Appl 34(23):20539–20573CrossRef Chakraborty SK, Chandel NS, Jat D, Tiwari MK, Rajwade YA, Subeesh A (2022) Deep learning approaches and interventions for futuristic engineering in agriculture. Neural Comput Appl 34(23):20539–20573CrossRef
15.
Zurück zum Zitat Larios N, Deng H, Zhang W, Sarpola M, Yuen J, Paasch R, Moldenke A, Lytle DA, Correa SR, Mortensen EN (2008) Automated insect identification through concatenated histograms of local appearance features: feature vector generation and region detection for deformable objects. Mach Vis Appl 19(2):105–123CrossRef Larios N, Deng H, Zhang W, Sarpola M, Yuen J, Paasch R, Moldenke A, Lytle DA, Correa SR, Mortensen EN (2008) Automated insect identification through concatenated histograms of local appearance features: feature vector generation and region detection for deformable objects. Mach Vis Appl 19(2):105–123CrossRef
16.
Zurück zum Zitat Zhao J, Liu M, Yao M (2009) Study on image recognition of insect pest of sugarcane cotton aphis based on rough set and fuzzy c-means clustering. In: 2009 third international symposium on intelligent information technology application, vol. 2, IEEE, pp 553–555 Zhao J, Liu M, Yao M (2009) Study on image recognition of insect pest of sugarcane cotton aphis based on rough set and fuzzy c-means clustering. In: 2009 third international symposium on intelligent information technology application, vol. 2, IEEE, pp 553–555
17.
Zurück zum Zitat Bai T, Meng H, Yao J (2014) A forecasting method of forest pests based on the rough set and pso-bp neural network. Neural Comput Appl 25:1699–1707CrossRef Bai T, Meng H, Yao J (2014) A forecasting method of forest pests based on the rough set and pso-bp neural network. Neural Comput Appl 25:1699–1707CrossRef
18.
Zurück zum Zitat Xie C, Zhang J, Li R, Li J, Hong P, Xia J, Chen P (2015) Automatic classification for field crop insects via multiple-task sparse representation and multiple-kernel learning. Comput Electron Agric 119:123–132CrossRef Xie C, Zhang J, Li R, Li J, Hong P, Xia J, Chen P (2015) Automatic classification for field crop insects via multiple-task sparse representation and multiple-kernel learning. Comput Electron Agric 119:123–132CrossRef
19.
Zurück zum Zitat Johannes A, Picon A, Alvarez-Gila A, Echazarra J, Rodriguez-Vaamonde S, Navajas AD, Ortiz-Barredo A (2017) Automatic plant disease diagnosis using mobile capture devices, applied on a wheat use case. Comput Electron Agric 138:200–209CrossRef Johannes A, Picon A, Alvarez-Gila A, Echazarra J, Rodriguez-Vaamonde S, Navajas AD, Ortiz-Barredo A (2017) Automatic plant disease diagnosis using mobile capture devices, applied on a wheat use case. Comput Electron Agric 138:200–209CrossRef
20.
Zurück zum Zitat Islam M, Dinh A, Wahid K, Bhowmik P (2017) Detection of potato diseases using image segmentation and multiclass support vector machine. In: 2017 IEEE 30th Canadian conference on electrical and computer engineering (CCECE), IEEE, pp 1–4 Islam M, Dinh A, Wahid K, Bhowmik P (2017) Detection of potato diseases using image segmentation and multiclass support vector machine. In: 2017 IEEE 30th Canadian conference on electrical and computer engineering (CCECE), IEEE, pp 1–4
21.
Zurück zum Zitat Rahman CR, Arko PS, Ali ME, Khan MAI, Apon SH, Nowrin F, Wasif A (2020) Identification and recognition of rice diseases and pests using convolutional neural networks. Biosyst Eng 194:112–120CrossRef Rahman CR, Arko PS, Ali ME, Khan MAI, Apon SH, Nowrin F, Wasif A (2020) Identification and recognition of rice diseases and pests using convolutional neural networks. Biosyst Eng 194:112–120CrossRef
22.
Zurück zum Zitat Ramesh S, Vydeki D (2020) Recognition and classification of paddy leaf diseases using optimized deep neural network with Jaya algorithm. Inf Process Agric 7(2):249–260 Ramesh S, Vydeki D (2020) Recognition and classification of paddy leaf diseases using optimized deep neural network with Jaya algorithm. Inf Process Agric 7(2):249–260
23.
Zurück zum Zitat Gadekallu TR, Rajput DS, Reddy M, Lakshmanna K, Bhattacharya S, Singh S, Jolfaei A, Alazab M (2021) A novel PCA-whale optimization-based deep neural network model for classification of tomato plant diseases using GPU. J Real-Time Image Process 18(4):1383–1396CrossRef Gadekallu TR, Rajput DS, Reddy M, Lakshmanna K, Bhattacharya S, Singh S, Jolfaei A, Alazab M (2021) A novel PCA-whale optimization-based deep neural network model for classification of tomato plant diseases using GPU. J Real-Time Image Process 18(4):1383–1396CrossRef
24.
Zurück zum Zitat Kusrini K, Suputa S, Setyanto A, Agastya IMA, Priantoro H, Chandramouli K, Izquierdo E (2020) Data augmentation for automated pest classification in mango farms. Comput Electron Agric 179:105842CrossRef Kusrini K, Suputa S, Setyanto A, Agastya IMA, Priantoro H, Chandramouli K, Izquierdo E (2020) Data augmentation for automated pest classification in mango farms. Comput Electron Agric 179:105842CrossRef
25.
Zurück zum Zitat Wang J, Li Y, Feng H, Ren L, Du X, Wu J (2020) Common pests image recognition based on deep convolutional neural network. Comput Electron Agric 179:105834CrossRef Wang J, Li Y, Feng H, Ren L, Du X, Wu J (2020) Common pests image recognition based on deep convolutional neural network. Comput Electron Agric 179:105834CrossRef
26.
Zurück zum Zitat Xie C, Wang R, Zhang J, Chen P, Dong W, Li R, Chen T, Chen H (2018) Multi-level learning features for automatic classification of field crop pests. Comput Electron Agric 152:233–241CrossRef Xie C, Wang R, Zhang J, Chen P, Dong W, Li R, Chen T, Chen H (2018) Multi-level learning features for automatic classification of field crop pests. Comput Electron Agric 152:233–241CrossRef
27.
Zurück zum Zitat Wu X, Zhan C, Lai YK, Cheng MM, Yang J (2019) Ip102: a large-scale benchmark dataset for insect pest recognition. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 8787–8796 Wu X, Zhan C, Lai YK, Cheng MM, Yang J (2019) Ip102: a large-scale benchmark dataset for insect pest recognition. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 8787–8796
28.
Zurück zum Zitat Ren F, Liu W, Wu G (2019) Feature reuse residual networks for insect pest recognition. IEEE Access 7:122758–122768CrossRef Ren F, Liu W, Wu G (2019) Feature reuse residual networks for insect pest recognition. IEEE Access 7:122758–122768CrossRef
Metadaten
Titel
Visual regenerative fusion network for pest recognition
verfasst von
C. Nandhini
M. Brindha
Publikationsdatum
25.11.2023
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 6/2024
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-023-09173-w

Weitere Artikel der Ausgabe 6/2024

Neural Computing and Applications 6/2024 Zur Ausgabe

Premium Partner