Skip to main content

2022 | OriginalPaper | Buchkapitel

Tracking and Counting Method for Tomato Fruits Scouting Robot in Greenhouse

verfasst von : Guanglin Dai, Ling Hu, Pengbo Wang, Jiacheng Rong

Erschienen in: Intelligent Robotics and Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The quantity of tomatoes is closely related to their yield information, and a powerful inspection robot that can automatically count tomatoes is urgently necessary for the hot and harsh environment of greenhouses. With the continuous progress of computer vision technology, the use of deep learning algorithms for counting tomatoes can greatly improve the inspection speed of the inspection robot. This paper propose a tomato fruit counting method for greenhouse inspection robots, which tracks the position of tomatoes in the image by the spatial displacement information of the robot, while 3D depth filtering can effectively avoid the interference of background tomatoes on the counting. The main advantages of this method are: (1) it can realize the tracking of bunched fruits and the counting of single fruits at the same time; (2) it can avoid the interference of background tomatoes. The experimental results of the greenhouse showed that the accuracy rates of bunch and single fruit counting were higher than 84% and 86% respectively, which greatly improved the inspection speed compared with manual counting and basically meet the counting requirements of the current greenhouse.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Yangyang, Z., Jianlei, K., Xuebo, J., et al.: Crop deep: the crop vision dataset for deep-learning-based classification and detection in precision agriculture. Sensors 19(5), 1058 (2019) Yangyang, Z., Jianlei, K., Xuebo, J., et al.: Crop deep: the crop vision dataset for deep-learning-based classification and detection in precision agriculture. Sensors 19(5), 1058 (2019)
2.
Zurück zum Zitat Tian, H., Tianhai, W., Yadong, L., et al.: Computer vision technology in agricultural automation—a review. Inf. Process. Agri. 7(1), 1–19 (2020) Tian, H., Tianhai, W., Yadong, L., et al.: Computer vision technology in agricultural automation—a review. Inf. Process. Agri. 7(1), 1–19 (2020)
3.
Zurück zum Zitat Bargoti, S., Underwood, J.P.: Image segmentation for fruit detection and yield estimation in apple orchards. J. Field Robot. 34(6), 1039–1060 (2017)CrossRef Bargoti, S., Underwood, J.P.: Image segmentation for fruit detection and yield estimation in apple orchards. J. Field Robot. 34(6), 1039–1060 (2017)CrossRef
4.
Zurück zum Zitat Liu, X., Chen, S.W., Aditya, S., et al.: Robust fruit counting: combining deep learning, tracking, and structure from motion. In: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1045–1052(2018) Liu, X., Chen, S.W., Aditya, S., et al.: Robust fruit counting: combining deep learning, tracking, and structure from motion. In: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1045–1052(2018)
5.
Zurück zum Zitat Ramos, P.J., Prieto, F.A., Montoya, E.C., et al.: Automatic fruit count on coffee branches using computer vision. Comput. Electron. Agric. 137, 9–22 (2017)CrossRef Ramos, P.J., Prieto, F.A., Montoya, E.C., et al.: Automatic fruit count on coffee branches using computer vision. Comput. Electron. Agric. 137, 9–22 (2017)CrossRef
6.
Zurück zum Zitat Häni, N., Roy, P., Isler, V.: A comparative study of fruit detection and counting methods for yield mapping in apple orchards. J. Field Robot. 37(2), 263–282 (2020)CrossRef Häni, N., Roy, P., Isler, V.: A comparative study of fruit detection and counting methods for yield mapping in apple orchards. J. Field Robot. 37(2), 263–282 (2020)CrossRef
7.
Zurück zum Zitat Afonso, M., Fonteijn, H., Fiorentin, F. S., et al.: Tomato fruit detection and counting in greenhouses using deep learning. Front. Plant Sci. 1759 (2020) Afonso, M., Fonteijn, H., Fiorentin, F. S., et al.: Tomato fruit detection and counting in greenhouses using deep learning. Front. Plant Sci. 1759 (2020)
8.
Zurück zum Zitat Kirk, R., Mangan, M., Cielniak, G.: Robust counting of soft fruit through occlusions with re-identification. In: Vincze, M., Patten, T., Christensen, H.I., Nalpantidis, L., Liu, M. (eds.) Computer Vision Systems. ICVS 2021. LNCS, vol. 12899, pp. 211–222 (2021). https://doi.org/10.1007/978-3-030-87156-7_17 Kirk, R., Mangan, M., Cielniak, G.: Robust counting of soft fruit through occlusions with re-identification. In: Vincze, M., Patten, T., Christensen, H.I., Nalpantidis, L., Liu, M. (eds.) Computer Vision Systems. ICVS 2021. LNCS, vol. 12899, pp. 211–222 (2021). https://​doi.​org/​10.​1007/​978-3-030-87156-7_​17
9.
Zurück zum Zitat Redmon, J., Divvala, S., Girshick, R., et al.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016) Redmon, J., Divvala, S., Girshick, R., et al.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016)
10.
Zurück zum Zitat Jiang, B., Luo, R., Mao, J., et al.: Acquisition of localization confidence for accurate object detection. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 784–799 (2018) Jiang, B., Luo, R., Mao, J., et al.: Acquisition of localization confidence for accurate object detection. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 784–799 (2018)
11.
Zurück zum Zitat Wojke, N., Bewley, A., Paulus, D.: Simple online and realtime tracking with a deep association metric. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 3645–3649 (2017) Wojke, N., Bewley, A., Paulus, D.: Simple online and realtime tracking with a deep association metric. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 3645–3649 (2017)
Metadaten
Titel
Tracking and Counting Method for Tomato Fruits Scouting Robot in Greenhouse
verfasst von
Guanglin Dai
Ling Hu
Pengbo Wang
Jiacheng Rong
Copyright-Jahr
2022
DOI
https://doi.org/10.1007/978-3-031-13844-7_6