Skip to main content

2016 | OriginalPaper | Buchkapitel

Recognition and Localization Method of Overlapping Apples for Apple Harvesting Robot

verfasst von : Tian Shen, Dean Zhao, Weikuan Jia, Yu Chen

Erschienen in: Computer and Computing Technologies in Agriculture IX

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In order to meet the speed requirements of harvesting robot, a method of tracking and recognition of overlapping apples is proposed in this paper. First of all, the first image should be segmented and denoised, the center and the radius is determined, the template which is used for matching is extracted according to the center and radius. Then, determine the center of ten images which are taken continuously, fit motion path of the robot according to the center of each image and predict subsequent motion path. The next processing area is determined according to the radius and predicted path. Finally, overlapping apples are identified by fast normalized cross correlation match method. Experiments prove that the new method can locate the center and radius of overlapping apples correctly. Besides, matching time is reduced by 48.1 % compared with the original one.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Wei, X., Jia, K., Lan, J., et al.: Automatic method of fruit object extraction under complex agricultural background for vision system of fruit picking robot. Optik-Int. J. Light Electr. Opt. 125(19), 5684–5689 (2014)CrossRef Wei, X., Jia, K., Lan, J., et al.: Automatic method of fruit object extraction under complex agricultural background for vision system of fruit picking robot. Optik-Int. J. Light Electr. Opt. 125(19), 5684–5689 (2014)CrossRef
2.
Zurück zum Zitat Ji, W., Zhao, D., Cheng, F., et al.: Automatic recognition vision system guided for apple harvesting robot. Comput. Electr. Eng. 38(5), 1186–1195 (2012)CrossRef Ji, W., Zhao, D., Cheng, F., et al.: Automatic recognition vision system guided for apple harvesting robot. Comput. Electr. Eng. 38(5), 1186–1195 (2012)CrossRef
3.
Zurück zum Zitat Zhang, L., Yang, Q., Bao, G., et al.: Overview of research on agricultural robot in China. Int. J. Agric. Biol. Eng. 1(1), 12–21 (2008) Zhang, L., Yang, Q., Bao, G., et al.: Overview of research on agricultural robot in China. Int. J. Agric. Biol. Eng. 1(1), 12–21 (2008)
4.
Zurück zum Zitat Chen, X., Yang, S.X.: A practical solution for ripe tomato recognition and localisation. J. Real-Time Image Proc. 8(1), 35–51 (2013)MathSciNetCrossRef Chen, X., Yang, S.X.: A practical solution for ripe tomato recognition and localisation. J. Real-Time Image Proc. 8(1), 35–51 (2013)MathSciNetCrossRef
5.
Zurück zum Zitat Ogawa, Y., Kondo, N., Monta, M., et al.: Spraying robot for grape production. In: Yuta, S., Asama, H., Prassler, E., Tsubouchi, T., Thrun, S. (eds.) Field and Service Robotics, pp. 539–548. Springer, Heidelberg (2006)CrossRef Ogawa, Y., Kondo, N., Monta, M., et al.: Spraying robot for grape production. In: Yuta, S., Asama, H., Prassler, E., Tsubouchi, T., Thrun, S. (eds.) Field and Service Robotics, pp. 539–548. Springer, Heidelberg (2006)CrossRef
6.
Zurück zum Zitat van Henten, E.J., Hemming, J., Van Tuijl, B.A.J., et al.: An autonomous robot for harvesting cucumbers in greenhouses. Auton. Robots 13(3), 241–258 (2002)CrossRefMATH van Henten, E.J., Hemming, J., Van Tuijl, B.A.J., et al.: An autonomous robot for harvesting cucumbers in greenhouses. Auton. Robots 13(3), 241–258 (2002)CrossRefMATH
7.
Zurück zum Zitat Ji, W., Zhao, D., Cheng, F., et al.: Automatic recognition vision system guided for apple harvesting robot. Comput. Electr. Eng. 38(5), 1186–1195 (2012)CrossRef Ji, W., Zhao, D., Cheng, F., et al.: Automatic recognition vision system guided for apple harvesting robot. Comput. Electr. Eng. 38(5), 1186–1195 (2012)CrossRef
8.
Zurück zum Zitat Hayashi, S., Shigematsu, K., Yamamoto, S., et al.: Evaluation of a strawberry-harvesting robot in a field test. Biosyst. Eng. 105(2), 160–171 (2010)CrossRef Hayashi, S., Shigematsu, K., Yamamoto, S., et al.: Evaluation of a strawberry-harvesting robot in a field test. Biosyst. Eng. 105(2), 160–171 (2010)CrossRef
9.
Zurück zum Zitat Rajendra, P., Kondo, N., Ninomiya, K., et al.: Machine vision algorithm for robots to harvest strawberries in tabletop culture greenhouses. Eng. Agric. Environ. Food 2(1), 24–30 (2009)CrossRef Rajendra, P., Kondo, N., Ninomiya, K., et al.: Machine vision algorithm for robots to harvest strawberries in tabletop culture greenhouses. Eng. Agric. Environ. Food 2(1), 24–30 (2009)CrossRef
10.
Zurück zum Zitat Karvelis, P., Likas, A., Fotiadis, D.I.: Identifying touching and overlapping chromosomes using the watershed transform and gradient paths. Pattern Recogn. Lett. 31(16), 2474–2488 (2010)CrossRef Karvelis, P., Likas, A., Fotiadis, D.I.: Identifying touching and overlapping chromosomes using the watershed transform and gradient paths. Pattern Recogn. Lett. 31(16), 2474–2488 (2010)CrossRef
11.
Zurück zum Zitat Pastrana, J.C., Rath, T.: Novel image processing approach for solving the overlapping problem in agriculture. Biosyst. Eng. 115(1), 106–115 (2013)CrossRef Pastrana, J.C., Rath, T.: Novel image processing approach for solving the overlapping problem in agriculture. Biosyst. Eng. 115(1), 106–115 (2013)CrossRef
12.
Zurück zum Zitat Xu, Y., Imou, K., Kaizu, Y., et al.: Two-stage approach for detecting slightly overlapping strawberries using HOG descriptor. Biosyst. Eng. 115(2), 144–153 (2013)CrossRef Xu, Y., Imou, K., Kaizu, Y., et al.: Two-stage approach for detecting slightly overlapping strawberries using HOG descriptor. Biosyst. Eng. 115(2), 144–153 (2013)CrossRef
13.
Zurück zum Zitat Qi, X., Xing, F., Foran, D.J., et al.: Robust segmentation of overlapping cells in histopathology specimens using parallel seed detection and repulsive level set. IEEE Trans. Biomed. Eng. 59(3), 754–765 (2012)CrossRef Qi, X., Xing, F., Foran, D.J., et al.: Robust segmentation of overlapping cells in histopathology specimens using parallel seed detection and repulsive level set. IEEE Trans. Biomed. Eng. 59(3), 754–765 (2012)CrossRef
14.
Zurück zum Zitat Cloppet, F., Boucher, A.: Segmentation of overlapping/aggregating nuclei cells in biological images. In: 19th International Conference on Pattern Recognition, pp. 1–4. IEEE (2008) Cloppet, F., Boucher, A.: Segmentation of overlapping/aggregating nuclei cells in biological images. In: 19th International Conference on Pattern Recognition, pp. 1–4. IEEE (2008)
15.
Zurück zum Zitat Priya, E., Srinivasan, S.: Separation of overlapping bacilli in microscopic digital TB images. Biocybern. Biomed. Eng. 35(2), 87–99 (2015)CrossRef Priya, E., Srinivasan, S.: Separation of overlapping bacilli in microscopic digital TB images. Biocybern. Biomed. Eng. 35(2), 87–99 (2015)CrossRef
16.
Zurück zum Zitat Wang, D., Song, H., Tie, Z., et al.: Recognition and localization of occluded apples using K-means clustering algorithm and convex hull theory: a comparison. Multimedia Tools Appl. 75, 3177–3198 (2016)CrossRef Wang, D., Song, H., Tie, Z., et al.: Recognition and localization of occluded apples using K-means clustering algorithm and convex hull theory: a comparison. Multimedia Tools Appl. 75, 3177–3198 (2016)CrossRef
17.
Zurück zum Zitat Lü, J., Zhao, D., Ji, W., et al.: Fast positioning method of apple harvesting robot for oscillating fruit. Trans. Chin. Soc. Agric. Eng. 28(13), 48–53 (2012) Lü, J., Zhao, D., Ji, W., et al.: Fast positioning method of apple harvesting robot for oscillating fruit. Trans. Chin. Soc. Agric. Eng. 28(13), 48–53 (2012)
18.
Zurück zum Zitat Chtcheglova, L.A., Waschke, J., Wildling, L., et al.: Nano-scale dynamic recognition imaging on vascular endothelial cells. Biophys. J. 93(2), L11–L13 (2007)CrossRef Chtcheglova, L.A., Waschke, J., Wildling, L., et al.: Nano-scale dynamic recognition imaging on vascular endothelial cells. Biophys. J. 93(2), L11–L13 (2007)CrossRef
19.
Zurück zum Zitat Gonzalez, R.C., Woods, R.E., Eddins, S.L.: Digital Image Processing Using MATLAB. Pearson Education India (2004) Gonzalez, R.C., Woods, R.E., Eddins, S.L.: Digital Image Processing Using MATLAB. Pearson Education India (2004)
20.
Zurück zum Zitat Serra, J., Soille, P.: Mathematical Morphology and Its Applications to Image Processing. Springer Science & Business Media, Heidelberg (2012)MATH Serra, J., Soille, P.: Mathematical Morphology and Its Applications to Image Processing. Springer Science & Business Media, Heidelberg (2012)MATH
21.
Zurück zum Zitat Kaur, B., Garg, A.: Mathematical morphological edge detection for remote sensing images. In: 3rd International Conference on Electronics Computer Technology, vol. 5, pp. 324–327. IEEE (2011) Kaur, B., Garg, A.: Mathematical morphological edge detection for remote sensing images. In: 3rd International Conference on Electronics Computer Technology, vol. 5, pp. 324–327. IEEE (2011)
22.
Zurück zum Zitat Heo, Y.S., Lee, K.M., Lee, S.U.: Robust stereo matching using adaptive normalized cross-correlation. IEEE Trans. Pattern Anal. Mach. Intell. 33(4), 807–822 (2011)CrossRef Heo, Y.S., Lee, K.M., Lee, S.U.: Robust stereo matching using adaptive normalized cross-correlation. IEEE Trans. Pattern Anal. Mach. Intell. 33(4), 807–822 (2011)CrossRef
23.
Zurück zum Zitat Saravanan, C., Surender, M.: Algorithm for face matching using normalized cross-correlation. Int. J. Eng. Adv. Technol. 2 (2013). ISSN: 2249-8958 Saravanan, C., Surender, M.: Algorithm for face matching using normalized cross-correlation. Int. J. Eng. Adv. Technol. 2 (2013). ISSN: 2249-8958
Metadaten
Titel
Recognition and Localization Method of Overlapping Apples for Apple Harvesting Robot
verfasst von
Tian Shen
Dean Zhao
Weikuan Jia
Yu Chen
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-48354-2_34

Premium Partner