Skip to main content
Top

2016 | OriginalPaper | Chapter

Recognition and Localization Method of Overlapping Apples for Apple Harvesting Robot

Authors : Tian Shen, Dean Zhao, Weikuan Jia, Yu Chen

Published in: Computer and Computing Technologies in Agriculture IX

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In order to meet the speed requirements of harvesting robot, a method of tracking and recognition of overlapping apples is proposed in this paper. First of all, the first image should be segmented and denoised, the center and the radius is determined, the template which is used for matching is extracted according to the center and radius. Then, determine the center of ten images which are taken continuously, fit motion path of the robot according to the center of each image and predict subsequent motion path. The next processing area is determined according to the radius and predicted path. Finally, overlapping apples are identified by fast normalized cross correlation match method. Experiments prove that the new method can locate the center and radius of overlapping apples correctly. Besides, matching time is reduced by 48.1 % compared with the original one.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Wei, X., Jia, K., Lan, J., et al.: Automatic method of fruit object extraction under complex agricultural background for vision system of fruit picking robot. Optik-Int. J. Light Electr. Opt. 125(19), 5684–5689 (2014)CrossRef Wei, X., Jia, K., Lan, J., et al.: Automatic method of fruit object extraction under complex agricultural background for vision system of fruit picking robot. Optik-Int. J. Light Electr. Opt. 125(19), 5684–5689 (2014)CrossRef
2.
go back to reference Ji, W., Zhao, D., Cheng, F., et al.: Automatic recognition vision system guided for apple harvesting robot. Comput. Electr. Eng. 38(5), 1186–1195 (2012)CrossRef Ji, W., Zhao, D., Cheng, F., et al.: Automatic recognition vision system guided for apple harvesting robot. Comput. Electr. Eng. 38(5), 1186–1195 (2012)CrossRef
3.
go back to reference Zhang, L., Yang, Q., Bao, G., et al.: Overview of research on agricultural robot in China. Int. J. Agric. Biol. Eng. 1(1), 12–21 (2008) Zhang, L., Yang, Q., Bao, G., et al.: Overview of research on agricultural robot in China. Int. J. Agric. Biol. Eng. 1(1), 12–21 (2008)
4.
go back to reference Chen, X., Yang, S.X.: A practical solution for ripe tomato recognition and localisation. J. Real-Time Image Proc. 8(1), 35–51 (2013)MathSciNetCrossRef Chen, X., Yang, S.X.: A practical solution for ripe tomato recognition and localisation. J. Real-Time Image Proc. 8(1), 35–51 (2013)MathSciNetCrossRef
5.
go back to reference Ogawa, Y., Kondo, N., Monta, M., et al.: Spraying robot for grape production. In: Yuta, S., Asama, H., Prassler, E., Tsubouchi, T., Thrun, S. (eds.) Field and Service Robotics, pp. 539–548. Springer, Heidelberg (2006)CrossRef Ogawa, Y., Kondo, N., Monta, M., et al.: Spraying robot for grape production. In: Yuta, S., Asama, H., Prassler, E., Tsubouchi, T., Thrun, S. (eds.) Field and Service Robotics, pp. 539–548. Springer, Heidelberg (2006)CrossRef
6.
go back to reference van Henten, E.J., Hemming, J., Van Tuijl, B.A.J., et al.: An autonomous robot for harvesting cucumbers in greenhouses. Auton. Robots 13(3), 241–258 (2002)CrossRefMATH van Henten, E.J., Hemming, J., Van Tuijl, B.A.J., et al.: An autonomous robot for harvesting cucumbers in greenhouses. Auton. Robots 13(3), 241–258 (2002)CrossRefMATH
7.
go back to reference Ji, W., Zhao, D., Cheng, F., et al.: Automatic recognition vision system guided for apple harvesting robot. Comput. Electr. Eng. 38(5), 1186–1195 (2012)CrossRef Ji, W., Zhao, D., Cheng, F., et al.: Automatic recognition vision system guided for apple harvesting robot. Comput. Electr. Eng. 38(5), 1186–1195 (2012)CrossRef
8.
go back to reference Hayashi, S., Shigematsu, K., Yamamoto, S., et al.: Evaluation of a strawberry-harvesting robot in a field test. Biosyst. Eng. 105(2), 160–171 (2010)CrossRef Hayashi, S., Shigematsu, K., Yamamoto, S., et al.: Evaluation of a strawberry-harvesting robot in a field test. Biosyst. Eng. 105(2), 160–171 (2010)CrossRef
9.
go back to reference Rajendra, P., Kondo, N., Ninomiya, K., et al.: Machine vision algorithm for robots to harvest strawberries in tabletop culture greenhouses. Eng. Agric. Environ. Food 2(1), 24–30 (2009)CrossRef Rajendra, P., Kondo, N., Ninomiya, K., et al.: Machine vision algorithm for robots to harvest strawberries in tabletop culture greenhouses. Eng. Agric. Environ. Food 2(1), 24–30 (2009)CrossRef
10.
go back to reference Karvelis, P., Likas, A., Fotiadis, D.I.: Identifying touching and overlapping chromosomes using the watershed transform and gradient paths. Pattern Recogn. Lett. 31(16), 2474–2488 (2010)CrossRef Karvelis, P., Likas, A., Fotiadis, D.I.: Identifying touching and overlapping chromosomes using the watershed transform and gradient paths. Pattern Recogn. Lett. 31(16), 2474–2488 (2010)CrossRef
11.
go back to reference Pastrana, J.C., Rath, T.: Novel image processing approach for solving the overlapping problem in agriculture. Biosyst. Eng. 115(1), 106–115 (2013)CrossRef Pastrana, J.C., Rath, T.: Novel image processing approach for solving the overlapping problem in agriculture. Biosyst. Eng. 115(1), 106–115 (2013)CrossRef
12.
go back to reference Xu, Y., Imou, K., Kaizu, Y., et al.: Two-stage approach for detecting slightly overlapping strawberries using HOG descriptor. Biosyst. Eng. 115(2), 144–153 (2013)CrossRef Xu, Y., Imou, K., Kaizu, Y., et al.: Two-stage approach for detecting slightly overlapping strawberries using HOG descriptor. Biosyst. Eng. 115(2), 144–153 (2013)CrossRef
13.
go back to reference Qi, X., Xing, F., Foran, D.J., et al.: Robust segmentation of overlapping cells in histopathology specimens using parallel seed detection and repulsive level set. IEEE Trans. Biomed. Eng. 59(3), 754–765 (2012)CrossRef Qi, X., Xing, F., Foran, D.J., et al.: Robust segmentation of overlapping cells in histopathology specimens using parallel seed detection and repulsive level set. IEEE Trans. Biomed. Eng. 59(3), 754–765 (2012)CrossRef
14.
go back to reference Cloppet, F., Boucher, A.: Segmentation of overlapping/aggregating nuclei cells in biological images. In: 19th International Conference on Pattern Recognition, pp. 1–4. IEEE (2008) Cloppet, F., Boucher, A.: Segmentation of overlapping/aggregating nuclei cells in biological images. In: 19th International Conference on Pattern Recognition, pp. 1–4. IEEE (2008)
15.
go back to reference Priya, E., Srinivasan, S.: Separation of overlapping bacilli in microscopic digital TB images. Biocybern. Biomed. Eng. 35(2), 87–99 (2015)CrossRef Priya, E., Srinivasan, S.: Separation of overlapping bacilli in microscopic digital TB images. Biocybern. Biomed. Eng. 35(2), 87–99 (2015)CrossRef
16.
go back to reference Wang, D., Song, H., Tie, Z., et al.: Recognition and localization of occluded apples using K-means clustering algorithm and convex hull theory: a comparison. Multimedia Tools Appl. 75, 3177–3198 (2016)CrossRef Wang, D., Song, H., Tie, Z., et al.: Recognition and localization of occluded apples using K-means clustering algorithm and convex hull theory: a comparison. Multimedia Tools Appl. 75, 3177–3198 (2016)CrossRef
17.
go back to reference Lü, J., Zhao, D., Ji, W., et al.: Fast positioning method of apple harvesting robot for oscillating fruit. Trans. Chin. Soc. Agric. Eng. 28(13), 48–53 (2012) Lü, J., Zhao, D., Ji, W., et al.: Fast positioning method of apple harvesting robot for oscillating fruit. Trans. Chin. Soc. Agric. Eng. 28(13), 48–53 (2012)
18.
go back to reference Chtcheglova, L.A., Waschke, J., Wildling, L., et al.: Nano-scale dynamic recognition imaging on vascular endothelial cells. Biophys. J. 93(2), L11–L13 (2007)CrossRef Chtcheglova, L.A., Waschke, J., Wildling, L., et al.: Nano-scale dynamic recognition imaging on vascular endothelial cells. Biophys. J. 93(2), L11–L13 (2007)CrossRef
19.
go back to reference Gonzalez, R.C., Woods, R.E., Eddins, S.L.: Digital Image Processing Using MATLAB. Pearson Education India (2004) Gonzalez, R.C., Woods, R.E., Eddins, S.L.: Digital Image Processing Using MATLAB. Pearson Education India (2004)
20.
go back to reference Serra, J., Soille, P.: Mathematical Morphology and Its Applications to Image Processing. Springer Science & Business Media, Heidelberg (2012)MATH Serra, J., Soille, P.: Mathematical Morphology and Its Applications to Image Processing. Springer Science & Business Media, Heidelberg (2012)MATH
21.
go back to reference Kaur, B., Garg, A.: Mathematical morphological edge detection for remote sensing images. In: 3rd International Conference on Electronics Computer Technology, vol. 5, pp. 324–327. IEEE (2011) Kaur, B., Garg, A.: Mathematical morphological edge detection for remote sensing images. In: 3rd International Conference on Electronics Computer Technology, vol. 5, pp. 324–327. IEEE (2011)
22.
go back to reference Heo, Y.S., Lee, K.M., Lee, S.U.: Robust stereo matching using adaptive normalized cross-correlation. IEEE Trans. Pattern Anal. Mach. Intell. 33(4), 807–822 (2011)CrossRef Heo, Y.S., Lee, K.M., Lee, S.U.: Robust stereo matching using adaptive normalized cross-correlation. IEEE Trans. Pattern Anal. Mach. Intell. 33(4), 807–822 (2011)CrossRef
23.
go back to reference Saravanan, C., Surender, M.: Algorithm for face matching using normalized cross-correlation. Int. J. Eng. Adv. Technol. 2 (2013). ISSN: 2249-8958 Saravanan, C., Surender, M.: Algorithm for face matching using normalized cross-correlation. Int. J. Eng. Adv. Technol. 2 (2013). ISSN: 2249-8958
Metadata
Title
Recognition and Localization Method of Overlapping Apples for Apple Harvesting Robot
Authors
Tian Shen
Dean Zhao
Weikuan Jia
Yu Chen
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-48354-2_34

Premium Partner