Skip to main content

2020 | OriginalPaper | Buchkapitel

7. Machine Vision System for Orchard Management

verfasst von : Duke M. Bulanon, Tyler Hestand, Connor Nogales, Brice Allen, Jason Colwell

Erschienen in: Machine Vision and Navigation

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter overviews different machine vision systems in agricultural applications. Several different applications are presented, but a machine vision system which estimates fruit yield, an example of an orchard management application, is discussed at length. From the farmer’s perspective, an early yield prediction serves as an early revenue estimate. From this prediction, resources, such as employees and storage space, can more efficiently be allocated, and future seasons can be better planned. The yield estimate is accomplished using a camera with a color filter that isolates the blossoms on a tree when the tree is in its full blossom. The blossoms in the resulting image can be counted and the yield estimated. An estimate during the blossom period, as compared to when the fruit has begun to mature, provides a crop yield prediction several months in advance. Discussed as well, in this chapter, is a machine vision system which navigates a robot through orchard rows. This system can be used in conjunction with the yield estimation system, but it has additional applications such as incorporating a water or pesticide system, which can treat the trees as it passes by. To be effective, this type of system, must consider the operating scene as it can limit or constraint the system effectiveness. Such systems tend to be unique to the operating environment.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
7.
Zurück zum Zitat Awcock, G. J., & Thomas, R. (1995). Applied image processing. New York: McGraw-Hill.CrossRef Awcock, G. J., & Thomas, R. (1995). Applied image processing. New York: McGraw-Hill.CrossRef
8.
Zurück zum Zitat Chao, K., Park, B., Chen, Y. R., Hruschka, W. R., & Wheaton, F. W. (2000). Design of a dual-camera system for poultry carcasses inspection. Applied Engineering in Agriculture, 16(5), 581–587.CrossRef Chao, K., Park, B., Chen, Y. R., Hruschka, W. R., & Wheaton, F. W. (2000). Design of a dual-camera system for poultry carcasses inspection. Applied Engineering in Agriculture, 16(5), 581–587.CrossRef
9.
Zurück zum Zitat Bulanon, D. M., & Kataoka, T. (2010). Fruit detection system and an end effector for robotic harvesting of Fuji apples’, International commission of Agricultural and. Biosystems Engineering Journal, 12(1), 203–210. Bulanon, D. M., & Kataoka, T. (2010). Fruit detection system and an end effector for robotic harvesting of Fuji apples’, International commission of Agricultural and. Biosystems Engineering Journal, 12(1), 203–210.
10.
Zurück zum Zitat Ni, Z., & Burks, T. F. (2013). Plant or tree reconstruction based on stereo vision. In Annual meeting of the American Society of Agricultural and Biological Engineers, 2013. Ni, Z., & Burks, T. F. (2013). Plant or tree reconstruction based on stereo vision. In Annual meeting of the American Society of Agricultural and Biological Engineers, 2013.
11.
Zurück zum Zitat Bulanon, D. M., Burks, T. F., & Alchanatis, V. (2008). Study on temporal variation in citrus canopy using thermal imaging for citrus fruit detection. Biosystems Engineering, 101(2), 161–171.CrossRef Bulanon, D. M., Burks, T. F., & Alchanatis, V. (2008). Study on temporal variation in citrus canopy using thermal imaging for citrus fruit detection. Biosystems Engineering, 101(2), 161–171.CrossRef
12.
Zurück zum Zitat Corke, P. (2011). Robotics, Vision and Control: Fundamental Algorithms in MATLAB. Springer Tracts in Advanced Robotics, 73(6), 2011.MATH Corke, P. (2011). Robotics, Vision and Control: Fundamental Algorithms in MATLAB. Springer Tracts in Advanced Robotics, 73(6), 2011.MATH
15.
Zurück zum Zitat Ruiz-Altisent, N., Ruiz-Garcia, L., Moreda, G. P., Lu, R., HernandezSanchez, N., Correa, E. C., et al. (2010). Sensors for product characterization and quality of specialty crops—A review. Computers and Electronics in Agriculture, 74, 176–194.CrossRef Ruiz-Altisent, N., Ruiz-Garcia, L., Moreda, G. P., Lu, R., HernandezSanchez, N., Correa, E. C., et al. (2010). Sensors for product characterization and quality of specialty crops—A review. Computers and Electronics in Agriculture, 74, 176–194.CrossRef
16.
Zurück zum Zitat Davies, E. R. (1997). Machine vision: Theory, algorithms, practicalities. New York: Academic Press. Davies, E. R. (1997). Machine vision: Theory, algorithms, practicalities. New York: Academic Press.
17.
Zurück zum Zitat Guyer, D. E., Miles, G. E., Schreiber, M. M., Mitchell, O. R., & Vanderbilt, V. C. (1986). Machine vision and image processing for plant identification. Transactions of ASAE, 29(6), 1500–1507.CrossRef Guyer, D. E., Miles, G. E., Schreiber, M. M., Mitchell, O. R., & Vanderbilt, V. C. (1986). Machine vision and image processing for plant identification. Transactions of ASAE, 29(6), 1500–1507.CrossRef
18.
Zurück zum Zitat Lee, W. S., Slaughter, D. C., & Giles, D. K. (1999). Robotic weed control system for tomatoes. Precision Agriculture, 1, 95–113.CrossRef Lee, W. S., Slaughter, D. C., & Giles, D. K. (1999). Robotic weed control system for tomatoes. Precision Agriculture, 1, 95–113.CrossRef
19.
Zurück zum Zitat Bulanon, D. M., Lonai, J., Skovgard, H., & Fallahi, E. (2016). Evaluation of different irrigation methods for an apple orchard using an aerial imaging system. ISPRS International Journal of Geo-Information, 5, 79.CrossRef Bulanon, D. M., Lonai, J., Skovgard, H., & Fallahi, E. (2016). Evaluation of different irrigation methods for an apple orchard using an aerial imaging system. ISPRS International Journal of Geo-Information, 5, 79.CrossRef
20.
Zurück zum Zitat Lindner, L., Sergiyenko, O., Rivas-López, M., Valdez-Salas, B., Rodríguez-Quiñonez, J. C., Hernández-Balbuena, D., et al. (2016, November). Machine vision system for UAV navigation. In Electrical Systems for Aircraft, Railway, Ship Propulsion and Road Vehicles & International Transportation Electrification Conference (ESARS-ITEC), International Conference on IEEE (pp. 1–6). Lindner, L., Sergiyenko, O., Rivas-López, M., Valdez-Salas, B., Rodríguez-Quiñonez, J. C., Hernández-Balbuena, D., et al. (2016, November). Machine vision system for UAV navigation. In Electrical Systems for Aircraft, Railway, Ship Propulsion and Road Vehicles & International Transportation Electrification Conference (ESARS-ITEC), International Conference on IEEE (pp. 1–6).
21.
Zurück zum Zitat Lindner, L., Sergiyenko, O., Rivas-López, M., Ivanov, M., Rodríguez-Quiñonez, J. C., Hernández-Balbuena, D., et al. (2017, June). Machine vision system errors for unmanned aerial vehicle navigation. In Industrial Electronics (ISIE), 2017 IEEE 26th International Symposium on IEEE (pp. 1615–1620). Lindner, L., Sergiyenko, O., Rivas-López, M., Ivanov, M., Rodríguez-Quiñonez, J. C., Hernández-Balbuena, D., et al. (2017, June). Machine vision system errors for unmanned aerial vehicle navigation. In Industrial Electronics (ISIE), 2017 IEEE 26th International Symposium on IEEE (pp. 1615–1620).
22.
Zurück zum Zitat Wu, W. Y., Wang, M. J., & Liu, C. M. (1996). Automated inspection of printed circuit boards through machine vision. Computers in Industry, 28(2), 103–111.CrossRef Wu, W. Y., Wang, M. J., & Liu, C. M. (1996). Automated inspection of printed circuit boards through machine vision. Computers in Industry, 28(2), 103–111.CrossRef
23.
Zurück zum Zitat Miller, M. K., & Delwiche, M. J. (1989). A color vision system for peach grading. Transactions of ASAE, 32(4), 1484–1490.CrossRef Miller, M. K., & Delwiche, M. J. (1989). A color vision system for peach grading. Transactions of ASAE, 32(4), 1484–1490.CrossRef
24.
Zurück zum Zitat Bulanon, D. M., Burks, T. F., Kim, D. G., & Ritenour, M. A. (2013). Citrus black spot detection using hyperspectral image analysis. Agricultural Engineering International: CIGR Journal, 15(3), 171–180. Bulanon, D. M., Burks, T. F., Kim, D. G., & Ritenour, M. A. (2013). Citrus black spot detection using hyperspectral image analysis. Agricultural Engineering International: CIGR Journal, 15(3), 171–180.
25.
Zurück zum Zitat Rehkugler, G. E., & Throop, J. A. (1986). Apple sorting with machine vision. Transactions of ASAE, 29(10), 1388–1397.CrossRef Rehkugler, G. E., & Throop, J. A. (1986). Apple sorting with machine vision. Transactions of ASAE, 29(10), 1388–1397.CrossRef
26.
Zurück zum Zitat Costa, C., Antonucci, F., Pallottino, F., Aguzzi, J., Sun, D. W., & Menesatti, P. (2011). Shape analysis of agricultural products: A review of recent research advances and potential to computer vision. Food and Bioprocess Technology, 4, 673–692.CrossRef Costa, C., Antonucci, F., Pallottino, F., Aguzzi, J., Sun, D. W., & Menesatti, P. (2011). Shape analysis of agricultural products: A review of recent research advances and potential to computer vision. Food and Bioprocess Technology, 4, 673–692.CrossRef
27.
Zurück zum Zitat Morimoto, T., Takeuchi, T., Miyata, H., & Hashimoto, Y. (2000). Pattern recognition of fruit shape based on the concept of chaos and neural networks. Computers and Electronics in Agriculture, 26, 171–186.CrossRef Morimoto, T., Takeuchi, T., Miyata, H., & Hashimoto, Y. (2000). Pattern recognition of fruit shape based on the concept of chaos and neural networks. Computers and Electronics in Agriculture, 26, 171–186.CrossRef
28.
Zurück zum Zitat Pallottino, F., Menesatti, C., Costa, C., Paglia, G., De Salvador, F. R., & Lolletti, D. (2010). Image analysis techniques for automated hazelnut peeling determination. Food and Bioprocess Technology, 3(1), 155–159.CrossRef Pallottino, F., Menesatti, C., Costa, C., Paglia, G., De Salvador, F. R., & Lolletti, D. (2010). Image analysis techniques for automated hazelnut peeling determination. Food and Bioprocess Technology, 3(1), 155–159.CrossRef
29.
Zurück zum Zitat Parrish, E., & Goksel, A. K. (1977). Pictorial pattern recognition applied to fruit harvesting. Transactions of ASAE, 20, 822–827.CrossRef Parrish, E., & Goksel, A. K. (1977). Pictorial pattern recognition applied to fruit harvesting. Transactions of ASAE, 20, 822–827.CrossRef
30.
Zurück zum Zitat Slaughter, D., & Harrel, R. C. (1987). Color vision in robotic fruit harvesting. Transactions of ASAE, 30(4), 1144–1148.CrossRef Slaughter, D., & Harrel, R. C. (1987). Color vision in robotic fruit harvesting. Transactions of ASAE, 30(4), 1144–1148.CrossRef
31.
Zurück zum Zitat Bulanon, D. M., Burks, T., & Alchanatis, V. (2009). Image fusion of visible and thermal images for fruit detection. Biosystems Engineering, 103(1), 12–22.CrossRef Bulanon, D. M., Burks, T., & Alchanatis, V. (2009). Image fusion of visible and thermal images for fruit detection. Biosystems Engineering, 103(1), 12–22.CrossRef
32.
Zurück zum Zitat Ehsani, R., & Karimi, D. (2010). Yield monitors for specialty crops. Landbauforschung Völkenrode, Special Issue, 340, 31–43. Ehsani, R., & Karimi, D. (2010). Yield monitors for specialty crops. Landbauforschung Völkenrode, Special Issue, 340, 31–43.
33.
Zurück zum Zitat Maja, J. M., Campbell, T., Neto, J. C., & Astillo, P. (2016). Predicting cotton yield of small field plots in a cotton breeding program using UAV imagery data. In Proc SPIE 986, Autonomous Air and Ground Sensing Systems for Agricultural Optimization and Phenotyping, 98660C. Retrieved May 17, 2016. Maja, J. M., Campbell, T., Neto, J. C., & Astillo, P. (2016). Predicting cotton yield of small field plots in a cotton breeding program using UAV imagery data. In Proc SPIE 986, Autonomous Air and Ground Sensing Systems for Agricultural Optimization and Phenotyping, 98660C. Retrieved May 17, 2016.
34.
Zurück zum Zitat Tumbo, S. D., Whitney, J. D., Miller, W. M., & Wheaton, T. A. (2002). Development and testing of a citrus yield monitor. Applied Engineering in Agriculture, 18, 399–403. Tumbo, S. D., Whitney, J. D., Miller, W. M., & Wheaton, T. A. (2002). Development and testing of a citrus yield monitor. Applied Engineering in Agriculture, 18, 399–403.
35.
Zurück zum Zitat Annamalai, P., & Lee, W. S. (2003). Citrus yield mapping system using machine vision, 2003 ASAE Annual Meeting. American Society of Agricultural and Biological Engineers. Annamalai, P., & Lee, W. S. (2003). Citrus yield mapping system using machine vision, 2003 ASAE Annual Meeting. American Society of Agricultural and Biological Engineers.
36.
Zurück zum Zitat Stajnko, D., Rakun, J., & Blanke, M. (2009). Modelling apple fruit yield using image analysis for fruit colour, shape and texture. European Journal of Horticultural Science, 74(6), 260–267. Stajnko, D., Rakun, J., & Blanke, M. (2009). Modelling apple fruit yield using image analysis for fruit colour, shape and texture. European Journal of Horticultural Science, 74(6), 260–267.
37.
Zurück zum Zitat Lee, W. S., Alchanatis, V., Yang, C., Hirafuji, M., Moshou, D., & Li, C. (2010). Sensing technologies for precision specialty crop production. Computers and Electronics in Agriculture, 74, 2–33.CrossRef Lee, W. S., Alchanatis, V., Yang, C., Hirafuji, M., Moshou, D., & Li, C. (2010). Sensing technologies for precision specialty crop production. Computers and Electronics in Agriculture, 74, 2–33.CrossRef
38.
Zurück zum Zitat Zaman, Q. U., Swain, K. C., Schumann, A. W., & Percival, D. C. (2010). Automated, low-cost yield mapping of wild blueberry fruit. Applied Engineering in Agriculture, 26(2), 225–232.CrossRef Zaman, Q. U., Swain, K. C., Schumann, A. W., & Percival, D. C. (2010). Automated, low-cost yield mapping of wild blueberry fruit. Applied Engineering in Agriculture, 26(2), 225–232.CrossRef
39.
Zurück zum Zitat Wang, Q., Nuske, S., Bergerman, M., & Singh, S. (2012). Automated crop yield estimation for apple orchards. In Proceedings of the International symposim on Experimental Robotics, June 2012, Quebec City. Wang, Q., Nuske, S., Bergerman, M., & Singh, S. (2012). Automated crop yield estimation for apple orchards. In Proceedings of the International symposim on Experimental Robotics, June 2012, Quebec City.
40.
Zurück zum Zitat Cheng, H., Damerow, L., Sun, Y., & Blanke, M. (2017). Early yield prediction using image analysis of apple fruit and tree canopy features with neural networks. Journal of Imaging, 3, 6.CrossRef Cheng, H., Damerow, L., Sun, Y., & Blanke, M. (2017). Early yield prediction using image analysis of apple fruit and tree canopy features with neural networks. Journal of Imaging, 3, 6.CrossRef
41.
Zurück zum Zitat MATLAB. (2016). MATLAB and image processing toolbox release. Natick, MA: The MathWorks. MATLAB. (2016). MATLAB and image processing toolbox release. Natick, MA: The MathWorks.
44.
Zurück zum Zitat Bertsekas, D. P., & Tsitsiklis, J. N. (2008). Introduction to probability (2nd ed.). Belmont: Athena Scientific. Bertsekas, D. P., & Tsitsiklis, J. N. (2008). Introduction to probability (2nd ed.). Belmont: Athena Scientific.
45.
Zurück zum Zitat Lay, D. C. (2003). Linear algebra and its applications (3rd ed.). Boston: Addison-Wesley. Lay, D. C. (2003). Linear algebra and its applications (3rd ed.). Boston: Addison-Wesley.
46.
Zurück zum Zitat Zhang, L., Zhang, H., Chen, Y., Dai, S., Li, X., Imou, K., Liu, Z., & Li, M. (2019). Real-time monitoring of optimum timing for harvesting fresh tea leaves based on machine vision. International Journal of Agricultural & Biological Engineering, 12(1), 6–9.CrossRef Zhang, L., Zhang, H., Chen, Y., Dai, S., Li, X., Imou, K., Liu, Z., & Li, M. (2019). Real-time monitoring of optimum timing for harvesting fresh tea leaves based on machine vision. International Journal of Agricultural & Biological Engineering, 12(1), 6–9.CrossRef
51.
Zurück zum Zitat Richey, C. B. (1959). “Automatic pilot” for farm tractors. Agricultural Engineering, 40(2), 78–79, 93. Richey, C. B. (1959). “Automatic pilot” for farm tractors. Agricultural Engineering, 40(2), 78–79, 93.
52.
Zurück zum Zitat Tillet, N. D. (1991). Automatic guidance sensors for agricultural field machines: A review. Journal of Agricultural Engineering Research, 50, 167–187.CrossRef Tillet, N. D. (1991). Automatic guidance sensors for agricultural field machines: A review. Journal of Agricultural Engineering Research, 50, 167–187.CrossRef
53.
Zurück zum Zitat Reid, J. F., Zhang, Q., Noguchi, N., & Dickson, M. (2000). Agricultural automatic guidance in North America. Computers and Electronics in Agriculture, 25(1/2), 154–168. Reid, J. F., Zhang, Q., Noguchi, N., & Dickson, M. (2000). Agricultural automatic guidance in North America. Computers and Electronics in Agriculture, 25(1/2), 154–168.
55.
Zurück zum Zitat Bolton, W. (2001). Mechatronics, electronic control systems in mechanical and electrical engineering (2nd ed.). Boston: Addison Wesley Longman. Bolton, W. (2001). Mechatronics, electronic control systems in mechanical and electrical engineering (2nd ed.). Boston: Addison Wesley Longman.
Metadaten
Titel
Machine Vision System for Orchard Management
verfasst von
Duke M. Bulanon
Tyler Hestand
Connor Nogales
Brice Allen
Jason Colwell
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-22587-2_7

Neuer Inhalt