Skip to main content
Erschienen in: Machine Vision and Applications 5/2016

01.07.2016 | Special Issue Paper

Multi-modality imagery database for plant phenotyping

verfasst von: Jeffrey A. Cruz, Xi Yin, Xiaoming Liu, Saif M. Imran, Daniel D. Morris, David M. Kramer, Jin Chen

Erschienen in: Machine Vision and Applications | Ausgabe 5/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Among many applications of machine vision, plant image analysis has recently began to gain more attention due to its potential impact on plant visual phenotyping, particularly in understanding plant growth, assessing the quality/performance of crop plants, and improving crop yield. Despite its importance, the lack of publicly available research databases containing plant imagery has substantially hindered the advancement of plant image analysis. To alleviate this issue, this paper presents a new multi-modality plant imagery database named “MSU-PID,” with two distinct properties. First, MSU-PID is captured using four types of imaging sensors, fluorescence, infrared, RGB color, and depth. Second, the imaging setup and the variety of manual labels allow MSU-PID to be suitable for a diverse set of plant image analysis applications, such as leaf segmentation, leaf counting, leaf alignment, and leaf tracking. We provide detailed information on the plants, imaging sensors, calibration, labeling, and baseline performances of this new database.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Baker, N.R.: Chlorophyll fluorescence: a probe of photosynthesis in vivo. Annu. Rev. Plant Biol. 59, 89–113 (2008)CrossRef Baker, N.R.: Chlorophyll fluorescence: a probe of photosynthesis in vivo. Annu. Rev. Plant Biol. 59, 89–113 (2008)CrossRef
2.
Zurück zum Zitat Barbosa, I.B., Cristani, M., Del Bue, A., Bazzani, L., Murino, V.: Re-identification with RGB-D sensors. In: First International Workshop on Re-Identification, pp. 433–442 (2012) Barbosa, I.B., Cristani, M., Del Bue, A., Bazzani, L., Murino, V.: Re-identification with RGB-D sensors. In: First International Workshop on Re-Identification, pp. 433–442 (2012)
3.
Zurück zum Zitat Barrow, H.G., Tenenbaum, J.M., Bolles, R.C., Wolf, H.C.: Parametric correspondence and Chamfer matching: two new techniques for image matching. In: Technical report, DTIC Document (1977) Barrow, H.G., Tenenbaum, J.M., Bolles, R.C., Wolf, H.C.: Parametric correspondence and Chamfer matching: two new techniques for image matching. In: Technical report, DTIC Document (1977)
4.
Zurück zum Zitat Butler, W.L., Hendricks, S.B., Siegelman, H.W.: Action spectra of phytochrome in vitro. Photochem. Photobiol. 3(4), 521–528 (1964)CrossRef Butler, W.L., Hendricks, S.B., Siegelman, H.W.: Action spectra of phytochrome in vitro. Photochem. Photobiol. 3(4), 521–528 (1964)CrossRef
5.
Zurück zum Zitat Chelle, M.: Could plant leaves be treated as Lambertian surfaces in dense crop canopies to estimate light absorption? Ecol. Model. 198(1), 219–228 (2006)CrossRef Chelle, M.: Could plant leaves be treated as Lambertian surfaces in dense crop canopies to estimate light absorption? Ecol. Model. 198(1), 219–228 (2006)CrossRef
6.
Zurück zum Zitat Chen, D., Neumann, K., Friedel, S., Kilian, Benjamin, Chen, M., Altmann, T., Klukas, C.: Dissecting the phenotypic components of crop plant growth and drought responses based on high-throughput image analysis. Plant Cell 26(12), 4636–4655 (2014)CrossRef Chen, D., Neumann, K., Friedel, S., Kilian, Benjamin, Chen, M., Altmann, T., Klukas, C.: Dissecting the phenotypic components of crop plant growth and drought responses based on high-throughput image analysis. Plant Cell 26(12), 4636–4655 (2014)CrossRef
7.
Zurück zum Zitat Chen, J., Liu, X.: Transfer learning with one-class data. Pattern Recognit. Lett. 37, 32–40 (2013)CrossRef Chen, J., Liu, X.: Transfer learning with one-class data. Pattern Recognit. Lett. 37, 32–40 (2013)CrossRef
8.
Zurück zum Zitat Chen, J., Liu, X., Lyu, S.: Boosting with side information. In: Proceedings of the Asian Conference on Computer Vision (ACCV), pp. 563–577. Springer, New York (2013) Chen, J., Liu, X., Lyu, S.: Boosting with side information. In: Proceedings of the Asian Conference on Computer Vision (ACCV), pp. 563–577. Springer, New York (2013)
9.
Zurück zum Zitat Ding, Z., Ming, S., Fu, Y.: Latent low-rank transfer subspace learning for missing modality recognition. In: Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) (2014) Ding, Z., Ming, S., Fu, Y.: Latent low-rank transfer subspace learning for missing modality recognition. In: Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) (2014)
10.
Zurück zum Zitat Döös, B.R.: Population growth and loss of arable land. Glob. Environ. Change 12(4), 303–311 (2002)CrossRef Döös, B.R.: Population growth and loss of arable land. Glob. Environ. Change 12(4), 303–311 (2002)CrossRef
11.
Zurück zum Zitat Eskins, K.: Light-quality effects on Arabidopsis development. Red, blue and far-red regulation of flowering and morphology. Physiol. Plant. 86(3), 439–444 (1992) Eskins, K.: Light-quality effects on Arabidopsis development. Red, blue and far-red regulation of flowering and morphology. Physiol. Plant. 86(3), 439–444 (1992)
12.
Zurück zum Zitat Fahlgren, N., Gehan, M.A., Baxter, I.: Lights, camera, action: high-throughput plant phenotyping is ready for a close-up. Curr. Opin. Plant Biol. 24, 93–99 (2015)CrossRef Fahlgren, N., Gehan, M.A., Baxter, I.: Lights, camera, action: high-throughput plant phenotyping is ready for a close-up. Curr. Opin. Plant Biol. 24, 93–99 (2015)CrossRef
13.
Zurück zum Zitat Furbank, R.T., Tester, M.: Phenomics-technologies to relieve the phenotyping bottleneck. Trends Plant Sci. 16(12), 635–644 (2011)CrossRef Furbank, R.T., Tester, M.: Phenomics-technologies to relieve the phenotyping bottleneck. Trends Plant Sci. 16(12), 635–644 (2011)CrossRef
14.
Zurück zum Zitat Hansard, M., Lee, S., Choi, O., Horaud, R.: Time-of-Flight Cameras: Principles. Methods and Applications. Springer, New York (2013)CrossRef Hansard, M., Lee, S., Choi, O., Horaud, R.: Time-of-Flight Cameras: Principles. Methods and Applications. Springer, New York (2013)CrossRef
15.
Zurück zum Zitat Haug, S., Ostermann, J.: A crop/weed field image dataset for the evaluation of computer vision based precision agriculture tasks. In: Proceedings of the European Conference on Computer Vision Workshops (ECCVW), pp. 105–116. Springer, New York ( 2014) Haug, S., Ostermann, J.: A crop/weed field image dataset for the evaluation of computer vision based precision agriculture tasks. In: Proceedings of the European Conference on Computer Vision Workshops (ECCVW), pp. 105–116. Springer, New York ( 2014)
16.
Zurück zum Zitat Houle, D., Govindaraju, D.R., Omholt, S.: Phenomics: the next challenge. Nat. Rev. Genet. 11(12), 855–866 (2010)CrossRef Houle, D., Govindaraju, D.R., Omholt, S.: Phenomics: the next challenge. Nat. Rev. Genet. 11(12), 855–866 (2010)CrossRef
17.
Zurück zum Zitat Huang, G.B., Ramesh, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: a database for studying face recognition in unconstrained environments. In:Technical Report 07-49, University of Massachusetts, Amherst (2007) Huang, G.B., Ramesh, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: a database for studying face recognition in unconstrained environments. In:Technical Report 07-49, University of Massachusetts, Amherst (2007)
18.
Zurück zum Zitat Johannsen, W.L.: Erblichkeit in Populationen und in reinen Linien. Gustav Fischer, Germany (1903) Johannsen, W.L.: Erblichkeit in Populationen und in reinen Linien. Gustav Fischer, Germany (1903)
19.
Zurück zum Zitat Kramer, D., Cruz, J., Hall, C., Kovac, W.K., Zegarac, R.: Plant Phenometrics Systems and Methods and Devices Related Thereto. In: US Patent 20, 150, 204, 787 (2015) Kramer, D., Cruz, J., Hall, C., Kovac, W.K., Zegarac, R.: Plant Phenometrics Systems and Methods and Devices Related Thereto. In: US Patent 20, 150, 204, 787 (2015)
20.
Zurück zum Zitat Kumar, N., Belhumeur, P.N., Biswas, A., Jacobs, D.W., John Kress, W., Lopez, I.C., Soares, J.V.B.: Leafsnap: a computer vision system for automatic plant species identification. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 502–516. Springer, New York (2012) Kumar, N., Belhumeur, P.N., Biswas, A., Jacobs, D.W., John Kress, W., Lopez, I.C., Soares, J.V.B.: Leafsnap: a computer vision system for automatic plant species identification. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 502–516. Springer, New York (2012)
21.
Zurück zum Zitat Kevin, L., Bo, L., Ren, X., Fox, D.: A large-scale hierarchical multi-view RGB-D object dataset. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 1817–1824 (2011) Kevin, L., Bo, L., Ren, X., Fox, D.: A large-scale hierarchical multi-view RGB-D object dataset. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 1817–1824 (2011)
22.
Zurück zum Zitat McClung, C.R.: Plant circadian rhythms. Plant Cell 18(4), 792–803 (2006)CrossRef McClung, C.R.: Plant circadian rhythms. Plant Cell 18(4), 792–803 (2006)CrossRef
24.
Zurück zum Zitat Minervini, M., Scharr, H., Tsaftaris, S.A.: Image analysis: the new bottleneck in plant phenotyping. IEEE Signal Process. Mag. 32(4), 126–131 (2015)CrossRef Minervini, M., Scharr, H., Tsaftaris, S.A.: Image analysis: the new bottleneck in plant phenotyping. IEEE Signal Process. Mag. 32(4), 126–131 (2015)CrossRef
25.
Zurück zum Zitat Nguyen, V.D., Chew, M.T., Demidenko, S.: Vietnamese sign language reader using Intel Creative Senz3D. In: IEEE International Conference on Automation, Robotics and Applications (ICARA), pp. 77–82 (2015) Nguyen, V.D., Chew, M.T., Demidenko, S.: Vietnamese sign language reader using Intel Creative Senz3D. In: IEEE International Conference on Automation, Robotics and Applications (ICARA), pp. 77–82 (2015)
26.
Zurück zum Zitat Oxborough, Kevin: Imaging of chlorophyll a fluorescence: theoretical and practical aspects of an emerging technique for the monitoring of photosynthetic performance. J. Exp. Bot. 55(400), 1195–1205 (2004)CrossRef Oxborough, Kevin: Imaging of chlorophyll a fluorescence: theoretical and practical aspects of an emerging technique for the monitoring of photosynthetic performance. J. Exp. Bot. 55(400), 1195–1205 (2004)CrossRef
27.
Zurück zum Zitat Phillips, P.J., Moon, H., Rauss, P.J., Rizvi, S.: The FERET evaluation methodology for face recognition algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 22(10), 1090–1104 (2000)CrossRef Phillips, P.J., Moon, H., Rauss, P.J., Rizvi, S.: The FERET evaluation methodology for face recognition algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 22(10), 1090–1104 (2000)CrossRef
28.
Zurück zum Zitat Scharr, H., Minervini, M., Fischbach, A., Tsaftaris, S.A.: Annotated image datasets of rosette plants. In:Technical Report FZJ-2014-03837 (2014) Scharr, H., Minervini, M., Fischbach, A., Tsaftaris, S.A.: Annotated image datasets of rosette plants. In:Technical Report FZJ-2014-03837 (2014)
29.
Zurück zum Zitat Schöttler, M.A., Tóth, S.Z., Boulouis, A., Kahlau, S.: Photosynthetic complex stoichiometry dynamics in higher plants: biogenesis, function, and turnover of ATP synthase and the cytochrome b 6 f complex. J. Exp. Bot. 66(9), 2373–2400 (2015)CrossRef Schöttler, M.A., Tóth, S.Z., Boulouis, A., Kahlau, S.: Photosynthetic complex stoichiometry dynamics in higher plants: biogenesis, function, and turnover of ATP synthase and the cytochrome b 6 f complex. J. Exp. Bot. 66(9), 2373–2400 (2015)CrossRef
30.
Zurück zum Zitat Silberman, N., Fergus, R.: Indoor scene segmentation using a structured light sensor. In: IEEE International Conference on Computer Vision Workshops (ICCV Workshops), pp. 601–608 (2011) Silberman, N., Fergus, R.: Indoor scene segmentation using a structured light sensor. In: IEEE International Conference on Computer Vision Workshops (ICCV Workshops), pp. 601–608 (2011)
31.
Zurück zum Zitat Söderkvist, O.: Computer vision classification of leaves from Swedish trees. In: Master thesis, Linköping University (2001) Söderkvist, O.: Computer vision classification of leaves from Swedish trees. In: Master thesis, Linköping University (2001)
32.
Zurück zum Zitat Sturm, J., Engelhard, N., Endres, F., Burgard, W., Cremers, D.: A benchmark for the evaluation of RGB-D SLAM systems. In: Proceedings of the International Conference on Intelligent Robot Systems (IROS), pp. 573–580 (2012) Sturm, J., Engelhard, N., Endres, F., Burgard, W., Cremers, D.: A benchmark for the evaluation of RGB-D SLAM systems. In: Proceedings of the International Conference on Intelligent Robot Systems (IROS), pp. 573–580 (2012)
33.
Zurück zum Zitat Sung, J., Ponce, C., Selman, B., Saxena, A.: Human activity detection from RGBD images. CoRR 64 (2011) Sung, J., Ponce, C., Selman, B., Saxena, A.: Human activity detection from RGBD images. CoRR 64 (2011)
34.
Zurück zum Zitat Walter, A., Liebisch, F., Hund, A.: Plant phenotyping: from bean weighing to image analysis. Plant Methods 11(1), 14 (2015)CrossRef Walter, A., Liebisch, F., Hund, A.: Plant phenotyping: from bean weighing to image analysis. Plant Methods 11(1), 14 (2015)CrossRef
35.
Zurück zum Zitat Woolley, J.T.: Reflectance and transmittance of light by leaves. Plant Physiol. 47(5), 656–662 (1971)CrossRef Woolley, J.T.: Reflectance and transmittance of light by leaves. Plant Physiol. 47(5), 656–662 (1971)CrossRef
36.
Zurück zum Zitat Wu, S.G., Bao, F.S., Xu, E.Y., Wang, Y.-X., Chang, Y.-F., Xiang, Q.-L.: A leaf recognition algorithm for plant classification using probabilistic neural network. In: IEEE International Symposium on Signal Processing and Information Technology, pp. 11–16 (2007) Wu, S.G., Bao, F.S., Xu, E.Y., Wang, Y.-X., Chang, Y.-F., Xiang, Q.-L.: A leaf recognition algorithm for plant classification using probabilistic neural network. In: IEEE International Symposium on Signal Processing and Information Technology, pp. 11–16 (2007)
37.
Zurück zum Zitat Yin, X., Liu, X., Chen, J., Kramer, D.M.: Multi-leaf alignment from fluorescence plant images. In: IEEE Winter Conference on Applications of Computer Vision (WACV), Steamboat Springs (2014) Yin, X., Liu, X., Chen, J., Kramer, D.M.: Multi-leaf alignment from fluorescence plant images. In: IEEE Winter Conference on Applications of Computer Vision (WACV), Steamboat Springs (2014)
38.
Zurück zum Zitat Yin, X., Liu, X., Chen, J., Kramer, D.M.: Multi-leaf tracking from fluorescence plant videos. In: Proceedings of the International Conference on Image Processing (ICIP), Paris (2014) Yin, X., Liu, X., Chen, J., Kramer, D.M.: Multi-leaf tracking from fluorescence plant videos. In: Proceedings of the International Conference on Image Processing (ICIP), Paris (2014)
39.
Zurück zum Zitat Yin, X., Liu, X., Chen, J., Kramer, D.M.: Joint Multi-Leaf Segmentation, Alignment, and Tracking from Fluorescence Plant Videos (2015). arXiv:1505.00353 Yin, X., Liu, X., Chen, J., Kramer, D.M.: Joint Multi-Leaf Segmentation, Alignment, and Tracking from Fluorescence Plant Videos (2015). arXiv:​1505.​00353
40.
Zurück zum Zitat Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)CrossRef Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)CrossRef
Metadaten
Titel
Multi-modality imagery database for plant phenotyping
verfasst von
Jeffrey A. Cruz
Xi Yin
Xiaoming Liu
Saif M. Imran
Daniel D. Morris
David M. Kramer
Jin Chen
Publikationsdatum
01.07.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
Machine Vision and Applications / Ausgabe 5/2016
Print ISSN: 0932-8092
Elektronische ISSN: 1432-1769
DOI
https://doi.org/10.1007/s00138-015-0734-6

Weitere Artikel der Ausgabe 5/2016

Machine Vision and Applications 5/2016 Zur Ausgabe

Premium Partner