Skip to main content
Top
Published in: Machine Vision and Applications 5/2016

01-07-2016 | Special Issue Paper

Multi-modality imagery database for plant phenotyping

Authors: Jeffrey A. Cruz, Xi Yin, Xiaoming Liu, Saif M. Imran, Daniel D. Morris, David M. Kramer, Jin Chen

Published in: Machine Vision and Applications | Issue 5/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Among many applications of machine vision, plant image analysis has recently began to gain more attention due to its potential impact on plant visual phenotyping, particularly in understanding plant growth, assessing the quality/performance of crop plants, and improving crop yield. Despite its importance, the lack of publicly available research databases containing plant imagery has substantially hindered the advancement of plant image analysis. To alleviate this issue, this paper presents a new multi-modality plant imagery database named “MSU-PID,” with two distinct properties. First, MSU-PID is captured using four types of imaging sensors, fluorescence, infrared, RGB color, and depth. Second, the imaging setup and the variety of manual labels allow MSU-PID to be suitable for a diverse set of plant image analysis applications, such as leaf segmentation, leaf counting, leaf alignment, and leaf tracking. We provide detailed information on the plants, imaging sensors, calibration, labeling, and baseline performances of this new database.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Baker, N.R.: Chlorophyll fluorescence: a probe of photosynthesis in vivo. Annu. Rev. Plant Biol. 59, 89–113 (2008)CrossRef Baker, N.R.: Chlorophyll fluorescence: a probe of photosynthesis in vivo. Annu. Rev. Plant Biol. 59, 89–113 (2008)CrossRef
2.
go back to reference Barbosa, I.B., Cristani, M., Del Bue, A., Bazzani, L., Murino, V.: Re-identification with RGB-D sensors. In: First International Workshop on Re-Identification, pp. 433–442 (2012) Barbosa, I.B., Cristani, M., Del Bue, A., Bazzani, L., Murino, V.: Re-identification with RGB-D sensors. In: First International Workshop on Re-Identification, pp. 433–442 (2012)
3.
go back to reference Barrow, H.G., Tenenbaum, J.M., Bolles, R.C., Wolf, H.C.: Parametric correspondence and Chamfer matching: two new techniques for image matching. In: Technical report, DTIC Document (1977) Barrow, H.G., Tenenbaum, J.M., Bolles, R.C., Wolf, H.C.: Parametric correspondence and Chamfer matching: two new techniques for image matching. In: Technical report, DTIC Document (1977)
4.
go back to reference Butler, W.L., Hendricks, S.B., Siegelman, H.W.: Action spectra of phytochrome in vitro. Photochem. Photobiol. 3(4), 521–528 (1964)CrossRef Butler, W.L., Hendricks, S.B., Siegelman, H.W.: Action spectra of phytochrome in vitro. Photochem. Photobiol. 3(4), 521–528 (1964)CrossRef
5.
go back to reference Chelle, M.: Could plant leaves be treated as Lambertian surfaces in dense crop canopies to estimate light absorption? Ecol. Model. 198(1), 219–228 (2006)CrossRef Chelle, M.: Could plant leaves be treated as Lambertian surfaces in dense crop canopies to estimate light absorption? Ecol. Model. 198(1), 219–228 (2006)CrossRef
6.
go back to reference Chen, D., Neumann, K., Friedel, S., Kilian, Benjamin, Chen, M., Altmann, T., Klukas, C.: Dissecting the phenotypic components of crop plant growth and drought responses based on high-throughput image analysis. Plant Cell 26(12), 4636–4655 (2014)CrossRef Chen, D., Neumann, K., Friedel, S., Kilian, Benjamin, Chen, M., Altmann, T., Klukas, C.: Dissecting the phenotypic components of crop plant growth and drought responses based on high-throughput image analysis. Plant Cell 26(12), 4636–4655 (2014)CrossRef
7.
go back to reference Chen, J., Liu, X.: Transfer learning with one-class data. Pattern Recognit. Lett. 37, 32–40 (2013)CrossRef Chen, J., Liu, X.: Transfer learning with one-class data. Pattern Recognit. Lett. 37, 32–40 (2013)CrossRef
8.
go back to reference Chen, J., Liu, X., Lyu, S.: Boosting with side information. In: Proceedings of the Asian Conference on Computer Vision (ACCV), pp. 563–577. Springer, New York (2013) Chen, J., Liu, X., Lyu, S.: Boosting with side information. In: Proceedings of the Asian Conference on Computer Vision (ACCV), pp. 563–577. Springer, New York (2013)
9.
go back to reference Ding, Z., Ming, S., Fu, Y.: Latent low-rank transfer subspace learning for missing modality recognition. In: Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) (2014) Ding, Z., Ming, S., Fu, Y.: Latent low-rank transfer subspace learning for missing modality recognition. In: Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) (2014)
10.
go back to reference Döös, B.R.: Population growth and loss of arable land. Glob. Environ. Change 12(4), 303–311 (2002)CrossRef Döös, B.R.: Population growth and loss of arable land. Glob. Environ. Change 12(4), 303–311 (2002)CrossRef
11.
go back to reference Eskins, K.: Light-quality effects on Arabidopsis development. Red, blue and far-red regulation of flowering and morphology. Physiol. Plant. 86(3), 439–444 (1992) Eskins, K.: Light-quality effects on Arabidopsis development. Red, blue and far-red regulation of flowering and morphology. Physiol. Plant. 86(3), 439–444 (1992)
12.
go back to reference Fahlgren, N., Gehan, M.A., Baxter, I.: Lights, camera, action: high-throughput plant phenotyping is ready for a close-up. Curr. Opin. Plant Biol. 24, 93–99 (2015)CrossRef Fahlgren, N., Gehan, M.A., Baxter, I.: Lights, camera, action: high-throughput plant phenotyping is ready for a close-up. Curr. Opin. Plant Biol. 24, 93–99 (2015)CrossRef
13.
go back to reference Furbank, R.T., Tester, M.: Phenomics-technologies to relieve the phenotyping bottleneck. Trends Plant Sci. 16(12), 635–644 (2011)CrossRef Furbank, R.T., Tester, M.: Phenomics-technologies to relieve the phenotyping bottleneck. Trends Plant Sci. 16(12), 635–644 (2011)CrossRef
14.
go back to reference Hansard, M., Lee, S., Choi, O., Horaud, R.: Time-of-Flight Cameras: Principles. Methods and Applications. Springer, New York (2013)CrossRef Hansard, M., Lee, S., Choi, O., Horaud, R.: Time-of-Flight Cameras: Principles. Methods and Applications. Springer, New York (2013)CrossRef
15.
go back to reference Haug, S., Ostermann, J.: A crop/weed field image dataset for the evaluation of computer vision based precision agriculture tasks. In: Proceedings of the European Conference on Computer Vision Workshops (ECCVW), pp. 105–116. Springer, New York ( 2014) Haug, S., Ostermann, J.: A crop/weed field image dataset for the evaluation of computer vision based precision agriculture tasks. In: Proceedings of the European Conference on Computer Vision Workshops (ECCVW), pp. 105–116. Springer, New York ( 2014)
16.
go back to reference Houle, D., Govindaraju, D.R., Omholt, S.: Phenomics: the next challenge. Nat. Rev. Genet. 11(12), 855–866 (2010)CrossRef Houle, D., Govindaraju, D.R., Omholt, S.: Phenomics: the next challenge. Nat. Rev. Genet. 11(12), 855–866 (2010)CrossRef
17.
go back to reference Huang, G.B., Ramesh, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: a database for studying face recognition in unconstrained environments. In:Technical Report 07-49, University of Massachusetts, Amherst (2007) Huang, G.B., Ramesh, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: a database for studying face recognition in unconstrained environments. In:Technical Report 07-49, University of Massachusetts, Amherst (2007)
18.
go back to reference Johannsen, W.L.: Erblichkeit in Populationen und in reinen Linien. Gustav Fischer, Germany (1903) Johannsen, W.L.: Erblichkeit in Populationen und in reinen Linien. Gustav Fischer, Germany (1903)
19.
go back to reference Kramer, D., Cruz, J., Hall, C., Kovac, W.K., Zegarac, R.: Plant Phenometrics Systems and Methods and Devices Related Thereto. In: US Patent 20, 150, 204, 787 (2015) Kramer, D., Cruz, J., Hall, C., Kovac, W.K., Zegarac, R.: Plant Phenometrics Systems and Methods and Devices Related Thereto. In: US Patent 20, 150, 204, 787 (2015)
20.
go back to reference Kumar, N., Belhumeur, P.N., Biswas, A., Jacobs, D.W., John Kress, W., Lopez, I.C., Soares, J.V.B.: Leafsnap: a computer vision system for automatic plant species identification. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 502–516. Springer, New York (2012) Kumar, N., Belhumeur, P.N., Biswas, A., Jacobs, D.W., John Kress, W., Lopez, I.C., Soares, J.V.B.: Leafsnap: a computer vision system for automatic plant species identification. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 502–516. Springer, New York (2012)
21.
go back to reference Kevin, L., Bo, L., Ren, X., Fox, D.: A large-scale hierarchical multi-view RGB-D object dataset. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 1817–1824 (2011) Kevin, L., Bo, L., Ren, X., Fox, D.: A large-scale hierarchical multi-view RGB-D object dataset. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 1817–1824 (2011)
22.
24.
go back to reference Minervini, M., Scharr, H., Tsaftaris, S.A.: Image analysis: the new bottleneck in plant phenotyping. IEEE Signal Process. Mag. 32(4), 126–131 (2015)CrossRef Minervini, M., Scharr, H., Tsaftaris, S.A.: Image analysis: the new bottleneck in plant phenotyping. IEEE Signal Process. Mag. 32(4), 126–131 (2015)CrossRef
25.
go back to reference Nguyen, V.D., Chew, M.T., Demidenko, S.: Vietnamese sign language reader using Intel Creative Senz3D. In: IEEE International Conference on Automation, Robotics and Applications (ICARA), pp. 77–82 (2015) Nguyen, V.D., Chew, M.T., Demidenko, S.: Vietnamese sign language reader using Intel Creative Senz3D. In: IEEE International Conference on Automation, Robotics and Applications (ICARA), pp. 77–82 (2015)
26.
go back to reference Oxborough, Kevin: Imaging of chlorophyll a fluorescence: theoretical and practical aspects of an emerging technique for the monitoring of photosynthetic performance. J. Exp. Bot. 55(400), 1195–1205 (2004)CrossRef Oxborough, Kevin: Imaging of chlorophyll a fluorescence: theoretical and practical aspects of an emerging technique for the monitoring of photosynthetic performance. J. Exp. Bot. 55(400), 1195–1205 (2004)CrossRef
27.
go back to reference Phillips, P.J., Moon, H., Rauss, P.J., Rizvi, S.: The FERET evaluation methodology for face recognition algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 22(10), 1090–1104 (2000)CrossRef Phillips, P.J., Moon, H., Rauss, P.J., Rizvi, S.: The FERET evaluation methodology for face recognition algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 22(10), 1090–1104 (2000)CrossRef
28.
go back to reference Scharr, H., Minervini, M., Fischbach, A., Tsaftaris, S.A.: Annotated image datasets of rosette plants. In:Technical Report FZJ-2014-03837 (2014) Scharr, H., Minervini, M., Fischbach, A., Tsaftaris, S.A.: Annotated image datasets of rosette plants. In:Technical Report FZJ-2014-03837 (2014)
29.
go back to reference Schöttler, M.A., Tóth, S.Z., Boulouis, A., Kahlau, S.: Photosynthetic complex stoichiometry dynamics in higher plants: biogenesis, function, and turnover of ATP synthase and the cytochrome b 6 f complex. J. Exp. Bot. 66(9), 2373–2400 (2015)CrossRef Schöttler, M.A., Tóth, S.Z., Boulouis, A., Kahlau, S.: Photosynthetic complex stoichiometry dynamics in higher plants: biogenesis, function, and turnover of ATP synthase and the cytochrome b 6 f complex. J. Exp. Bot. 66(9), 2373–2400 (2015)CrossRef
30.
go back to reference Silberman, N., Fergus, R.: Indoor scene segmentation using a structured light sensor. In: IEEE International Conference on Computer Vision Workshops (ICCV Workshops), pp. 601–608 (2011) Silberman, N., Fergus, R.: Indoor scene segmentation using a structured light sensor. In: IEEE International Conference on Computer Vision Workshops (ICCV Workshops), pp. 601–608 (2011)
31.
go back to reference Söderkvist, O.: Computer vision classification of leaves from Swedish trees. In: Master thesis, Linköping University (2001) Söderkvist, O.: Computer vision classification of leaves from Swedish trees. In: Master thesis, Linköping University (2001)
32.
go back to reference Sturm, J., Engelhard, N., Endres, F., Burgard, W., Cremers, D.: A benchmark for the evaluation of RGB-D SLAM systems. In: Proceedings of the International Conference on Intelligent Robot Systems (IROS), pp. 573–580 (2012) Sturm, J., Engelhard, N., Endres, F., Burgard, W., Cremers, D.: A benchmark for the evaluation of RGB-D SLAM systems. In: Proceedings of the International Conference on Intelligent Robot Systems (IROS), pp. 573–580 (2012)
33.
go back to reference Sung, J., Ponce, C., Selman, B., Saxena, A.: Human activity detection from RGBD images. CoRR 64 (2011) Sung, J., Ponce, C., Selman, B., Saxena, A.: Human activity detection from RGBD images. CoRR 64 (2011)
34.
go back to reference Walter, A., Liebisch, F., Hund, A.: Plant phenotyping: from bean weighing to image analysis. Plant Methods 11(1), 14 (2015)CrossRef Walter, A., Liebisch, F., Hund, A.: Plant phenotyping: from bean weighing to image analysis. Plant Methods 11(1), 14 (2015)CrossRef
35.
go back to reference Woolley, J.T.: Reflectance and transmittance of light by leaves. Plant Physiol. 47(5), 656–662 (1971)CrossRef Woolley, J.T.: Reflectance and transmittance of light by leaves. Plant Physiol. 47(5), 656–662 (1971)CrossRef
36.
go back to reference Wu, S.G., Bao, F.S., Xu, E.Y., Wang, Y.-X., Chang, Y.-F., Xiang, Q.-L.: A leaf recognition algorithm for plant classification using probabilistic neural network. In: IEEE International Symposium on Signal Processing and Information Technology, pp. 11–16 (2007) Wu, S.G., Bao, F.S., Xu, E.Y., Wang, Y.-X., Chang, Y.-F., Xiang, Q.-L.: A leaf recognition algorithm for plant classification using probabilistic neural network. In: IEEE International Symposium on Signal Processing and Information Technology, pp. 11–16 (2007)
37.
go back to reference Yin, X., Liu, X., Chen, J., Kramer, D.M.: Multi-leaf alignment from fluorescence plant images. In: IEEE Winter Conference on Applications of Computer Vision (WACV), Steamboat Springs (2014) Yin, X., Liu, X., Chen, J., Kramer, D.M.: Multi-leaf alignment from fluorescence plant images. In: IEEE Winter Conference on Applications of Computer Vision (WACV), Steamboat Springs (2014)
38.
go back to reference Yin, X., Liu, X., Chen, J., Kramer, D.M.: Multi-leaf tracking from fluorescence plant videos. In: Proceedings of the International Conference on Image Processing (ICIP), Paris (2014) Yin, X., Liu, X., Chen, J., Kramer, D.M.: Multi-leaf tracking from fluorescence plant videos. In: Proceedings of the International Conference on Image Processing (ICIP), Paris (2014)
39.
go back to reference Yin, X., Liu, X., Chen, J., Kramer, D.M.: Joint Multi-Leaf Segmentation, Alignment, and Tracking from Fluorescence Plant Videos (2015). arXiv:1505.00353 Yin, X., Liu, X., Chen, J., Kramer, D.M.: Joint Multi-Leaf Segmentation, Alignment, and Tracking from Fluorescence Plant Videos (2015). arXiv:​1505.​00353
40.
go back to reference Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)CrossRef Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)CrossRef
Metadata
Title
Multi-modality imagery database for plant phenotyping
Authors
Jeffrey A. Cruz
Xi Yin
Xiaoming Liu
Saif M. Imran
Daniel D. Morris
David M. Kramer
Jin Chen
Publication date
01-07-2016
Publisher
Springer Berlin Heidelberg
Published in
Machine Vision and Applications / Issue 5/2016
Print ISSN: 0932-8092
Electronic ISSN: 1432-1769
DOI
https://doi.org/10.1007/s00138-015-0734-6

Other articles of this Issue 5/2016

Machine Vision and Applications 5/2016 Go to the issue

Premium Partner