Skip to main content

2019 | OriginalPaper | Buchkapitel

One-Shot Learned Priors in Augmented Active Appearance Models for Anatomical Landmark Tracking

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In motion science, biology and robotics animal movement analyses are used for the detailed understanding of the human bipedal locomotion. For this investigations an immense amount of recorded image data has to be evaluated by biological experts. During this time-consuming evaluation single anatomical landmarks, for example bone ends, have to be located and annotated in each image. In this paper we show a reduction of this effort by automating the annotation with a minimum level of user interaction. Recent approaches, based on Active Appearance Models, are improved by priors based on anatomical knowledge and an online tracking method, requiring only a single labeled frame. In contrast, we propose a one-shot learned tracking-by-detection prior which overcomes the shortcomings of template drifts without increasing the number of training data. We evaluate our approach based on a variety of real-world X-ray locomotion datasets and show that our method outperforms recent state-of-the-art concepts for the task at hand.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Nyakatura, J.A., Andrada, E., Blickhan, R., Fischer, M.S.: Avian bipedal locomotion. In: 5th International Symposium on Adaptive Motion of Animals and Machines (AMAM). Elsevier (2011) Nyakatura, J.A., Andrada, E., Blickhan, R., Fischer, M.S.: Avian bipedal locomotion. In: 5th International Symposium on Adaptive Motion of Animals and Machines (AMAM). Elsevier (2011)
2.
Zurück zum Zitat Andrada, E., Nyakatura, J.A., Bergmann, F., Blickhan, R.: Adjustments of global and local hindlimb properties during terrestrial locomotion of the common quail (coturnix coturnix). J. Exp. Biol. (2013) Andrada, E., Nyakatura, J.A., Bergmann, F., Blickhan, R.: Adjustments of global and local hindlimb properties during terrestrial locomotion of the common quail (coturnix coturnix). J. Exp. Biol. (2013)
3.
Zurück zum Zitat Sigal, L., Balan, A.O., Black, M.J.: HumanEva: synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion. Int. J. Comput. Vis. 87(1–2), 4 (2010)CrossRef Sigal, L., Balan, A.O., Black, M.J.: HumanEva: synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion. Int. J. Comput. Vis. 87(1–2), 4 (2010)CrossRef
4.
Zurück zum Zitat Haase, D., Andrada, E., Nyakatura, J.A., Kilbourne, B.M., Denzler, J.: Automated approximation of center of mass position in X-ray sequences of animal locomotion. J. Biomech. 46, 2082–2086 (2013)CrossRef Haase, D., Andrada, E., Nyakatura, J.A., Kilbourne, B.M., Denzler, J.: Automated approximation of center of mass position in X-ray sequences of animal locomotion. J. Biomech. 46, 2082–2086 (2013)CrossRef
5.
Zurück zum Zitat Haase, D., Denzler, J.: 2D and 3D analysis of animal locomotion from biplanar X-ray videos using augmented active appearance models. EURASIP J. Image Video Process. (2013) Haase, D., Denzler, J.: 2D and 3D analysis of animal locomotion from biplanar X-ray videos using augmented active appearance models. EURASIP J. Image Video Process. (2013)
6.
Zurück zum Zitat Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. (2001) Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. (2001)
7.
Zurück zum Zitat Amthor, M., Haase, D., Denzler, J.: Fast and robust landmark tracking in X-ray locomotion sequences containing severe occlusions. In: International Workshop on Vision, Modelling, and Visualization (VMV). Eurographics Association (2012) Amthor, M., Haase, D., Denzler, J.: Fast and robust landmark tracking in X-ray locomotion sequences containing severe occlusions. In: International Workshop on Vision, Modelling, and Visualization (VMV). Eurographics Association (2012)
8.
Zurück zum Zitat Mothes, O., Denzler, J.: Anatomical landmark tracking by one-shot learned priors for augmented active appearance models. In: International Conference on Computer Vision Theory and Applications (VISAPP), pp. 246–254 (2017) Mothes, O., Denzler, J.: Anatomical landmark tracking by one-shot learned priors for augmented active appearance models. In: International Conference on Computer Vision Theory and Applications (VISAPP), pp. 246–254 (2017)
11.
Zurück zum Zitat Lelieveldt, B., Üzümcü, M., van der Geest, R., Reiber, J., Sonka, M.: Multi-view active appearance models for consistent segmentation of multiple standard views: application to long- and short-axis cardiac MR images. In: International Congress Series (2003) Lelieveldt, B., Üzümcü, M., van der Geest, R., Reiber, J., Sonka, M.: Multi-view active appearance models for consistent segmentation of multiple standard views: application to long- and short-axis cardiac MR images. In: International Congress Series (2003)
12.
Zurück zum Zitat Amthor, M., Haase, D., Denzler, J.: Robust pictorial structures for X-ray animal skeleton tracking. In: International Conference on Computer Vision Theory and Applications (VISAPP). SCITEPRESS (2014) Amthor, M., Haase, D., Denzler, J.: Robust pictorial structures for X-ray animal skeleton tracking. In: International Conference on Computer Vision Theory and Applications (VISAPP). SCITEPRESS (2014)
13.
Zurück zum Zitat Andriluka, M., Roth, S., Schiele, B.: Monocular 3D pose estimation and tracking by detection. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE (2010) Andriluka, M., Roth, S., Schiele, B.: Monocular 3D pose estimation and tracking by detection. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE (2010)
14.
Zurück zum Zitat Li, L., Nawaz, T., Ferryman, J.: Pets 2015: datasets and challenge. In: 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS). IEEE (2015) Li, L., Nawaz, T., Ferryman, J.: Pets 2015: datasets and challenge. In: 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS). IEEE (2015)
15.
Zurück zum Zitat Zhang, L., Li, Y., Nevatia, R.: Global data association for multi-object tracking using network flows. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008. IEEE (2008) Zhang, L., Li, Y., Nevatia, R.: Global data association for multi-object tracking using network flows. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008. IEEE (2008)
16.
Zurück zum Zitat Berclaz, J., Fleuret, F., Türetken, E., Fua, P.: Multiple object tracking using k-shortest paths optimization. IEEE Trans. Pattern Anal. Mach. Intell. 33, 1806–1819 (2011)CrossRef Berclaz, J., Fleuret, F., Türetken, E., Fua, P.: Multiple object tracking using k-shortest paths optimization. IEEE Trans. Pattern Anal. Mach. Intell. 33, 1806–1819 (2011)CrossRef
17.
Zurück zum Zitat Jiang, X., Haase, D., Körner, M., Bothe, W., Denzler, J.: Accurate 3D multi-marker tracking in X-ray cardiac sequences using a two-stage graph modeling approach. In: Wilson, R., Hancock, E., Bors, A., Smith, W. (eds.) CAIP 2013. LNCS, vol. 8048, pp. 117–125. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-40246-3_15CrossRef Jiang, X., Haase, D., Körner, M., Bothe, W., Denzler, J.: Accurate 3D multi-marker tracking in X-ray cardiac sequences using a two-stage graph modeling approach. In: Wilson, R., Hancock, E., Bors, A., Smith, W. (eds.) CAIP 2013. LNCS, vol. 8048, pp. 117–125. Springer, Heidelberg (2013). https://​doi.​org/​10.​1007/​978-3-642-40246-3_​15CrossRef
18.
Zurück zum Zitat Dehghan, A., Modiri Assari, S., Shah, M.: GMMCP tracker: globally optimal generalized maximum multi clique problem for multiple object tracking. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE (2015) Dehghan, A., Modiri Assari, S., Shah, M.: GMMCP tracker: globally optimal generalized maximum multi clique problem for multiple object tracking. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE (2015)
19.
Zurück zum Zitat Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005. IEEE (2005) Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005. IEEE (2005)
20.
Zurück zum Zitat Felzenszwalb, P.F., Girshick, R.B., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1627–1645 (2010)CrossRef Felzenszwalb, P.F., Girshick, R.B., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1627–1645 (2010)CrossRef
21.
Zurück zum Zitat Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91–110 (2004)CrossRef Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91–110 (2004)CrossRef
22.
Zurück zum Zitat Breiman, L.: Classification and Regression Trees. CRC Press, Boca Raton (2017)CrossRef Breiman, L.: Classification and Regression Trees. CRC Press, Boca Raton (2017)CrossRef
24.
Zurück zum Zitat Sun, Y., Wang, X., Tang, X.: Deep convolutional network cascade for facial point detection. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE (2013) Sun, Y., Wang, X., Tang, X.: Deep convolutional network cascade for facial point detection. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE (2013)
25.
Zurück zum Zitat Zhou, E., Fan, H., Cao, Z., Jiang, Y., Yin, Q.: Extensive facial landmark localization with coarse-to-fine convolutional network cascade. In: 2013 IEEE International Conference on Computer Vision Workshops (ICCVW). IEEE (2013) Zhou, E., Fan, H., Cao, Z., Jiang, Y., Yin, Q.: Extensive facial landmark localization with coarse-to-fine convolutional network cascade. In: 2013 IEEE International Conference on Computer Vision Workshops (ICCVW). IEEE (2013)
27.
Zurück zum Zitat Kendall, D.G.: Shape manifolds, procrustean metrics, and complex projective spaces. Bull. London Math. Soc. 16, 81–121 (1984)MathSciNetCrossRef Kendall, D.G.: Shape manifolds, procrustean metrics, and complex projective spaces. Bull. London Math. Soc. 16, 81–121 (1984)MathSciNetCrossRef
30.
Zurück zum Zitat Baker, S., Matthews, I.: Lucas-kanade 20 years on: a unifying framework. Int. J. Comput. Vis. 56(3), 221–255 (2004)CrossRef Baker, S., Matthews, I.: Lucas-kanade 20 years on: a unifying framework. Int. J. Comput. Vis. 56(3), 221–255 (2004)CrossRef
32.
33.
Zurück zum Zitat Bellman, R.: On a routing problem. Q. Appl. Math. 16(1), 87–90 (1958)CrossRef Bellman, R.: On a routing problem. Q. Appl. Math. 16(1), 87–90 (1958)CrossRef
Metadaten
Titel
One-Shot Learned Priors in Augmented Active Appearance Models for Anatomical Landmark Tracking
verfasst von
Oliver Mothes
Joachim Denzler
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-12209-6_5