Skip to main content
Top

2020 | OriginalPaper | Chapter

Analysis of Human Motion Based on AI Technologies: Applications for Safeguarding Folk Dance Performances

Authors : Nikos Grammalidis, Iris Kico, Fotis Liarokapis

Published in: Strategic Innovative Marketing and Tourism

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Analysis of human motion is an important research area in computer vision with numerous applications. Recent projects, such as EU i-Treasures and TERPSICHORE projects conduct research in this field to improve the capture, analysis and presentation of Intangible Cultural Heritage (ICH) using ICT-based approaches. The final goal is to document these forms of intangible heritage and to capture the associated knowledge in order to safeguard and transmit this information to the next generations. In addition, these approaches can give rise to new services for research, education and cultural tourism. They can also be used by creative industries (e.g. companies performing film, video, TV or VR applications production), as well as by local communities, creating new local development opportunities by promoting local heritage. This paper first reviews some very recent state of the art approaches based on deep learning which can achieve impressive results in recovering human motion (2D or 3D) and structure (skeleton with joints or realistic 3D model of the human body). Based on such approaches, we then propose a dance analysis approach, currently under development in TERPSICHORE project. Preliminary results are presented and, finally, some conclusions are drawn.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Andriluka M, Pishchulin L, Gehler P, Schiele B (2014) 2D human pose estimation: new benchmark and state of the art analysis. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR), Columbus, OH, USA, June 23–28, 2014. IEEE, Columbus, OH Andriluka M, Pishchulin L, Gehler P, Schiele B (2014) 2D human pose estimation: new benchmark and state of the art analysis. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR), Columbus, OH, USA, June 23–28, 2014. IEEE, Columbus, OH
3.
go back to reference Cao Z, Simon T, Wei SE, Sheikh Y (2017) Realtime multi-person 2D pose estimation using part affinity fields. In: The IEEE conference on computer vision and pattern recognition (CVPR), Honolulu, HI, USA, July 21–26, 2017. IEEE, Honolulu, HI Cao Z, Simon T, Wei SE, Sheikh Y (2017) Realtime multi-person 2D pose estimation using part affinity fields. In: The IEEE conference on computer vision and pattern recognition (CVPR), Honolulu, HI, USA, July 21–26, 2017. IEEE, Honolulu, HI
4.
go back to reference Wei SE, Ramakrishna V, Kanade T, Sheikh Y (2016) Convolutional pose machines. In: Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA, June 27–30, 2016. IEEE, Las Vegas, NV, pp 4724–4732CrossRef Wei SE, Ramakrishna V, Kanade T, Sheikh Y (2016) Convolutional pose machines. In: Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA, June 27–30, 2016. IEEE, Las Vegas, NV, pp 4724–4732CrossRef
5.
go back to reference Simon T, Joo H, Matthews I, Sheikh Y (2017) Hand keypoint detection in single images using multiview bootstrapping. In: The IEEE conference on computer vision and pattern recognition (CVPR), Honolulu, HI, USA, July 21–26, 2017, vol 2. IEEE, Honolulu, HI Simon T, Joo H, Matthews I, Sheikh Y (2017) Hand keypoint detection in single images using multiview bootstrapping. In: The IEEE conference on computer vision and pattern recognition (CVPR), Honolulu, HI, USA, July 21–26, 2017, vol 2. IEEE, Honolulu, HI
6.
go back to reference Zhou X, Huang Q, Sun X, Xue X, Wei Y (2017) Towards 3D human pose estimation in the wild: a weakly-supervised approach. In: 2017 IEEE international conference on computer vision (ICCV), Venice, Italy, October 22–29, 2017. IEEE, Venice Zhou X, Huang Q, Sun X, Xue X, Wei Y (2017) Towards 3D human pose estimation in the wild: a weakly-supervised approach. In: 2017 IEEE international conference on computer vision (ICCV), Venice, Italy, October 22–29, 2017. IEEE, Venice
7.
go back to reference Newell A, Yang K, Deng J (2016) Stacked hourglass networks for human pose estimation. In: Liebe B, Matas J, Sebe N, Welling M (eds) Proceedings of 14th European conference, European conference on computer vision (ECCV) 2016, Amsterdam, The Netherlands, October 11–14, 2016. Springer, Cham, pp 483–499 Newell A, Yang K, Deng J (2016) Stacked hourglass networks for human pose estimation. In: Liebe B, Matas J, Sebe N, Welling M (eds) Proceedings of 14th European conference, European conference on computer vision (ECCV) 2016, Amsterdam, The Netherlands, October 11–14, 2016. Springer, Cham, pp 483–499
9.
go back to reference Mehta D, Rhodin H, Casas D, Fua P, Sotnychenko O, Xu W, Theobalt C (2017) Monocular 3D human pose estimation in the wild using improved CNN supervision. In: 2017 International conference on 3D vision (3DV), Qingdao, China, October 10–12, 2017. IEEE, Qingdao, pp 506–516 Mehta D, Rhodin H, Casas D, Fua P, Sotnychenko O, Xu W, Theobalt C (2017) Monocular 3D human pose estimation in the wild using improved CNN supervision. In: 2017 International conference on 3D vision (3DV), Qingdao, China, October 10–12, 2017. IEEE, Qingdao, pp 506–516
10.
go back to reference Güler RA, Neverova N, Kokkinos I (2018) DensePose: dense human pose estimation in the wild. In: Proc. CVPR Güler RA, Neverova N, Kokkinos I (2018) DensePose: dense human pose estimation in the wild. In: Proc. CVPR
11.
go back to reference Güler RA, Trigeorgis G, Antonakos E, Snape P, Zafeiriou S, Kokkinos I (2017) DenseReg: fully convolutional dense shape regression in-the-wild. In: The IEEE conference on computer vision and pattern recognition (CVPR), Honolulu, HI, USA, July 21–26, 2017. IEEE, Honolulu, HI Güler RA, Trigeorgis G, Antonakos E, Snape P, Zafeiriou S, Kokkinos I (2017) DenseReg: fully convolutional dense shape regression in-the-wild. In: The IEEE conference on computer vision and pattern recognition (CVPR), Honolulu, HI, USA, July 21–26, 2017. IEEE, Honolulu, HI
12.
go back to reference He K, Gkioxari G, Dollar P, Girshick R, Mask R-CNN (2017) Proceedings of IEEE international conference on computer vision (ICCV), Venice, Italy, October 22–29, 2017. IEEE, Venice He K, Gkioxari G, Dollar P, Girshick R, Mask R-CNN (2017) Proceedings of IEEE international conference on computer vision (ICCV), Venice, Italy, October 22–29, 2017. IEEE, Venice
13.
go back to reference Kanazawa A, Black MJ, Jacobs DW, Malik J (2018) End-to-end recovery of human shape and pose. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp 7122–7131 Kanazawa A, Black MJ, Jacobs DW, Malik J (2018) End-to-end recovery of human shape and pose. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp 7122–7131
18.
go back to reference Chan C, Ginosar S, Zhou T, Efros AA (2018) Everybody dance now. arXiv preprint arXiv:1808.07371 Chan C, Ginosar S, Zhou T, Efros AA (2018) Everybody dance now. arXiv preprint arXiv:1808.07371
19.
go back to reference Wang T-C, Liu M-Y, Zhu J-Y, Tao A, Kautz J, Catanzaro B (2017) High-resolution image synthesis and semantic manipulation with conditional GANs. arXiv preprint arXiv:1711.11585 Wang T-C, Liu M-Y, Zhu J-Y, Tao A, Kautz J, Catanzaro B (2017) High-resolution image synthesis and semantic manipulation with conditional GANs. arXiv preprint arXiv:1711.11585
20.
go back to reference Martinez J, Hossain R, Romero J, Little JJ (2017) A simple yet effective baseline for 3d human pose estimation. In: ICCV Martinez J, Hossain R, Romero J, Little JJ (2017) A simple yet effective baseline for 3d human pose estimation. In: ICCV
21.
go back to reference Yasunori K, Ogaki K, Matsui Y, Odagiri Y (2018) Unsupervised adversarial learning of 3D human pose from 2D joint locations. arXiv preprint arXiv:1803.08244 Yasunori K, Ogaki K, Matsui Y, Odagiri Y (2018) Unsupervised adversarial learning of 3D human pose from 2D joint locations. arXiv preprint arXiv:1803.08244
22.
go back to reference Newell A, Yang K, Deng J (2016) Stacked hourglass networks for human pose estimation. In: European conference on computer vision. Springer, Cham, pp 483–499CrossRef Newell A, Yang K, Deng J (2016) Stacked hourglass networks for human pose estimation. In: European conference on computer vision. Springer, Cham, pp 483–499CrossRef
23.
go back to reference Hutchinson-Guest AD (1989) Choreo-graphics: a comparison of dance notation systems from 15th century to the present. In: International conference exploring research. Routledge, New York, p 194 Hutchinson-Guest AD (1989) Choreo-graphics: a comparison of dance notation systems from 15th century to the present. In: International conference exploring research. Routledge, New York, p 194
24.
go back to reference Laban R (1928) Schrifttanz. Universal, Wein Laban R (1928) Schrifttanz. Universal, Wein
25.
go back to reference Crnkovic-Friis L (2016) Generative choreography using deep learning. In: 7th International conference on computational creativity, ICCC2016 Crnkovic-Friis L (2016) Generative choreography using deep learning. In: 7th International conference on computational creativity, ICCC2016
26.
go back to reference Dimitropoulos K, Tsalakanidou F, Nikolopoulos S, Kompatsiaris I, Grammalidis N, Manitsaris S, Hadjileontiadis L (2018) A multimodal approach for the safeguarding and transmission of intangible cultural heritage: the case of i-treasures. IEEE Intell Syst 33(6):3–16CrossRef Dimitropoulos K, Tsalakanidou F, Nikolopoulos S, Kompatsiaris I, Grammalidis N, Manitsaris S, Hadjileontiadis L (2018) A multimodal approach for the safeguarding and transmission of intangible cultural heritage: the case of i-treasures. IEEE Intell Syst 33(6):3–16CrossRef
Metadata
Title
Analysis of Human Motion Based on AI Technologies: Applications for Safeguarding Folk Dance Performances
Authors
Nikos Grammalidis
Iris Kico
Fotis Liarokapis
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-36126-6_35