Top

Published in:

2011 | OriginalPaper | Chapter

7. Cloth Simulation Based Motion Capture of Dressed Humans

Authors : Nils Hasler, Bodo Rosenhahn, Hans-Peter Seidel

Published in: Virtual Realities

Publisher: Springer Vienna

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Commonly, marker based as well as markerless motion capture systems assume that the tracked person is wearing tightly fitting clothes. Unfortunately, this restriction cannot be satisfied in many situations and most preexisting video data does not adhere to it either. In this work we propose a graphics based vision approach for tracking humans markerlessly without making this assumption. Instead, a physically based simulation of the clothing the tracked person is wearing is used to guide the tracking algorithm.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Action Capture: A VR-Based Method for Character Animation

next chapter Remote 3D Medical Consultation

Ascher, U., Boxerman, E.: On the modified conjugate gradient method in cloth simulation. The Visual Computer 19(7–8), 523–531 (2003)

Baraff, D., Witkin, A.: Large steps in cloth simulation. In: Proceedings of ACM SIGGRAPH 98, pp. 43–54. ACM (1998)

Bhat, K., Twigg, C., Hodgins, J., Khosla, P., Popović, Z., Seitz, S.: Estimating cloth simulation parameters from video. In: Proceedings of ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA 2003), pp. 37–51. ACM (2003)

Bregler, C., Malik, J.: Tracking people with twists and exponential maps. In: CVPR ’98: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p. 8. IEEE Computer Society, Washington, DC, USA (1998)

Bregler, C., Malik, J., Pullen, K.: Twist based acquisition and tracking of animal and human kinematics. International Journal of Computer Vision 56(3), 179–194 (2004). DOI dx.doi.org/10.1023/B:VISI.0000011203.00237.9b

Bridson, R.: Computational aspects of dynamic surfaces. Ph.D. thesis, Stanford University (2003)

Bridson, R., Fedkiw, R., Anderson, J.: Robust treatment of collisions, contact and friction for cloth animation. ACM Transactions on Graphics (ACM SIGGRAPH 2002) 21(3), 594–603 (2002)

Brox, T., Rousson, M., Deriche, R., Weickert, J.: Unsupervised segmentation incorporating colour, texture, and motion. In: N. Petkov, M.A. Westenberg (eds.) Computer Analysis of Images and Patterns, LNCS, vol. 2756, pp. 353–360. Springer, Groningen, (2003)

Chan, T., Vese, L.: Active contours without edges. In: IEEE Transactions on Image Processing, vol. 10, pp. 266–277. Los Angeles, CA, USA (2001)

10.

Choi, K.J., Ko, H.S.: Stable but responsive cloth. ACM Transactions on Graphics (ACM SIGGRAPH 2002) 21(3), 604–611 (2002)

11.

Desbrun, M., Schröder, P., Barr, A.: Interactive animation of structured deformable objects. In: Proceedings of Graphics Interface (GI 1999), pp. 1–8. Canadian Computer-Human Communications Society (1999)

12.

Eberhardt, B., Weber, A., Straßer, W.: A fast, flexible, particle-system model for cloth draping. IEEE Computer Graphics and Applications 16(5), 52–59 (1996)CrossRef

13.

Gavrila, D.M.: The visual analysis of human movement: A survey. Computer Vision and Image Understanding 73(1), 82–98 (1999)MATHCrossRef

14.

Gavrila, D.M., Davis, L.S.: 3-d model-based tracking of humans in action: a multi-view approach. In: CVPR ’96: Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR ’96), p. 73. IEEE Computer Society, Washington, DC, USA (1996)

15.

Hogg, D.: Model-based vision: a program to see a walking person. Image and Vision Computing 1(1), 5–20 (1983)CrossRef

16.

Jojic, N., Huang, T.: On analysis of cloth drape range data. In: ACCV ’98: Proceedings of the Third Asian Conference on Computer Vision-Volume II, pp. 463–470. Springer, London (1997)

17.

Kang, Y.M., Cho, H.G.: Bilayered approximate integration for rapid and plausible animation of virtual cloth with realistic wrinkles. In: Proceedings of Computer Animation, pp. 203–214. IEEE Computer Society (2002)

18.

Kawabata, S.: The standardization and analysis of hand evaluation. The Textile Machinery Society of Japan (1980)

19.

Lowe, D.: Object recognition from local scale-invariant features. In: International Conference on Computer Vision, pp. 1150–1157 (1999)

20.

Mezger, J., Kimmerle, S., Etzmuß, O.: Progress in collision detection and response techniques for cloth animation. In: Proceedings of 10th Pacific Conference on Computer Graphics and Applications (PG 2002), pp. 444–445. IEEE Computer Society (2002)

21.

Moeslund, T., Granum, E.: A survey of computer vision-based human motion capture. Computer Vision and Image Understanding: CVIU 81(3), 231–268 (2001)MATHCrossRef

22.

Murray, R.M., Sastry, S.S., Zexiang, L.: A Mathematical Introduction to Robotic Manipulation. CRC, Boca Raton (1994)MATH

23.

Muybridge, E.: Animal Locomotion (1887)

24.

Pritchard, D., Heidrich, W.: Cloth motion capture. Computer Graphics Forum (Eurographics 2003) 22(3), 263–271 (2003)

25.

Provot, X.: Collision and self-collision handling in cloth model dedicated to design garments. In: Proceedings of the Eurographics Workshop on Computer Animation and Simulation (CAS 1997), pp. 177–189. Springer (1997)

26.

Richards, J.G.: The measurement of human motion: A comparison of commercially available systems. Human Movement Science 18(5), 589–602 (1999)CrossRef

27.

Rohr, K.: Incremental recognition of pedestrians from image sequences. In: Computer Vision and Pattern Recognition, 1993. Proceedings CVPR ’93., 1993 IEEE Computer Society Conference on, pp. 8–13. New York (1993)

28.

Rosenhahn, B., Kersting, U., Powell, K., Klette, R., Klette, G., Seidel, H.P.: A system for articulated tracking incorporating a clothing model. Machine Vision and Applications (2006). DOI 10.1007/s00138-006-0046-y

29.

Scholz, V., Magnor, M.: Cloth motion from optical flow. In: B. Girod, M. Magnor, H.P. Seidel (eds.) Proc. Vision, Modeling and Visualization 2004, pp. 117–124. Akademische Verlagsgesellschaft Aka GmbH, Stanford (2004)

30.

Scholz, V., Stich, T., Keckeisen, M., Wacker, M., Magnor, M.: Garment motion capture using color-coded patterns. Computer Graphics Forum (Proc. Eurographics EG’05) 24(3), 439–448 (2005)

31.

Shewchuk, J.R.: Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator. In: M.C. Lin, D. Manocha (eds.) Applied Computational Geometry: Towards Geometric Engineering, Lecture Notes in Computer Science, vol. 1148, pp. 203–222. Springer, Berlin (1996)CrossRef

32.

Terzopoulos, D., Platt, J., Barr, A., Fleischer, K.: Elastically deformable models. In: Computer Graphics (Proceedings of ACM SIGGRAPH 87), pp. 205–214. ACM (1987)

33.

Volino, P., Magnenat-Thalmann, N.: Accurate garment prototyping and simulation. Computer-Aided Design Applications 2(5), 645–654 (2005)

34.

White, R., Forsyth, D., Vasanth, J.: Capturing real folds in cloth. Tech. Rep. UCB/EECS-2006-10, EECS Department, University of California, Berkeley (2006)

35.

Wren, C.R., Azarbayejani, A., Darrell, T., Pentland, A.P.: Pfinder: Real-time tracking of the human body. IEEE Trans. Pattern Analysis and Machine Intelligence 19(7), 780–785 (1997). DOI dx.doi.org/10.1109/34.598236

Title: Cloth Simulation Based Motion Capture of Dressed Humans
Authors: Nils Hasler
Bodo Rosenhahn
Hans-Peter Seidel
Publisher: Springer Vienna
Book: Virtual Realities
Print ISBN: 978-3-211-99177-0

Electronic ISBN: 978-3-211-99178-7

Copyright Year: 2011
DOI: https://doi.org/10.1007/978-3-211-99178-7_7