skip to main content
10.1145/2948910.2948959acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmocoConference Proceedingsconference-collections
short-paper

Towards the design of augmented feedforward and feedback for sensorimotor learning of motor skills

Authors Info & Claims
Published:05 July 2016Publication History

ABSTRACT

Creating a digital metaphor of the "in person transmission" of manual-crafting motor skills, is an extremely complicated and challenging task. We are aiming to achieve the above by creating a mixed reality environment, supported by an interactive system for sensorimotor learning that relies on pathing techniques. The gestural instruction of a person, the Learner, arises from the reference gesture of an Expert. The concept of the system is based on the simple idea of guiding with the projection of a gesture depicting path in 2D space and in real time. The path is projected either as a feedforward that describes the gesture that has to be executed next, either as a feedback that amends the gesture while taking into account the time needed to correct the mistake. This projection takes place in the exact area where the object lies and the Learner is being trained, to avoid any distraction from the crafting task.

References

  1. Fraser Anderson, Tovi Grossman, Justin Matejka, George Fitzmaurice. 2013. YouMove: Enhancing Movement Training with an Augmented Reality Mirror. In Proceedings of the 26th annual ACM symposium on User interface software and technology (UIST 2013), http://doi.acm.org/10.1145/2501988.2502045 Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Jacky C.P. Chan, Howard Leung, Jeff K.T. Tang and Taku Komura. 2011. A Virtual Reality Dance Training System Using Motion Capture Technology. IEEE Transactions on Learning Technologies, v.4 n.2, p.187--195, April 2011, http://doi.acm.org/10.1109/TLT.2010.27 Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Minoru Fujimoto, Masahiko Tsukamoto, Tsutomu Terada. 2012. A Dance Training System that Maps Self-Images onto an Instruction Video. In Proceedings of the 5th International Conference on Advances in Computer-Human Interactions (Achi 2012), pp.309--314..http://www.thinkmind.org/download.php?articleid=achi_2012_12_30_20280 PDFGoogle ScholarGoogle Scholar
  4. Alina Glushkova, Sotiris Manitsaris. 2015. Gesture Recognition Technologies for Gestural Know-how Management -- Preservation and Transmission of Expert Gestures in Wheel Throwing Pottery. In Proceedings of the 7th International Conference on Computer Supported Education (CSEDU 2015), 405--410, http://doi.acm.org/10.5220/0005475904050410Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Tim Hopper. 2014. PRINCIPLES OF LEARNING MOTOR SKILLS. Retrieved May 4, 2016 from http://web.uvic.ca/~thopper/WEB/archive247/term2/week3/principleslearning.htmGoogle ScholarGoogle Scholar
  6. Sotiris Manitsaris, Alina Glushkova, Eleni Katsouli, Athanasios Manitsaris and Christina Volioti. 2015. Modeling gestural know-how in pottery based on state-space estimation and system dynamic simulation. In Proceedings of the 6th International Conference on Applied Human Factors and Ergonomics (AHFE 2015),http://doi.acm.org/10.1016/j.promfg.2015.07.833Google ScholarGoogle Scholar
  7. Otniel Portillo-Rodriguez, Oscar O. Sandoval-Gonzalez, Emanuele Ruffaldi, Rosario Leonardi, Carlo Alberto Avizzano and Massimo Bergamasco. 2008. Real-Time Gesture Recognition, Evaluation and Feed-Forward Correction of a Multimodal Tai Chi Platform. In Proceedings of the 3rd international workshop on Haptic and Audio Interaction Design (HAID 2008), http://doi.acm.org/10.1007/978-3-540-87883-4 4 Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Amit Patel. 2009. Amit's A* Pages. Retrieved November 22, 2016 from http://theory.stanford.edu/~amitp/GameProgramming/Google ScholarGoogle Scholar
  9. Philo Tan Chua, R. Crivella, B. Daly, Ning Hu, R. Scaaf, D. Ventura, T. Camill, J.Hodgins, R. Pausch. 2003. Training for physical tasks in virtual environments: Tai Chi. In Proceedings of the IEEE Virtual Reality Conference (VR 2003), http://doi.acm.org/10.1109/VR.2003.1191125 Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Michael Polanyi. 1973. Personal Knowledge-Towards a Post-critical Philosophy. London, Routledge & Kegan Paul.Google ScholarGoogle Scholar
  11. Rajinder Sodhi, Hrvoje Benko and Andrew D. Wilson. 2012. LightGuide: Projected Visualizations for Hand Movement Guidance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, http://doi.acm.org/10.1145/2207676.2207702 Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Joao Vieira, Mauricio Sousa, Artur Arsenio and Joaquim Jorge. 2015. Augmented Reality for Rehabilitation Using Multimodal Feedback. In Proceedings of the 3rd 2015 Workshop on ICTs for improving Patients Rehabilitation Research Techniques (REHAB 2015), http://doi.acm.org/10.1145/28389544.2838954 Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Ungyeon Yang. 2002. Implementation and Evaluation of "Just Follow Me": An Immersive, VR-Based, Motion-Training System. In Proceedings of the International Conference on Virtual Systems and Multimedia (VSMM 2002), http://doi.acm.org/10.1162/105474602317473240Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    MOCO '16: Proceedings of the 3rd International Symposium on Movement and Computing
    July 2016
    300 pages
    ISBN:9781450343077
    DOI:10.1145/2948910

    Copyright © 2016 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 5 July 2016

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • short-paper
    • Research
    • Refereed limited

    Acceptance Rates

    Overall Acceptance Rate50of110submissions,45%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader