Enrico Costanza
Samuel A. Inverso
ABSTRACT
Using a mobile device in a social context should not cause embarrassment and disruption to the immediate environment. Interaction with mobile and wearable devices needs to be subtle, discreet and unobtrusive. Therefore, we promote the idea of "intimate interfaces": discrete interfaces that allow control of mobile devices through subtle gestures in order to gain social acceptance. To achieve this goal, we present an electromyogram (EMG) based wearable input device which recognizes isometric muscular activity: activity related to very subtle or no movement at all. In the online experiment reported, the EMG device, worn on an armband around the bicep, was able to reliably recognize a motionless gesture without calibration or training across users with different muscle volumes. Hence, EMG-based input devices can provide an effective solution for designing mobile interfaces that are subtle and intimate, and therefore socially acceptable.
- Ängeslevä, J., O'Modhrain, S., Oakley, I., Hughes, S. Body Mnemonics. Proc. Physical Interaction (PI03) - Workshop on Real World User Interfaces, a workshop at the Mobile HCI Conference 2003.]]Google Scholar
- Barreto, A., Scargle, S., Adjouadi, M. Hands-off human-computer interfaces for individuals with severe motor disabilities. Proc. HCI International 1999, 970--974.]] Google ScholarDigital Library
- De Luca, C.J. Physiology and Mathematics of Myoelectric Signals. IEEE Transactions on Biomedical Engineering, Vol. BME-26, No.6, June 1979.]]Google ScholarCross Ref
- De Luca, C.J. Surface Electromyography: Detection and Recording. Whitepaper, DelSys Inc., 2002. http://www.delsys.com/library/papers/SEMGintro.pdf]]Google Scholar
- DeVaul, R., Sung, M., Gips, J., Pentland, A. MIThril 2003: Applications and Architecture. Proc the 7th IEEE International Symposium on Wearable Computers, 2003.]] Google ScholarDigital Library
- Dubost, G., Tanaka, A. A Wireless, Networked-based Biosensor Interface for Music. Proc. International Computer Music Conference, 2002.]]Google Scholar
- Fistre, J., Tanaka, A. Real Time EMG Gesture Recognition for Consumer Electronics Device Control. Presented at Sony CSL Paris Open House 10/2002, http://www.csl.sony.fr/~atau/gesture/.]]Google Scholar
- Fitzmaurice. G., Ishii, H., and Buxton, W. A. S. Laying the Foundations for Graspable User Interfaces. Proceedings of CHI'95, pp 422--449.]] Google ScholarDigital Library
- Geelhoed, E., Falahee, M., Latham, K. Safety and Comfort of Eyeglass Displays. Proc. of the 2nd international symposium on Handheld and Ubiquitous Computing, 2000, p.236--247.]] Google ScholarDigital Library
- Harrison, B.L., Fishkin, K.P., Gujar, A., Mochon, C., and Want, R. Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces. Proc CHI 1998, ACM Press (1998).]] Google ScholarDigital Library
- Hart, S. G., Wickens C. Workload Assesment and Prediction. In Booher, H.R., ed. MANPRINT, an approach to system integration, Van Nostrand Reinhold, New York, 1990, pp 182--188.]]Google Scholar
- Headon, R., Coulouris, G. Supporting Gestural Input for Users on the Move. Proc IEE Eurowearable '03, pp 107--112.]]Google Scholar
- Healy, J., Picard, R. Digital Processing of Affective Signals. Proc. ICASSP (1998).]]Google ScholarCross Ref
- Hefftner, G., Zucchini, W., Jaros, G.G. The Electromyogram (EMG) as a Control Signal for Functional Neuromuscular Stimulation-Part I: Autoregressive Modeling as a Means of EMG Signature Discrimination. IEEE Trans. Biomed. Eng., vol. 35, pp. 230--236, April 1988.]]Google ScholarCross Ref
- Hinckley, K., Pierce, J., Sinclair, M., Horvitz, E. Sensing techniques for mobile interaction. Proc UIST 2000, ACM Press (2000).]] Google ScholarDigital Library
- http://www.bodymedia.com/]]Google Scholar
- http://www.eyetap.org/]]Google Scholar
- http://www.microopticalcorp.com/]]Google Scholar
- Ishii, H. and Ullmer, B. Tangible bits: Towards Seamless Interfaces between People, Bits, and Atoms. Proceedings of CHI'97, pp 234--241.]] Google ScholarDigital Library
- Kasai, I., Tanijiri, Y., Endo, T., Ueda, H. A Forgettable near Eye Display. Proc Fourth International Symposium on Wearable Computers (ISWC'00).]] Google ScholarDigital Library
- Knapp, B., Lusted, H. A Bioelectric Controller for Computer Music Applications. Computer Music Journal, vol. 14, No. 1, Spring 1990.]]Google ScholarCross Ref
- Lumsden, J., Brewster, S. A paradigm shift: alternative interaction techniques for use with mobile & wearable devices. Proc. of the 13th Annual IBM Centers for Advanced Studies Conference CASCON'2003.]] Google ScholarDigital Library
- Oakley, I., Angesleva, J., Hughes, S., O'Modhrain, S. Tilt and Feel: Scrolling with Vibrotactile Display. Proc EuroHaptics'04.]]Google Scholar
- Pirhonen, A., Brewster, S.A., Holguin, C. Gestural and Audio Metaphors as a Means of Control in Mobile Devices. Proc. CHI 2002, ACM Press 2002.]] Google ScholarDigital Library
- Poupyrev, I., Maruyama, S., Rekimoto, J. Ambient touch: designing tactile interfaces for handheld devices. Proc UIST 2002, ACM Press (2002), pp 51--60.]] Google ScholarDigital Library
- Putnam, W., Knapp, B. The Use of the Electromyogram in a Man-Machine Interface. Proc. of the Virtual Reality and Persons With Disabilities Conference, June 1993.]]Google Scholar
- Rekimoto, J. GestureWrist and GesturePad: Unobtrusive Wearable Interaction Devices. Proc. 5th IEEE International Symposium on Wearable Computers, 2001.]] Google ScholarDigital Library
- Rekimoto, J. Tilting Operations for Small Screen Interfaces. Proc. UIST'96, 1996.]] Google ScholarDigital Library
- Schalk, G., McFarland, D. J., Hinterberger, T., Birbaumer, N., Wolpaw, J. R. BCI2000: A general-purpose brain-computer interface (bci) system. IEEE Transactions on Biomedical Engineering, 51(6):1034--1043, 2004.]]Google Scholar
- Tanaka A., Knapp B. Multimodal Interaction in Music Using the Electromyogram and Relative Position Sensing. Proc NIME'02.]] Google ScholarDigital Library
- Trejo, L.J. Wheeler, K.R. Jorgensen, C.C. Rosipal, R. Clanton, S.T. Matthews, B. Hibbs, A.D. Matthews, R. Krupka, M. Multimodal Neuroelectric Interface Development. IEEE Transactions on Neural Systems and Rehabilitation Engineering, June 2003, Vol. 11, No. 2, pp 199--203.]]Google Scholar
- Wheeler, K.R., Jorgensen, C.C. Gestures as Input: Neuroelectric Joysticks and Keyboards. IEEE Pervasive Computing, April-June 2003 (Vol. 2, No. 2).]] Google ScholarDigital Library
Index Terms
- Toward subtle intimate interfaces for mobile devices using an EMG controller
Recommendations
Intimate interfaces in action: assessing the usability and subtlety of emg-based motionless gestures
CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsMobile communication devices, such as mobile phones and networked personal digital assistants (PDAs), allow users to be constantly connected and communicate anywhere and at any time, often resulting in personal and private communication taking place in ...
Gesture Segmentation and Recognition with an EMG-Based Intimate Approach - An Accuracy and Usability Study
CISIS '12: Proceedings of the 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems (CISIS)In this paper we propose an approach to address the gesture segmentation issue, an important concern strongly related to the gesture recognition field. Gesture segmentation has two main goals: first, detecting when a gesture begins and ends, second, ...
Game-based EMG biofeedback system for muscle training in the elderly
i-CREATe '11: Proceedings of the 5th International Conference on Rehabilitation Engineering & Assistive TechnologyThis paper presents a game-based EMG biofeedback system for training the tibialis anterior muscle in elderly persons. The strong tibialis anterior muscle can reduce the risk of loss of balance, which causes fall in the elderly. Therefore, the volunteers ...
Comments