Gilles Bailly
Thomas Pietrzak
Jonathan Deber
Daniel J. Wigdor
ABSTRACT
Hotkeys are an efficient method of selecting commands on a keyboard. However, these shortcuts are often underused by users. We present Métamorphe, a novel keyboard with keys that can be individually raised and lowered to promote hotkeys usage. Métamorphe augments the output of traditional keyboards with haptic and visual feedback, and offers a novel design space for user input on raised keys (e.g., gestures such as squeezing or pushing the sides of a key). We detail the implementation of Métamorphe and discuss design factors. We also report two user studies. The first is a user-defined interface study that shows that the new input vocabulary is usable and useful, and provides insights into the mental models that users associate with raised keys. The second user study shows improved eyes-free selection performance for raised keys as well as the surrounding unraised keys.
Supplemental Material
- Bau, O., Petrevski, U., and Mackay, W. (2009) BubbleWrap: A Textile Based Electromagnetic Haptic Display. CHI EA'09, 3607--3612. Google Scholar
Digital Library
- Beaudouin-Lafon, M. (2004) Designing Interaction, not Interfaces. AVI '04, 15--22. Google ScholarDigital Library
- Bewley, W. L., Roberts, T. L., Sehroit, D., and Verplank, W. L. (1983) Human Factors Testing in the Design of Xerox's 8010 "Star" Office Workstation. CHI '83, 72--77. Google ScholarDigital Library
- Block, F., Gellersen, G., and Villar, N. (2010) Touch-Display Keyboards: Transforming Keyboards into Interactive Surfaces. CHI '10, 1145--1154. Google ScholarDigital Library
- Campbell, C. S., Zhai, S., May, K. W., and Maglio, P. P. (1999) What You Feel Must be What You See: Adding Tactile Feedback to the Trackpoint. INTERACT '99, 383--390.Google Scholar
- Carroll, J. M., and Rosson, M. B. Paradox of the Active User. MIT Press, Cambridge, MA, USA, 1987, pp 80--111. Google ScholarDigital Library
- Dietz, P., H., Eidelson, B., Westhues, J., and Bathiche, S. (2009) A Practical Pressure Sensitive Computer Keyboard. UIST '09, 55--58. Google ScholarDigital Library
- Fitzmaurice, G., Matejka, J., Khan A., Glueck M., and Kurtenbach, G. (2008) PieCursor: Merging Pointing and Command Selection for Rapid In-place Tool Switching. CHI '08, 1361--1370. Google ScholarDigital Library
- Grossman, T., Dragicevic, P., and Balakrishnan, R. (2007) Strategies for Accelerating On-line Learning of Hotkeys. CHI '07, 1591--1600. Google ScholarDigital Library
- Harrison, C. and Hudson, S. E. (2009) Providing Dynamically Changeable Physical Buttons on a Visual Display. CHI '09, 299--308. Google ScholarDigital Library
- Hoffmann, D., Spelmezan, D., and Borchers, J. (2009) TypeRight: a Keyboard with Tactile Error Prevention. CHI '09, 2265--2268. Google ScholarDigital Library
- Hoggan, E., Brewster, S. A., and Johnston, J. (2008) Investigating the Effectiveness of Tactile Feedback for Mobile Touchscreens. CHI '08, 1573--1582. Google ScholarDigital Library
- Huynh, K., Stepp, C.E., White, L.W., Colgate, J.E., and Matsuoka, Y. Finding a feature on a 3D object through single-digit haptic exploration. IEEE Haptics Symposium '10, 83--89. Google ScholarDigital Library
- Jorgensen, A., Garde, A., Laursen, B., and Jensen, B. Using Mouse and Keyboard Under Time pressure: Preference, Strategies and Learning. Behavior and Information Tech. 21, 5 (2002), 317--319.Google ScholarCross Ref
- Kato, J., Sakamoto, D., and Igarashi, T. (2010) Surfboard: Keyboard with Microphone as a Low-cost Interactive Surface. UIST '10, 387--388. Google ScholarDigital Library
- Kim, S., Kim, H., Lee, B., Nam, T.-J., and Lee, W. (2008) Inflatable Mouse: Volume-adjustable Mouse with Air- pressure-sensitive Input and Haptic Feedback. CHI '08, 211--214. Google ScholarDigital Library
- Krisler, B., and Alterman, R. (2008) Training Towards Mastery: Overcoming the Active User Paradox. NordiCHI '08, 239--248. Google ScholarDigital Library
- Kurtenbach, G. The Design and Evaluation of Marking Menus. Ph.D. Thesis, Dept. of Computer Science, University of Toronto, 1993. Google ScholarDigital Library
- Lane, D. M., Napier, A. H., Peres, C. S., and Sándor, A. The Hidden Costs of Graphical User Interfaces: The Failure to Make the Transition from Menus and Icon Tool Bars to Keyboard Shortcuts. International Journal of Human-Computer Interaction 18, 2 (2005), 133--144.Google ScholarCross Ref
- Lederman, S.J., and Klatzky, R. L. Hand Movements: A Window Into Haptic Object Recognition. Cog. Psych. 19, 3 (1987), 342--368.Google Scholar
- Lewis, J. R., Potosnak, K. M., and Magyar, R. L. Keys and Keyboards. In M. Helander, T. K. Landauer, P. V. Prabhu. Handbook of HumanComputer Interaction. Elsevier, 1997, 1285--1311.Google Scholar
- Loy, C., Lai, W., and Lim, C. Development of a Pressure-based Typing Biometrics User Authentication System. Tech. rep., University of Science Malaysia & MIMOS Berhad, 2005.Google Scholar
- Lylykangas, J., Surakka, V., Salminen, K., Raisamo, J., Laitinen, P., Rönning, K., and Raisamo, R. (2011) Designing Tactile Feedback for Piezo Buttons. CHI '11, 3281--3284. Google ScholarDigital Library
- McLoone, H., Hinckley, K., and Cutrell, E. (2003) Bimanual Interaction on the Microsoft Office Keyboard. INTERACT '03, 49--56.Google Scholar
- Microsoft Adaptive Keyboard. http://www.microsoft.com/appliedsciences/content/projects/uist.aspxGoogle Scholar
- Nielsen, J. Usability Engineering. Morgan Kaufman, 1993. Google ScholarDigital Library
- Optimus Maximus Keyboard, ArtLebedev Studios. http://www.artlebedev.com/everything/optimus/Google Scholar
- Peres, S. C., Ii, F. P. T., Fleetwood, M. D., Chung, P., and Paige-Smith, D. L. Keyboard Shortcut Usage: The roles of Social Factors and Computer Experience. In Proc. of Human Factors and Ergonomics Society 48th Annual Meeting 2004, 803--807.Google ScholarCross Ref
- Poupyrev, I., Nashida, T., Maruyama, S., Rekimoto, J., and Yamaji, Y. (2004) Lumen: Interactive Visual and Shape Display for Calm Computing. SIGGRAPH '04, 17. Google ScholarDigital Library
- Poupyrev, I., Nashida, T., and Okabe, M. (2007) Actuation and Tangible User Interfaces: The Vaucanson Duck, Robots, and Shape Displays. TEI '07, 206--212. Google ScholarDigital Library
- Rasmussen, M. K., Pedersen E. W., Petersen, M. G., and Hornbæk, K. (2012) Shape-Changing Interfaces: A Review of the Design Space and Open Research Questions. CHI '12, 735--744. Google ScholarDigital Library
- Reflex Keyboard, Smartfish Technologies.Google Scholar
- Rekimoto, J., Ishizawa, T., Schwesig, C., and Oba, H. (2003) PreSense: Interaction Techniques for Finger Sensing Input Devices. UIST '03, 203--212. Google ScholarDigital Library
- Richter H., and Wiethoff, A. (2011) EdgeMatrix: Remote Tactile Feedback on Interactive Surfaces using a Shape Display. TEI '11.Google Scholar
- Rutledge, J. D., and Selker, T. (1990) Force-to-Motion Functions for Pointing. INTERACT '90, 701--706. Google ScholarDigital Library
- Savioz, G., Markovic, M., & Pierrard, Y. (2011) Towards multi-finger haptic devices: A computer keyboard with adjustable force feedback. ICEMS '11.Google ScholarCross Ref
- Scarr, J., Cockburn, A., Gutwin, C., and Quinn, P. (2011) Dips and Ceilings: Understanding and Supporting Transitions to Expertise in User Interfaces. CHI '11, 2741--2750. Google ScholarDigital Library
- Weiss, M., Schwarz, F., Jakubowski, S., and Borchers, J. (2010) Madgets: Actuating Widgets on Interactive Tabletops. UIST '10, 293--302. Google ScholarDigital Library
- Weiss, M., Remy, C., and Borchers, J. (2011) Rendering Physical Effects in Tabletop Controls. CHI '11, 3009--3012. Google ScholarDigital Library
- Westerman, W. Hand Tracking, Finger Identification, And Chordic Manipulation On A Multi-Touch Surface. Ph.D Thesis, U. of Delaware, 1999.Google Scholar
- Wigdor, D. and Wixon, D. Brave NUI World: Designing Natural User Interfaces for Touch and Gesture. Morgan Kaufman, 2011. Google ScholarDigital Library
- Wilson, A. D. (2006) Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input. UIST '06, 255--258. Google ScholarDigital Library
- Wobbrock, J. O., Morris, M. R., and Wilson, A. D. (2009) User-Defined Gestures for Surface Computing. CHI '09, 1083--1092 Google ScholarDigital Library
Index Terms
- Métamorphe: augmenting hotkey usage with actuated keys
Recommendations
Simulating an extendable tangible slider for eyes-free one-handed interaction on mobile devices
AVI '18: Proceedings of the 2018 International Conference on Advanced Visual InterfacesSliders are widely used on mobile devices. Envisioning mobile devices that can dynamically deform to raise tangible controls from the screen surface, tangible sliders offer the benefit of eyes-free interaction. However, reaching for distant values with ...
“Just Like Blooming Fireworks, And Match With Function Perfectly”: Explore and Evaluate User-Defined One-Handed Gestures of Smartwatch
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing SystemsOne-handed gesture interaction is a more convenient input interaction method on smartwatches for some special scenarios, e.g. wearing a smartwatch when running or biking. To explore user-friendly one-handed gestures, what users are thinking when using ...
KirigamiTable: Designing for Proxemic Transitions with a Shape-Changing Tabletop
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing SystemsA core challenge in tabletop research is to support transitions between individual activities and team work. Shape-changing tabletops open up new opportunities for addressing this challenge. However, interaction design for shape-changing furniture is in ...
Comments