ABSTRACT
Device deformation allows new types of gestures to be used in interaction. We identify that the gesture/use-case pairings proposed by interaction designers are often driven by factors relating improved tangibility, spatial directionality and strong metaphorical bonds. With this starting point, we argue that some of the designs may not make use of the full potential of deformation gestures as continuous, bipolar input techniques. In two user studies, we revisited the basics of deformation input by taking a new systematic look at the question of matching gestures with use cases. We observed comparable levels of UX when using bend input in different continuous bipolar interactions, irrespective of the choice of tangibility, directionality and metaphor. We concluded that device bend gestures use their full potential when used to control continuous bipolar parameters, and when quick reactions are needed. From our studies, we also identify relative strengths of absolute and relative mappings, and report a Fitts' law study for device bending input.
- Ahmaniemi, T.T. and Lantz, V.T. Augmented reality target finding based on tactile cues. in ICMI'09. 2009. Cambridge, Massachusetts, USA: ACM. Google ScholarDigital Library
- Akamatsu, M. and MacKenzie, I.S., Movement characteristics using a mouse with tactile and force feedback. International Journal of Human-Computer Studies, 1996. 45: p. 483--493. Google ScholarDigital Library
- Burstyn, J., Banerjee, A., and Vertegaal, R., FlexView: an evaluation of depth navigation on deformable mobile devices, in TEI'13. 2013, ACM: Barcelona, Spain. p. 193--200. Google ScholarDigital Library
- Fitts, P.M., The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 1954. 47(6): p. 381--391.Google Scholar
- Gallant, D.T., Seniuk, A.G., and Vertegaal, R., Towards more paper-like input: flexible input devices for foldable interaction styles, in UIST'08. 2008, ACM: Monterey, CA, USA. p. 283--286. Google ScholarDigital Library
- Girouard, A., Tarun, A., and Vertegaal, R., DisplayStacks: interaction techniques for stacks of flexible thin-film displays, in CHI'12. 2012, ACM: Austin, Texas, USA. p. 2431--2440. Google ScholarDigital Library
- Goyal, N. COMET: Collaboration in Mobile Environments by Twisting. in ECSCW'09. 2009. Vienna, Austria.Google Scholar
- Herkenrath, G., Karrer, T., and Borchers, J., Twend: twisting and bending as new interaction gesture in mobile devices, in Extended Abstracts on CHI'08. 2008, ACM: Florence, Italy. p. 3819--3824. Google ScholarDigital Library
- Holman, D., Vertegaal, R., Altosaar, M., Troje, N., and Johns, D., Paper windows: interaction techniques for digital paper, in CHI'05. 2005, ACM: Portland, Oregon, USA. p. 591--599. Google ScholarDigital Library
- Ishii, H., Tangible bits: beyond pixels, in TEI'08. 2008, ACM: Bonn, Germany. p. xv-xxv. Google ScholarDigital Library
- Khalilbeigi, M., Lissermann, R., Kleine, W., and Steimle, J., FoldMe: interacting with double-sided foldable displays, in TEI'12. 2012, ACM: Kingston, Ontario, Canada. p. 33--40. Google ScholarDigital Library
- Khalilbeigi, M., Lissermann, R., Muhlhauser, M., and Steimle, J., Xpaaand: interaction techniques for rollable displays, in CHI'11. 2011, ACM: Vancouver, BC, Canada. p. 2729--2732. Google ScholarDigital Library
- Kildal, J. Interacting with Deformable User Interfaces: Effect of Material Stiffness and Type of Deformation Gesture. in HAID'12. 2012: Springer Berlin Heidelberg. Google ScholarDigital Library
- Kildal, J., Lucero, A., and Boberg, M., Twisting touch: combining deformation and touch as input within the same interaction cycle on handheld devices, in MobileHCI'13. 2013, ACM: Munich, Germany. p. 237246. Google ScholarDigital Library
- Kildal, J., Paasovaara, S., and Aaltonen, V., Kinetic device: designing interactions with a deformable mobile interface, in Extended Abstracts on CHI'12 2012, ACM: Austin, Texas, USA. p. 1871--1876. Google ScholarDigital Library
- Kildal, J. and Wilson, G., Feeling it: the roles of stiffness, deformation range and feedback in the control of deformable ui, in ICMI'12. 2012, ACM: Santa Monica, California, USA. p. 393--400. Google ScholarDigital Library
- Lahey, B., Girouard, A., Burleson, W., and Vertegaal, R., PaperPhone: understanding the use of bend gestures in mobile devices with flexible electronic paper displays, in CHI'11. 2011, ACM: Vancouver, BC, Canada. p. 1303--1312. Google ScholarDigital Library
- Lee, S.-S., Kim, S., Jin, B., Choi, E., Kim, B., Jia, X., Kim, D., and Lee, K.-p., How users manipulate deformable displays as input devices, in CHI'10. 2010, ACM: Atlanta, Georgia, USA. p. 1647--1656. Google ScholarDigital Library
- Murakami, T. and Nakajima, N., DO-IT: deformable object as input tool for 3-D geometric operation. Computer-Aided Design, 2000. 32(1): p. 5--16.Google Scholar
- Murata. Murata's Flexible Remote. Available from: http://techcrunch.com/2011/09/23/muratas-flexibleremote-lets-you-control-your-tv-with-bending-andtwisting-motions/.Google Scholar
- Nokia. NRC developed Nokia Kinetic prototype demoed at Nokia World 2011. 2011 {cited 2013 12.9.2013}; Available from: http://research.nokia.com/news/12110.Google Scholar
- Raghu Prasad, M.S., Purswani, S., and Manivannan, M. Modeling of Human Hand Force Based Tasks Using Fitts's Law. in ICoRD'13. 2013: Springer India.Google Scholar
- Ramos, G., Boulos, M., and Balakrishnan, R. Pressure widgets. in SIGCHI conference on Human factors in computing systems. 2004. Vienna, Austria. Google ScholarDigital Library
- Rohs, M., Oulasvirta, A., and Suomalainen, T., Interaction with magic lenses: real-world validation of a Fitts' Law model, in CHI'11. 2011, ACM: Vancouver, BC, Canada. p. 2725--2728. Google ScholarDigital Library
- Roudaut, A., Karnik, A., Lochtefeld, M., and Subramanian, S., Morphees: toward high "shape resolution" in self-actuated flexible mobile devices, in CHI'13. 2013, ACM: Paris, France. p. 593--602. Google ScholarDigital Library
- Schwesig, C., Poupyrev, I., and Mori, E., Gummi: a bendable computer, in CHI'04. 2004, ACM: Vienna, Austria. p. 263--270. Google ScholarDigital Library
- Scott, J., Brown, L., and Molloy, M., Mobile Device Interaction with Force Sensing. Pervasive Computing, ed. H. Tokuda, et al. Vol. 5538. 2009: Springer Berlin Heidelberg. 133--150. Google ScholarDigital Library
- Sheng, J., Balakrishnan, R., and Singh, K., An interface for virtual 3D sculpting via physical proxy, in GRAPHITE'06. 2006, ACM: Kuala Lumpur, Malaysia. p. 213--220. Google ScholarDigital Library
- Steimle, J., Jordt, A., and Maes, P., Flexpad: highly flexible bending interactions for projected handheld displays, in CHI'13. 2013, ACM: Paris, France. p. 237246. Google ScholarDigital Library
- Tajika, T., Yonezawa, T., and Mitsunaga, N., Intuitive page-turning interface of e-books on flexible e-paper based on user studies, in MM'08. 2008, ACM: Vancouver, British Columbia, Canada. p. 793--796. Google ScholarDigital Library
- Tarun, A.P., Wang, P., Girouard, A., Strohmeier, P., Reilly, D., and Vertegaal, R., PaperTab: an electronic paper computer with multiple large flexible electrophoretic displays, in Extended Abstracts on CHI'13. 2013, ACM: Paris, France. p. 3131--3134. Google ScholarDigital Library
- Vertegaal, R. and Poupyrev, I., Organic User Interfaces. Commun. ACM, 2008. 51(6): p. 26--30. Google ScholarDigital Library
- Warren, K., Lo, J., Vadgama, V., and Girouard, A., Bending the rules: bend gesture classification for flexible displays, in CHI'13. 2013, ACM: Paris, France. p. 607--610. Google ScholarDigital Library
- Watanabe, J.-I., Mochizuki, A., and Horry, Y., Bookisheet: bendable device for browsing content using the metaphor of leafing through the pages, in Ubicomp'08. 2008, ACM: Seoul, Korea. p. 360--369. Google ScholarDigital Library
- Wightman, D., Ginn, T., and Vertegaal, R., Bendflip: examining input techniques for electronic book readers with flexible form factors, in INTERACT'11. 2011, Springer-Verlag: Lisbon, Portugal. p. 117--133. Google ScholarDigital Library
- Ye, Z. and Khalid, H., Cobra: flexible displays for mobilegaming scenarios, in Extended Abstracts on CHI'10. 2010, ACM: Atlanta, Georgia, USA. p. 4363--4368. Google ScholarDigital Library
Index Terms
- What is a device bend gesture really good for?
Recommendations
WhammyPhone: Exploring Tangible Audio Manipulation Using Bend Input on a Flexible Smartphone
UIST '16 Adjunct: Adjunct Proceedings of the 29th Annual ACM Symposium on User Interface Software and TechnologyWe present WhammyPhone, a novel audio interface that supports physical manipulation of digital audio through bend gestures. WhammyPhone combines a high-resolution flexible display, bend sensors, and a set of intuitive interaction techniques that enable ...
Force-enabled TouchPad in Cars: Improving Target Selection using Absolute Input
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing SystemsCurrent automotive interfaces rely heavily on touchscreen interfaces which leverage simple and intuitive direct touch interaction. Since input and output are co-located, displays have to be positioned within hand's reach. When the display is outside the ...
The Effects of Encumbrance and Mobility on Touch-Based Gesture Interactions for Mobile Phones
MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and ServicesIn this paper, we investigate the effects of mobility and encumbrance (holding objects such as shopping bags) on standard gestures commonly performed on touchscreens: tapping, dragging, spreading & pinching and rotating clockwise & anticlockwise when ...
Comments