Jeni Paay
ABSTRACT
In recent years there has been an increasing interest in cross-device interaction research involving mobile computing. We contribute to this research with a comparative study of four interaction techniques for moving information from a mobile device to a large display. The four techniques (Pinch, Swipe, Throw, and Tilt) were compared through a laboratory experiment with 53 participants, measuring their effectiveness, efficiency and error size. Findings from the experiment revealed that the Swipe technique performed best on all measures. In terms of effectiveness, the Tilt technique performed the worst, and especially so with small targets. In terms of efficiency and error size, the Pinch technique was the slowest and also the most imprecise. We also found that target size mattered considerably for all techniques, confirming previous research. Based on our findings we discuss why the individual techniques performed as observed, and discuss implications for using mobile devices in cross-device interaction design.
- Benko, H. and Wilson, A.D. 2010. Multi-point interactions with immersive omnidirectional visualizations in a dome. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, New York, NY, USA, 19--28. Google Scholar
Digital Library
- Boring, S., Altendorfer, M., Broll, G., Hilliges, O. and Butz, A. 2007. Shoot & copy: phonecam-based information transfer from public displays onto mobile phones. In Proceedings of the 4th international conference on mobile technology, applications, and systems and the 1st international symposium on Computer human interaction in mobile technology (Mobility '07). ACM, New York, NY, USA, 24--31. Google ScholarDigital Library
- Boring, S., Jurmu, M., and Butz, A. 2009. Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7 (OZCHI '09). ACM, New York, NY, USA, 161--168. Google ScholarDigital Library
- Bragdon, A., DeLine, R., Hinckley, R. and Morris, M.R. 2011. Code space: touch + air gesture hybrid interactions for supporting developer meetings. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '11). ACM, New York, NY, USA, 212--221. Google ScholarDigital Library
- Chen, X., Grossman, T., Wigdor, D.J. and Fitzmaurice, G. 2014. Duet: exploring joint interactions on a smart phone and a smart watch. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 159--168. Google ScholarDigital Library
- Hamilton, P. and Wigdor, D.J. 2014. Conductor: enabling and understanding cross-device interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 2773--2782. Google ScholarDigital Library
- Hoaglin, D.C., Iglewicz, B. and Tukey, J.W., 1986. Performance of some resistant rules for outlier labeling. Journal of the American Statistical Association, 81(396), pp. 991--999.Google ScholarCross Ref
- Ikematsu, K. and Siio, I. 2015. Memory Stones: An Intuitive Information Transfer Technique between Multi-touch Computers. In Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications (HotMobile '15). ACM, New York, NY, USA, 3--8. Google ScholarDigital Library
- Jokela, T., Ojala, J. and Olsson, T. 2015. A Diary Study on Combining Multiple Information Devices in Everyday Activities and Tasks. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3903--3912. Google ScholarDigital Library
- Lucero, A., Holopainen, J. and Jokela, T. 2012. MobiComics: collaborative use of mobile phones and large displays for public expression. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services (MobileHCI '12). ACM, New York, NY, USA, 383--392. Google ScholarDigital Library
- Lund, A.M. 2001. Measuring Usability with the USE Questionnaire. STC Usability SIG Newsletter. (2001).Google Scholar
- Marquardt, N., Hinckley, K. and Greenberg, S. 2012. Cross-device interaction via micro-mobility and f-formations. In Proceedings of the 25th annual ACM symposium on User interface software and technology (UIST '12). ACM, New York, NY, USA, 13--22. Google ScholarDigital Library
- Myers, B.A. 2001. Using handhelds and PCs together. Commun. ACM 44, 11 (November 2001), 34--41. Google ScholarDigital Library
- Nielsen, H.S., Olsen, M.P., Skov, M.B. and Kjeldskov, J. 2014. JuxtaPinch: exploring multi-device interaction in collocated photo sharing. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services (MobileHCI '14). ACM, New York, NY, USA, 183--192. Google ScholarDigital Library
- Rekimoto, J. 1997. Pick-and-drop: a direct manipulation technique for multiple computer environments. In Proceedings of the 10th annual ACM symposium on User interface software and technology (UIST '97). ACM, New York, NY, USA, 31--39. Google ScholarDigital Library
- Rekimoto, J. 1998. February. Multiple-Computer User Interfaces: A cooperative environment consisting of multiple digital devices. In International Workshop on Cooperative Buildings (pp. 33--40). Springer Berlin Heidelberg. Google ScholarDigital Library
- Rädle, R., Jetter, H., Schreiner, M., Lu, Z., Reiterer, H. and Rogers, Y. 2015. Spatially-aware or Spatially-agnostic?: Elicitation and Evaluation of User-Defined Cross-Device Interactions. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3913--3922. Google ScholarDigital Library
- Scheible, J., Ojala, T. and Coulton, P. 2008. MobiToss: a novel gesture based interface for creating and sharing mobile multimedia art on large public displays. In Proceedings of the 16th ACM international conference on Multimedia (MM '08). ACM, New York, NY, USA, 957--960. Google ScholarDigital Library
- Schmidt, D., Chehimi, F., Rukzio, E. and Gellersen, H. 2010. PhoneTouch: a technique for direct phone interaction on surfaces. In Proceedings of the 23nd annual ACM symposium on User interface software and technology (UIST '10). ACM, New York, NY, USA, 13--16. Google ScholarDigital Library
- Schmidt, D., Seifert, J., Rukzio, E. and Gellersen, H. A 2012. A cross-device interaction style for mobiles and surfaces. In Proceedings of the Designing Interactive Systems Conference (DIS '12). ACM, New York, NY, USA, 318--327. Google ScholarDigital Library
- Skov, M.B., Kjeldskov, J., Paay, J., Jensen, H.P. and Olsen, M.P. 2015. Investigating Cross-Device Interaction Techniques: A Case of Card Playing on Handhelds and Tablets. In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction (OzCHI '15). ACM, New York, NY, USA, 446--454. Google ScholarDigital Library
- Sørensen, H., Raptis, D., Kjeldskov, J. and Skov, M.B. 2014. The 4C framework: principles of interaction in digital ecosystems. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14). ACM, New York, NY, USA, 87--97. Google ScholarDigital Library
- Walter, R., Bailly, G., Valkanova, N. and Müller, J. Cuenesics: Using Mid-air Gestures to Select Items on Interactive Public Displays. In Proc. MobileHCI '14, ACM Press (2014), 299--308. Bowman, M., Debray, S. K., and Peterson, L. L. 1993. Reasoning about naming systems. ACM Trans. Program. Lang. Syst. 15, 5 (Nov. 1993), 795--825. Google ScholarDigital Library
Index Terms
- A Comparison of Techniques for Cross-Device Interaction from Mobile Devices to Large Displays
Recommendations
Investigating Cross-Device Interaction between a Handheld Device and a Large Display
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing SystemsThere is a growing interest in HCI research to explore cross-device interaction, giving rise to an interest in different approaches facilitating interaction between handheld devices and large displays. Contributing to this, we have investigated the use ...
A comparison of techniques for cross-device interaction from mobile devices to large displays
In recent years there has been an increasing interest in cross-device interaction research involving mobile computing. We contribute to this research with a comparative study of four interaction techniques for moving information from a mobile device to ...
Interaction with large ubiquitous displays using camera-equipped mobile phones
In the ubiquitous computing environment, people will interact with everyday objects (or computers embedded in them) in ways different from the usual and familiar desktop user interface. One such typical situation is interacting with applications through ...
Comments