Paul Strohmeier
ABSTRACT
We present a system for cross-device interactions and interaction scenarios based on touch events between devices. DisplayPointers were designed to explore the affordances of manipulating physical display-objects in multi-device environments. The interactions presented in this paper are an exploration of what a touch between two devices means; a search for a language of physical cross-device interactions. DisplayPointers are implemented by augmenting off-the-shelf devices: our system is fully mobile and can be easily implemented by other researchers and designers.
Supplemental Material
- Alissa Antle and Sijie Wang. 2013. Comparing motor-cognitive strategies for spatial problem solving with tangible and multi-touch interfaces. Proceedings of the 7th International Conference on tangible, embedded and embodied interaction: 65--72. http://doi.org/10.1145/2460625.2460635 Google Scholar
Digital Library
- Peter Bennett, Stuart Nolan, Ved Uttamchandani, Michael Pages, Kirsten Cater, and Mike Fraser. 2015. Resonant Bits. Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction - TEI '14, ACM Press, 49--52. http://doi.org/10.1145/2677199.2680569 Google ScholarDigital Library
- E. A. Bier, M. C. Stone, Ken Pier, William Buxton, and T. D. DeRose. 1993. Toolglass and magic lenses: the see-through interface. Proceedings of the 20th annual conference on Computer graphics and interactive techniques, ACM, 73--80. http://doi.org/10.1145/166117.166126 Google ScholarDigital Library
- Liwei Chan, Stefanie Müller, Anne Roudaut, and Patrick Baudisch. 2012. CapStones and ZebraWidgets. Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12, 2189. http://doi.org/10.1145/2207676.2208371Google ScholarDigital Library
- Nicholas Chen, François Guimbretière, and Abigail Sellen. 2013. Graduate student use of a multi-slate reading system. Proc CHI, ACM Press, 1799. http://doi.org/10.1145/2470654.2466237 Google ScholarDigital Library
- A Clark. 1998. Being there: putting brain, body and world back together again. MIT Press. Google ScholarDigital Library
- Christopher Collins and Sheelagh Carpendale. 2007. VisLink: Revealing relationships amongst visualizations. IEEE Transactions on Visualization and Computer Graphics 13, 6: 1192--1199. http://doi.org/10.1109/TVCG.2007.70521 Google ScholarDigital Library
- Augusto Esteves, Saskia Bakker, Alissa N Antle, Aaron May, Jillian Warren, and Ian Oakley. 2015. The ATB Framework: Quantifying and Classifying Epistemic Strategies in Tangible Problem-Solving Tasks. 13--20. http://doi.org/10.1145/2677199.2680546 Google ScholarDigital Library
- George W. Fitzmaurice. 1993. Situated information spaces and spatially aware palmtop computers. Communications of the ACM 36, 7: 39--49. http://doi.org/10.1145/159544.159566 Google ScholarDigital Library
- Antonio Gomes and Roel Vertegaal. 2014. Paperfold. Proceedings of the extended abstracts of the 32nd annual ACM conference on Human factors in computing systems - CHI EA '14, 535--538. http://doi.org/10.1145/2559206.2574770 Google ScholarDigital Library
- Peter Hamilton and Daniel J. Wigdor. 2014. Conductor. Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14, ACM Press, 2773--2782. http://doi.org/10.1145/2556288.2557170 Google ScholarDigital Library
- Ken Hinckley, Morgan Dixon, Raman Sarin, Francois Guimbretiere, and Ravin Balakrishnan. 2009. Codex: A Dual Screen Tablet Computer. Design: 1933--1942. http://doi.org/10.1145/1518701.1518996 Google ScholarDigital Library
- Ken Hinckley and Hyunyoung Song. 2011. Sensor Synaesthesia: Touch in Motion, and Motion in Touch. Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11, ACM Press, 801. http://doi.org/10.1145/1978942.1979059 Google ScholarDigital Library
- Ken Hinckley. 2003. Synchronous gestures for multiple persons and computers. Proceedings of the 16th annual ACM symposium on User interface software and technology - UIST '03, ACM Press, 149--158. http://doi.org/10.1145/964696.964713 Google ScholarDigital Library
- David Holman, Roel Vertegaal, Mark Altosaar, Nikolaus Troje, and Derek Johns. 2005. Paper Windows. Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '05, ACM Press, 591. http://doi.org/10.1145/1054972.1055054Google Scholar
- Mohammadreza Khalilbeigi, Roman Lissermann, Wolfgang Kleine, and Jürgen Steimle. 2012. FoldMe. Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction - TEI '12, ACM Press, 33. http://doi.org/10.1145/2148131.2148142Google Scholar
- Sang-won Leigh. 2015. THAW: Tangible Interaction with See-Through Augmentation for Smartphones on Computer Screens. Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction - TEI '14: 89--96. http://doi.org/10.1145/2677199.2680584 Google ScholarDigital Library
- Ming Li and Leif Kobbelt. 2015. ACTUI: Using Commodity Mobile Devices to Build Active Tangible User Interfaces. MobileHCI: 592--597. http://doi.org/10.1145/2786567.2792895 Google ScholarDigital Library
- Robert Mahony, Tarek Hamel, and Jean Michel Pflimlin. 2008. Nonlinear complementary filters on the special orthogonal group. IEEE Transactions on Automatic Control 53, 5: 1203--1218. http://doi.org/10.1109/TAC.2008.923738Google ScholarCross Ref
- C. C. Marshall and Sara Bly. 2005. Turning the page on navigation. Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries, June, ACM Press, 07--11. http://doi.org/10.1145/1065385.1065438 Google ScholarDigital Library
- Chris North and Ben Shneiderman. 1997. A Taxonomy of Multiple Window Coordinations. 97--18. http://doi.org/10.1.1.29.2424Google Scholar
- William Premerlani and Paul Bizard. 2009. Direction Cosine Matrix IMU: Theory. Dcm: 1--30.Google Scholar
- Roman Rädle, Hans-Christian Jetter, Nicolai Marquardt, Harald Reiterer, and Yvonne Rogers. 2014. HuddleLamp. Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces - ITS '14, ACM Press, 45--54. http://doi.org/10.1145/2669485.2669500Google Scholar
- Jun Rekimoto. 1995. The Magnifying Glass Approach to Augmented Reality Systems. International Conference on Artificial Reality and Telexistence icat 95, 4: 123--132. http://doi.org/10.1.1.50.5835Google Scholar
- Dominik Schmidt, Fadi Chehimi, Enrico Rukzio, and Hans Gellersen. 2010. PhoneTouch: A technique for direct phone interaction on surfaces. Proc. UIST. http://doi.org/10.1145/1866029.1866034 Google ScholarDigital Library
- Abigail J. Sellen and Richard H. R. Harper. 2002. The Myth of The Paperless Office. Massechussets Institute of Technology. Retrieved February 4, 2015 from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.91.6538&rep=rep1&type=pdf Google ScholarDigital Library
- Aneesh P. Tarun, Peng Wang, Audrey Girouard, Paul Strohmeier, Derek Reilly, and Roel Vertegaal. 2013. PaperTab. CHI '13 Extended Abstracts on Human Factors in Computing Systems on - CHI EA '13, 3131. http://doi.org/10.1145/2468356.2479628Google Scholar
- R. Vertegaal and J. S. Shell. 2008. Attentive user interfaces: the surveillance and sousveillance of gaze-aware objects. Social Science Information 47, 3: 275--298. http://doi.org/10.1177/0539018408092574Google ScholarCross Ref
- Stephen Voida, Matthew Tobiasz, Julie Stromer, Petra Isenberg, and Sheelagh Carpendale. 2009. Getting practical with interactive tabletop displays. Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces - ITS '09, ACM Press, 109. http://doi.org/10.1145/1731903.1731926 Google ScholarDigital Library
- Colin Ware and Marlon Lewis. 1995. The DragMag image magnifier. Conference companion on Human factors in computing systems - CHI '95, ACM Press, 407--408. http://doi.org/10.1145/223355.223749 Google ScholarDigital Library
- Pierre Wellner. 1993. Interacting with paper on the DigitalDesk. Communications of the ACM 36, 7: 87--96. http://doi.org/10.1145/159544.159630 Google ScholarDigital Library
- Matthew Wright and Adrian Freed. 1997. Open Sound Control: A New Protocol for Communicating with Sound Synthesizers. Proc. ICMC 1997, International Computer Music Association, 101--104. Retrieved from http://cnmat.berkeley.edu/publication/open_sound_control_new_protocol_communicating_sound_synthesizersGoogle Scholar
- Masasuke Yasumoto. 2015. VISTouch: Dynamic Three-Dimensional Connection between Multiple Mobile Devices. 89--92. Retrieved from http://doi.acm.org/10.1145/2735711.2735823 Google ScholarDigital Library
Index Terms
- DisplayPointers: seamless cross-device interactions
Recommendations
THAW: tangible interaction with see-through augmentation for smartphones on computer screens
UIST '14 Adjunct: Adjunct Proceedings of the 27th Annual ACM Symposium on User Interface Software and TechnologyIn this paper, we present a novel interaction system that allows a collocated large display and small handheld devices to seamlessly work together. The smartphone acts both as a physical interface and as an additional graphics layer for near-surface ...
THAW: Tangible Interaction with See-Through Augmentation for Smartphones on Computer Screens
TEI '15: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied InteractionThe huge influx of mobile display devices is transforming computing into multi-device interaction, demanding a fluid mechanism for using multiple devices in synergy. In this paper, we present a novel interaction system that allows a collocated large ...
Using Personal Devices to Facilitate Multi-user Interaction with Large Display Walls
UIST '15 Adjunct: Adjunct Proceedings of the 28th Annual ACM Symposium on User Interface Software & TechnologyLarge display walls and personal devices such as Smartphones have complementary characteristics. While large displays are well-suited to multi-user interaction (potentially with complex data), they are inherently public and generally cannot present an ...
Comments