Björn Hartmann
Michel Beaudouin-Lafon
Wendy E. Mackay
ABSTRACT
As computing environments that combine multiple displays and input devices become more common, the need for applications that take advantage of these capabilities becomes more pressing. However, few applications are designed to support such multi-surface environments. We investigate how to adapt existing applications without access to their source code. We introduce HydraScope, a framework for transforming existing web applications into meta-applications that execute and synchronize multiple copies of applications in parallel, with a multi-user input layer for interacting with it. We describe the Hydra-Scope architecture, validated with five meta-applications.
Supplemental Material
Available for Download
- M. Beaudouin-Lafon, S. Huot, M. Nancel, W. Mackay, E. Pietriga, R. Primet, J. Wagner, O. Chapuis, C. Pillias, J. R. Eagan, T. Gjerlufsen, and C. Klokmose. Multisurface interaction in the WILD room. IEEE Computer, 45:48--56, 2012. Google Scholar
Digital Library
- E. A. Bier and S. Freeman. MMM: a user interface architecture for shared editors on a single screen. In Proc. User Interface Software and Technology, UIST '91, 79--86. ACM, 1991. Google ScholarDigital Library
- M. Bolin, M. Webber, P. Rha, T. Wilson, and R. C. Miller. Automation and customization of rendered web pages. In Proc. User Interface Software and Technology, UIST '05, 163--172. ACM, 2005. Google ScholarDigital Library
- J. R. Eagan, M. Beaudouin-Lafon, and W. E. Mackay. Cracking the cocoa nut: user interface programming at runtime. In Proc. User Interface Software and Technology, UIST '11, 225--234. ACM, 2011. Google ScholarDigital Library
- T. Gjerlufsen, C. N. Klokmose, J. Eagan, C. Pillias, and M. Beaudouin-Lafon. Shared Substance: developing flexible multi-surface applications. In Proc. Human Factors in Computing Systems, CHI '11, 3383--3392. ACM, 2011. Google ScholarDigital Library
- B. Hartmann, M. R. Morris, H. Benko, and A. D. Wilson. Augmenting interactive tables with mice & keyboards. In Proc. User Interface Software and Technology, UIST '09, 149--152. ACM, 2009. Google ScholarDigital Library
- B. Hartmann, L. Wu, K. Collins, and S. R. Klemmer. Programming by a sample: rapidly creating web applications with d.mix. In Proc. User Interface Software and Technology, UIST '07, 241--250. ACM, 2007. Google ScholarDigital Library
- G. Humphreys, M. Houston, R. Ng, R. Frank, S. Ahern, P. D. Kirchner, and J. T. Klosowski. Chromium: a stream-processing framework for interactive rendering on clusters. In Proc. Computer Graphics and Interactive Techniques, SIGGRAPH '02, 693--702. ACM, 2002. Google ScholarDigital Library
- B. Johanson, G. Hutchins, T. Winograd, and M. Stone. PointRight: experience with flexible input redirection in interactive workspaces. In Proc. User Interface Software and Technology, UIST '02, 227--234. ACM, 2002. Google ScholarDigital Library
- B. Johanson, S. Ponnekanti, C. Sengupta, and A. Fox. Multibrowsing: Moving web content across multiple displays. In Proc. Ubiquitous Computing, UbiComp '01, 346--353. Springer-Verlag, 2001. Google ScholarDigital Library
- M. A. Nacenta, S. Sallam, B. Champoux, S. Subramanian, and C. Gutwin. Perspective cursor: perspective-based interaction for multi-display environments. In Proc. Human Factors in Computing Systems, CHI '06, 289--298. ACM, 2006. Google ScholarDigital Library
- E. Pietriga, S. Huot, M. Nancel, and R. Primet. Rapid development of user interfaces on cluster-driven wall displays with jBricks. In Proc. Engineering Interactive Computing Systems, EICS '11, 185--190. ACM, 2011. Google ScholarDigital Library
- T. Richardson, Q. Stafford-Fraser, K. Wood, and A. Hopper. Virtual network computing. Internet Computing, IEEE, 2(1):33--38, jan/feb 1998. Google ScholarDigital Library
- M. Q. Wang Baldonado, A. Woodruff, and A. Kuchinsky. Guidelines for using multiple views in information visualization. In Proc. Advanced Visual Interfaces, AVI '00, 110--119. ACM, 2000. Google ScholarDigital Library
- T. Yeh, T.-H. Chang, and R. C. Miller. Sikuli: using GUI screenshots for search and automation. In Proc. User Interface Software and Technology, UIST '09, 183--192. ACM, 2009. Google ScholarDigital Library
Index Terms
- HydraScope: creating multi-surface meta-applications through view synchronization and input multiplexing
Recommendations
Creating web-based interactive public display applications with the PuReWidgets toolkit
MUM '12: Proceedings of the 11th International Conference on Mobile and Ubiquitous MultimediaInteraction is repeatedly pointed out as a key enabling element towards more engaging and valuable public displays. Still, most digital public displays today do not support any interactive features. We believe that this is mainly due to the lack of ...
A generic direct-manipulation 3D-auditory environment for hierarchical navigation in non-visual interaction
Assets '96: Proceedings of the second annual ACM conference on Assistive technologiesAuditory presentation methods may significantly enhance the interaction quality during user-computer dialogue. The impact of auditory interaction methods is important in the context of non-visual interaction, where audio is ...
INDIGO: une architecture pour la conception d'applications graphiques interactives distribuées
IHM '05: Proceedings of the 17th Conference on l'Interaction Homme-MachineThe INDIGO project develops a new generation of tools for distributed interactive applications. The proposed architecture is composed of object servers that manage the applications's data and interaction and rendering servers that manage display and ...
Comments