Martin Kaltenbrunner
Ross Bencina
ABSTRACT
This article provides an introductory overview to first-time users of the reacTIVision framework -- an open-source cross-platform computer-vision framework primarily designed for the construction of table-based tangible user interfaces. The central component of the framework is a standalone application for fast and robust tracking of fiducial markers in a real-time video stream. The framework also defines a transport protocol for efficient and reliable transmission of object states via a local or wide area network. In addition, the distribution includes a collection of client example projects for various programming environments that allow the rapid development of unique tangible user interfaces. This article also provides a discussion of key points relevant to the construction of the necessary table hardware and surveys some projects that have been based on this technology.
- Bencina, R. & Kaltenbrunner, M. "The Design and Evolution of Fiducials for the reacTIVision System", Proceedings of the 3rd International Conference on Generative Systems in the Electronic Arts (3rd Iteration 2005), Melbourne (Australia)Google Scholar
- Bencina, R. & Kaltenbrunner, M. & Jordà& Jordàà, S. "Improved Topological Fiducial Tracking in the reacTIVision System", Proceedings of the IEEE International Workshop on Projector-Camera Systems (Procams 2005), San Diego (USA) Google ScholarDigital Library
- Costanza, E. & Shelley, S. B. & Robinson, J. "D-touch: A Consumer-Grade Tangible Interface Module and Musical Applications". Proceedings of Conference on Human-Computer Interaction (HCI03), Bath (UK)Google Scholar
- Han, J. Y. "Low-cost multi-touch sensing through frustrated total internal reflection", Proceedings of the 18th annual ACM symposium on User interface software and technology 2005, Seattle (USA) Google ScholarDigital Library
- Jordà, S. & Kaltenbrunner, M. & Geiger, G. & Bencina, R. "The reacTable*", Proceedings of the International Computer Music Conference (ICMC2005), Barcelona (Spain)Google Scholar
- Kaltenbrunner, M. & Bovermann, T. & Bencina, R. & Costanza, E. "TUIO - A Protocol for Table Based Tangible User Interfaces", Proceedings of the 6th International Workshop on Gesture in Human-Computer Interaction and Simulation (GW 2005), Vannes (France)Google Scholar
- Kato, H. & Billinghurst, M. & Poupyrev, I. & Imamoto, K. & Tachibana, K. "Virtual Object Manipulation on a Table-Top AR Environment", Proceedings of the International Symposium on Augmented Reality (ISAR 2000), Munich (Germany)Google ScholarCross Ref
- MIDI Manufacturers Association, http://www.midi.org/Google Scholar
- Ullmer, B. & Ishii, H. "Emerging Frameworks for Tangible User Interfaces", In J. M. Carroll, editor, Human-Computer Interaction in the New Millennium, pp. 579--601, 2001Google Scholar
- Wright M. & Freed, A. & Momeni, A. "OpenSound Control: State of the Art 2003", Proceedings of the 3rd Conference on New Interfaces for Musical Expression (NIME03), Montreal (Canada) Google ScholarDigital Library
Index Terms
- reacTIVision: a computer-vision framework for table-based tangible interaction
Recommendations
reacTIVision and TUIO: a tangible tabletop toolkit
ITS '09: Proceedings of the ACM International Conference on Interactive Tabletops and SurfacesThis article presents the recent updates and an evaluation of reacTIVision, a computer vision toolkit for fiducial marker tracking and multi-touch interaction. It also discusses the current and future development of the TUIO protocol and framework, ...
TouchBridge: augmenting active tangibles for camera-based multi-touch surfaces
ITS '10: ACM International Conference on Interactive Tabletops and SurfacesThe augmentation of tabletop multi-touch surfaces with physical objects is a well visited approach for the realisation of tangible user interfaces. Interaction with objects on a multi-touch surface is often limited to spatial manipulation and common ...
Comparing Tangible and Multi-touch Interaction for Interactive Data Visualization Tasks
TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied InteractionInteractive visualization plays a key role in the analysis of large datasets. It can help users to explore data, investigate hypotheses and find patterns. The easier and more tangible the interaction, the more likely it is to enhance understanding. This ...
Comments