ABSTRACT
We explore a variety of interaction and visualization techniques for fluid navigation, segmentation, linking, and annotation of digital videos. These techniques are developed within a concept prototype called LEAN that is designed for use with pressure-sensitive digitizer tablets. These techniques include a transient position+velocity widget that allows users not only to move around a point of interest on a video, but also to rewind or fast forward at a controlled variable speed. We also present a new variation of fish-eye views called twist-lens, and incorporate this into a position control slider designed for the effective navigation and viewing of large sequences of video frames. We also explore a new style of widgets that exploit the use of the pen's pressure-sensing capability, increasing the input vocabulary available to the user. Finally, we elaborate on how annotations referring to objects that are temporal in nature, such as video, may be thought of as links, and fluidly constructed, visualized and navigated.
Supplemental Material
- 1. Bier, E., Stone, M., Pier, K., Buxton, W., & DeRose, T. (1993). Toolglass and Magic Lenses: The see-through interface. ACM SIGGRAPH Conference on Computer Graphics and Interactive Techniques. p. 73-80. Google ScholarDigital Library
- 2. Buxton, W., Chuncking and phrasing and the design of human-computer dialogues, in Readings in human-computer interaction: Towards the year 2000, R. Baecker, et al., Editors. 1986, Morgan Kaufmann: San Fransisco, CA. p. 494-499. Google ScholarDigital Library
- 3. Gross, M.D., & Do, E.Y.-L. (1996). Ambiguous intentions: a paper-like interface for creative design. ACM UIST Symposium on User Interface Software and Technology. p. 183-192. Google ScholarDigital Library
- 4. Guimbretière, F., Stone, M., & Winograd, T. (2001). Fluid interaction with high-resolution wall-size displays. ACM UIST Symposium on User Interface Software and Technology. p. 21-30. Google ScholarDigital Library
- 5. Guimbretière, F., & Winograd, T. (2000). FlowMenus: combining command, text, and data entry. ACM UIST Symposium on User Interface Software and Technology. p. 213-216. Google ScholarDigital Library
- 6. Harrison, B.L., & Baecker, R.M. (1992). Designing video annotation and analysis systems. Graphics Interface. p. 157-166. Google ScholarDigital Library
- 7. Hong, J.I., & Landay, J.A. (2000). SATIN: a toolkit for informal ink-based applications. ACM UIST Symposium on User Interface Software and Technology. p. 63-72. Google ScholarDigital Library
- 8. Kurtenbach, G., & Buxton, W. (1993). The limits of expert performance using hierarchical marking menus. ACM CHI Conference on Human Factors in Computing Systems. p. 35-42. Google ScholarDigital Library
- 9. Lin, J., Newman, M.W., Hong, J.I., & Landay, J.A. (2000). DENIM: finding a tighter fit between tools and practice for web site design. ACM CHI Conference on Human Factors in Computing Systems. p. 510-517. Google ScholarDigital Library
- 10. Marshall, C.C. (1997). Annotation: from paper books to the digital library. ACM International Conference on Digital Libraries. p. 131-140. Google ScholarDigital Library
- 11. McGuffin, M., & Balakrishnan, R. (2002). Acquisition of expanding targets. ACM CHI Conference on Human Factors in Computing Systems. p. 57-64. Google ScholarDigital Library
- 12. McGuffin, M., Burtnyk, N., & Kurtenbach, G. (2002). FaST Sliders: Integrating marking menus and the adjustment of continuous values. Graphics Interface. p. 35-42.Google Scholar
- 13. Myers, B.A., Casares, J.P., Stevens, S., Dabbish, L., Yocum, D., & Corbett, A. (2001). A multiview intelligent editor for digital video libraries. ACM/IEEE-CS Joint Conference on Digital Libraries. p. 106-115. Google ScholarDigital Library
- 14. Mynatt, E., Igarashi, T., Edwards, W., & LaMarca, A. (1999). Flatland: New dimensions in office whiteboards. ACM CHI Conference on Human Factors in Computing Systems. p. 346-353. Google ScholarDigital Library
- 15. Pederson, E., McCall, K., Moran, T., & Halasz, F. (1993). Tivoli: An electronic whiteboard for informal workgroup meetings. ACM CHI Conference on Human Factors in Computing Systems. p. 391-398. Google ScholarDigital Library
- 16. Pook, S., Lecolinet, E., Vaysseix, G., & Barillot, E. (2000). Control menus: Execution and control in a single interactor. ACM CHI Conference on Human Factors in Computing Systems (Extended Abstracts). p. 263-264. Google ScholarDigital Library
- 17. Rubine, D. (1991). Specifying gestures by example. ACM SIGGRAPH Conference on Computer Graphics and Interactive Techniques. p. 329-337. Google ScholarDigital Library
- 18. Sawhney, N., Balcom, D., & Smith, I. (1996). HyperCafe: narrative and aesthetic properties of hypervideo. ACM Hypertext Conference. p. 1-10. Google ScholarDigital Library
- 19. Schilit, B.N., Golovchinsky, G., & Price, M.N. (1998). Beyond paper: supporting active reading with free form digital ink annotations. ACM CHI Conference on Human Factors in Computing Systems. p. 249-256. Google ScholarDigital Library
- 20. Shneiderman, B., & Kang, H. (2000). Direct Annotation: A drag-and-drop strategy for labeling photos. IEEE Conference on Information Visualization. p. 88-98. Google ScholarDigital Library
- 21. Snibbe, S.S., MacLean, K.E., Shaw, R., Roderick, J., Verplank, W., & Scheeff, M. (2001). Haptic techniques for media control. ACM UIST Symposium on User Interface Software and Technology. p. 199-208. Google ScholarDigital Library
- 22. Tsang, M., Fitzmaurice, G.W., Kurtenbach, G., Khan, A., & Buxton, B. (2002). Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display. ACM UIST Symposium on User Interface Software and Technology. p. 111-120. Google ScholarDigital Library
Index Terms
- Fluid interaction techniques for the control and annotation of digital video
Recommendations
Multimodal video annotation for contemporary dance creation
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing SystemsThis paper presents a video annotator that supports multimodal annotation and is applied to contemporary dance as a creation tool. The prototype, developed for Tablet PCs, explores bimanual interaction, using pen and touch input interfaces. This ...
Sensing techniques for tablet+stylus interaction
UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technologyWe explore grip and motion sensing to afford new techniques that leverage how users naturally manipulate tablet and stylus devices during pen + touch interaction. We can detect whether the user holds the pen in a writing grip or tucked between his ...
Novel interaction techniques using touch-sensitive tangibles in tabletop environments
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfacesIn this work, we propose techniques for interaction that use a touch-sensitive tangible to assist 3D manipulation in tabletop applications. The objective of this research is to investigate the effectiveness and user satisfaction with this combination ...
Comments