Daniel Vogel
Ravin Balakrishnan
ABSTRACT
We define occlusion-aware interfaces as interaction techniques which know what area of the display is currently occluded, and use this knowledge to counteract potential problems and/or utilize the hidden area. As a case study, we describe the Occlusion-Aware Viewer, which identifies important regions hidden beneath the hand and displays them in a non-occluded area using a bubble-like callout. To determine what is important, we use an application agnostic image processing layer. For the occluded area, we use a user configurable, real-time version of Vogel et al.'s [21] geometric model. In an evaluation with a simultaneous monitoring task, we find the technique can successfully mitigate the effects of occlusion, although issues with ambiguity and stability suggest further refinements. Finally, we present designs for three other occlusion-aware techniques for pop-ups, dragging, and a hidden widget.
Supplemental Material
- Accot, J. and Zhai, S. More than dotting the i's -- foundations for crossing-based interfaces. In Proc. CHI, ACM (2002), 73--80. Google Scholar
Digital Library
- Apitz, G. and Guimbretière, F. CrossY: a crossing-based drawing application. In Proc. UIST, ACM (2004), 3--12. Google ScholarDigital Library
- Benko, H., Wilson, A.D., and Baudisch, P. Precise selection techniques for multi-touch screens. In Proc. CHI, ACM (2006), 1263--1272. Google ScholarDigital Library
- Bezerianos, A., Dragicevic, P., and Balakrishnan, R. Mnemonic rendering: an image-based approach for exposing hidden changes in dynamic displays. In Proc.UIST, ACM (2006), 159--168. Google ScholarDigital Library
- Brandl, P., Leitner, J., Seifried, T., Haller, M., Doray, B., and To, P. Occlusion-aware menu design for digital tabletops. Ext. Abstracts CHI, ACM (2009), 3223--3228. Google ScholarDigital Library
- Cotting, D. and Gross, M. Interactive environment-aware display bubbles. In Proc. UIST, ACM (2006), 245--254. Google ScholarDigital Library
- Echtler, F., Huber, M., and Klinker, G. Shadow tracking on multi-touch tables. In Proc. Advanced visual interfaces, ACM (2008), 388--391. Google ScholarDigital Library
- Forlines, C. and Balakrishnan, R. Evaluating tactile feedback and direct vs. indirect stylus input in pointing and crossing selection tasks. In Proc. CHI, ACM (2008), 1563--1572. Google ScholarDigital Library
- Forlines, C., Vogel, D., and Balakrishnan, R. HybridPointing: fluid switching between absolute and relative pointing with a direct input device. In Proc. UIST, ACM (2006), 211--220. Google ScholarDigital Library
- Hancock, M.S. and Booth, K.S. Improving menu placement strategies for pen input. In Proc. Graphics Interface, (2004), 221--230. Google ScholarDigital Library
- Inkpen, K., Dearman, D., Argue, R., et al. Left-Handed Scrolling for Pen-Based Devices. International Journal of Human-Computer Interaction 21, 1 (2006), 91--108.Google Scholar
- Ishak, E.W. and Feiner, S.K. Interacting with hidden content using content-aware free-space transparency. In Proc. UIST, ACM (2004), 189--192. Google ScholarDigital Library
- Meyer, A. Pen computing: a technology overview and a vision. SIGCHI Bull 27, 3 (1995), 46--90. Google ScholarDigital Library
- Pheasant, S. and Hastlegrave, C. Bodyspace: Anthropometry, Ergonomics and the Design of the Work. CRC, 2006.Google Scholar
- Ramos, G. and Balakrishnan, R. Fluid interaction techniques for the control and annotation of digital video. In Proc. UIST, ACM (2003), 105--114. Google ScholarDigital Library
- Schilit, B.N., Golovchinsky, G., and Price, M.N. Beyond paper: supporting active reading with free form digital ink annotations. In Proc. CHI, ACM (1998), 249--256. Google ScholarDigital Library
- Shen, C., Hancock, M.S., Forlines, C., and Vernier, F.D. CoR2Ds. Ext. Abstracts CHI, ACM (2005), 1781--1784. Google ScholarDigital Library
- Vogel, D. and Balakrishnan, R. Direct Pen Interaction with a Conventional Graphical User Interface. Human-Computer Interaction, (forthcoming).Google Scholar
- Vogel, D. and Balakrishnan, R. Distant freehand pointing and clicking on very large, high resolution displays. In Proc. UIST, ACM (2005), 33--42. Google ScholarDigital Library
- Vogel, D. and Baudisch, P. Shift: a technique for operating pen-based interfaces using touch. In Proc. CHI, ACM (2007), 657--666. Google ScholarDigital Library
- Vogel, D., Cudmore, M., Casiez, G., Balakrishnan, R., and Keliher, L. Hand Occlusion with Tablet-sized Direct Pen Input. In Proc. CHI, ACM (2009), 557--566. Google ScholarDigital Library
- Zeleznik, R. and Miller, T. Fluid inking: augmenting the medium of free-form inking with gestures. In Proc. Graphics Interface, (2006), 155--162. Google ScholarDigital Library
Index Terms
- Occlusion-aware interfaces
Recommendations
Hand occlusion on a multi-touch tabletop
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe examine the shape of hand and forearm occlusion on a multi-touch table for different touch contact types and tasks. Individuals have characteristic occlusion shapes, but with commonalities across tasks, postures, and handedness. Based on this, we ...
Occlusion Detectable Stereo -- Occlusion Patterns in Camera Matrix
CVPR '96: Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)In stereo algorithms with more than two cameras, the improvement of accuracy is often reported since they are robust against noise. However, another important aspect of the polynocular stereo, that is the ability of occlusion detection, has been paid ...
Towards occlusion-aware multifocal displays
The human visual system uses numerous cues for depth perception, including disparity, accommodation, motion parallax and occlusion. It is incumbent upon virtual-reality displays to satisfy these cues to provide an immersive user experience. Multifocal ...
Comments