Kirsten Cater
ABSTRACT
The complexity of most virtual environments prevents them being rendered in real time even on modern graphics hardware. Knowledge of the visual system of the user viewing the environment may be used to significantly reduce image computation times. In this paper, we demonstrate the principle of Change Blindness, a major side effect of brief visual disruptions, including an eye saccade, a flicker, or a blink, where portions of the scene that have changed simultaneously with the visual disruption go unnoticed to the viewer. The onset of the visual disruption inhibits visual attention by swamping the user's local motion signals, short-circuiting the automatic system that normally draws attention to the change location. Without automatic control, attention is controlled entirely by slower, higher-level mechanisms in the visual system, that search the scene, object by object, until attention finally focuses on the object that is changing.Previous work in perception-based rendering has exploited human visual acuity, to control detail (and therefore time) spent on rendering parts of a scene. In our experiment we show that if changes in rendering detail occur when there is a visual disruption, then visual attention to the change is dramatically slowed as in natural scenes. Therefore, if the principal is used in dynamic animations the change will have passed through the visual field without notice before the viewers' attention has picked up the change. Our results clearly show that flaws in the human visual system, such as Change Blindness, can be exploited to reduce rendering times substantially without compromising perceived visual quality.
- BOLIN MR. AND MEYER GW. 1998 A Perceptually Based Adaptive Sampling Algorithm, In Proceedings of SIGGRAPH 1998, ACM Press / ACM SIGGRAPH, New York. M. Cohen, Ed., Computer Graphics Proceedings, Annual Conference Series, ACM, 299-309 Google Scholar
Digital Library
- CATER K., CHALMERS AG. AND DALTON C. 2001 Change blindness with varying rendering fidelity: looking but not seeing, Sketch SIGGRAPH 2001, Conference Abstracts and Applications.Google Scholar
- CATER K., CHALMERS AG. AND LEDDA P. 2002 Selective Quality Rendering by Exploiting Human Inattentional Blindness: Looking but not Seeing, In Proceedings of Symposium on Virtual Reality Software and Technology 2002, ACM. Google ScholarDigital Library
- DALY S. 1998 Engineering observations from spatiovelocity and spatiotemporal visual models. In IS&T/SPIE Conference on Human Vision and Electronic Imaging III, SPIE vol. 3299, 152-166.Google Scholar
- DOWLING JE. 1987 The retina: An approachable part of the brain, Cambridge: Belknap.Google Scholar
- FERWERDA J., PATTANAIK SN, SHIRLEY P. AND GREENBERG DP. 1996 A Model of Visual Adaptation for Realistic Image Synthesis, In Proceedings of SIGGRAPH 1996, ACM Press / ACM SIGGRAPH, New York. H. Rushmeier, Ed., Computer Graphics Proceedings, Annual Conference Series, ACM, 249-258 Google ScholarDigital Library
- GREENBERG DP, TORRANCE KE, SHIRLEY P., ARVO J., FERWERDA J., PATTANAIK SN. LAFORTUNE E., WALTER B., FOO S-C. AND TRUMBORE B. 1997 A Framework for Realistic Image Synthesis, In Proceedings of SIGGRAPH 1997 (Special Session), ACM Press / ACM SIGGRAPH, New York. T. Whitted, Ed., Computer Graphics Proceedings, Annual Conference Series, ACM, 477-494. Google ScholarDigital Library
- ITTI L. AND KOCH C. 2000 A saliency-based search mechanism for overt and covert shifts of visual attention, In Vision Research, vol. 40, no 10-12, 1489-1506.Google ScholarCross Ref
- LEVIN D. T. AND SIMONS D. J 1997 Failure to detect changes to attended objects in motion pictures, Psychonomic Bulletin and Review, 4(4) pp. 501-506Google ScholarCross Ref
- LOSCHKY LC. AND MCCONKIE GW. 1999 Gaze Contingent Displays: Maximizing Display Bandwidth Efficiency. ARL Federated Laboratory Advanced Displays and Interactive Displays Consortium, Advanced Displays and Interactive Displays Third Annual Symposium, 79-83.Google Scholar
- LOSCHKY LC, MCCONKIE GW, YANG J AND MILLER ME. 2001 Perceptual Effects of a Gaze-Contingent Multi-Resolution Display Based on a Model of Visual Sensitivity. In the ARL Federated Laboratory 5th Annual Symposium - ADID Consortium Proceedings, 53-58.Google Scholar
- LUEBKE D. AND HALLEN B. 2001 Perceptually driven simplification for interactive rendering, In Proceedings of 12th Eurographics Workshop on Rendering, 221-223. Google ScholarDigital Library
- LUEBKE D., REDDY M., WATSON B., COHEN J. AND VARSHNEY A. 2001. Advanced Issues in Level of Detail. Course #41 at SIGGRAPH 2001. Los Angeles, CA. August 12-17, 2001.Google Scholar
- MACIEL PWC. AND SHIRLEY P. 1995 Visual Navigation of Large Environments Using Textured Clusters, In Proceedings of Symposium on Interactive 3D Graphics, 95-102. Google ScholarDigital Library
- MACK A. AND ROCK I. 1998 Inattentional Blindness, Massachusetts Institute of Technology Press.Google Scholar
- MCCONKIE GW. AND LOSCHKY LC. 1997 Human Performance with a Gaze-Linked Multi-Resolutional Display. ARL Federated Laboratory Advanced Displays and Interactive Displays Consortium, Advanced Displays and Interactive Displays First Annual Symposium, 25-34.Google Scholar
- MCNAMARA A., CHALMERS AG, TROSCIANKO T., AND GILCHRIST I. 2000 Comparing Real and Synthetic Scenes using Human Judgements of Lightness. In B Peroche and H Rushmeier (eds), 12th Eurographics Workshop on Rendering, 207-219. Google ScholarDigital Library
- MYSZKOWSKI K., TAWARA T., AKAMINE H. AND SEIDEL H-P. 2001 Perception-Guided Global Illumination Solution for Animation Rendering. In Proceedings of SIGGRAPH 2001, ACM Press / ACM SIGGRAPH, New York. E. Fiume, Ed., Computer Graphics Proceedings, Annual ConferenceSeries, ACM, 221-230. Google ScholarDigital Library
- O. REGAN JK, DEUBEL H., CLARK JJ. AND RENSINK RA. 2000 Picture changes during blinks: looking without seeing and seeing without looking. Visual Cognition.7, 1, 191-212.Google Scholar
- O'REGAN JK, RENSINK RA, AND CLARK JJ. 1999 Change Blindness as a Result of 'Mudsplashes'. Nature, 398:34Google ScholarCross Ref
- O'REGAN, J. K. 1992 Solving the "real" mysteries of visual perception: The world as an outside memory. Canadian Journal of Psychology 46, 461-488Google ScholarCross Ref
- PARKER, S. 1989. The eye and seeing. In the Human Body series. New York: Franklin Watts.Google Scholar
- PATTANAIK SN, FERWERDA J, FAIRCHILD MD, AND GREENBERG DP. 1998 A Multiscale Model of Adaptation and Spatial Vision for Realistic Image Display, in Proceedings of SIGGRAPH 1998, ACM Press / ACM SIGGRAPH, New York. M. Cohen, Ed., Computer Graphics Proceedings, Annual Conference Series, ACM, 287-298. Google ScholarDigital Library
- RAMASUBRAMANIAN M., PATTANAIK SN, GREENBERG DP. 1999 A Perceptually Based Physical Error Metric for Realistic Image Synthesis, In Proceedings of SIGGRAPH 1999, ACM Press / ACM SIGGRAPH, New York. Computer A. Rockwood, Ed., Graphics Proceedings, Annual Conference Series, ACM, 73-82. Google ScholarDigital Library
- REDDY M. 1997. Perceptually Modulated Level of Detail for Virtual Environments. Ph.D. Thesis (CST- 134-97), University of Edinburgh.Google Scholar
- RENSINK R. A, O'REGAN J. K AND CLARK J. J. 1997 To see or not to see: The need for attention to perceive changes in scenes, Psychological Science, 8(5) pp. 368-373Google ScholarCross Ref
- SIMONS D. J AND LEVIN D. T 1998 Failure to detect changes to people during real-world interaction, Psychonomic Bulletin and Review, 5(4) pp. 644-649Google ScholarCross Ref
- WARD LARSON, G. 1998. Rendering with RADIANCE: The art and science of lighting simulation. San Francisco: Morgan Kauffman. Google ScholarDigital Library
- WATSON, B., FRIEDMAN, A. ANDMCGAFFEY, A. 1997 An evaluation of Level of Detail Degradation in Head-Mounted Display Peripheries. Presence, 6, 6, 630-637.Google ScholarDigital Library
- WATSON B., FRIEDMAN A. AND MCGAFFEY A 2001 Measuring and Predicting Visual Fidelity, In Proceedings of SIGGRAPH 2001, ACM Press / ACM SIGGRAPH, New York. E. Fiume, Ed., Computer Graphics Proceedings, Annual Conference Series, ACM, 213.220. Google ScholarDigital Library
- YANTIS S. 1996 Attentional capture in vision. In A. Kramer, M. Coles and G. Logan (eds), Converging operations in the study of selective visual attention, 45-76, American Psychological Association.Google Scholar
- YARBUS AL.1967 Eye movements during perception of complex objects. In L. A. Riggs, Ed., Eye Movements and Vision, Plenum Press, New York, Chapter VII, 171-196.Google Scholar
- YEE H. 2000 Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments, MSc. Thesis, Program of Computer Graphics, Cornell University. Google ScholarDigital Library
- YEE H., PATTANAIK, S., AND GREENBERG, DP. 2001 Spatiotemporal sensitivity and Visual Attention for efficient rendering of dynamic Environments, In ACM Transactions on Computer Graphics, vol. 20, no 1, 39-65. Google ScholarDigital Library
Index Terms
- Varying rendering fidelity by exploiting human change blindness
Recommendations
Selective quality rendering by exploiting human inattentional blindness: looking but not seeing
VRST '02: Proceedings of the ACM symposium on Virtual reality software and technologyThere are two major influences on human visual attention: bottom-up and top-down processing. Bottom-up processing is the automatic direction of gaze to lively or colourful objects as determined by low-level vision. In contrast, top-down processing is ...
Perceptually guided high-fidelity rendering exploiting movement bias in visual attention
A major obstacle for real-time rendering of high-fidelity graphics is computational complexity. A key point to consider in the pursuit of “realism in real time” in computer graphics is that the Human Visual System (HVS) is a fundamental part of the ...
Low-Level Image Cues in the Perception of Translucent Materials
When light strikes a translucent material (such as wax, milk or fruit flesh), it enters the body of the object, scatters and reemerges from the surface. The diffusion of light through translucent materials gives them a characteristic visual softness and ...
Comments