Eric Saund
ABSTRACT
The human visual system makes a great deal more of images than the elemental marks on a surface. In the course of viewing, creating, or editing a picture, we actively construct a host of visual structures and relationships as components of sensible interpretations. This paper shows how some of these computational processes can be incorporated into perceptually-supported image editing tools, enabling machines to better engage users at the level of their own percepts. We focus on the domain of freehand sketch editors, such as an electronic whiteboard application for a pen-based computer. By using computer vision techniques to perform covert recognition of visual structure as it emerges during the course of a drawing/editing session, a perceptually supported image editor gives users access to visual objects as they are perceived by the human visual system. We present a flexible image interpretation architecture based on token grouping in a multiscale blackboard data structure. This organization supports multiple perceptual interpretations of line drawing data, domain-specific knowledge bases for interpretable visual structures, and gesture-based selection of visual objects. A system implementing these ideas, called PerSketch, begins to explore a new space of WYPIWYG (What You Perceive Is What You Get) image editing tools.
- 1.Joseph, S., and Pridmore, T. Knowledge-Directed Interpretation of Mechanical Engineering Drawings. IEEE TPAMI, 14:9 (1992), 928-940. Google Scholar
Digital Library
- 2.Lee, S. Recognizing Hand-Drawn Electrical Circuit Symbols with Attributed Graph Matching. In H. S. Baird, H. Bunke, and K. Yamamoto (eds.), Structured Document Image Analysis. Springer-Verlag, New York, 1992.Google ScholarCross Ref
- 3.Mart, D. Early Processing of Visual Information. Phil. Trans. R. Soc. Lond., B 275 (1976), 483-519.Google ScholarCross Ref
- 4.Mohan, R., and Nevatia, R. Using Perceptual Organization to Extract 3-D Structures. IEEE TPAMI, 11:11 (1989), 1121-1139 Google ScholarDigital Library
- 5.Montalvo, F. Diagram Understanding: The Symbolic Descriptions Behind the Scenes. In T. ichikawa, E. Jungert, and R. Korfhage (eds.), Visual Languages and Applications. Plenum Press, New York, 1990.Google Scholar
- 6.Moran, T. Deformalizing Computer and Communication Systems. Position Paper for the InterCHI93 Research Symposium. 1993.Google Scholar
- 7.Okazaki, S., and Tsuji, Y. An Adaptive Recognition Method for Line Drawings Using Construction Rules. NEC Research and Development Journal, 92 (1989).Google Scholar
- 8.Pedersen, E., McCall, K., Moran, T., and Halasz, F. Tivoli: An Electronic Whiteboard for Informal Workgroup Meetings. Proceedings of the lnterCH193 Conference on Human Factors in Computer Systems. ACM, New York, 1993. Google ScholarDigital Library
- 9.Sarkar, S., and Boyer, K. Integration, Inference, and Management of Spatial Information Using Bayesian Networks: Perceptual Organization. IEEE TPAMI, 15:3 (1993),256-274. Google ScholarDigital Library
- 10.Sato, T., and Tojo, A. Recognition and Understanding of Hand-Drawn Diagrams. Proc. 6th International Conference on Pattern Recognition. IEEE Computer Society Press, New Jersey, 1982.Google Scholar
- 11.Saund, E. Symbolic Construction of a 2-D Scale-Space Image. lEEE TPAMI, 12:8 (1990), 817-830. Google ScholarDigital Library
- 12.Saund, E. Identifying Salient Circular Arcs on Curves. CVGIP: Image Understanding, 58:3 (1993), 327-337. Google ScholarDigital Library
Index Terms
- A perceptually-supported sketch editor
Recommendations
Perceptual organization in an interactive sketch editing application
ICCV '95: Proceedings of the Fifth International Conference on Computer VisionThe paper shows how techniques from computational vision can be deployed to support interactive sketch editing. While conventional computer supported drawing tools give users access to visible marks or image objects at a single level of abstraction, a ...
In Search of Perceptually Salient Groupings
Finding meaningful groupings of image primitives has been a long-standing problem in computer vision. This paper studies how salient groupings can be produced using established theories in the field of visual perception alone. The major contribution is ...
Combining local belief from low-level primitives for perceptual grouping
Segmentation is usually unable to cope with artifacts due to slight change in lighting conditions or object occlusion for instance. That is why perceptual grouping is often used to overcome segmentation's lacks. This refers to the ability of human ...
Comments