Modeling Reality for Camera Registration in Augmented Reality Applications

Excerpt

One of the central problems of Augmented Reality is to make reality and virtual objects coincide in some way. Any technique aiming at solving this problem requires an internal way of representing the real objects of interest, i.e. the objects that the system expects to see. We name these representations Reality Models and take in this work a closer look at the various ways of representing reality in the context of AR. We propose a classification of AR applications based on the requirements on Reality Models. AR applications can be first classified into applications where the full 6DOF camera pose is recovered and applications where a 2D object localization in the image space is sufficient. We further detail the classification by providing examples of planar fiducials and textured objects in the first case and object detection and local pose estimation in the second case. In all provided examples we extend the state of the art by providing new Reality Models or better ways to construct and use existing ones. …