Abstract
Auto-calibration is the recovery of the full camera geometry and Euclidean scene structure from several images of an unknown 3D scene, using rigidity constraints and partial knowledge of the camera intrinsic parameters. It fails for certain special classes of camera motion. This paper derives necessary and sufficient conditions for unique auto-calibration, for several practically important cases where some of the intrinsic parameters are known (e.g. skew, aspect ratio) and others can vary (e.g. focal length). We introduce a novel subgroup condition on the camera calibration matrix, which helps to systematize this sort of auto-calibration problem. We show that for subgroup constraints, criticality is independent of the exact values of the intrinsic parameters and depends only on the camera motion. We study such critical motions for arbitrary numbers of images under the following constraints: vanishing skew, known aspect ratio and full internal calibration modulo unknown focal lengths. We give explicit, geometric descriptions for most of the singular cases. For example, in the case of unknown focal lengths, the only critical motions are: (i) arbitrary rotations about the optical axis and translations, (ii) arbitrary rotations about at most two centres, (iii) forward-looking motions along an ellipse and/or a corresponding hyperbola in an orthogonal plane. Some practically important special cases are also analyzed in more detail.
Similar content being viewed by others
References
M. Armstrong, A. Zisserman, and R. Hartley, “Self-calibration from image triplets,” in European Conf. Computer Vision, Cambridge, UK, 1996, pp. 3–16.
K. Åström and A. Heyden, “Euclidean reconstruction from constant intrinsic parameters,” in Int. Conf. Pattern Recognition, Vienna, Austria, 1996, pp. 339–343.
K.B. Atkinson, Close Range Photogrammetry and Machine Vision, Whittles Publishing, 1996.
S. Bougnoux, “From projective to euclidean space under any practical situation, a criticism of self-calibration,” in Int. Conf. Computer Vision, Mumbai, India, 1998, pp. 790–796.
C.G. Cullen, Matrices and Linear Transformations, Addison-Wesley Publishing Company, 1966.
O.D. Faugeras, “What can be seen in three dimensions with an uncalibrated stereo rig?,” in European Conf. Computer Vision, Santa Margherita Liguere, Italy, 1992, pp. 563–578.
O. Faugeras, Three-Dimensional Computer Vision, MIT Press: Cambridge, Mass., 1993.
O. Faugeras, Q.-T. Luong, and S. Maybank, “Camera self-calibration: Theory and experiments,” in European Conf. Computer Vision, Santa Margherita Liguere, Italy, 1992, pp. 321–334.
G. Golub and C. Van Loan, Matrix Computation, The Johns Hopkins University Press: Baltimore, 1989.
R. Hartley, “Estimation of relative camera positions for uncalibrated cameras,” in European Conf. Computer Vision, Santa Margherita Liguere, Italy, 1992, pp. 579–587.
R. Hartley, “Extraction of focal lengths from the fundamental matrix,” unpublished manuscript, 1993.
R. Hartley, R. Gupta, and T. Chang, “Stereo from uncalibrated cameras,” in Conf. Computer Vision and Pattern Recognition, Champaign, USA, 1992, pp. 761–764.
H. Helmholtz, Handbuch der Physiologischen Optik, Leibzig: Voss, 1867.
A. Heyden and K. Åström, “Euclidean reconstruction from image sequences with varying and unknown focal length and principal point,” in Conf. Computer Vision and Pattern Recognition, San Juan, Puerto Rico, 1997, pp. 438–443.
A. Heyden and K. Åström, “Minimal conditions on intrinsic parameters for euclidean reconstruction,” in Asian Conf. Computer Vision, Vol. II, Hong Kong, 1998, pp. 169–176.
A. Heyden and K. Åström, “Flexible calibration: Minimal cases for auto-calibration,” in Int. Conf. Computer Vision, Kerkyra, Greece, 1999, pp. 350–355.
A. Heyden and G. Sparr, “Reconstruction from calibrated cameras-A new proof of the Kruppa demazure theorem,” Journal of Mathematical Imaging and Vision, Vol. 10, No. 2, pp. 123–142, 1999.
B.K.P. Horn, “Motion fields are hardly ever ambiguous,” Int. Journal Computer Vision, Vol. 1, No. 3, pp. 239–258, 1987.
F. Kahl, “Critical motions and ambiguous euclidean reconstructions in auto-calibration,” in Int. Conf. Computer Vision, Kerkyra, Greece, 1999, pp. 469–475.
F. Kahl and B. Triggs, “Critical motions in euclidean structure from motion,” in Conf. Coumputer Vision and Pattern Recognition, Fort Collins, USA, 1999, pp. 366–372.
J. Krames, “Zur Ermittlung eines Objectes aus zwei Perspectiven (Ein Beitrag zur Theorie der gefährlichen Örter),” Montach. Math. Phys. Vol. 49, pp. 327–354, 1941.
E. Kruppa, “Zur Ermittlung eines Objektes aus zwei Perspektiven mit innerer Orientierung,” Sitz-Ber. Akad. Wiss., Wien, math. naturw. Kl. Abt, Vol. IIa, No. 122, 1939–1948, 1913.
H.C. Longuet-Higgins, “Multiple interpretations of a pair of images of a surface,” Phil. Trans. Royal Soc. London A, Vol. 418, pp. 1–15, 1988.
S. Maybank, Theory of Reconstruction from Image Motion, Springer-Verlag: Berlin, Heidelberg, New York, 1993.
S.J. Maybank and O.D. Faugeras, “A theory of self calibration of a moving camera,” Int. Journal Computer Vision, Vol. 8, No. 2, pp. 123–151, 1992.
S. Maybank and A. Shashua, “Ambiguity in reconstruction from images of six points,” in Int. Conf. Computer Vision, Mumbai, India, 1998, pp. 703–708.
S. Negahdaripour, “Multiple interpretations of the shape and motion of objects from two perspective images,” IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 12, No. 11, pp. 1025–1039, 1990.
G. Newsam, D. Huynh, M. Brooks, and H.-P. Pan, “Recovering unknown focal lengths in self-calibration: An essentially linear algorithm and degenerate configurations,” in Int. Arch. Photogrammetry & Remote Sensing, Vol. XXXI-B3, Vienna, Austria, 1996, pp. 575–580.
M. Pollefeys, R. Koch, and L. Van Gool, “Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters,” in Int. Conf. Computer Vision, Mumbai, India, 1998, pp. 90–95.
M. Pollefeys, L. Van Gool, and M. Oosterlinck, “The modulus constraint: A new constraint for self-calibration,” in Int. Conf. Pattern Recognition, Vienna, Austria, 1996a, pp. 349–353.
M. Pollefeys, L.Van Gool, and M. Proesmans, “Euclidean 3D reconstruction from image sequences with variable focal lengths,” European Conf. Computer Vision, Cambridge, UK, 1996b, pp. 31–42.
H. Schröter, Theorie der Oberflächen zweiter Ordnung und der Raumkurve dritter Ordnung als Erzeugnisse projektvischer Gebilde, Leibzig: Teubner, 1880.
J.G. Semple and G.T. Kneebone, Algebraic Projective Geometry, Clarendon Press: Oxford, 1952.
B. Spain, Analytical Quadrics, Pergamon Press, 1960.
G. Sparr, “An algebraic-analytic method for affine shapes of point configurations,” in Scandinavian Conf. on Image Analysis, Aalborg, Denmark, 1991, pp. 274–281.
P. Sturm, “Critical motion sequences for monocular self-calibration and uncalibrated Euclidean reconstruction,” in Conf. Computer Vision and Pattern Recognition, San Juan, Puerto Rico, 1997a, pp. 1100–1105.
P. Sturm, “Vision 3D Non Calibrée: Contributions à la reconstruction projective et Étude des mouvements critiques pour l'auto-calibrage,” Ph.D. thesis, Institut National Polytechnique de Grenoble, 1997b.
P. Sturm, “Critical motion sequences for the self-calibration of cameras and stereo systems with variable focal length,” in British Machine Vision Conf., Nottingham, UK, 1999, pp. 63–72.
B. Triggs, “Autocalibration and the absolute quadric,” in Conf. Computer Vision and Pattern Recognition, San Juan, Puerto Rico, 1997, pp. 609–614.
L.Van Gool, T. Moons, M. Proesmans, and M. Van Diest, “Affine reconstruction from perspective image pairs obtained by a translating camera,” in Int. Conf. Pattern Recognition, Jerusalem, Israel, 1994, pp. 290–294.
C. Zeller and O. Faugeras, “Camera self-calibration from video sequences: The Kruppa equations revisited,” Technical Report 2793, INRIA, Sophia-Antipolis, France, 1996.
A. Zisserman, P. Beardsley, and I. Reid, “Metric Calibration of a stereo rig,” IEEE Workshop on Representation of Visual Scenes, Cambridge MA, USA, 1995, pp. 93–110.
A. Zisserman, D. Liebowitz, and M. Armstrong, “Resolving ambiguities in auto-calibration,” Phil. Trans. Royal Soc. London A, Vol. 356, No. 1740, pp. 1193–1211, 1998.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Kahl, F., Triggs, B. & Åström, K. Critical Motions for Auto-Calibration When Some Intrinsic Parameters Can Vary. Journal of Mathematical Imaging and Vision 13, 131–146 (2000). https://doi.org/10.1023/A:1026524030731
Issue Date:
DOI: https://doi.org/10.1023/A:1026524030731