Skip to main content
Top

2016 | OriginalPaper | Chapter

Degeneracies in Rolling Shutter SfM

Authors : Cenek Albl, Akihiro Sugimoto, Tomas Pajdla

Published in: Computer Vision – ECCV 2016

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We address the problem of Structure from Motion (SfM) with rolling shutter cameras. We first show that many common camera configurations, e.g. cameras with parallel readout directions, become critical and allow for a large class of ambiguities in multi-view reconstruction. We provide mathematical analysis for one, two and some multi-view cases and verify it by synthetic experiments. Next, we demonstrate that bundle adjustment with rolling shutter cameras, which are close to critical configurations, may still produce drastically deformed reconstructions. Finally, we provide practical recipes how to photograph with rolling shutter cameras to avoid scene deformations in SfM. We evaluate the recipes and provide a quantitative analysis of their performance in real experiments. Our results show how to reconstruct correct 3D models with rolling shutter cameras.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ait-Aider, O., Berry, F.: Structure and kinematics triangulation with a rolling shutter stereo rig. In: IEEE 12th International Conference on Computer Vision, pp. 1835–1840, September 2009 Ait-Aider, O., Berry, F.: Structure and kinematics triangulation with a rolling shutter stereo rig. In: IEEE 12th International Conference on Computer Vision, pp. 1835–1840, September 2009
2.
go back to reference Ait-aider, O., Andreff, N., Lavest, J.M., Blaise, U., Ferr, P.C., Cnrs, L.U.: Simultaneous object pose and velocity computation using a single view from a rolling shutter camera. In: Proceedings of the European Conference on Computer Vision, pp. 56–68 (2006) Ait-aider, O., Andreff, N., Lavest, J.M., Blaise, U., Ferr, P.C., Cnrs, L.U.: Simultaneous object pose and velocity computation using a single view from a rolling shutter camera. In: Proceedings of the European Conference on Computer Vision, pp. 56–68 (2006)
3.
go back to reference Albl, C., Kukelova, Z., Pajdla, T.: R6p - rolling shutter absolute pose problem. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2292–2300, June 2015 Albl, C., Kukelova, Z., Pajdla, T.: R6p - rolling shutter absolute pose problem. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2292–2300, June 2015
4.
go back to reference Hartley, R., Kahl, F.: Critical configurations for projective reconstruction from multiple views. IJCV 71, 5–47 (2006)CrossRef Hartley, R., Kahl, F.: Critical configurations for projective reconstruction from multiple views. IJCV 71, 5–47 (2006)CrossRef
5.
go back to reference Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, New York (2003)MATH Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, New York (2003)MATH
6.
go back to reference Hedborg, J., Ringaby, E., Forssen, P.E., Felsberg, M.: Structure and motion estimation from rolling shutter video. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), pp. 17–23 (2011) Hedborg, J., Ringaby, E., Forssen, P.E., Felsberg, M.: Structure and motion estimation from rolling shutter video. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), pp. 17–23 (2011)
7.
go back to reference Hedborg, J., Forssèn, P.E., Felsberg, M., Ringaby, E.: Rolling shutter bundle adjustment. In: CVPR, pp. 1434–1441 (2012) Hedborg, J., Forssèn, P.E., Felsberg, M., Ringaby, E.: Rolling shutter bundle adjustment. In: CVPR, pp. 1434–1441 (2012)
8.
go back to reference Kahl, F., Hartley, R.: Critical curves and surfaces for euclidean reconstruction. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2351, pp. 447–462. Springer, Heidelberg (2002). doi:10.1007/3-540-47967-8_30 CrossRef Kahl, F., Hartley, R.: Critical curves and surfaces for euclidean reconstruction. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2351, pp. 447–462. Springer, Heidelberg (2002). doi:10.​1007/​3-540-47967-8_​30 CrossRef
9.
go back to reference Klein, G., Murray, D.: Parallel tracking and mapping on a camera phone. In: 8th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2009, pp. 83–86, October 2009 Klein, G., Murray, D.: Parallel tracking and mapping on a camera phone. In: 8th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2009, pp. 83–86, October 2009
10.
go back to reference Magerand, L., Bartoli, A., Ait-Aider, O., Pizarro, D.: Global optimization of object pose and motion from a single rolling shutter image with automatic 2D-3D matching. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7572, pp. 456–469. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33718-5_33 Magerand, L., Bartoli, A., Ait-Aider, O., Pizarro, D.: Global optimization of object pose and motion from a single rolling shutter image with automatic 2D-3D matching. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7572, pp. 456–469. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-33718-5_​33
11.
go back to reference Meingast, M., Geyer, C., Sastry, S.: Geometric models of rolling-shutter cameras. Comput. Res. Repository (2005) Meingast, M., Geyer, C., Sastry, S.: Geometric models of rolling-shutter cameras. Comput. Res. Repository (2005)
12.
go back to reference Moulon, P., Monasse, P., Marlet, R.: Global fusion of relative motions for robust, accurate and scalable structure from motion. In: 2013 IEEE International Conference on Computer Vision (ICCV), pp. 3248–3255, December 2013 Moulon, P., Monasse, P., Marlet, R.: Global fusion of relative motions for robust, accurate and scalable structure from motion. In: 2013 IEEE International Conference on Computer Vision (ICCV), pp. 3248–3255, December 2013
13.
go back to reference Oth, L., Furgale, P., Kneip, L., Siegwart, R.: Rolling shutter camera calibration. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1360–1367, June 2013 Oth, L., Furgale, P., Kneip, L., Siegwart, R.: Rolling shutter camera calibration. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1360–1367, June 2013
14.
go back to reference Saurer, O., Koser, K., Bouguet, J.Y., Pollefeys, M.: Rolling shutter stereo. In: 2013 IEEE International Conference on Computer Vision (ICCV), pp. 465–472, December 2013 Saurer, O., Koser, K., Bouguet, J.Y., Pollefeys, M.: Rolling shutter stereo. In: 2013 IEEE International Conference on Computer Vision (ICCV), pp. 465–472, December 2013
15.
go back to reference Saurer, O., Pollefeys, M., Lee, G.H.: A minimal solution to the rolling shutter pose estimation problem. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1328–1334, September 2015 Saurer, O., Pollefeys, M., Lee, G.H.: A minimal solution to the rolling shutter pose estimation problem. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1328–1334, September 2015
16.
go back to reference Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: exploring photo collections in 3d. In: ACM SIGGRAPH 2006 Papers, pp. 835–846. ACM, New York (2006) Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: exploring photo collections in 3d. In: ACM SIGGRAPH 2006 Papers, pp. 835–846. ACM, New York (2006)
17.
go back to reference Triggs, B., McLauchlan, P.F., Hartley, R.I., Fitzgibbon, A.W.: Bundle adjustment — a modern synthesis. In: Triggs, B., Zisserman, A., Szeliski, R. (eds.) IWVA 1999. LNCS, vol. 1883, pp. 298–372. Springer, Heidelberg (2000). doi:10.1007/3-540-44480-7_21 CrossRef Triggs, B., McLauchlan, P.F., Hartley, R.I., Fitzgibbon, A.W.: Bundle adjustment — a modern synthesis. In: Triggs, B., Zisserman, A., Szeliski, R. (eds.) IWVA 1999. LNCS, vol. 1883, pp. 298–372. Springer, Heidelberg (2000). doi:10.​1007/​3-540-44480-7_​21 CrossRef
18.
go back to reference Wu, C.: VisualSFM: A Visual Structure from Motion System (2011) Wu, C.: VisualSFM: A Visual Structure from Motion System (2011)
Metadata
Title
Degeneracies in Rolling Shutter SfM
Authors
Cenek Albl
Akihiro Sugimoto
Tomas Pajdla
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-46454-1_3

Premium Partner