Skip to main content

2017 | OriginalPaper | Buchkapitel

3D Motion Consistency Analysis for Segmentation in 2D Video Projection

verfasst von : Wei Zhao, Nico Roos, Ralf Peeters

Erschienen in: Computer Analysis of Images and Patterns

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Motion segmentation for 2D videos is usually based on tracked 2D point motions, obtained for a sequence of frames. However, the 3D real world motion consistency is easily lost in the process, due to projection from 3D space to the 2D image plane. Several approaches have been proposed in the literature to recover 3D motion consistency from 2D point motions. To further improve on this, we here propose a new criterion and associated technique, which can be used to determine whether a group of points show 2D motions consistent with joint 3D motion. It is also applicable for estimating the 3D motion information content. We demonstrate that the proposed criterion can be applied to improve segmentation results in two ways: finding the misclassified points in a group, and assigning unclassified points to the correct group. Experiments with synthetic data and different noise levels, and with real data taken from a benchmark, give insight in the performance of the algorithm under various conditions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Altunbasak, Y., Eren, P.E., Tekalp, A.M.: Region-based parametric motion segmentation using color information. Graph. Model. Image Process. 60(1), 13–23 (1998)CrossRef Altunbasak, Y., Eren, P.E., Tekalp, A.M.: Region-based parametric motion segmentation using color information. Graph. Model. Image Process. 60(1), 13–23 (1998)CrossRef
2.
Zurück zum Zitat Borshukov, G.D., Bozdagi, G., Altunbasak, Y., Tekalp, A.M.: Motion segmentation by multistage affine classification. IEEE Trans. Image Process. 6(11), 1591–1594 (1997)CrossRef Borshukov, G.D., Bozdagi, G., Altunbasak, Y., Tekalp, A.M.: Motion segmentation by multistage affine classification. IEEE Trans. Image Process. 6(11), 1591–1594 (1997)CrossRef
3.
Zurück zum Zitat Boult, T.E., Brown, L.G.: Factorization-based segmentation of motions. In: 1991 Proceedings of the IEEE Workshop on Visual Motion, pp. 179–186. IEEE (1991) Boult, T.E., Brown, L.G.: Factorization-based segmentation of motions. In: 1991 Proceedings of the IEEE Workshop on Visual Motion, pp. 179–186. IEEE (1991)
4.
Zurück zum Zitat Bovik, A.C.: Handbook of Image and Video Processing. Academic Press, London (2010)MATH Bovik, A.C.: Handbook of Image and Video Processing. Academic Press, London (2010)MATH
5.
Zurück zum Zitat Costeira, J., Kanade, T.: A multi-body factorization method for motion analysis. In: 1995 Proceedings of the Fifth International Conference on Computer Vision, pp. 1071–1076. IEEE (1995) Costeira, J., Kanade, T.: A multi-body factorization method for motion analysis. In: 1995 Proceedings of the Fifth International Conference on Computer Vision, pp. 1071–1076. IEEE (1995)
6.
Zurück zum Zitat Elhamifar, E., Vidal, R.: Sparse subspace clustering. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 2790–2797. IEEE (2009) Elhamifar, E., Vidal, R.: Sparse subspace clustering. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 2790–2797. IEEE (2009)
7.
Zurück zum Zitat Gruber, A., Weiss, Y.: Multibody factorization with uncertainty and missing data using the EM algorithm. In: 2004 Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, vol. 1, p. I. IEEE (2004) Gruber, A., Weiss, Y.: Multibody factorization with uncertainty and missing data using the EM algorithm. In: 2004 Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, vol. 1, p. I. IEEE (2004)
8.
Zurück zum Zitat Gruber, A., Weiss, Y.: Incorporating non-motion cues into 3D motion segmentation. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3953, pp. 84–97. Springer, Heidelberg (2006). doi:10.1007/11744078_7 CrossRef Gruber, A., Weiss, Y.: Incorporating non-motion cues into 3D motion segmentation. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3953, pp. 84–97. Springer, Heidelberg (2006). doi:10.​1007/​11744078_​7 CrossRef
9.
Zurück zum Zitat Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, New York (2004). ISBN: 0521540518CrossRefMATH Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, New York (2004). ISBN: 0521540518CrossRefMATH
10.
Zurück zum Zitat Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2003)MATH Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2003)MATH
11.
Zurück zum Zitat Horn, B.K., Schunck, B.G.: Determining optical flow. In: 1981 Technical Symposium East, pp. 319–331. International Society for Optics and Photonics (1981) Horn, B.K., Schunck, B.G.: Determining optical flow. In: 1981 Technical Symposium East, pp. 319–331. International Society for Optics and Photonics (1981)
12.
Zurück zum Zitat Jian, Y.D., Chen, C.S.: Two-view motion segmentation with model selection and outlier removal by Ransac-enhanced Dirichlet process mixture models. Int. J. Comput. Vision 88(3), 489–501 (2010)MathSciNetCrossRef Jian, Y.D., Chen, C.S.: Two-view motion segmentation with model selection and outlier removal by Ransac-enhanced Dirichlet process mixture models. Int. J. Comput. Vision 88(3), 489–501 (2010)MathSciNetCrossRef
13.
Zurück zum Zitat Jodoin, P.M., Pierard, S., Wang, Y., Van Droogenbroeck, M.: Overview and benchmarking of motion detection methods (2014) Jodoin, P.M., Pierard, S., Wang, Y., Van Droogenbroeck, M.: Overview and benchmarking of motion detection methods (2014)
14.
Zurück zum Zitat Tomasi, C., Kanade, T.: Shape and motion from image streams under orthography: a factorization method. Int. J. Comput. Vision 9(2), 137–154 (1992)CrossRef Tomasi, C., Kanade, T.: Shape and motion from image streams under orthography: a factorization method. Int. J. Comput. Vision 9(2), 137–154 (1992)CrossRef
15.
Zurück zum Zitat Torr, P.H., Szeliski, R., Anandan, P.: An integrated Bayesian approach to layer extraction from image sequences. IEEE Trans. Pattern Anal. Mach. Intell. 23(3), 297–303 (2001)CrossRef Torr, P.H., Szeliski, R., Anandan, P.: An integrated Bayesian approach to layer extraction from image sequences. IEEE Trans. Pattern Anal. Mach. Intell. 23(3), 297–303 (2001)CrossRef
16.
Zurück zum Zitat Torr, P.H.S., Zisserman, A.: Concerning Bayesian motion segmentation, model averaging, matching and the trifocal tensor. In: Burkhardt, H., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1406, pp. 511–527. Springer, Heidelberg (1998). doi:10.1007/BFb0055687 Torr, P.H.S., Zisserman, A.: Concerning Bayesian motion segmentation, model averaging, matching and the trifocal tensor. In: Burkhardt, H., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1406, pp. 511–527. Springer, Heidelberg (1998). doi:10.​1007/​BFb0055687
17.
Zurück zum Zitat Tron, R., Vidal, R.: A benchmark for the comparison of 3-D motion segmentation algorithms. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2007, pp. 1–8. IEEE (2007) Tron, R., Vidal, R.: A benchmark for the comparison of 3-D motion segmentation algorithms. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2007, pp. 1–8. IEEE (2007)
18.
Zurück zum Zitat Ullman, S.: The interpretation of structure from motion. Proc. R. Soc. Lond. B Biol. Sci. 203(1153), 405–426 (1979)CrossRef Ullman, S.: The interpretation of structure from motion. Proc. R. Soc. Lond. B Biol. Sci. 203(1153), 405–426 (1979)CrossRef
19.
Zurück zum Zitat Vidal, R., Soatto, S., Ma, Y., Sastry, S.: Segmentation of dynamic scenes from the multibody fundamental matrix. Urbana 51(61801), 1–2 Vidal, R., Soatto, S., Ma, Y., Sastry, S.: Segmentation of dynamic scenes from the multibody fundamental matrix. Urbana 51(61801), 1–2
20.
Zurück zum Zitat Wang, H., Kläser, A., Schmid, C., Liu, C.L.: Dense trajectories and motion boundary descriptors for action recognition. Int. J. Comput. Vision 103(1), 60–79 (2013)MathSciNetCrossRef Wang, H., Kläser, A., Schmid, C., Liu, C.L.: Dense trajectories and motion boundary descriptors for action recognition. Int. J. Comput. Vision 103(1), 60–79 (2013)MathSciNetCrossRef
21.
Zurück zum Zitat Wang, J.Y., Adelson, E.H.: Layered representation for motion analysis. In: 1993 IEEE Proceedings of the Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 1993, pp. 361–366. IEEE (1993) Wang, J.Y., Adelson, E.H.: Layered representation for motion analysis. In: 1993 IEEE Proceedings of the Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 1993, pp. 361–366. IEEE (1993)
22.
Zurück zum Zitat Weiss, Y.: Smoothness in layers: motion segmentation using nonparametric mixture estimation. In: 1997 IEEE Proceedings of the Computer Society Conference on Computer Vision and Pattern Recognition, pp. 520–526. IEEE (1997) Weiss, Y.: Smoothness in layers: motion segmentation using nonparametric mixture estimation. In: 1997 IEEE Proceedings of the Computer Society Conference on Computer Vision and Pattern Recognition, pp. 520–526. IEEE (1997)
23.
Zurück zum Zitat Yuan, C.: Motion segmentation and dense reconstruction of scenes containing moving objects observed by a moving camera. ProQuest (2007) Yuan, C.: Motion segmentation and dense reconstruction of scenes containing moving objects observed by a moving camera. ProQuest (2007)
24.
Zurück zum Zitat Zelnik-Manor, L., Machline, M., Irani, M.: Multi-body factorization with uncertainty: revisiting motion consistency. Int. J. Comput. Vision 68(1), 27–41 (2006)CrossRef Zelnik-Manor, L., Machline, M., Irani, M.: Multi-body factorization with uncertainty: revisiting motion consistency. Int. J. Comput. Vision 68(1), 27–41 (2006)CrossRef
25.
Zurück zum Zitat Zhang, J., Shi, F., Liu, Y.: Motion segmentation by multibody trifocal tensor using line correspondence. In: 2006 Proceedings of the 18th International Conference on Pattern Recognition, ICPR 2006, vol. 1, pp. 599–602. IEEE (2006) Zhang, J., Shi, F., Liu, Y.: Motion segmentation by multibody trifocal tensor using line correspondence. In: 2006 Proceedings of the 18th International Conference on Pattern Recognition, ICPR 2006, vol. 1, pp. 599–602. IEEE (2006)
26.
Zurück zum Zitat Zhao, W., Roos, N.: Motion based segmentation for robot vision using adapted em algorithm. In: Proceedings of the 11th International Conference on Computer Vision Theory and Applications, VISIGRAp 2016, pp. 649–656 (2016) Zhao, W., Roos, N.: Motion based segmentation for robot vision using adapted em algorithm. In: Proceedings of the 11th International Conference on Computer Vision Theory and Applications, VISIGRAp 2016, pp. 649–656 (2016)
27.
Zurück zum Zitat Zhao, W., Roos, N.: An EM based approach for motion segmentation of video sequence. In: Proceedings of the 24th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, WSCG 2016, pp. 61–69 (2016) Zhao, W., Roos, N.: An EM based approach for motion segmentation of video sequence. In: Proceedings of the 24th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, WSCG 2016, pp. 61–69 (2016)
Metadaten
Titel
3D Motion Consistency Analysis for Segmentation in 2D Video Projection
verfasst von
Wei Zhao
Nico Roos
Ralf Peeters
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-64698-5_37