Skip to main content

2015 | OriginalPaper | Buchkapitel

Unsupervised Motion Segmentation Using Metric Embedding of Features

verfasst von : Yusuf Osmanlıoğlu, Sven Dickinson, Ali Shokoufandeh

Erschienen in: Similarity-Based Pattern Recognition

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Motion segmentation is a well studied problem in computer vision. Most approaches assume a priori knowledge of the number of moving objects in the scene. In the absence of such information, motion segmentation is generally achieved through brute force search, e.g., searching over all possible priors or iterating over a search for the most prominent motion. In this paper, we propose an efficient method that achieves motion segmentation over a sequence of frames while estimating the number of moving segments; no prior assumption is made about the structure of scene. We utilize metric embedding to map a complex graph of image features and their relations into hierarchically well-separated tree, yielding a simplified topology over which the motions are segmented. Moreover, the method provides a hierarchical decomposition of motion for objects with moving parts.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bartal, Y.: Probabilistic approximation of metric spaces and its algorithmic applications. In: Proceedings of the 37th Annual Symposium on Foundations of Computer Science, FOCS 1996, pp. 184–193. IEEE Computer Society, Washington, DC (1996) Bartal, Y.: Probabilistic approximation of metric spaces and its algorithmic applications. In: Proceedings of the 37th Annual Symposium on Foundations of Computer Science, FOCS 1996, pp. 184–193. IEEE Computer Society, Washington, DC (1996)
2.
Zurück zum Zitat Bartal, Y.: On approximating arbitrary metrices by tree metrics. In: Proceedings of the 30th Annual ACM Symposium on Theory of Computing, STOC 1998, pp. 161–168. ACM, New York (1998) Bartal, Y.: On approximating arbitrary metrices by tree metrics. In: Proceedings of the 30th Annual ACM Symposium on Theory of Computing, STOC 1998, pp. 161–168. ACM, New York (1998)
3.
Zurück zum Zitat Charikar, M., Chekuri, C., Goel, A., Guha, S., Plotkin, S.: Approximating a finite metric by a small number of tree metrics. In: Proceedings of the 39th Annual Symposium on Foundations of Computer Science, FOCS 1998, pp. 379–388. IEEE Computer Society, Washington, DC (1998) Charikar, M., Chekuri, C., Goel, A., Guha, S., Plotkin, S.: Approximating a finite metric by a small number of tree metrics. In: Proceedings of the 39th Annual Symposium on Foundations of Computer Science, FOCS 1998, pp. 379–388. IEEE Computer Society, Washington, DC (1998)
4.
Zurück zum Zitat Colombari, A., Fusiello, A., Murino, V.: Segmentation and tracking of multiple video objects. Pattern Recogn. 40(4), 1307–1317 (2007)CrossRefMATH Colombari, A., Fusiello, A., Murino, V.: Segmentation and tracking of multiple video objects. Pattern Recogn. 40(4), 1307–1317 (2007)CrossRefMATH
5.
Zurück zum Zitat Dahlhaus, E., Johnson, D.S., Papadimitriou, C.H., Seymour, P.D., Yannakakis, M.: The complexity of multiway cuts (extended abstract). In: Proceedings of the 24th Annual ACM Symposium on Theory of Computing, STOC 1992, pp. 241–251. ACM, New York (1992) Dahlhaus, E., Johnson, D.S., Papadimitriou, C.H., Seymour, P.D., Yannakakis, M.: The complexity of multiway cuts (extended abstract). In: Proceedings of the 24th Annual ACM Symposium on Theory of Computing, STOC 1992, pp. 241–251. ACM, New York (1992)
6.
Zurück zum Zitat Demirci, M.F., Osmanlioglu, Y., Shokoufandeh, A., Dickinson, S.: Efficient many-to-many feature matching under the l1 norm. Comput. Vis. Image Underst. 115(7), 976–983 (2011)CrossRef Demirci, M.F., Osmanlioglu, Y., Shokoufandeh, A., Dickinson, S.: Efficient many-to-many feature matching under the l1 norm. Comput. Vis. Image Underst. 115(7), 976–983 (2011)CrossRef
8.
Zurück zum Zitat Fakcharoenphol, J., Rao, S., Talwar, K.: A tight bound on approximating arbitrary metrics by tree metrics. In: Proceedings of the 35th Annual ACM Symposium on Theory of Computing, STOC 2003, pp. 448–455. ACM, New York (2003) Fakcharoenphol, J., Rao, S., Talwar, K.: A tight bound on approximating arbitrary metrics by tree metrics. In: Proceedings of the 35th Annual ACM Symposium on Theory of Computing, STOC 2003, pp. 448–455. ACM, New York (2003)
9.
Zurück zum Zitat Flores-Mangas, F., Jepson, A.D.: Fast rigid motion segmentation via incrementally-complex local models. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2259–2266. IEEE (2013) Flores-Mangas, F., Jepson, A.D.: Fast rigid motion segmentation via incrementally-complex local models. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2259–2266. IEEE (2013)
10.
Zurück zum Zitat Goemans, M.X., Williamson, D.P.: The primal-dual method for approximation algorithms and its application to network design problems. In: Hochbaum, D.S. (ed.) Approximation Algorithms for NP-hard Problems, pp. 144–191. PWS Publishing Co., Boston (1997) Goemans, M.X., Williamson, D.P.: The primal-dual method for approximation algorithms and its application to network design problems. In: Hochbaum, D.S. (ed.) Approximation Algorithms for NP-hard Problems, pp. 144–191. PWS Publishing Co., Boston (1997)
11.
Zurück zum Zitat Julià, C., Sappa, A.D., Lumbreras, F., Serrat, J., López, A.: Motion segmentation from feature trajectories with missing data. In: Martí, J., Benedí, J.M., Mendonça, A.M., Serrat, J. (eds.) IbPRIA 2007. LNCS, vol. 4477, pp. 483–490. Springer, Heidelberg (2007) CrossRef Julià, C., Sappa, A.D., Lumbreras, F., Serrat, J., López, A.: Motion segmentation from feature trajectories with missing data. In: Martí, J., Benedí, J.M., Mendonça, A.M., Serrat, J. (eds.) IbPRIA 2007. LNCS, vol. 4477, pp. 483–490. Springer, Heidelberg (2007) CrossRef
12.
Zurück zum Zitat Karp, R.M.: A 2k-competitive algorithm for the circle. Manuscript, 5 August 1989 Karp, R.M.: A 2k-competitive algorithm for the circle. Manuscript, 5 August 1989
14.
Zurück zum Zitat Kleinberg, J., Tardos, É.: Approximation algorithms for classification problems with pairwise relationships: metric labeling and Markov random fields. J. ACM 49(5), 616–639 (2002)MathSciNetCrossRefMATH Kleinberg, J., Tardos, É.: Approximation algorithms for classification problems with pairwise relationships: metric labeling and Markov random fields. J. ACM 49(5), 616–639 (2002)MathSciNetCrossRefMATH
15.
Zurück zum Zitat Kong, M., Leduc, J.P., Ghosh, B.K., Wickerhauser, V.M.: Spatio-temporal continuous wavelet transforms for motion-based segmentation in real image sequences. In: Proceedings of the 1998 International Conference on Image Processing, ICIP 1998, vol. 2, pp. 662–666. IEEE (1998) Kong, M., Leduc, J.P., Ghosh, B.K., Wickerhauser, V.M.: Spatio-temporal continuous wavelet transforms for motion-based segmentation in real image sequences. In: Proceedings of the 1998 International Conference on Image Processing, ICIP 1998, vol. 2, pp. 662–666. IEEE (1998)
16.
Zurück zum Zitat Konjevod, G., Ravi, R., Salman, F.S.: On approximating planar metrics by tree metrics. Inf. Process. Lett. 80(4), 213–219 (2001)MathSciNetCrossRefMATH Konjevod, G., Ravi, R., Salman, F.S.: On approximating planar metrics by tree metrics. Inf. Process. Lett. 80(4), 213–219 (2001)MathSciNetCrossRefMATH
17.
Zurück zum Zitat Kumar, M.P., Torr, P.H., Zisserman, A.: Learning layered motion segmentations of video. Int. J. Comput. Vis. 76(3), 301–319 (2008)CrossRef Kumar, M.P., Torr, P.H., Zisserman, A.: Learning layered motion segmentations of video. Int. J. Comput. Vis. 76(3), 301–319 (2008)CrossRef
18.
Zurück zum Zitat Li, R., Songyu, Y., Yang, X.: Efficient spatio-temporal segmentation for extracting moving objects in video sequences. IEEE Trans. Consum. Electron. 53(3), 1161–1167 (2007)CrossRef Li, R., Songyu, Y., Yang, X.: Efficient spatio-temporal segmentation for extracting moving objects in video sequences. IEEE Trans. Consum. Electron. 53(3), 1161–1167 (2007)CrossRef
19.
Zurück zum Zitat Osmanlıoğlu, Y., Shokoufandeh, A.: Multi-layer tree matching using HSTs. In: Liu, C.-L., Luo, B., Kropatsch, W.G., Cheng, J. (eds.) GbRPR 2015. LNCS, vol. 9069, pp. 198–207. Springer, Heidelberg (2015) Osmanlıoğlu, Y., Shokoufandeh, A.: Multi-layer tree matching using HSTs. In: Liu, C.-L., Luo, B., Kropatsch, W.G., Cheng, J. (eds.) GbRPR 2015. LNCS, vol. 9069, pp. 198–207. Springer, Heidelberg (2015)
20.
Zurück zum Zitat Rathi, Y., Vaswani, N., Tannenbaum, A., Yezzi, A.: Tracking deforming objects using particle filtering for geometric active contours. IEEE Trans. Pattern Anal. Mach. Intell. 29(8), 1470–1475 (2007)CrossRef Rathi, Y., Vaswani, N., Tannenbaum, A., Yezzi, A.: Tracking deforming objects using particle filtering for geometric active contours. IEEE Trans. Pattern Anal. Mach. Intell. 29(8), 1470–1475 (2007)CrossRef
21.
Zurück zum Zitat Shen, H., Zhang, L., Huang, B., Li, P.: A map approach for joint motion estimation, segmentation, and super resolution. IEEE Trans. Image Process. 16(2), 479–490 (2007)MathSciNetCrossRef Shen, H., Zhang, L., Huang, B., Li, P.: A map approach for joint motion estimation, segmentation, and super resolution. IEEE Trans. Image Process. 16(2), 479–490 (2007)MathSciNetCrossRef
22.
Zurück zum Zitat Stolkin, R., Greig, A., Hodgetts, M., Gilby, J.: An EM/E-MRF algorithm for adaptive model based tracking in extremely poor visibility. Image Vis. Comput. 26(4), 480–495 (2008)CrossRef Stolkin, R., Greig, A., Hodgetts, M., Gilby, J.: An EM/E-MRF algorithm for adaptive model based tracking in extremely poor visibility. Image Vis. Comput. 26(4), 480–495 (2008)CrossRef
23.
Zurück zum Zitat Tomasi, C., Kanade, T.: Shape and motion from image streams under orthography: a factorization method. Int. J. Comput. Vis. 9(2), 137–154 (1992)CrossRef Tomasi, C., Kanade, T.: Shape and motion from image streams under orthography: a factorization method. Int. J. Comput. Vis. 9(2), 137–154 (1992)CrossRef
24.
Zurück zum Zitat Vazirani, V.V.: Approximation Algorithms. Springer, Heidelberg (2003)CrossRef Vazirani, V.V.: Approximation Algorithms. Springer, Heidelberg (2003)CrossRef
25.
Zurück zum Zitat Zhang, J., Shi, F., Wang, J., Liu, Y.: 3D motion segmentation from straight-line optical flow. In: Sebe, N., Liu, Y., Zhuang, Y., Huang, T.S. (eds.) MCAM 2007. LNCS, vol. 4577, pp. 85–94. Springer, Heidelberg (2007) CrossRef Zhang, J., Shi, F., Wang, J., Liu, Y.: 3D motion segmentation from straight-line optical flow. In: Sebe, N., Liu, Y., Zhuang, Y., Huang, T.S. (eds.) MCAM 2007. LNCS, vol. 4577, pp. 85–94. Springer, Heidelberg (2007) CrossRef
Metadaten
Titel
Unsupervised Motion Segmentation Using Metric Embedding of Features
verfasst von
Yusuf Osmanlıoğlu
Sven Dickinson
Ali Shokoufandeh
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-24261-3_11