Skip to main content
Erschienen in: Neural Computing and Applications 6/2018

20.08.2016 | Original Article

STMVO: biologically inspired monocular visual odometry

verfasst von: Yangming Li, Jian Zhang, Shuai Li

Erschienen in: Neural Computing and Applications | Ausgabe 6/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Visual odometry (VO) is a fundamental and challenging problem in both the computer vision community and the robotics community. VO refers the process of recovering the relative movements of a camera by analyzing the associated image sequence. While VO is generally formulated as descriptors-based feature tracking with outliers rejection and global optimization, these algorithms are not only computationally expensive but also lack robustness. In the paper, a biologically inspired solution to the monocular visual odometry problem was presented, which was named as shunting short-term memory monocular visual odometry. The proposed method is simple and concise in both concept and implementation. To be more specific, it utilizes the shunting short-term memory to represent the key frames and the latest observations and also to adapt to uncertainties and ambiguities. And scan matching scheme is adopted to search the movement that best explained the difference between the latest observation and the key frame. Because of the dynamic properties of the neural network, the proposed method requires neither explicit extraction of features and descriptors, nor outliers detection and bundle optimization. Theoretical analysis in the paper showed that the proposed method has Lyapunov stability and constant computational complexity. The proposed method was also compared with the classical monocular VO algorithm in real indoor environments, and the experimental results proved that the proposed method outperforms the classical method on both effectiveness and robustness.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Scaramuzza D, Fraundorfer F (2011) Visual odometry [tutorial]. Robot Autom Mag IEEE 18(4):80–92CrossRef Scaramuzza D, Fraundorfer F (2011) Visual odometry [tutorial]. Robot Autom Mag IEEE 18(4):80–92CrossRef
2.
Zurück zum Zitat Nistér D, Naroditsky O, Bergen J (2004) Visual odometry. In: Proceedings of the 2004 IEEE computer society conference on computer vision and pattern recognition, 2004. CVPR 2004, vol 1, IEEE pp 1–652 Nistér D, Naroditsky O, Bergen J (2004) Visual odometry. In: Proceedings of the 2004 IEEE computer society conference on computer vision and pattern recognition, 2004. CVPR 2004, vol 1, IEEE pp 1–652
3.
Zurück zum Zitat Fraundorfer F, Scaramuzza D (2012) Visual odometry: part II: matching, robustness, optimization, and applications. Robot Autom Mag IEEE 19(2):78–90CrossRef Fraundorfer F, Scaramuzza D (2012) Visual odometry: part II: matching, robustness, optimization, and applications. Robot Autom Mag IEEE 19(2):78–90CrossRef
4.
Zurück zum Zitat Li Y, Olson EB (2011) Structure tensors for general purpose lidar feature extraction. In: 2011 IEEE international conference on robotics and automation (ICRA). IEEE, pp 1869–1874 Li Y, Olson EB (2011) Structure tensors for general purpose lidar feature extraction. In: 2011 IEEE international conference on robotics and automation (ICRA). IEEE, pp 1869–1874
5.
Zurück zum Zitat Cao Z, Cheng L, Zhou C, Gu N, Wang X, Tan M (2015) Spiking neural network-based target tracking control for autonomous mobile robots. Neural Comput Appl 26(8):1839–1847CrossRef Cao Z, Cheng L, Zhou C, Gu N, Wang X, Tan M (2015) Spiking neural network-based target tracking control for autonomous mobile robots. Neural Comput Appl 26(8):1839–1847CrossRef
6.
Zurück zum Zitat Forster C, Pizzoli M, Scaramuzza D (2014) Svo: fast semi-direct monocular visual odometry. In: 2014 IEEE international conference on robotics and automation (ICRA), May 2014, pp 15–22 Forster C, Pizzoli M, Scaramuzza D (2014) Svo: fast semi-direct monocular visual odometry. In: 2014 IEEE international conference on robotics and automation (ICRA), May 2014, pp 15–22
7.
Zurück zum Zitat Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRef Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRef
8.
Zurück zum Zitat Bay H, Ess A, Tuytelaars T, Van Gool L (2008) Speeded-up robust features (surf). Comput Vis Image Underst 110(3):346–359CrossRef Bay H, Ess A, Tuytelaars T, Van Gool L (2008) Speeded-up robust features (surf). Comput Vis Image Underst 110(3):346–359CrossRef
9.
Zurück zum Zitat Zheng Y, Jeon B, Xu D, Wu Q, Zhang H (2015) Image segmentation by generalized hierarchical fuzzy c-means algorithm. J Intell Fuzzy Syst Appl Eng Technol 28(2):961–973 Zheng Y, Jeon B, Xu D, Wu Q, Zhang H (2015) Image segmentation by generalized hierarchical fuzzy c-means algorithm. J Intell Fuzzy Syst Appl Eng Technol 28(2):961–973
10.
Zurück zum Zitat Chen B, Shu H, Coatrieux G, Chen G, Sun X, Coatrieux JL (2015) Color image analysis by quaternion-type moments. J Math Imaging Vis 51(1):124–144MathSciNetCrossRefMATH Chen B, Shu H, Coatrieux G, Chen G, Sun X, Coatrieux JL (2015) Color image analysis by quaternion-type moments. J Math Imaging Vis 51(1):124–144MathSciNetCrossRefMATH
11.
Zurück zum Zitat Xia Z, Wang X, Sun X, Liu Q, Xiong N (2016) Steganalysis of LSB matching using differences between nonadjacent pixels. Multimed Tools Appl 75:1947–1962CrossRef Xia Z, Wang X, Sun X, Liu Q, Xiong N (2016) Steganalysis of LSB matching using differences between nonadjacent pixels. Multimed Tools Appl 75:1947–1962CrossRef
12.
Zurück zum Zitat Li Y, Li S, Song Q, Liu H, Meng MQH (2014) Fast and robust data association using posterior based approximate joint compatibility test. IEEE Trans Ind Inf 10(1):331–339CrossRef Li Y, Li S, Song Q, Liu H, Meng MQH (2014) Fast and robust data association using posterior based approximate joint compatibility test. IEEE Trans Ind Inf 10(1):331–339CrossRef
13.
Zurück zum Zitat Li J, Li X, Yang B, Sun X (2015) Segmentation-based image copy-move forgery detection scheme. IEEE Trans Inf Forensics Secur 10(3):507–518CrossRef Li J, Li X, Yang B, Sun X (2015) Segmentation-based image copy-move forgery detection scheme. IEEE Trans Inf Forensics Secur 10(3):507–518CrossRef
14.
Zurück zum Zitat Pan Z, Zhang Y, Kwong S (2015) Efficient motion and disparity estimation optimization for low complexity multiview video coding. IEEE Trans Broadcast 61(2):166–176CrossRef Pan Z, Zhang Y, Kwong S (2015) Efficient motion and disparity estimation optimization for low complexity multiview video coding. IEEE Trans Broadcast 61(2):166–176CrossRef
15.
Zurück zum Zitat Nistér D (2004) An efficient solution to the five-point relative pose problem. IEEE Trans Pattern Anal Mach Intell 26(6):756–770CrossRef Nistér D (2004) An efficient solution to the five-point relative pose problem. IEEE Trans Pattern Anal Mach Intell 26(6):756–770CrossRef
16.
Zurück zum Zitat Williams B, Reid I (2010) On combining visual slam and visual odometry. In: 2010 IEEE international conference on robotics and automation (ICRA). IEEE pp 3494–3500 Williams B, Reid I (2010) On combining visual slam and visual odometry. In: 2010 IEEE international conference on robotics and automation (ICRA). IEEE pp 3494–3500
17.
Zurück zum Zitat Mur-Artal R, Montiel J, Tardós JD (2015) Orb-slam: a versatile and accurate monocular slam system. IEEE Trans Robot 31(5):1147–1163CrossRef Mur-Artal R, Montiel J, Tardós JD (2015) Orb-slam: a versatile and accurate monocular slam system. IEEE Trans Robot 31(5):1147–1163CrossRef
18.
Zurück zum Zitat Gu B, Sheng V, Tay KY, Romano W, Li S (2015) Incremental support vector learning for ordinal regression. IEEE Trans Neural Netw Learn Syst 26(7):1403–1416MathSciNetCrossRef Gu B, Sheng V, Tay KY, Romano W, Li S (2015) Incremental support vector learning for ordinal regression. IEEE Trans Neural Netw Learn Syst 26(7):1403–1416MathSciNetCrossRef
19.
Zurück zum Zitat Li S, Liu B, Li Y (2013) Selective positive-negative feedback produces the winner-take-all competition in recurrent neural networks. IEEE Trans Neural Netw Learn Syst 24(2):301–309MathSciNetCrossRef Li S, Liu B, Li Y (2013) Selective positive-negative feedback produces the winner-take-all competition in recurrent neural networks. IEEE Trans Neural Netw Learn Syst 24(2):301–309MathSciNetCrossRef
20.
Zurück zum Zitat Luo X, You Z, Zhou M, Li S, Leung H, Xia Y, Zhu Q (2015) A highly efficient approach to protein interactome mapping based on collaborative filtering framework. Sci Rep 5:7702CrossRef Luo X, You Z, Zhou M, Li S, Leung H, Xia Y, Zhu Q (2015) A highly efficient approach to protein interactome mapping based on collaborative filtering framework. Sci Rep 5:7702CrossRef
21.
Zurück zum Zitat Duan S, Dong Z, Hu X, Wang L, Li H (2016) Small-world hopfield neural networks with weight salience priority and memristor synapses for digit recognition. Neural Comput Appl 27(4):837–844CrossRef Duan S, Dong Z, Hu X, Wang L, Li H (2016) Small-world hopfield neural networks with weight salience priority and memristor synapses for digit recognition. Neural Comput Appl 27(4):837–844CrossRef
22.
Zurück zum Zitat Zhao D, Ferguson AA, Jiang N (2016) What makes up plant genomes: the vanishing line between transposable elements and genes. Biochim Biophys Acta (BBA) Gene Regul Mech 1859(2):366–380CrossRef Zhao D, Ferguson AA, Jiang N (2016) What makes up plant genomes: the vanishing line between transposable elements and genes. Biochim Biophys Acta (BBA) Gene Regul Mech 1859(2):366–380CrossRef
23.
Zurück zum Zitat Li S, Cui H, Li Y, Liu B, Lou Y (2013) Decentralized control of collaborative redundant manipulators with partial command coverage via locally connected recurrent neural networks. Neural Comput Appl 23(3–4):1051–1060CrossRef Li S, Cui H, Li Y, Liu B, Lou Y (2013) Decentralized control of collaborative redundant manipulators with partial command coverage via locally connected recurrent neural networks. Neural Comput Appl 23(3–4):1051–1060CrossRef
24.
Zurück zum Zitat Li Y, Li S, Ge Y (2013) A biologically inspired solution to simultaneous localization and consistent mapping in dynamic environments. Neurocomputing 104:170–179CrossRef Li Y, Li S, Ge Y (2013) A biologically inspired solution to simultaneous localization and consistent mapping in dynamic environments. Neurocomputing 104:170–179CrossRef
25.
Zurück zum Zitat Li S, Wang Z, Li Y (2013) Using Laplacian eigenmap as heuristic information to solve nonlinear constraints defined on a graph and its application in distributed range-free localization of wireless sensor networks. Neural Process Lett 37(3):411–424CrossRef Li S, Wang Z, Li Y (2013) Using Laplacian eigenmap as heuristic information to solve nonlinear constraints defined on a graph and its application in distributed range-free localization of wireless sensor networks. Neural Process Lett 37(3):411–424CrossRef
26.
Zurück zum Zitat Gu B, Sheng VS, Wang Z, Ho D, Osman S, Li S (2015) Incremental learning for \(\nu\)-support vector regression. Neural Netw 67:140–150CrossRef Gu B, Sheng VS, Wang Z, Ho D, Osman S, Li S (2015) Incremental learning for \(\nu\)-support vector regression. Neural Netw 67:140–150CrossRef
27.
Zurück zum Zitat Chen L, Liu C, Wu R, He Y, Chai Y (2016) Finite-time stability criteria for a class of fractional-order neural networks with delay. Neural Comput Appl 27(3):549–556CrossRef Chen L, Liu C, Wu R, He Y, Chai Y (2016) Finite-time stability criteria for a class of fractional-order neural networks with delay. Neural Comput Appl 27(3):549–556CrossRef
28.
Zurück zum Zitat Grossberg S (1988) Nonlinear neural networks: principles, mechanisms, and architectures. Neural Netw 1(1):17–61CrossRef Grossberg S (1988) Nonlinear neural networks: principles, mechanisms, and architectures. Neural Netw 1(1):17–61CrossRef
29.
Zurück zum Zitat Hopfield JJ (1995) Pattern recognition computation using action potential timing for stimulus representation. Nature 376(6535):33–36CrossRef Hopfield JJ (1995) Pattern recognition computation using action potential timing for stimulus representation. Nature 376(6535):33–36CrossRef
30.
Zurück zum Zitat Scaramuzza D, Siegwart R (2008) Appearance-guided monocular omnidirectional visual odometry for outdoor ground vehicles. IEEE Trans Robot 24(5):1015–1026CrossRef Scaramuzza D, Siegwart R (2008) Appearance-guided monocular omnidirectional visual odometry for outdoor ground vehicles. IEEE Trans Robot 24(5):1015–1026CrossRef
31.
Zurück zum Zitat Hartley R, Zisserman A (2003) Multiple view geometry in computer vision. Cambridge University Press, CambridgeMATH Hartley R, Zisserman A (2003) Multiple view geometry in computer vision. Cambridge University Press, CambridgeMATH
32.
Zurück zum Zitat Varga RS (1962) Matrix iterative analysis. Prentice Hall, Englewood Cliffs Varga RS (1962) Matrix iterative analysis. Prentice Hall, Englewood Cliffs
33.
Zurück zum Zitat Li Y, Olson EB (2012) IPJC: The incremental posterior joint compatibility test for fast feature cloud matching. In: 2012 IEEE/RSJ international conference on intelligent robots and systems (IROS) (Oct. 2012), pp 147 –153 Li Y, Olson EB (2012) IPJC: The incremental posterior joint compatibility test for fast feature cloud matching. In: 2012 IEEE/RSJ international conference on intelligent robots and systems (IROS) (Oct. 2012), pp 147 –153
Metadaten
Titel
STMVO: biologically inspired monocular visual odometry
verfasst von
Yangming Li
Jian Zhang
Shuai Li
Publikationsdatum
20.08.2016
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 6/2018
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-016-2536-9

Weitere Artikel der Ausgabe 6/2018

Neural Computing and Applications 6/2018 Zur Ausgabe

Premium Partner