Skip to main content
Top

01-04-2024 | Research Article

Vanishing point estimation inspired by oblique effect in a field environment

Authors: Luping Wang, Yun Hao, Shanshan Wang, Hui Wei

Published in: Cognitive Neurodynamics

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Estimating a vanishing point (VP) is a core problem for understanding three-dimensional scenes and autonomous navigation. Existing methods are essential to estimating VPs in indoor and urban environments. However, doing so in diverse, unstructured, changing, and unexpected field environments remains a considerable challenge. Traditional methods of estimating structural VP have some shortcomings as they rely heavily on feature-intensive computation, making them less reliable due to a lack of adequate structures in a field environment due to disorganized disturbances. Inspired by the oblique effect, neurons prefer to respond to horizontal and vertical stimuli more than to diagonal, which can help estimate VPs. This study proposes a methodology to estimate VPs from a monocular camera for a field environment. Local orientation features are assigned to clusters inspired by the oblique effect. By extracting end points of different clusters, virtual local orientation features are reshaped. Based on geometric inferences of orientation, a VP is approximately estimated using optimal estimation and self-selectability. No prior training is needed, and camera calibration and internal parameters are not required. This approach is robust to changes in color and illumination using geometric inference, making it a perfect fit for field environments. Experimental results demonstrated that the method can successfully estimate VPs. This study presents a groundbreaking approach to evaluating VPs using a monocular camera. Inspired by the oblique effect, our method relies on explainable geometric inferences instead of prior training, resulting in a highly robust model that can handle changes in color and illumination. Our proposed approach significantly advances scene understanding and navigation, making it an ideal solution for field environments.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Bui TH, Saitoh T, Nobuyama E (2013) Road area detection based on texture orientations estimation and vanishing point detection. In: The SICE annual conference, pp 1138–1143 Bui TH, Saitoh T, Nobuyama E (2013) Road area detection based on texture orientations estimation and vanishing point detection. In: The SICE annual conference, pp 1138–1143
go back to reference Chang C, Zhao J, Itti L (2018) DeepVP: deep learning for vanishing point detection on 1 million street view images. In: IEEE international conference on robotics and automation, ICRA , Brisbane, Australia, May 21–25. IEEE, pp 1–8 Chang C, Zhao J, Itti L (2018) DeepVP: deep learning for vanishing point detection on 1 million street view images. In: IEEE international conference on robotics and automation, ICRA , Brisbane, Australia, May 21–25. IEEE, pp 1–8
go back to reference Cheng M, Zhang Y, Su Y, Alvarez JM, Kong H (2018) Curb detection for road and sidewalk detection. IEEE Trans Veh Technol 67(11):10330–10342CrossRef Cheng M, Zhang Y, Su Y, Alvarez JM, Kong H (2018) Curb detection for road and sidewalk detection. IEEE Trans Veh Technol 67(11):10330–10342CrossRef
go back to reference Coughlan JM, Yuille AL (2003) Manhattan world: orientation and outlier detection by Bayesian inference. Neural Comput 15(5):1063–1088CrossRefPubMed Coughlan JM, Yuille AL (2003) Manhattan world: orientation and outlier detection by Bayesian inference. Neural Comput 15(5):1063–1088CrossRefPubMed
go back to reference Denis P, Elder JH, Estrada FJ (2008) Efficient Edge-Based Methods for Estimating Manhattan Frames in Urban Imagery. In: Forsyth DA, Torr PHS, Zisserman A (eds) 10th European conference on computer vision, Marseille, France, October 12–18, Proceedings, Part II. vol. 5303 of Lecture Notes in Computer Science. Springer, pp 197–210 Denis P, Elder JH, Estrada FJ (2008) Efficient Edge-Based Methods for Estimating Manhattan Frames in Urban Imagery. In: Forsyth DA, Torr PHS, Zisserman A (eds) 10th European conference on computer vision, Marseille, France, October 12–18, Proceedings, Part II. vol. 5303 of Lecture Notes in Computer Science. Springer, pp 197–210
go back to reference Ding W, Li Y, Liu H (2016) Efficient vanishing point detection method in unstructured road environments based on dark channel prior. IET Comput Vis 10(8):852–860CrossRef Ding W, Li Y, Liu H (2016) Efficient vanishing point detection method in unstructured road environments based on dark channel prior. IET Comput Vis 10(8):852–860CrossRef
go back to reference Guo Y, Liu F, Ma Y (2023) Vanishing point detection of unstructured road based on two-line exhaustive search. In: Subramanian K (ed) Third international conference on intelligent computing and human-computer interaction (ICHCI 2022). vol 12509. SPIE, p 125090V Guo Y, Liu F, Ma Y (2023) Vanishing point detection of unstructured road based on two-line exhaustive search. In: Subramanian K (ed) Third international conference on intelligent computing and human-computer interaction (ICHCI 2022). vol 12509. SPIE, p 125090V
go back to reference Han J, Yang Z, Hu G, Zhang T, Song J (2019) Accurate and robust vanishing point detection method in unstructured road scenes. J Intell Robotic Syst 94(1):143–158CrossRef Han J, Yang Z, Hu G, Zhang T, Song J (2019) Accurate and robust vanishing point detection method in unstructured road scenes. J Intell Robotic Syst 94(1):143–158CrossRef
go back to reference Hidayat R, Yanto ITR, Ramli AA, Fudzee MFM, Ahmar AS (2021) Generalized normalized Euclidean distance based fuzzy soft set similarity for data classification. Comput Syst Sci Eng 38(1):119–130CrossRef Hidayat R, Yanto ITR, Ramli AA, Fudzee MFM, Ahmar AS (2021) Generalized normalized Euclidean distance based fuzzy soft set similarity for data classification. Comput Syst Sci Eng 38(1):119–130CrossRef
go back to reference Huang L, Shou T, Chen X, Yu H, Sun C, Liang Z (2006) Slab-like functional architecture of higher order cortical area 21a showing oblique effect of orientation preference in the cat. Neuroimage 32(3):1365–1374CrossRefPubMed Huang L, Shou T, Chen X, Yu H, Sun C, Liang Z (2006) Slab-like functional architecture of higher order cortical area 21a showing oblique effect of orientation preference in the cat. Neuroimage 32(3):1365–1374CrossRefPubMed
go back to reference Jang J, Jo Y, Shin M, Paik J (2021) Camera orientation estimation using motion-based vanishing point detection for advanced driver-assistance systems. IEEE Trans Intell Transp Syst 22(10):6286–6296CrossRef Jang J, Jo Y, Shin M, Paik J (2021) Camera orientation estimation using motion-based vanishing point detection for advanced driver-assistance systems. IEEE Trans Intell Transp Syst 22(10):6286–6296CrossRef
go back to reference Kamil DA, Wahyono, Harjoko A (2022) Vanishing point detection using angle-based hough transform and RANSAC. In: Seventh international conference on informatics and computing (ICIC), pp 1–5 Kamil DA, Wahyono, Harjoko A (2022) Vanishing point detection using angle-based hough transform and RANSAC. In: Seventh international conference on informatics and computing (ICIC), pp 1–5
go back to reference Kloukiniotis A, Moustakas K (2022) Vanishing point detection based on the fusion of lidar and image data. In: 30th Mediterranean conference on control and automation, MED, Vouliagmeni, Greece, June 28–July 1. IEEE, pp 688–692 Kloukiniotis A, Moustakas K (2022) Vanishing point detection based on the fusion of lidar and image data. In: 30th Mediterranean conference on control and automation, MED, Vouliagmeni, Greece, June 28–July 1. IEEE, pp 688–692
go back to reference Koenderink JJ, Doorn AJV, Kappers AM (1996) Pictorial surface attitude and local depth comparisons. Percept Psychophys 58(2):163–173CrossRefPubMed Koenderink JJ, Doorn AJV, Kappers AM (1996) Pictorial surface attitude and local depth comparisons. Percept Psychophys 58(2):163–173CrossRefPubMed
go back to reference Kong H, Audibert J, Ponce J (2010) General road detection from a single image. IEEE Trans Image Process 19(8):2211–2220CrossRefPubMed Kong H, Audibert J, Ponce J (2010) General road detection from a single image. IEEE Trans Image Process 19(8):2211–2220CrossRefPubMed
go back to reference Kong H, Sarma SE, Tang F (2013) Generalizing Laplacian of Gaussian filters for vanishing-point detection. IEEE Trans Intell Transp Syst 14(1):408–418CrossRef Kong H, Sarma SE, Tang F (2013) Generalizing Laplacian of Gaussian filters for vanishing-point detection. IEEE Trans Intell Transp Syst 14(1):408–418CrossRef
go back to reference Li Y, Tong G, Sun A, Ding W (2018) Road extraction algorithm based on intrinsic image and vanishing point for unstructured road image. Robot Auton Syst 109:86–96CrossRef Li Y, Tong G, Sun A, Ding W (2018) Road extraction algorithm based on intrinsic image and vanishing point for unstructured road image. Robot Auton Syst 109:86–96CrossRef
go back to reference Li H, Zhao J, Bazin J, Liu Y (2022) Quasi-globally optimal and near/true real-time vanishing point estimation in Manhattan world. IEEE Trans Pattern Anal Mach Intell 44(3):1503–1518CrossRefPubMed Li H, Zhao J, Bazin J, Liu Y (2022) Quasi-globally optimal and near/true real-time vanishing point estimation in Manhattan world. IEEE Trans Pattern Anal Mach Intell 44(3):1503–1518CrossRefPubMed
go back to reference Li H, Kim P, Zhao J, Joo K, Cai Z, Liu Z, et al. (2020) Globally Optimal and Efficient Vanishing Point Estimation in Atlanta World. In: Vedaldi A, Bischof H, Brox T, Frahm J (eds) 16th European Conference, Glasgow, UK, August 23–28, Proceedings, Part XXII. vol. 12367 of Lecture Notes in Computer Science. Springer, pp 153–169 Li H, Kim P, Zhao J, Joo K, Cai Z, Liu Z, et al. (2020) Globally Optimal and Efficient Vanishing Point Estimation in Atlanta World. In: Vedaldi A, Bischof H, Brox T, Frahm J (eds) 16th European Conference, Glasgow, UK, August 23–28, Proceedings, Part XXII. vol. 12367 of Lecture Notes in Computer Science. Springer, pp 153–169
go back to reference Liu Y, Zeng M, Meng Q (2021) Unstructured road vanishing point detection using convolutional neural networks and heatmap regression. IEEE Trans Instrum Meas 70:1–8CrossRef Liu Y, Zeng M, Meng Q (2021) Unstructured road vanishing point detection using convolutional neural networks and heatmap regression. IEEE Trans Instrum Meas 70:1–8CrossRef
go back to reference Moghadam P, Starzyk JA, Wijesoma WS (2012) Fast vanishing-point detection in unstructured environments. IEEE Trans Image Process 21(1):425–430CrossRefPubMed Moghadam P, Starzyk JA, Wijesoma WS (2012) Fast vanishing-point detection in unstructured environments. IEEE Trans Image Process 21(1):425–430CrossRefPubMed
go back to reference Ozcelik YB, Altan A (2023a) Classification of diabetic retinopathy by machine learning algorithm using entropy-based features. In: Cankaya international congress on scientific research, pp 523–535 Ozcelik YB, Altan A (2023a) Classification of diabetic retinopathy by machine learning algorithm using entropy-based features. In: Cankaya international congress on scientific research, pp 523–535
go back to reference Ozcelik YB, Altan A (2023b) Overcoming nonlinear dynamics in diabetic retinopathy classification: a robust ai-based model with chaotic swarm intelligence optimization and recurrent long short-term memory. Fractal Fract 7(8):598CrossRef Ozcelik YB, Altan A (2023b) Overcoming nonlinear dynamics in diabetic retinopathy classification: a robust ai-based model with chaotic swarm intelligence optimization and recurrent long short-term memory. Fractal Fract 7(8):598CrossRef
go back to reference Rasmussen C (2008) RoadCompass: following rural roads with vision + ladar using vanishing point tracking. Auton Robots 25(3):205–229CrossRef Rasmussen C (2008) RoadCompass: following rural roads with vision + ladar using vanishing point tracking. Auton Robots 25(3):205–229CrossRef
go back to reference Shuai Y, Tiantian Y, Guodong Y, Zize L (2017) Regression convolutional network for vanishing point detection. In: 32nd youth academic annual conference of chinese association of automation (YAC), pp 634–638 Shuai Y, Tiantian Y, Guodong Y, Zize L (2017) Regression convolutional network for vanishing point detection. In: 32nd youth academic annual conference of chinese association of automation (YAC), pp 634–638
go back to reference Wang L, Wei H (2020) Avoiding non-Manhattan obstacles based on projection of spatial corners in indoor environment. IEEE/CAA J Automatica Sinica 7:1190–1200CrossRef Wang L, Wei H (2020) Avoiding non-Manhattan obstacles based on projection of spatial corners in indoor environment. IEEE/CAA J Automatica Sinica 7:1190–1200CrossRef
go back to reference Wang L, Wei H (2020) Understanding of wheelchair ramp scenes for disabled people with visual impairments. Eng Appl Artif Intell 90:103569CrossRef Wang L, Wei H (2020) Understanding of wheelchair ramp scenes for disabled people with visual impairments. Eng Appl Artif Intell 90:103569CrossRef
go back to reference Wang L, Wei H (2020) Understanding of curved corridor scenes based on projection of spatial right-angles. IEEE Trans Image Process 29:9345–9359CrossRef Wang L, Wei H (2020) Understanding of curved corridor scenes based on projection of spatial right-angles. IEEE Trans Image Process 29:9345–9359CrossRef
go back to reference Wang L, Wei H (2022) Curved alleyway understanding based on monocular vision in street scenes. IEEE Trans Intell Transp Syst 23(7):8544–8563CrossRef Wang L, Wei H (2022) Curved alleyway understanding based on monocular vision in street scenes. IEEE Trans Intell Transp Syst 23(7):8544–8563CrossRef
go back to reference Wang L, Wei H (2023) Winding pathway understanding based on angle projections in a field environment. Appl Intell 53:16859–16874CrossRef Wang L, Wei H (2023) Winding pathway understanding based on angle projections in a field environment. Appl Intell 53:16859–16874CrossRef
go back to reference Wang E, Sun A, Li Y, Hou X, Zhu Y (2018) Fast vanishing point detection method based on road border region estimation. IET Image Process 12(3):361–373CrossRef Wang E, Sun A, Li Y, Hou X, Zhu Y (2018) Fast vanishing point detection method based on road border region estimation. IET Image Process 12(3):361–373CrossRef
go back to reference Wei H, Wang L (2018) Understanding of indoor scenes based on projection of spatial rectangles. Pattern Recogn 81:497–514CrossRef Wei H, Wang L (2018) Understanding of indoor scenes based on projection of spatial rectangles. Pattern Recogn 81:497–514CrossRef
go back to reference Wei H, Wang L (2018) Visual navigation using projection of spatial right-angle in indoor environment. IEEE Trans Image Process 27(7):3164–3177CrossRefPubMed Wei H, Wang L (2018) Visual navigation using projection of spatial right-angle in indoor environment. IEEE Trans Image Process 27(7):3164–3177CrossRefPubMed
go back to reference Wigness MB, Eum S, Rogers JG, Han D, Kwon H (2019) A RUGD dataset for autonomous navigation and visual perception in unstructured outdoor environments. In: IEEE/RSJ international conference on intelligent robots and systems, IROS , Macau, SAR, China, pp 5000–5007 Wigness MB, Eum S, Rogers JG, Han D, Kwon H (2019) A RUGD dataset for autonomous navigation and visual perception in unstructured outdoor environments. In: IEEE/RSJ international conference on intelligent robots and systems, IROS , Macau, SAR, China, pp 5000–5007
go back to reference Yag X, Altan A (2022) Artificial intelligence-based robust hybrid algorithm design and implementation for real-time detection of plant diseases in agricultural environments. Biology 11(12):1732CrossRefPubMedPubMedCentral Yag X, Altan A (2022) Artificial intelligence-based robust hybrid algorithm design and implementation for real-time detection of plant diseases in agricultural environments. Biology 11(12):1732CrossRefPubMedPubMedCentral
go back to reference Yang W, Fang B, Tang YY (2018) Fast and accurate vanishing point detection and its application in inverse perspective mapping of structured road. IEEE Trans Syst Man Cybern Syst 48(5):755–766CrossRef Yang W, Fang B, Tang YY (2018) Fast and accurate vanishing point detection and its application in inverse perspective mapping of structured road. IEEE Trans Syst Man Cybern Syst 48(5):755–766CrossRef
Metadata
Title
Vanishing point estimation inspired by oblique effect in a field environment
Authors
Luping Wang
Yun Hao
Shanshan Wang
Hui Wei
Publication date
01-04-2024
Publisher
Springer Netherlands
Published in
Cognitive Neurodynamics
Print ISSN: 1871-4080
Electronic ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-024-10102-3