Skip to main content
Top

2018 | OriginalPaper | Chapter

Combining CNN and MRF for Road Detection

Authors : Lei Geng, Jiangdong Sun, Zhitao Xiao, Fang Zhang, Jun Wu

Published in: Artificial Intelligence and Robotics

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Road detection aims at detecting the (drivable) road surface ahead vehicle and plays a crucial role in driver assistance system. To improve the accuracy and robustness of road detection approaches in complex environments, a new road detection method based on CNN (convolutional neural network) and MRF (markov random field) is proposed. The original road image is segmented into super-pixels of uniform size using simple linear iterative clustering (SLIC) algorithm. On this basis, we train the CNN which can automatically learn the features that are most beneficial to classification. Then, the trained CNN is applied to classify road region and non-road region. Finally, based on the relationship between the super-pixels neighborhood, we utilize MRF to optimize the classification results of CNN. Quantitative and qualitative experiments on the publicly datasets demonstrate that the proposed method is robust in complex environments. Furthermore, compared with state-of-the-art algorithms, the approach provides the better performance.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Research Institute of Highway Ministry of Transport: The Blue Book of Road Safety in China 2014, pp. 13–14. China Communications Press, Beijing (2015) Research Institute of Highway Ministry of Transport: The Blue Book of Road Safety in China 2014, pp. 13–14. China Communications Press, Beijing (2015)
2.
go back to reference Cao, X., Lin, R., Yan, P., Li, X.: Visual attention accelerated vehicle detection in low-altitude airborne video of urban environment. IEEE Trans. Circuits Syst. Video Technol. 22(3), 366–378 (2012)CrossRef Cao, X., Lin, R., Yan, P., Li, X.: Visual attention accelerated vehicle detection in low-altitude airborne video of urban environment. IEEE Trans. Circuits Syst. Video Technol. 22(3), 366–378 (2012)CrossRef
3.
go back to reference Wang, K., Huang, Z.H., Zhong, Z.H.: Algorithm for urban road detection based on uncertain bezier deformable template. J. Mech. Eng. 49(8), 143–150 (2013)CrossRef Wang, K., Huang, Z.H., Zhong, Z.H.: Algorithm for urban road detection based on uncertain bezier deformable template. J. Mech. Eng. 49(8), 143–150 (2013)CrossRef
4.
go back to reference Wang, J., Gu, F., Zhang, C., Zhang, G.: Lane boundary detection based on parabola model. In: IEEE International Conference on Information and Automation, pp. 1729–1734. IEEE, Harbin (2010) Wang, J., Gu, F., Zhang, C., Zhang, G.: Lane boundary detection based on parabola model. In: IEEE International Conference on Information and Automation, pp. 1729–1734. IEEE, Harbin (2010)
5.
go back to reference Kong, H., Audibert, J.Y., Ponce, J.: Vanishing point detection for road detection. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 96–103. IEEE (2009) Kong, H., Audibert, J.Y., Ponce, J.: Vanishing point detection for road detection. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 96–103. IEEE (2009)
6.
go back to reference Alvarez, J.M., ĹOpez, A.M.: Road detection based on illuminant invariance. IEEE Trans. Intell. Transp. Syst. 12(1), 184–193 (2011)CrossRef Alvarez, J.M., ĹOpez, A.M.: Road detection based on illuminant invariance. IEEE Trans. Intell. Transp. Syst. 12(1), 184–193 (2011)CrossRef
7.
go back to reference Mendes, C.C.T., Frémont, V., Wolf, D.F.: Exploiting fully convolutional neural networks for fast road detection. In: IEEE International Conference on Robotics and Automation. IEEE (2016) Mendes, C.C.T., Frémont, V., Wolf, D.F.: Exploiting fully convolutional neural networks for fast road detection. In: IEEE International Conference on Robotics and Automation. IEEE (2016)
8.
go back to reference Brostow, G.J., Shotton, J., Fauqueur, J., Cipolla, R.: Segmentation and recognition using structure from motion point clouds. In: ECCV, vol. 1, pp. 44–57 (2008) Brostow, G.J., Shotton, J., Fauqueur, J., Cipolla, R.: Segmentation and recognition using structure from motion point clouds. In: ECCV, vol. 1, pp. 44–57 (2008)
9.
go back to reference Sturgess, P., Alahari, K., Ladicky, L., Torr, P.H.S.: Combining appearance and structure from motion features for road scene understanding. In: BMVC’09 (2009) Sturgess, P., Alahari, K., Ladicky, L., Torr, P.H.S.: Combining appearance and structure from motion features for road scene understanding. In: BMVC’09 (2009)
10.
go back to reference Yuan, Y., Jiang, Z., Wang, Q.: Video-based road detection via online structural learning. Neurocomputing 168(C), 336–347 (2015) Yuan, Y., Jiang, Z., Wang, Q.: Video-based road detection via online structural learning. Neurocomputing 168(C), 336–347 (2015)
11.
go back to reference Fernández, C., Izquierdo, R., Llorca, D.F., Sotelo, M.A: A comparative analysis of decision trees based classifiers for road detection in urban environments. In: Proceedings of the IEEE International Conference on Intelligent Transportation Systems 2015, pp. 719–724 (2015) Fernández, C., Izquierdo, R., Llorca, D.F., Sotelo, M.A: A comparative analysis of decision trees based classifiers for road detection in urban environments. In: Proceedings of the IEEE International Conference on Intelligent Transportation Systems 2015, pp. 719–724 (2015)
12.
go back to reference Alvarez, J.M., Gevers, T., Lecun, Y., Lopez, A.M.: Road scene segmentation from a single image. In: Computer Vision–ECCV, pp. 376–389. Springer, Berlin (2012) Alvarez, J.M., Gevers, T., Lecun, Y., Lopez, A.M.: Road scene segmentation from a single image. In: Computer Vision–ECCV, pp. 376–389. Springer, Berlin (2012)
13.
go back to reference Brostow, G.J., Fauqueur, J., Cipolla, R.: Semantic object classes in video: a high definition ground truth database. Pattern Recogn. Lett. 30(2), 88–97 (2009)CrossRef Brostow, G.J., Fauqueur, J., Cipolla, R.: Semantic object classes in video: a high definition ground truth database. Pattern Recogn. Lett. 30(2), 88–97 (2009)CrossRef
14.
go back to reference Achanta, R., Shaji, A., Smith, K.: SLIC super-pixels compared to state-of-the-art super-pixels methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)CrossRef Achanta, R., Shaji, A., Smith, K.: SLIC super-pixels compared to state-of-the-art super-pixels methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)CrossRef
15.
go back to reference Achanta, R., Shaji, A., Smith, K.: SLIC Super-pixels. Swiss federal Institute of Technology, Lausanne, Vaud, Switzerland (2010) Achanta, R., Shaji, A., Smith, K.: SLIC Super-pixels. Swiss federal Institute of Technology, Lausanne, Vaud, Switzerland (2010)
16.
go back to reference Cecotti, H., Graser, A.: Convolutional neural networks for P300 detection with application to brain-computer interfaces. IEEE Trans. Pattern Anal. Mach. Intell. 33(3), 433–445 (2010)CrossRef Cecotti, H., Graser, A.: Convolutional neural networks for P300 detection with application to brain-computer interfaces. IEEE Trans. Pattern Anal. Mach. Intell. 33(3), 433–445 (2010)CrossRef
17.
go back to reference Ji, S., Xu, W., Yang, M., et al.: 3D convolutional neural networks for human action recognition. IEEE Trans. Pattern Anal. Mach. lntell. 35(1), 221–231 (2013)CrossRef Ji, S., Xu, W., Yang, M., et al.: 3D convolutional neural networks for human action recognition. IEEE Trans. Pattern Anal. Mach. lntell. 35(1), 221–231 (2013)CrossRef
18.
go back to reference Turaga, S.C., Murray, J.F., Jain, V., Roth, F., Helmstaedter, M., Briggman, K., Denk, W., Seung, H.S.: Convolutional networks can learn to generate affinity graphs for image segmentation. Neural Comp. 22, 511–538 (2010)CrossRefMATH Turaga, S.C., Murray, J.F., Jain, V., Roth, F., Helmstaedter, M., Briggman, K., Denk, W., Seung, H.S.: Convolutional networks can learn to generate affinity graphs for image segmentation. Neural Comp. 22, 511–538 (2010)CrossRefMATH
19.
go back to reference Lu, H., Li, Y., Chen, M., Kim, H., Serikawa, S.: Brain intelligence: go beyond artificial intelligence. Mob. Netw. Appl. 1–10 (2017) Lu, H., Li, Y., Chen, M., Kim, H., Serikawa, S.: Brain intelligence: go beyond artificial intelligence. Mob. Netw. Appl. 1–10 (2017)
22.
go back to reference Serikawa, S., Lu, H.: Underwater image dehazing using joint trilateral filter. Comput. Electr. Eng. 40(1), 41–50 (2014)CrossRef Serikawa, S., Lu, H.: Underwater image dehazing using joint trilateral filter. Comput. Electr. Eng. 40(1), 41–50 (2014)CrossRef
23.
go back to reference Li, S.Z.: Markov Random Field Modeling in Computer Vision. Springer, Tokyo, Japan (1995) Li, S.Z.: Markov Random Field Modeling in Computer Vision. Springer, Tokyo, Japan (1995)
24.
go back to reference Brostow, G.J., Fauqueur, J., Cipolla, R.: Semantic object classes in video: a high definition ground truth database. Pattern Recog. Lett. (2008) Brostow, G.J., Fauqueur, J., Cipolla, R.: Semantic object classes in video: a high definition ground truth database. Pattern Recog. Lett. (2008)
Metadata
Title
Combining CNN and MRF for Road Detection
Authors
Lei Geng
Jiangdong Sun
Zhitao Xiao
Fang Zhang
Jun Wu
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-69877-9_12

Premium Partner