Skip to main content
Erschienen in: Neural Processing Letters 8/2023

19.07.2023

ContourNet: Research on Contour Based Nighttime Semantic Segmentation

verfasst von: Yang Yang, Changjiang Liu, Hao Li

Erschienen in: Neural Processing Letters | Ausgabe 8/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Due to the scarcity of nighttime semantic segmentation datasets and the high demand for network models, the development of semantic segmentation of nighttime scenes is still very slow. This paper proposes a new network model, ContourNet, which can model multi-level features. In addition, a separate contour network module is designed to accurately predict object contours, improving performance for objects far away, small, or with high contour continuity. A large number of experiments demonstrate that the ContourNet proposed in this paper can significantly improve the semantic segmentation ability of existing models for nighttime images, and can also improve the semantic segmentation accuracy of daytime images to a certain extent, with good generalization abilities. Specifically, after adding the contour module in this article, MIoU has increased by 5.1% on the night dataset Rebecca; MIoU has increased by 2.5% on the daytime dataset CamVid.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39(4):640–651 Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39(4):640–651
2.
Zurück zum Zitat Huang K, Shi B, Li X, Li X, Huang S, Li Y (2022) Multi-modal sensor fusion for auto driving perception: a survey. arXiv e-prints Huang K, Shi B, Li X, Li X, Huang S, Li Y (2022) Multi-modal sensor fusion for auto driving perception: a survey. arXiv e-prints
3.
Zurück zum Zitat Luo S, Dai H, Shao L, Ding Y (2021) M3dssd: monocular 3d single stage object detector. In: 2021 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp. 6141–6150 Luo S, Dai H, Shao L, Ding Y (2021) M3dssd: monocular 3d single stage object detector. In: 2021 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp. 6141–6150
4.
Zurück zum Zitat Yang Z, Xinjun H, Yudong Y (2021) Design and research of industrial robot control system based on machine vision. In: 2021 5th international conference on electronics, communication and aerospace technology (ICECA), pp. 209–212 Yang Z, Xinjun H, Yudong Y (2021) Design and research of industrial robot control system based on machine vision. In: 2021 5th international conference on electronics, communication and aerospace technology (ICECA), pp. 209–212
5.
Zurück zum Zitat Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 1–1 Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 1–1
6.
Zurück zum Zitat Peng D, Lei Y, Hayat M, Guo Y, Li W (2022) Semantic-aware domain generalized segmentation. In: 2022 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp. 2584–2595 Peng D, Lei Y, Hayat M, Guo Y, Li W (2022) Semantic-aware domain generalized segmentation. In: 2022 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp. 2584–2595
7.
Zurück zum Zitat Zhang J, Cao Y, Wu Q (2021) Vector of locally and adaptively aggregated descriptors for image feature representation. Pattern Recogn 116(4):107952CrossRef Zhang J, Cao Y, Wu Q (2021) Vector of locally and adaptively aggregated descriptors for image feature representation. Pattern Recogn 116(4):107952CrossRef
9.
Zurück zum Zitat Kittler J (1983) On the accuracy of the sobel edge detector. Image Vis Comput 1(1):37–42CrossRef Kittler J (1983) On the accuracy of the sobel edge detector. Image Vis Comput 1(1):37–42CrossRef
10.
Zurück zum Zitat Arbelaez P, Maire M, Fowlkes C, Malik J (2011) Contour detection and hierarchical image segmentation. IEEE Trans Pattern Anal Mach Intell 33(5):898–916CrossRef Arbelaez P, Maire M, Fowlkes C, Malik J (2011) Contour detection and hierarchical image segmentation. IEEE Trans Pattern Anal Mach Intell 33(5):898–916CrossRef
11.
Zurück zum Zitat Zhang J, Fan J, Yang J, Yu J (2022) Semisupervised image classification by mutual learning of multiple self-supervised models. Int J Intell Syst 37(5):3117–3141CrossRef Zhang J, Fan J, Yang J, Yu J (2022) Semisupervised image classification by mutual learning of multiple self-supervised models. Int J Intell Syst 37(5):3117–3141CrossRef
12.
Zurück zum Zitat Wei S, Wang X, Yan W, Xiang B, Zhang Z (2015) Deepcontour: a deep convolutional feature learned by positive-sharing loss for contour detection. Comput Vis Pattern Recognit Wei S, Wang X, Yan W, Xiang B, Zhang Z (2015) Deepcontour: a deep convolutional feature learned by positive-sharing loss for contour detection. Comput Vis Pattern Recognit
13.
Zurück zum Zitat Xie S, Tu Z (2015) Holistically-nested edge detection. Int J Comput Vision 125(1–3):3–18MathSciNet Xie S, Tu Z (2015) Holistically-nested edge detection. Int J Comput Vision 125(1–3):3–18MathSciNet
14.
Zurück zum Zitat Soria X, Riba E, Sappa A (2020) Dense extreme inception network: towards a robust cnn model for edge detection. In: Workshop on applications of computer vision Soria X, Riba E, Sappa A (2020) Dense extreme inception network: towards a robust cnn model for edge detection. In: Workshop on applications of computer vision
15.
Zurück zum Zitat Teichmann M, Weber M, Zöllner JM, Cipolla R, Urtasun R (2016) Multinet: real-time joint semantic reasoning for autonomous driving. In: 2018 IEEE intelligent vehicles symposium (IV) pp. 1013–1020 Teichmann M, Weber M, Zöllner JM, Cipolla R, Urtasun R (2016) Multinet: real-time joint semantic reasoning for autonomous driving. In: 2018 IEEE intelligent vehicles symposium (IV) pp. 1013–1020
16.
Zurück zum Zitat Cheng D, Meng G, Xiang S, Pan C (2017) Fusionnet: edge aware deep convolutional networks for semantic segmentation of remote sensing harbor images. IEEE J Sel Top Appl Earth Observ Remote Sensing 99:1–15 Cheng D, Meng G, Xiang S, Pan C (2017) Fusionnet: edge aware deep convolutional networks for semantic segmentation of remote sensing harbor images. IEEE J Sel Top Appl Earth Observ Remote Sensing 99:1–15
17.
Zurück zum Zitat Guo X, Yu L, Ling H (2016) Lime: low-light image enhancement via illumination map estimation. IEEE Trans Image Process 99:1–1MATH Guo X, Yu L, Ling H (2016) Lime: low-light image enhancement via illumination map estimation. IEEE Trans Image Process 99:1–1MATH
18.
Zurück zum Zitat Wu W, Weng J, Zhang P, Wang X, Yang W, Jiang J (2022) Uretinex-net: retinex-based deep unfolding network for low-light image enhancement. In: 2022 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp. 5891–5900 Wu W, Weng J, Zhang P, Wang X, Yang W, Jiang J (2022) Uretinex-net: retinex-based deep unfolding network for low-light image enhancement. In: 2022 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp. 5891–5900
19.
Zurück zum Zitat Ma L, Ma T, Liu R, Fan X, Luo Z (2022) Toward fast, flexible, and robust low-light image enhancement. 2022 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp. 5627–5636 Ma L, Ma T, Liu R, Fan X, Luo Z (2022) Toward fast, flexible, and robust low-light image enhancement. 2022 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp. 5627–5636
20.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2015) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), pp. 770–778 He K, Zhang X, Ren S, Sun J (2015) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), pp. 770–778
21.
Zurück zum Zitat Tan X, Xu K, Cao Y, Zhang Y, Ma L, Lau R (2021) Night-time scene parsing with a large real dataset. IEEE Trans Image Process Tan X, Xu K, Cao Y, Zhang Y, Ma L, Lau R (2021) Night-time scene parsing with a large real dataset. IEEE Trans Image Process
22.
Zurück zum Zitat Brostow GJ, Fauqueur J, Cipolla R (2009) Semantic object classes in video: a high-definition ground truth database. Pattern Recogn Lett 30(2):88–97CrossRef Brostow GJ, Fauqueur J, Cipolla R (2009) Semantic object classes in video: a high-definition ground truth database. Pattern Recogn Lett 30(2):88–97CrossRef
23.
Zurück zum Zitat Yu C, Wang J, Peng C, Gao C, Yu G, Sang N (2018) Bisenet: bilateral segmentation network for real-time semantic segmentation. In: European conference on computer vision Yu C, Wang J, Peng C, Gao C, Yu G, Sang N (2018) Bisenet: bilateral segmentation network for real-time semantic segmentation. In: European conference on computer vision
24.
Zurück zum Zitat Zhao J, Liu J, Fan DP, Cao Y, Yang J, Cheng MM (2019) Egnet: edge guidance network for salient object detection. 2019 IEEE/CVF international conference on computer vision (ICCV), pp. 8778–8787 Zhao J, Liu J, Fan DP, Cao Y, Yang J, Cheng MM (2019) Egnet: edge guidance network for salient object detection. 2019 IEEE/CVF international conference on computer vision (ICCV), pp. 8778–8787
25.
Zurück zum Zitat Nirkin Y, Wolf L, Hassner T (2021) Hyperseg: patch-wise hypernetwork for real-time semantic segmentation. Comput Vis Pattern Recognit Nirkin Y, Wolf L, Hassner T (2021) Hyperseg: patch-wise hypernetwork for real-time semantic segmentation. Comput Vis Pattern Recognit
26.
Zurück zum Zitat Cordts M, Omran M, Ramos S, Rehfeld T, Enzweiler M, Benenson R, Franke U, Roth S, Schiele B (2016) The cityscapes dataset for semantic urban scene understanding. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR) pp. 3213–3223 Cordts M, Omran M, Ramos S, Rehfeld T, Enzweiler M, Benenson R, Franke U, Roth S, Schiele B (2016) The cityscapes dataset for semantic urban scene understanding. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR) pp. 3213–3223
27.
Zurück zum Zitat Zhao H, Qi X, Shen X, Shi J, Jia J (2017) ICNet for real-time semantic segmentation on high-resolution images Zhao H, Qi X, Shen X, Shi J, Jia J (2017) ICNet for real-time semantic segmentation on high-resolution images
28.
Zurück zum Zitat Li H, Xiong P, Fan H, Sun J (2020) Dfanet: deep feature aggregation for real-time semantic segmentation. In: 2019 IEEE/CVF conference on computer vision and pattern recognition (CVPR) Li H, Xiong P, Fan H, Sun J (2020) Dfanet: deep feature aggregation for real-time semantic segmentation. In: 2019 IEEE/CVF conference on computer vision and pattern recognition (CVPR)
29.
Zurück zum Zitat Hu P, Heilbron FC, Wang O, Lin ZL, Sclaroff S, Perazzi F (2020) Temporally distributed networks for fast video semantic segmentation. In: 2020 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp. 8815–8824 Hu P, Heilbron FC, Wang O, Lin ZL, Sclaroff S, Perazzi F (2020) Temporally distributed networks for fast video semantic segmentation. In: 2020 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp. 8815–8824
30.
Zurück zum Zitat Li H, Liu C, Yang Y (2023) Layernet: a one-step layered network for semantic segmentation at night. IEEE Comput Graph Appl Li H, Liu C, Yang Y (2023) Layernet: a one-step layered network for semantic segmentation at night. IEEE Comput Graph Appl
31.
Zurück zum Zitat Fu J, Liu J, Tian H, Fang Z, Lu H (2018) Dual attention network for scene segmentation. In: 2019 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp. 3141–3149 Fu J, Liu J, Tian H, Fang Z, Lu H (2018) Dual attention network for scene segmentation. In: 2019 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp. 3141–3149
Metadaten
Titel
ContourNet: Research on Contour Based Nighttime Semantic Segmentation
verfasst von
Yang Yang
Changjiang Liu
Hao Li
Publikationsdatum
19.07.2023
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 8/2023
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-023-11366-2

Weitere Artikel der Ausgabe 8/2023

Neural Processing Letters 8/2023 Zur Ausgabe

Neuer Inhalt