Skip to main content
Erschienen in: Neural Processing Letters 1/2023

08.08.2022

ChaInNet: Deep Chain Instance Segmentation Network for Panoptic Segmentation

verfasst von: Lin Mao, Fengzhi Ren, Dawei Yang, Rubo Zhang

Erschienen in: Neural Processing Letters | Ausgabe 1/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We consider the competition between instance and semantic segmentation in panoptic segmentation to develop the deep chain instance segmentation network (ChaInNet) to mitigate this problem. Segmentation competition is caused by the usual contradiction between instance and semantic segmentation when predicting instance objects. ChaInNet alternately performs inter-reference learning by stacking two-branch chain blocks to improve feature extraction from network layers. Panoptic segmentation using ChaInNet accurately extracts the contour of instance objects and improves the accuracy of instance segmentation, thus reducing the adverse effects of segmentation competition on the quality of the outcome. ChaInNet is a general instance segmentation architecture that can be widely used in various object recognition tasks. Experimental results on the MS COCO and Cityscapes benchmark datasets show that ChaInNet provides state-of-the-art segmentation and outperforms Mask R-CNN, which is commonly used for identifying instance objects in panoptic segmentation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat He K, Gkioxari G, Dollár P, Girshick R, Mask R-CNN (2017) Proceedings of the IEEE International Conference on Computer Vision pp. 2980–2988 He K, Gkioxari G, Dollár P, Girshick R, Mask R-CNN (2017) Proceedings of the IEEE International Conference on Computer Vision pp. 2980–2988
2.
Zurück zum Zitat Ye L, Liu Z, Wang Y (2017) Depth-aware object instance segmentation, Proceedings of the IEEE International Conference on Image Processing (ICIP) pp. 325–329 Ye L, Liu Z, Wang Y (2017) Depth-aware object instance segmentation, Proceedings of the IEEE International Conference on Image Processing (ICIP) pp. 325–329
3.
Zurück zum Zitat Shang C, Wu Q, Meng F, Xu L (2019) Instance Segmentation by Learning Deep Feature in Embedding Space, Proceedings of the IEEE International Conference on Image Processing (ICIP) pp. 2444–2448 Shang C, Wu Q, Meng F, Xu L (2019) Instance Segmentation by Learning Deep Feature in Embedding Space, Proceedings of the IEEE International Conference on Image Processing (ICIP) pp. 2444–2448
4.
Zurück zum Zitat Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition pp. 3431–3440 Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition pp. 3431–3440
5.
Zurück zum Zitat Badrinarayanan V, Kendall A, Cipolla R (2017) SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481–2495CrossRef Badrinarayanan V, Kendall A, Cipolla R (2017) SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481–2495CrossRef
6.
Zurück zum Zitat Chen L-C, Zhu Y, Papandreou G, Schroff F, Adam H (2018) Encoder-decoder with atrous separable convolution for semantic image segmentation, Proceedings of the European Conference on Computer Vision (ECCV) pp. 801–818 Chen L-C, Zhu Y, Papandreou G, Schroff F, Adam H (2018) Encoder-decoder with atrous separable convolution for semantic image segmentation, Proceedings of the European Conference on Computer Vision (ECCV) pp. 801–818
7.
Zurück zum Zitat Kirillov A, He K, Girshick R, Dollár P, Segmentation P (2019) Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition pp.9396–9405 Kirillov A, He K, Girshick R, Dollár P, Segmentation P (2019) Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition pp.9396–9405
8.
Zurück zum Zitat Kirillov A, Girshick R, He K, Dollár P Panoptic Feature Pyramid Networks, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2019. pp. 6392–6401 Kirillov A, Girshick R, He K, Dollár P Panoptic Feature Pyramid Networks, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2019. pp. 6392–6401
9.
Zurück zum Zitat Xiong Y, Liao R, Zhao H, Hu R, Bai M, Yumer E, Urtasun R (2019) UPSNet: A Unified Panoptic Segmentation Network, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition pp.8810–8818 Xiong Y, Liao R, Zhao H, Hu R, Bai M, Yumer E, Urtasun R (2019) UPSNet: A Unified Panoptic Segmentation Network, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition pp.8810–8818
10.
Zurück zum Zitat Li Y, Chen X, Zhu Z, Zhu Z, Xie L, Huang G, Du D, Wang X (2019) Attention-Guided Unified Network for Panoptic Segmentation, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition pp. 7019–7028 Li Y, Chen X, Zhu Z, Zhu Z, Xie L, Huang G, Du D, Wang X (2019) Attention-Guided Unified Network for Panoptic Segmentation, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition pp. 7019–7028
11.
12.
Zurück zum Zitat Zhao H, Shi J, Qi X, Wang X, Jia J Pyramid Scene Parsing Network, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2017, pp. 6230–6239 Zhao H, Shi J, Qi X, Wang X, Jia J Pyramid Scene Parsing Network, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2017, pp. 6230–6239
13.
Zurück zum Zitat Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848CrossRef Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848CrossRef
14.
Zurück zum Zitat Geus D, Meletis P, Dubbelman G (2018) Panoptic segmentation with a joint semantic and instance segmentation network.arXiv preprintarXiv:1809.02110, Geus D, Meletis P, Dubbelman G (2018) Panoptic segmentation with a joint semantic and instance segmentation network.arXiv preprintarXiv:1809.02110,
15.
Zurück zum Zitat Li J, Raventos A, Bhargava A, Tagawa T, Gaidon A (2018) Learning to fuse things and stuff. arXiv preprint arXiv:1812.01192, Li J, Raventos A, Bhargava A, Tagawa T, Gaidon A (2018) Learning to fuse things and stuff. arXiv preprint arXiv:1812.01192,
16.
Zurück zum Zitat Liu H, Peng C, Yu C, Wang J, Liu X, Yu G, Jiang W, Recognition (2019) pp. 6165–6174 Liu H, Peng C, Yu C, Wang J, Liu X, Yu G, Jiang W, Recognition (2019) pp. 6165–6174
17.
Zurück zum Zitat Lazarow J, Lee K, Shi K, Tu Z Learning Instance Occlusion for Panoptic Segmentation, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2020, pp. 10717–10726 Lazarow J, Lee K, Shi K, Tu Z Learning Instance Occlusion for Panoptic Segmentation, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2020, pp. 10717–10726
18.
Zurück zum Zitat Sofiiuk K, Sofiyuk K, Barinova O, Konushin A, Barinova O (2019) AdaptIS: Adaptive Instance Selection Network, Proceedings of the IEEE International Conference on Computer Vision pp. 7354–7362 Sofiiuk K, Sofiyuk K, Barinova O, Konushin A, Barinova O (2019) AdaptIS: Adaptive Instance Selection Network, Proceedings of the IEEE International Conference on Computer Vision pp. 7354–7362
19.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition pp. 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition pp. 770–778
20.
Zurück zum Zitat Xie S, Girshick R, Dollár P, Tu Z, He K, Recognition (2017) pp. 5987–5995 Xie S, Girshick R, Dollár P, Tu Z, He K, Recognition (2017) pp. 5987–5995
21.
Zurück zum Zitat Zagoruyko S, Komodakis N Wide Residual Networks. arXiv preprint arXiv:1605.07146,2017 Zagoruyko S, Komodakis N Wide Residual Networks. arXiv preprint arXiv:1605.07146,2017
22.
Zurück zum Zitat Zhang H, Wu C, Zhang Z, Zhu Y, Zhang Z, Lin H, Sun Y, He T, Mueller J, Manmatha R, Li M, Smola A ResNeSt: Split-Attention Networks. arXiv preprint arXiv: 2004.08955v1,2020 Zhang H, Wu C, Zhang Z, Zhu Y, Zhang Z, Lin H, Sun Y, He T, Mueller J, Manmatha R, Li M, Smola A ResNeSt: Split-Attention Networks. arXiv preprint arXiv: 2004.08955v1,2020
23.
Zurück zum Zitat Huang G, Liu Z, Van Der Maaten L, Weinberger KQ Densely Connected Convolutional Networks, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition2017, pp. 2261–2269 Huang G, Liu Z, Van Der Maaten L, Weinberger KQ Densely Connected Convolutional Networks, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition2017, pp. 2261–2269
24.
Zurück zum Zitat Nair V, Hinton GE Rectified linear units improve restricted boltzmann machines. Proceedings of the international conference on machine learning 2010, pp. 807–814 Nair V, Hinton GE Rectified linear units improve restricted boltzmann machines. Proceedings of the international conference on machine learning 2010, pp. 807–814
26.
Zurück zum Zitat Lin T-Y, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Dollar P, Zitnick L, Microsoft COCO Common Objects in Context, Proceedings of the European Conference on Computer Vision (ECCV) 2014, pp. 740–755 Lin T-Y, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Dollar P, Zitnick L, Microsoft COCO Common Objects in Context, Proceedings of the European Conference on Computer Vision (ECCV) 2014, pp. 740–755
27.
Zurück zum Zitat Cordts M, Omran M, Ramos S, Rehfeld T, Enzweiler M, Benenson R, Franke U, Roth S, Schiele B (2016) The cityscapes dataset for semantic urban scene understanding, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition pp. 3213–3223 Cordts M, Omran M, Ramos S, Rehfeld T, Enzweiler M, Benenson R, Franke U, Roth S, Schiele B (2016) The cityscapes dataset for semantic urban scene understanding, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition pp. 3213–3223
31.
Zurück zum Zitat Yang T-J, .Collins MD, Zhu Y, Hwang J-J, Liu T, Zhang X, Sze V, Papandreou G, Chen L-C DeeperLab:Single-Shot Image Parser. arXiv preprint arXiv:1902.09053,2017. Yang T-J, .Collins MD, Zhu Y, Hwang J-J, Liu T, Zhang X, Sze V, Papandreou G, Chen L-C DeeperLab:Single-Shot Image Parser. arXiv preprint arXiv:1902.09053,2017.
Metadaten
Titel
ChaInNet: Deep Chain Instance Segmentation Network for Panoptic Segmentation
verfasst von
Lin Mao
Fengzhi Ren
Dawei Yang
Rubo Zhang
Publikationsdatum
08.08.2022
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 1/2023
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-022-10899-2

Weitere Artikel der Ausgabe 1/2023

Neural Processing Letters 1/2023 Zur Ausgabe

Neuer Inhalt