Skip to main content
Erschienen in: Pattern Analysis and Applications 3/2023

22.03.2023 | Theoretical Advances

A single defocused image depth recovery with superpixel segmentation

verfasst von: Yanli Chen, Haitao Wang, Jinding Gao

Erschienen in: Pattern Analysis and Applications | Ausgabe 3/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Most of the depth restoration algorithms are complicated for a single defocused image, the restoration effect is poor on the image edges, complex textures and shadow areas. In this paper, the depth of a scene is recovered by a single image defocus cue, a novel approach of single defocused image depth restoration is proposed based on superpixel segmentation. First, the simple linear iterative cluster (SLIC) is used to divide the original image into several superpixel modules. Then, the defocus blur amount of each superpixel module is obtained according to the Gaussian–Cauchy mixed model, so as to obtain the superpixel-level sparse depth map. Finally, the cellular automata model is used to optimize the obtained sparse depth map and to restore the true and accurate panoramic depth map. Compared with other methods, the algorithm not only minimizes the error, but also simplifies the process of extending the edge defocus blur to the global. The experimental results on real data show that the method is not only less time-consuming, but also can effectively improve the depth recovery effect in areas with unclear edges, complex textures and shadows. These demonstrate the effectiveness of the method in providing reliable estimates of scene depth.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
5.
Zurück zum Zitat Chen CY, Cai JF, Zheng JM et al (2015) Kinect depth recovery using a color-guided, region-adaptive, and depth-selective framework. ACM Trans Intell Syst Technol 6(2):1–19CrossRef Chen CY, Cai JF, Zheng JM et al (2015) Kinect depth recovery using a color-guided, region-adaptive, and depth-selective framework. ACM Trans Intell Syst Technol 6(2):1–19CrossRef
8.
Zurück zum Zitat Akbarally H., Kleeman L., (1996). 3D robot sensing from sonar and vision. In: Proceedings of the 1996 IEEE international conference on robotics and automation, Minneapolis, Apr 2228, 1996. IEEE, Piscataway, pp 686–691 Akbarally H., Kleeman L., (1996). 3D robot sensing from sonar and vision. In: Proceedings of the 1996 IEEE international conference on robotics and automation, Minneapolis, Apr 2228, 1996. IEEE, Piscataway, pp 686–691
10.
Zurück zum Zitat Dellaert F, Seitz SM, Thorpe CE, et al. (2000) Structure from motion without correspondence. In: Proceedings of the 2000 conference on computer vision and pattern recognition, Hilton Head Island, Jun 13–15, 2000. IEEE Computer Society, Washington, pp 557–564. DOI:https://doi.org/10.1109/CVPR.2000.854916 Dellaert F, Seitz SM, Thorpe CE, et al. (2000) Structure from motion without correspondence. In: Proceedings of the 2000 conference on computer vision and pattern recognition, Hilton Head Island, Jun 13–15, 2000. IEEE Computer Society, Washington, pp 557–564. DOI:https://​doi.​org/​10.​1109/​CVPR.​2000.​854916
11.
Zurück zum Zitat Tomasi C, Kanade T (1992) Shape and motion from image streams under orthography: a factorization method. Int J Comput Vision 9(2):137–154CrossRef Tomasi C, Kanade T (1992) Shape and motion from image streams under orthography: a factorization method. Int J Comput Vision 9(2):137–154CrossRef
12.
Zurück zum Zitat Pentland AP (1987) A new sense for depth of field. IEEE Trans Pattern Anal Mach Intell 9(4):523–531CrossRef Pentland AP (1987) A new sense for depth of field. IEEE Trans Pattern Anal Mach Intell 9(4):523–531CrossRef
13.
Zurück zum Zitat Subbarao M, (1988) Parallel depth recovery by changing camera parameters. In: Proceedings of the 2nd international conference on computer vision, Tampa, Dec 5–8, 1988. IEEE, Piscataway, pp 149–155 Subbarao M, (1988) Parallel depth recovery by changing camera parameters. In: Proceedings of the 2nd international conference on computer vision, Tampa, Dec 5–8, 1988. IEEE, Piscataway, pp 149–155
14.
Zurück zum Zitat Kim GB, Tian GY (2009) A novel depth-from-focus-based measurement system for the reconstruction of surface morphology with depth discontinuity. Int J Advan Manuf Technol 40(11/12):1158–1165CrossRef Kim GB, Tian GY (2009) A novel depth-from-focus-based measurement system for the reconstruction of surface morphology with depth discontinuity. Int J Advan Manuf Technol 40(11/12):1158–1165CrossRef
15.
Zurück zum Zitat Rajagopalan AN et al (2020) Quantitative analysis of error bounds in the recovery of depth from defocused images. J Opt Soc Am A Opt Image Sci Vis 17(10):1722–1731CrossRef Rajagopalan AN et al (2020) Quantitative analysis of error bounds in the recovery of depth from defocused images. J Opt Soc Am A Opt Image Sci Vis 17(10):1722–1731CrossRef
16.
Zurück zum Zitat Levin A, Hasinoff SW, Green P, et al. (2009) 4D frequency analysis of computational cameras for depth of field extension. In: Proceedings of the 36th international conference and exhibition on computer graphiocs & interactive Techniques, New Orleans, Aug 3–7, 2009. New York, ACM, 97 Levin A, Hasinoff SW, Green P, et al. (2009) 4D frequency analysis of computational cameras for depth of field extension. In: Proceedings of the 36th international conference and exhibition on computer graphiocs & interactive Techniques, New Orleans, Aug 3–7, 2009. New York, ACM, 97
17.
Zurück zum Zitat Zhou CY, Nayar SK (2011) Computational cameras: convergence of optics and processing. IEEE Trans Image Process 20(12):3322–3340CrossRef Zhou CY, Nayar SK (2011) Computational cameras: convergence of optics and processing. IEEE Trans Image Process 20(12):3322–3340CrossRef
20.
Zurück zum Zitat Zhuo SJ, Sim T (2011) Defocus map estimation from a single image. Pattern Recogn 44(9):1852–1858CrossRef Zhuo SJ, Sim T (2011) Defocus map estimation from a single image. Pattern Recogn 44(9):1852–1858CrossRef
22.
Zurück zum Zitat Vargas J, Otón J, Marabini R et al (2013) FASTDEF: fast defocus and astigmatism estimation for high-throughput transmission electron microscopy. J Struct Biol 181(2):136–148CrossRef Vargas J, Otón J, Marabini R et al (2013) FASTDEF: fast defocus and astigmatism estimation for high-throughput transmission electron microscopy. J Struct Biol 181(2):136–148CrossRef
23.
Zurück zum Zitat Achanta R, Shaji A, Smith K et al (2012) SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans Pattern Anal Mach Intell 34(11):2274–2282CrossRef Achanta R, Shaji A, Smith K et al (2012) SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans Pattern Anal Mach Intell 34(11):2274–2282CrossRef
24.
Zurück zum Zitat Qin Y, Lu HC, Xu YQ et al. (2015) Saliency detection via cellular automata. In: Proceedings of the 2015 IEEE conference on computer vision and pattern recognition, Boston, Jun 7–12, 2015. IEEE Computer Society, Washington, pp110–119 Qin Y, Lu HC, Xu YQ et al. (2015) Saliency detection via cellular automata. In: Proceedings of the 2015 IEEE conference on computer vision and pattern recognition, Boston, Jun 7–12, 2015. IEEE Computer Society, Washington, pp110–119
25.
Zurück zum Zitat Cowburn RP, Welland ME (2000) Room temperature magnetic quantum cellular automata. Science 287(5457):1466–1468CrossRef Cowburn RP, Welland ME (2000) Room temperature magnetic quantum cellular automata. Science 287(5457):1466–1468CrossRef
26.
Zurück zum Zitat Von Neumann J (1951) The general and logical theory of automata. In: Aspray W, Burks A (eds) Papers of John Von Neumann on computing & computer theory. MIT Press, Cambridge, pp 391–431 Von Neumann J (1951) The general and logical theory of automata. In: Aspray W, Burks A (eds) Papers of John Von Neumann on computing & computer theory. MIT Press, Cambridge, pp 391–431
Metadaten
Titel
A single defocused image depth recovery with superpixel segmentation
verfasst von
Yanli Chen
Haitao Wang
Jinding Gao
Publikationsdatum
22.03.2023
Verlag
Springer London
Erschienen in
Pattern Analysis and Applications / Ausgabe 3/2023
Print ISSN: 1433-7541
Elektronische ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-023-01133-3

Weitere Artikel der Ausgabe 3/2023

Pattern Analysis and Applications 3/2023 Zur Ausgabe

Premium Partner