Skip to main content
Top
Published in: Experimental Mechanics 5/2018

03-04-2018

Full-Field Surface 3D Shape and Displacement Measurements Using an Unfocused Plenoptic Camera

Authors: B. Chen, B. Pan

Published in: Experimental Mechanics | Issue 5/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Full-field surface 3D shape and displacement measurements using a single commercial unfocused plenoptic camera (Lytro Illum) are reported in this work. Before measurements, the unfocused plenoptic camera is calibrated with two consecutive steps, including lateral calibration and depth calibration. Each raw image of a checkerboard pattern recorded by Lytro Illum is first extracted to an array of sub-aperture images (SAIs), and the center sub-aperture images (CSAIs) at diverse poses are used for lateral calibration to determine intrinsic and extrinsic parameters. The parallax maps between the CSAI and the remaining SAIs at each pose are then determined for depth parameters estimation using depth calibration. Furthermore, a newly developed physical-based depth distortion model is established to correct the serious distortion of the depth field. To realize shape and deformation measurements, the raw images of a test sample with speckle patterns premade on its surface are captured by Lytro Illum and extracted to arrays of SAIs. The parallax maps between the CSAI and the target SAIs are obtained using subset-based digital image correlation. Based on the pre-computed intrinsic and depth parameters and the disparity map, the full-field surface 3D shape and displacement of a test object are finally determined. The effectiveness and accuracy of the proposed approach are evaluated by a set of experiments involving the shape reconstruction of a cylinder, in-plane and out-of-plane displacement measurements of a flat plate and 3D full-field displacement measurements of a cantilever beam. The preliminary results indicate that the proposed method is expected to become a novel approach for full-field surface 3D shape and displacement measurements.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Glossary
CSAI
Center sub-aperture image. A raw image captured by a plenoptic camera can be extracted to an array of sub-aperture images, which are equivalent to an array of images captured with slight parallaxes. The one at the center is named as Center sub-aperture image.
DIC
Digital image correlation, a widely used optical technique for surface profile and deformation measurements.
EPI
Epipolar image, a 2D slice of the 4D light field by fixing the horizontal angular and spatial coordinates, or the vertical angular and spatial coordinates simultaneously.
IC-GN algorithm
Inverse-compositional Gauss-Newton algorithm, an efficient algorithm for subset matching in DIC.
MLA
Microlens array, inserted in front of the sensor and behind the main lens of the plenoptic camera.
PIV
Particle image velocimetry, an optical method to measure the velocity field of the flow.
RMS
Root mean square, a statistical value defined as the square root of the mean square.
ROI
Region of interest, a region on the image selected for further measurements. We only measure the profile or deformation in this region.
SAI
Sub-aperture image, images extracted from the raw image of the plenoptic camera by fixing angular coordinates.
SD
Standard deviation.
ZNSSD
Zero-mean normalized sum of squared difference.
Literature
1.
go back to reference Ives FE (1903) Parallax stereogram and process of making same. US Pat 725, 567 1–3 Ives FE (1903) Parallax stereogram and process of making same. US Pat 725, 567 1–3
2.
go back to reference Lippmann G (1908) La photographie intégrale. CR Acad Sci 146:446–451 Lippmann G (1908) La photographie intégrale. CR Acad Sci 146:446–451
3.
go back to reference Ives HE, Jones L (1928) A camera for making parallax panoramagrams. J Opt Soc Am 17:435–439CrossRef Ives HE, Jones L (1928) A camera for making parallax panoramagrams. J Opt Soc Am 17:435–439CrossRef
4.
go back to reference Ives HE (1931) The projection of parallax panoramagrams. J Opt Soc Am 21:397–409CrossRef Ives HE (1931) The projection of parallax panoramagrams. J Opt Soc Am 21:397–409CrossRef
5.
go back to reference Adelson EH, Wang JYA (1992) Single lens stereo with a plenoptic camera. IEEE Trans Pattern Anal Mach Intell 14:99–106CrossRef Adelson EH, Wang JYA (1992) Single lens stereo with a plenoptic camera. IEEE Trans Pattern Anal Mach Intell 14:99–106CrossRef
6.
go back to reference Bok Y, Jeon HG, Kweon IS (2017) Geometric calibration of micro-lens-based light field cameras using line features. IEEE Trans Pattern Anal Mach Intell 39:287–300CrossRef Bok Y, Jeon HG, Kweon IS (2017) Geometric calibration of micro-lens-based light field cameras using line features. IEEE Trans Pattern Anal Mach Intell 39:287–300CrossRef
7.
go back to reference Ng R, Levoy M, Duval G et al (2005) Light field photography with a hand-held plenoptic camera. Informational 1–11 Ng R, Levoy M, Duval G et al (2005) Light field photography with a hand-held plenoptic camera. Informational 1–11
8.
go back to reference Ng R (2006) Digital light field photography. Stanford Univ 1–203 Ng R (2006) Digital light field photography. Stanford Univ 1–203
9.
go back to reference Lumsdaine A, Georgiev T (2008) Full resolution lightfield rendering. Indiana Univ Adobe Syst Tech Rep 1–12 Lumsdaine A, Georgiev T (2008) Full resolution lightfield rendering. Indiana Univ Adobe Syst Tech Rep 1–12
10.
go back to reference Lumsdaine A, Georgiev T (2009) The focused plenoptic camera. 2009 I.E. Int Conf Comput Photogr ICCP 09 Lumsdaine A, Georgiev T (2009) The focused plenoptic camera. 2009 I.E. Int Conf Comput Photogr ICCP 09
11.
go back to reference Lumsdaine A (2010) Focused plenoptic camera and rendering. J Electron Imaging 19:21106CrossRef Lumsdaine A (2010) Focused plenoptic camera and rendering. J Electron Imaging 19:21106CrossRef
12.
go back to reference Levoy M, Hanrahan P (1996) Light field rendering. Proc 23rd annu conf comput graph interact tech - SIGGRAPH ‘96 31–42 Levoy M, Hanrahan P (1996) Light field rendering. Proc 23rd annu conf comput graph interact tech - SIGGRAPH ‘96 31–42
13.
go back to reference Wanner S, Fehr J, Jähne B (2011) Generating EPI representations of 4D light fields with a single lens focused plenoptic camera. Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics) 6938 LNCS:90–101 Wanner S, Fehr J, Jähne B (2011) Generating EPI representations of 4D light fields with a single lens focused plenoptic camera. Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics) 6938 LNCS:90–101
14.
go back to reference Johannsen O, Sulc A, Goldluecke B (2016) Occlusion-aware depth estimation using sparse light field coding. In: Rosenhahn B, Andres B (eds) Pattern Recognition, Gcpr 2016. Springer International Publishing, Cham, pp 207–218 Johannsen O, Sulc A, Goldluecke B (2016) Occlusion-aware depth estimation using sparse light field coding. In: Rosenhahn B, Andres B (eds) Pattern Recognition, Gcpr 2016. Springer International Publishing, Cham, pp 207–218
15.
go back to reference Lin H, Chen C, Kang SB, Yu J (2015) Depth recovery from light field using focal stack symmetry. Proc IEEE int conf comput vis 2015 inter, pp 3451–3459 Lin H, Chen C, Kang SB, Yu J (2015) Depth recovery from light field using focal stack symmetry. Proc IEEE int conf comput vis 2015 inter, pp 3451–3459
16.
go back to reference Tao MW, Srinivasan PP (2015) Depth from shading, defocus, and correspondence using light-field angular coherence. CVPR, pp 1940–1948 Tao MW, Srinivasan PP (2015) Depth from shading, defocus, and correspondence using light-field angular coherence. CVPR, pp 1940–1948
17.
go back to reference Wang TC, Efros AA, Ramamoorthi R (2015) Occlusion-aware depth estimation using light-field cameras. In: Proc. ieee int. conf. comput. vis, pp 3487–3495 Wang TC, Efros AA, Ramamoorthi R (2015) Occlusion-aware depth estimation using light-field cameras. In: Proc. ieee int. conf. comput. vis, pp 3487–3495
18.
go back to reference Jeon HG, Park JJ, Choe G et al (2015) Accurate depth map estimation from a lenslet light field camera. Proc IEEE comput soc conf comput vis pattern recognit 07–12–June, pp 1547–1555 Jeon HG, Park JJ, Choe G et al (2015) Accurate depth map estimation from a lenslet light field camera. Proc IEEE comput soc conf comput vis pattern recognit 07–12–June, pp 1547–1555
19.
go back to reference Dansereau DG, Pizarro O, Williams SB (2013) Decoding, calibration and rectification for lenselet-based plenoptic cameras. Proc IEEE comput soc conf comput vis pattern recognit, pp 1027–1034 Dansereau DG, Pizarro O, Williams SB (2013) Decoding, calibration and rectification for lenselet-based plenoptic cameras. Proc IEEE comput soc conf comput vis pattern recognit, pp 1027–1034
20.
go back to reference Yang P, Wang Z, Yan Y et al (2016) Close-range photogrammetry with light field camera: from disparity map to absolute distance. Appl Opt 55:7477–7486CrossRef Yang P, Wang Z, Yan Y et al (2016) Close-range photogrammetry with light field camera: from disparity map to absolute distance. Appl Opt 55:7477–7486CrossRef
21.
go back to reference Johannsen O, Heinze C, Goldluecke B, Perwaß C (2013) On the calibration of focused plenoptic cameras. Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics) 8200 LNCS, pp 302–317 Johannsen O, Heinze C, Goldluecke B, Perwaß C (2013) On the calibration of focused plenoptic cameras. Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics) 8200 LNCS, pp 302–317
22.
go back to reference Zeller N, Quint F, Stilla U (2016) Depth estimation and camera calibration of a focused plenoptic camera for visual odometry. ISPRS J Photogramm Remote Sens 118:83–100CrossRef Zeller N, Quint F, Stilla U (2016) Depth estimation and camera calibration of a focused plenoptic camera for visual odometry. ISPRS J Photogramm Remote Sens 118:83–100CrossRef
23.
go back to reference Zeller N, Quint F, Stilla U (2014) Calibration and accuracy analysis of a focused plenoptic camera. ISPRS Ann Photogramm Remote Sens Spat Inf Sci II-3, pp 205–212 Zeller N, Quint F, Stilla U (2014) Calibration and accuracy analysis of a focused plenoptic camera. ISPRS Ann Photogramm Remote Sens Spat Inf Sci II-3, pp 205–212
24.
go back to reference Heinze C, Spyropoulos S, Hussmann S, Perwass C (2016) Automated robust metric calibration algorithm for multifocus plenoptic cameras. IEEE Trans Instrum Meas 65:1197–1205CrossRef Heinze C, Spyropoulos S, Hussmann S, Perwass C (2016) Automated robust metric calibration algorithm for multifocus plenoptic cameras. IEEE Trans Instrum Meas 65:1197–1205CrossRef
25.
go back to reference Strobl KH, Lingenauber M (2016) Stepwise calibration of focused plenoptic cameras. Comput Vis Image Underst 145:140–147CrossRef Strobl KH, Lingenauber M (2016) Stepwise calibration of focused plenoptic cameras. Comput Vis Image Underst 145:140–147CrossRef
26.
go back to reference Lynch K (2011) Development of a 3D fluid velocimetry technique based on light field imaging. MS Thesis, Auburn University, Alabama Lynch K (2011) Development of a 3D fluid velocimetry technique based on light field imaging. MS Thesis, Auburn University, Alabama
27.
go back to reference Lynch K, Fahringer T, Thurow B (2012) Three-dimensional particle image velocimetry using a plenoptic camera. 50th AIAA Aerosp Sci Meet Incl New Horizons Forum Aerosp Expo, pp 1–14 Lynch K, Fahringer T, Thurow B (2012) Three-dimensional particle image velocimetry using a plenoptic camera. 50th AIAA Aerosp Sci Meet Incl New Horizons Forum Aerosp Expo, pp 1–14
28.
go back to reference Shi S, Wang J, Ding J et al (2016) Parametric study on light field volumetric particle image velocimetry. Flow Meas Instrum 49:70–88CrossRef Shi S, Wang J, Ding J et al (2016) Parametric study on light field volumetric particle image velocimetry. Flow Meas Instrum 49:70–88CrossRef
29.
go back to reference Bolan J, Johnson KC, Thurow BS (2014) Preliminary investigation of three-dimensional flame measurements with a plenoptic camera. 30th AIAA Aerodyn Meas Technol Gr Test Conf, pp 1–12 Bolan J, Johnson KC, Thurow BS (2014) Preliminary investigation of three-dimensional flame measurements with a plenoptic camera. 30th AIAA Aerodyn Meas Technol Gr Test Conf, pp 1–12
30.
go back to reference Carlsohn MF, Kemmling A, Petersen A, Wietzke L (2016) 3D real-time visualization of blood flow in cerebral aneurysms by light field particle image velocimetry. Proc SPIE 9897:989703CrossRef Carlsohn MF, Kemmling A, Petersen A, Wietzke L (2016) 3D real-time visualization of blood flow in cerebral aneurysms by light field particle image velocimetry. Proc SPIE 9897:989703CrossRef
31.
go back to reference Bing P, Li K, Tong W (2013) Fast, robust and accurate digital image correlation calculation without redundant computations. Exp Mech 53:1277–1289CrossRef Bing P, Li K, Tong W (2013) Fast, robust and accurate digital image correlation calculation without redundant computations. Exp Mech 53:1277–1289CrossRef
32.
go back to reference Yu L, Bing P (2017) Color stereo-digital image correlation method using a single 3CCD color camera. Exp Mech 57:649–657CrossRef Yu L, Bing P (2017) Color stereo-digital image correlation method using a single 3CCD color camera. Exp Mech 57:649–657CrossRef
33.
go back to reference Adelson EH, Bergen JR (1991) The plenoptic function and the elements of early vision. Comput Model Vis Process, pp 3–20 Adelson EH, Bergen JR (1991) The plenoptic function and the elements of early vision. Comput Model Vis Process, pp 3–20
34.
go back to reference Birklbauer C, Opelt S, Bimber O (2013) Rendering gigaray light fields. Comput Graphics Forum 32:469–478CrossRef Birklbauer C, Opelt S, Bimber O (2013) Rendering gigaray light fields. Comput Graphics Forum 32:469–478CrossRef
35.
go back to reference Cho D, Lee M, Kim S, Tai YW (2013) Modeling the calibration pipeline of the lytro camera for high quality light-field image reconstruction. Proc IEEE int conf comput vis, pp 3280–3287 Cho D, Lee M, Kim S, Tai YW (2013) Modeling the calibration pipeline of the lytro camera for high quality light-field image reconstruction. Proc IEEE int conf comput vis, pp 3280–3287
37.
go back to reference Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22:1330–1334CrossRef Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22:1330–1334CrossRef
38.
go back to reference Brown D (1966) Decentering distortion of lenses. Photogramm Eng 32:444–462 Brown D (1966) Decentering distortion of lenses. Photogramm Eng 32:444–462
39.
go back to reference Triggs B, McLauchlan PF, Hartley RI, Fitzgibbon AW (1999) Bundle adjustment—a modern synthesis. In: International workshop on vision algorithms. Springer, Berlin, Heidelberg, pp 298–372 Triggs B, McLauchlan PF, Hartley RI, Fitzgibbon AW (1999) Bundle adjustment—a modern synthesis. In: International workshop on vision algorithms. Springer, Berlin, Heidelberg, pp 298–372
40.
go back to reference Zhang Z (1999) Flexible camera calibration by viewing a plane from unknown orientations. Proc seventh IEEE int conf comput vis, vol 1, pp 666–673 Zhang Z (1999) Flexible camera calibration by viewing a plane from unknown orientations. Proc seventh IEEE int conf comput vis, vol 1, pp 666–673
41.
go back to reference Moré JJ (1978) The Levenberg-Marquardt algorithm: implementation and theory[M]//Numerical analysis. Springer, Berlin, Heidelberg, pp 105–116 Moré JJ (1978) The Levenberg-Marquardt algorithm: implementation and theory[M]//Numerical analysis. Springer, Berlin, Heidelberg, pp 105–116
42.
go back to reference Luo PF, Chen JN (2000) Measurement of curved-surface deformation in cylindrical coordinates. Exp Mech 40:345–350CrossRef Luo PF, Chen JN (2000) Measurement of curved-surface deformation in cylindrical coordinates. Exp Mech 40:345–350CrossRef
43.
go back to reference Szeliski R (2010) Computer vision: algorithms and applications. Computer (Long Beach Calif) 5:832 Szeliski R (2010) Computer vision: algorithms and applications. Computer (Long Beach Calif) 5:832
Metadata
Title
Full-Field Surface 3D Shape and Displacement Measurements Using an Unfocused Plenoptic Camera
Authors
B. Chen
B. Pan
Publication date
03-04-2018
Publisher
Springer US
Published in
Experimental Mechanics / Issue 5/2018
Print ISSN: 0014-4851
Electronic ISSN: 1741-2765
DOI
https://doi.org/10.1007/s11340-018-0383-6

Other articles of this Issue 5/2018

Experimental Mechanics 5/2018 Go to the issue

Premium Partners