Skip to main content
Top
Published in:
Cover of the book

2019 | OriginalPaper | Chapter

Calibrating, Rendering and Evaluating the Head Mounted Light Field Display

Authors : Anne Juhler Hansen, Jákup Klein, Martin Kraus

Published in: Computer Vision, Imaging and Computer Graphics – Theory and Applications

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

There are several benefits of using a light field display over a traditional HMD; in particular the light field can avoid the vergence-accommodation conflict and can also correct for near- and farsightedness. By rendering only four corner cameras of a subimage array, then these four views can be interpolated in order to create all subimages of the light field. We implement the interpolation of the subimages in the light field with the use of pixel reprojection, while maintaining correct perspective and shading. We give an comprehensive explanation of the construction and calibration of a head mounted light field display, and finally we evaluate the image quality through image difference and conduct a user evaluation of the light field images in order to evaluate if users are able to perceive a difference in the light field images created with the full array of virtual cameras and our method using four cameras and pixel reprojection. In most cases the users were unable to distinguish the images, and we conclude that pixel reprojection is a feasible method for rendering light fields as far as quality is concerned.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Hoffman, D.M., Girshick, A.R., Akeley, K., Banks, M.S.: Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. J. Vis. 8, 33 (2008)CrossRef Hoffman, D.M., Girshick, A.R., Akeley, K., Banks, M.S.: Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. J. Vis. 8, 33 (2008)CrossRef
2.
go back to reference Hansen, A.J., Kraus, M., Klein, J.: Light field rendering for head mounted displays using pixel reprojection. In: International Conference on Computer Graphics Theory and Applications (2017) Hansen, A.J., Kraus, M., Klein, J.: Light field rendering for head mounted displays using pixel reprojection. In: International Conference on Computer Graphics Theory and Applications (2017)
3.
go back to reference Charman, W.N.: The eye in focus: accommodation and presbyopia. Clin. Exp. Optom. 91, 207–225 (2008)CrossRef Charman, W.N.: The eye in focus: accommodation and presbyopia. Clin. Exp. Optom. 91, 207–225 (2008)CrossRef
4.
go back to reference Suryakumar, R., Meyers, J.P., Irving, E.L., Bobier, W.R.: Vergence accommodation and monocular closed loop blur accommodation have similar dynamic characteristics. Vis. Res. 47, 327–337 (2007)CrossRef Suryakumar, R., Meyers, J.P., Irving, E.L., Bobier, W.R.: Vergence accommodation and monocular closed loop blur accommodation have similar dynamic characteristics. Vis. Res. 47, 327–337 (2007)CrossRef
5.
go back to reference Schor, C.M., Alexander, J., Cormack, L., Stevenson, S.: Negative feedback control model of proximal convergence and accommodation. Ophthalmic Physiol. Opt. 12, 307–318 (1992)CrossRef Schor, C.M., Alexander, J., Cormack, L., Stevenson, S.: Negative feedback control model of proximal convergence and accommodation. Ophthalmic Physiol. Opt. 12, 307–318 (1992)CrossRef
6.
go back to reference Shibata, T., Kim, J., Hoffman, D.M., Banks, M.S.: Visual discomfort with stereo displays: effects of viewing distance and direction of vergence-accommodation conflict. In: Stereoscopic Displays and Applications XXII, vol. 7863, p. 78630P. International Society for Optics and Photonics (2011) Shibata, T., Kim, J., Hoffman, D.M., Banks, M.S.: Visual discomfort with stereo displays: effects of viewing distance and direction of vergence-accommodation conflict. In: Stereoscopic Displays and Applications XXII, vol. 7863, p. 78630P. International Society for Optics and Photonics (2011)
7.
go back to reference Kramida, G.: Resolving the vergence-accommodation conflict in head-mounted displays. IEEE Trans. Vis. Comput. Graph. 22, 1912–1931 (2016)CrossRef Kramida, G.: Resolving the vergence-accommodation conflict in head-mounted displays. IEEE Trans. Vis. Comput. Graph. 22, 1912–1931 (2016)CrossRef
8.
go back to reference Lanman, D., Luebke, D.: Near-eye light field displays. ACM Trans. Graph. (TOG) 32, 220 (2013)CrossRef Lanman, D., Luebke, D.: Near-eye light field displays. ACM Trans. Graph. (TOG) 32, 220 (2013)CrossRef
9.
go back to reference Adelson, E.: The plenoptic function and the elements of early vision, computational models of visual. In: Landy, M., Movshon, J.A. Processing, Chap. 1 (1991) Adelson, E.: The plenoptic function and the elements of early vision, computational models of visual. In: Landy, M., Movshon, J.A. Processing, Chap. 1 (1991)
10.
go back to reference Levoy, M., Hanrahan, P.: Light field rendering. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, pp. 31–42. ACM (1996) Levoy, M., Hanrahan, P.: Light field rendering. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, pp. 31–42. ACM (1996)
11.
go back to reference Wetzstein, G., Lanman, D., Hirsch, M., Raskar, R.: Tensor displays: compressive light field synthesis using multilayer displays with directional backlighting (2012)CrossRef Wetzstein, G., Lanman, D., Hirsch, M., Raskar, R.: Tensor displays: compressive light field synthesis using multilayer displays with directional backlighting (2012)CrossRef
12.
go back to reference Hirsch, M., Wetzstein, G., Raskar, R.: A compressive light field projection system. ACM Trans. Graph. (TOG) 33, 58 (2014)CrossRef Hirsch, M., Wetzstein, G., Raskar, R.: A compressive light field projection system. ACM Trans. Graph. (TOG) 33, 58 (2014)CrossRef
13.
go back to reference Jones, A., McDowall, I., Yamada, H., Bolas, M., Debevec, P.: Rendering for an interactive 360 light field display. ACM Trans. Graph. (TOG) 26, 40 (2007)CrossRef Jones, A., McDowall, I., Yamada, H., Bolas, M., Debevec, P.: Rendering for an interactive 360 light field display. ACM Trans. Graph. (TOG) 26, 40 (2007)CrossRef
14.
go back to reference Huang, F.C., Chen, K., Wetzstein, G.: The light field stereoscope: immersive computer graphics via factored near-eye light field displays with focus cues. ACM Trans. Graph. (TOG) 34, 60 (2015) Huang, F.C., Chen, K., Wetzstein, G.: The light field stereoscope: immersive computer graphics via factored near-eye light field displays with focus cues. ACM Trans. Graph. (TOG) 34, 60 (2015)
15.
go back to reference Rolland, J., Hua, H.: Head-mounted display systems. Encycl. Opt. Eng. 1, 1–13 (2005) Rolland, J., Hua, H.: Head-mounted display systems. Encycl. Opt. Eng. 1, 1–13 (2005)
16.
go back to reference Lanman, D., Luebke, D.: Supplementary material: near-eye light field displays (2013) Lanman, D., Luebke, D.: Supplementary material: near-eye light field displays (2013)
17.
go back to reference Shaoulov, V., Martins, R., Rolland, J.P.: Compact microlenslet-array-based magnifier. Opt. Lett. 29, 709–711 (2004)CrossRef Shaoulov, V., Martins, R., Rolland, J.P.: Compact microlenslet-array-based magnifier. Opt. Lett. 29, 709–711 (2004)CrossRef
18.
go back to reference Wilburn, B.S., Smulski, M., Lee, H.H.K., Horowitz, M.A.: Light field video camera. In: Media Processors 2002, vol. 4674, pp. 29–37. International Society for Optics and Photonics (2001) Wilburn, B.S., Smulski, M., Lee, H.H.K., Horowitz, M.A.: Light field video camera. In: Media Processors 2002, vol. 4674, pp. 29–37. International Society for Optics and Photonics (2001)
19.
go back to reference Schirmacher, H., Ming, L., Seidel, H.P.: On-the-fly processing of generalized lumigraphs. In: Computer Graphics Forum, vol. 20, pp. 165–174. Wiley Online Library (2001) Schirmacher, H., Ming, L., Seidel, H.P.: On-the-fly processing of generalized lumigraphs. In: Computer Graphics Forum, vol. 20, pp. 165–174. Wiley Online Library (2001)
20.
go back to reference Zhang, C., Chen, T.: Light field capturing with lensless cameras. In: IEEE International Conference on Image Processing, ICIP 2005, vol. 3, p. III-792. IEEE (2005) Zhang, C., Chen, T.: Light field capturing with lensless cameras. In: IEEE International Conference on Image Processing, ICIP 2005, vol. 3, p. III-792. IEEE (2005)
21.
go back to reference Ng, R., Levoy, M., Brédif, M., Duval, G., Horowitz, M., Hanrahan, P.: Light field photography with a hand-held plenoptic camera. Comput. Sci. Tech. Rep. CSTR 2, 1–11 (2005) Ng, R., Levoy, M., Brédif, M., Duval, G., Horowitz, M., Hanrahan, P.: Light field photography with a hand-held plenoptic camera. Comput. Sci. Tech. Rep. CSTR 2, 1–11 (2005)
22.
go back to reference Georgiev, T., Zheng, K.C., Curless, B., Salesin, D., Nayar, S.K., Intwala, C.: Spatio-angular resolution tradeoffs in integral photography. Rendering Tech. 2006, 263–272 (2006) Georgiev, T., Zheng, K.C., Curless, B., Salesin, D., Nayar, S.K., Intwala, C.: Spatio-angular resolution tradeoffs in integral photography. Rendering Tech. 2006, 263–272 (2006)
23.
go back to reference Naimark, M., Woodfill, J., Debevec, P., Villareal, L.: Immersion 94. Interval Research Corporation Image-Based Modeling and Rendering Project from Summer (1994) Naimark, M., Woodfill, J., Debevec, P., Villareal, L.: Immersion 94. Interval Research Corporation Image-Based Modeling and Rendering Project from Summer (1994)
24.
go back to reference Davis, A., Levoy, M., Durand, F.: Unstructured light fields. In: Computer Graphics Forum, vol. 31, pp. 305–314. Wiley Online Library (2012) Davis, A., Levoy, M., Durand, F.: Unstructured light fields. In: Computer Graphics Forum, vol. 31, pp. 305–314. Wiley Online Library (2012)
25.
go back to reference Ju Jeong, Y., Sung Chang, H., Ho Cho, Y., Nam, D., Jay Kuo, C.C.: 13.3: efficient direct light-field rendering for autostereoscopic 3D displays. In: SID Symposium Digest of Technical Papers, vol. 46, pp. 155–159. Wiley Online Library (2015)CrossRef Ju Jeong, Y., Sung Chang, H., Ho Cho, Y., Nam, D., Jay Kuo, C.C.: 13.3: efficient direct light-field rendering for autostereoscopic 3D displays. In: SID Symposium Digest of Technical Papers, vol. 46, pp. 155–159. Wiley Online Library (2015)CrossRef
26.
go back to reference Gupta, K., Kazi, S., Kong, T.: Dynamic this is a test eye gaze tracking for foveated rendering and retinal blur (2015) Gupta, K., Kazi, S., Kong, T.: Dynamic this is a test eye gaze tracking for foveated rendering and retinal blur (2015)
27.
go back to reference Guenter, B., Finch, M., Drucker, S., Tan, D., Snyder, J.: Foveated 3D graphics. ACM Trans. Graph. (TOG) 31, 164 (2012)CrossRef Guenter, B., Finch, M., Drucker, S., Tan, D., Snyder, J.: Foveated 3D graphics. ACM Trans. Graph. (TOG) 31, 164 (2012)CrossRef
28.
go back to reference Nehab, D., Sander, P.V., Lawrence, J., Tatarchuk, N., Isidoro, J.R.: Accelerating real-time shading with reverse reprojection caching. Graph. Hardw. 41, 61–62 (2007) Nehab, D., Sander, P.V., Lawrence, J., Tatarchuk, N., Isidoro, J.R.: Accelerating real-time shading with reverse reprojection caching. Graph. Hardw. 41, 61–62 (2007)
29.
go back to reference Havran, V., Damez, C., Myszkowski, K., Seidel, H.P.: An efficient spatio-temporal architecture for animation rendering. In: ACM SIGGRAPH 2003 Sketches and Applications, p. 1. ACM (2003) Havran, V., Damez, C., Myszkowski, K., Seidel, H.P.: An efficient spatio-temporal architecture for animation rendering. In: ACM SIGGRAPH 2003 Sketches and Applications, p. 1. ACM (2003)
30.
go back to reference Adelson, S.J., Hodges, L.F.: Generating exact ray-traced animation frames by reprojection. IEEE Comput. Graph. Appl. 15, 43–52 (1995)CrossRef Adelson, S.J., Hodges, L.F.: Generating exact ray-traced animation frames by reprojection. IEEE Comput. Graph. Appl. 15, 43–52 (1995)CrossRef
31.
go back to reference Tawara, T., Myszkowski, K., Seidel, H.P.: Exploiting temporal coherence in final gathering for dynamic scenes. In: Proceedings of the Computer Graphics International, pp. 110–119. IEEE (2004) Tawara, T., Myszkowski, K., Seidel, H.P.: Exploiting temporal coherence in final gathering for dynamic scenes. In: Proceedings of the Computer Graphics International, pp. 110–119. IEEE (2004)
32.
go back to reference Sitthi-amorn, P., Lawrence, J., Yang, L., Sander, P.V., Nehab, D., Xi, J.: Automated reprojection-based pixel shader optimization. ACM Trans. Graph. (TOG) 27, 127 (2008)CrossRef Sitthi-amorn, P., Lawrence, J., Yang, L., Sander, P.V., Nehab, D., Xi, J.: Automated reprojection-based pixel shader optimization. ACM Trans. Graph. (TOG) 27, 127 (2008)CrossRef
33.
go back to reference Kang, S.B.: Geometrically valid pixel reprojection methods for novel view synthesis. ISPRS J. Photogramm. Remote Sens. 53, 342–353 (1998)CrossRef Kang, S.B.: Geometrically valid pixel reprojection methods for novel view synthesis. ISPRS J. Photogramm. Remote Sens. 53, 342–353 (1998)CrossRef
35.
go back to reference Cunningham, D.W., Wallraven, C.: Experimental Design: From User Studies to Psychophysics. CRC Press, Boca Raton (2011)CrossRef Cunningham, D.W., Wallraven, C.: Experimental Design: From User Studies to Psychophysics. CRC Press, Boca Raton (2011)CrossRef
36.
go back to reference McKee, S.P., Klein, S.A., Teller, D.Y.: Statistical properties of forced-choice psychometric functions: implications of probit analysis. Percept. Psychophys. 37, 286–298 (1985)CrossRef McKee, S.P., Klein, S.A., Teller, D.Y.: Statistical properties of forced-choice psychometric functions: implications of probit analysis. Percept. Psychophys. 37, 286–298 (1985)CrossRef
37.
go back to reference Borg, M., Johansen, S.S., Krog, K.S., Thomsen, D.L., Kraus, M.: Using a graphics turing test to evaluate the effect of frame rate and motion blur on telepresence of animated objects. In: GRAPP/IVAPP, pp. 283–287 (2013) Borg, M., Johansen, S.S., Krog, K.S., Thomsen, D.L., Kraus, M.: Using a graphics turing test to evaluate the effect of frame rate and motion blur on telepresence of animated objects. In: GRAPP/IVAPP, pp. 283–287 (2013)
Metadata
Title
Calibrating, Rendering and Evaluating the Head Mounted Light Field Display
Authors
Anne Juhler Hansen
Jákup Klein
Martin Kraus
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-12209-6_1

Premium Partner