Skip to main content
Erschienen in:
Buchtitelbild

2019 | OriginalPaper | Buchkapitel

Calibrating, Rendering and Evaluating the Head Mounted Light Field Display

verfasst von : Anne Juhler Hansen, Jákup Klein, Martin Kraus

Erschienen in: Computer Vision, Imaging and Computer Graphics – Theory and Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

There are several benefits of using a light field display over a traditional HMD; in particular the light field can avoid the vergence-accommodation conflict and can also correct for near- and farsightedness. By rendering only four corner cameras of a subimage array, then these four views can be interpolated in order to create all subimages of the light field. We implement the interpolation of the subimages in the light field with the use of pixel reprojection, while maintaining correct perspective and shading. We give an comprehensive explanation of the construction and calibration of a head mounted light field display, and finally we evaluate the image quality through image difference and conduct a user evaluation of the light field images in order to evaluate if users are able to perceive a difference in the light field images created with the full array of virtual cameras and our method using four cameras and pixel reprojection. In most cases the users were unable to distinguish the images, and we conclude that pixel reprojection is a feasible method for rendering light fields as far as quality is concerned.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hoffman, D.M., Girshick, A.R., Akeley, K., Banks, M.S.: Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. J. Vis. 8, 33 (2008)CrossRef Hoffman, D.M., Girshick, A.R., Akeley, K., Banks, M.S.: Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. J. Vis. 8, 33 (2008)CrossRef
2.
Zurück zum Zitat Hansen, A.J., Kraus, M., Klein, J.: Light field rendering for head mounted displays using pixel reprojection. In: International Conference on Computer Graphics Theory and Applications (2017) Hansen, A.J., Kraus, M., Klein, J.: Light field rendering for head mounted displays using pixel reprojection. In: International Conference on Computer Graphics Theory and Applications (2017)
3.
Zurück zum Zitat Charman, W.N.: The eye in focus: accommodation and presbyopia. Clin. Exp. Optom. 91, 207–225 (2008)CrossRef Charman, W.N.: The eye in focus: accommodation and presbyopia. Clin. Exp. Optom. 91, 207–225 (2008)CrossRef
4.
Zurück zum Zitat Suryakumar, R., Meyers, J.P., Irving, E.L., Bobier, W.R.: Vergence accommodation and monocular closed loop blur accommodation have similar dynamic characteristics. Vis. Res. 47, 327–337 (2007)CrossRef Suryakumar, R., Meyers, J.P., Irving, E.L., Bobier, W.R.: Vergence accommodation and monocular closed loop blur accommodation have similar dynamic characteristics. Vis. Res. 47, 327–337 (2007)CrossRef
5.
Zurück zum Zitat Schor, C.M., Alexander, J., Cormack, L., Stevenson, S.: Negative feedback control model of proximal convergence and accommodation. Ophthalmic Physiol. Opt. 12, 307–318 (1992)CrossRef Schor, C.M., Alexander, J., Cormack, L., Stevenson, S.: Negative feedback control model of proximal convergence and accommodation. Ophthalmic Physiol. Opt. 12, 307–318 (1992)CrossRef
6.
Zurück zum Zitat Shibata, T., Kim, J., Hoffman, D.M., Banks, M.S.: Visual discomfort with stereo displays: effects of viewing distance and direction of vergence-accommodation conflict. In: Stereoscopic Displays and Applications XXII, vol. 7863, p. 78630P. International Society for Optics and Photonics (2011) Shibata, T., Kim, J., Hoffman, D.M., Banks, M.S.: Visual discomfort with stereo displays: effects of viewing distance and direction of vergence-accommodation conflict. In: Stereoscopic Displays and Applications XXII, vol. 7863, p. 78630P. International Society for Optics and Photonics (2011)
7.
Zurück zum Zitat Kramida, G.: Resolving the vergence-accommodation conflict in head-mounted displays. IEEE Trans. Vis. Comput. Graph. 22, 1912–1931 (2016)CrossRef Kramida, G.: Resolving the vergence-accommodation conflict in head-mounted displays. IEEE Trans. Vis. Comput. Graph. 22, 1912–1931 (2016)CrossRef
8.
Zurück zum Zitat Lanman, D., Luebke, D.: Near-eye light field displays. ACM Trans. Graph. (TOG) 32, 220 (2013)CrossRef Lanman, D., Luebke, D.: Near-eye light field displays. ACM Trans. Graph. (TOG) 32, 220 (2013)CrossRef
9.
Zurück zum Zitat Adelson, E.: The plenoptic function and the elements of early vision, computational models of visual. In: Landy, M., Movshon, J.A. Processing, Chap. 1 (1991) Adelson, E.: The plenoptic function and the elements of early vision, computational models of visual. In: Landy, M., Movshon, J.A. Processing, Chap. 1 (1991)
10.
Zurück zum Zitat Levoy, M., Hanrahan, P.: Light field rendering. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, pp. 31–42. ACM (1996) Levoy, M., Hanrahan, P.: Light field rendering. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, pp. 31–42. ACM (1996)
11.
Zurück zum Zitat Wetzstein, G., Lanman, D., Hirsch, M., Raskar, R.: Tensor displays: compressive light field synthesis using multilayer displays with directional backlighting (2012)CrossRef Wetzstein, G., Lanman, D., Hirsch, M., Raskar, R.: Tensor displays: compressive light field synthesis using multilayer displays with directional backlighting (2012)CrossRef
12.
Zurück zum Zitat Hirsch, M., Wetzstein, G., Raskar, R.: A compressive light field projection system. ACM Trans. Graph. (TOG) 33, 58 (2014)CrossRef Hirsch, M., Wetzstein, G., Raskar, R.: A compressive light field projection system. ACM Trans. Graph. (TOG) 33, 58 (2014)CrossRef
13.
Zurück zum Zitat Jones, A., McDowall, I., Yamada, H., Bolas, M., Debevec, P.: Rendering for an interactive 360 light field display. ACM Trans. Graph. (TOG) 26, 40 (2007)CrossRef Jones, A., McDowall, I., Yamada, H., Bolas, M., Debevec, P.: Rendering for an interactive 360 light field display. ACM Trans. Graph. (TOG) 26, 40 (2007)CrossRef
14.
Zurück zum Zitat Huang, F.C., Chen, K., Wetzstein, G.: The light field stereoscope: immersive computer graphics via factored near-eye light field displays with focus cues. ACM Trans. Graph. (TOG) 34, 60 (2015) Huang, F.C., Chen, K., Wetzstein, G.: The light field stereoscope: immersive computer graphics via factored near-eye light field displays with focus cues. ACM Trans. Graph. (TOG) 34, 60 (2015)
15.
Zurück zum Zitat Rolland, J., Hua, H.: Head-mounted display systems. Encycl. Opt. Eng. 1, 1–13 (2005) Rolland, J., Hua, H.: Head-mounted display systems. Encycl. Opt. Eng. 1, 1–13 (2005)
16.
Zurück zum Zitat Lanman, D., Luebke, D.: Supplementary material: near-eye light field displays (2013) Lanman, D., Luebke, D.: Supplementary material: near-eye light field displays (2013)
17.
Zurück zum Zitat Shaoulov, V., Martins, R., Rolland, J.P.: Compact microlenslet-array-based magnifier. Opt. Lett. 29, 709–711 (2004)CrossRef Shaoulov, V., Martins, R., Rolland, J.P.: Compact microlenslet-array-based magnifier. Opt. Lett. 29, 709–711 (2004)CrossRef
18.
Zurück zum Zitat Wilburn, B.S., Smulski, M., Lee, H.H.K., Horowitz, M.A.: Light field video camera. In: Media Processors 2002, vol. 4674, pp. 29–37. International Society for Optics and Photonics (2001) Wilburn, B.S., Smulski, M., Lee, H.H.K., Horowitz, M.A.: Light field video camera. In: Media Processors 2002, vol. 4674, pp. 29–37. International Society for Optics and Photonics (2001)
19.
Zurück zum Zitat Schirmacher, H., Ming, L., Seidel, H.P.: On-the-fly processing of generalized lumigraphs. In: Computer Graphics Forum, vol. 20, pp. 165–174. Wiley Online Library (2001) Schirmacher, H., Ming, L., Seidel, H.P.: On-the-fly processing of generalized lumigraphs. In: Computer Graphics Forum, vol. 20, pp. 165–174. Wiley Online Library (2001)
20.
Zurück zum Zitat Zhang, C., Chen, T.: Light field capturing with lensless cameras. In: IEEE International Conference on Image Processing, ICIP 2005, vol. 3, p. III-792. IEEE (2005) Zhang, C., Chen, T.: Light field capturing with lensless cameras. In: IEEE International Conference on Image Processing, ICIP 2005, vol. 3, p. III-792. IEEE (2005)
21.
Zurück zum Zitat Ng, R., Levoy, M., Brédif, M., Duval, G., Horowitz, M., Hanrahan, P.: Light field photography with a hand-held plenoptic camera. Comput. Sci. Tech. Rep. CSTR 2, 1–11 (2005) Ng, R., Levoy, M., Brédif, M., Duval, G., Horowitz, M., Hanrahan, P.: Light field photography with a hand-held plenoptic camera. Comput. Sci. Tech. Rep. CSTR 2, 1–11 (2005)
22.
Zurück zum Zitat Georgiev, T., Zheng, K.C., Curless, B., Salesin, D., Nayar, S.K., Intwala, C.: Spatio-angular resolution tradeoffs in integral photography. Rendering Tech. 2006, 263–272 (2006) Georgiev, T., Zheng, K.C., Curless, B., Salesin, D., Nayar, S.K., Intwala, C.: Spatio-angular resolution tradeoffs in integral photography. Rendering Tech. 2006, 263–272 (2006)
23.
Zurück zum Zitat Naimark, M., Woodfill, J., Debevec, P., Villareal, L.: Immersion 94. Interval Research Corporation Image-Based Modeling and Rendering Project from Summer (1994) Naimark, M., Woodfill, J., Debevec, P., Villareal, L.: Immersion 94. Interval Research Corporation Image-Based Modeling and Rendering Project from Summer (1994)
24.
Zurück zum Zitat Davis, A., Levoy, M., Durand, F.: Unstructured light fields. In: Computer Graphics Forum, vol. 31, pp. 305–314. Wiley Online Library (2012) Davis, A., Levoy, M., Durand, F.: Unstructured light fields. In: Computer Graphics Forum, vol. 31, pp. 305–314. Wiley Online Library (2012)
25.
Zurück zum Zitat Ju Jeong, Y., Sung Chang, H., Ho Cho, Y., Nam, D., Jay Kuo, C.C.: 13.3: efficient direct light-field rendering for autostereoscopic 3D displays. In: SID Symposium Digest of Technical Papers, vol. 46, pp. 155–159. Wiley Online Library (2015)CrossRef Ju Jeong, Y., Sung Chang, H., Ho Cho, Y., Nam, D., Jay Kuo, C.C.: 13.3: efficient direct light-field rendering for autostereoscopic 3D displays. In: SID Symposium Digest of Technical Papers, vol. 46, pp. 155–159. Wiley Online Library (2015)CrossRef
26.
Zurück zum Zitat Gupta, K., Kazi, S., Kong, T.: Dynamic this is a test eye gaze tracking for foveated rendering and retinal blur (2015) Gupta, K., Kazi, S., Kong, T.: Dynamic this is a test eye gaze tracking for foveated rendering and retinal blur (2015)
27.
Zurück zum Zitat Guenter, B., Finch, M., Drucker, S., Tan, D., Snyder, J.: Foveated 3D graphics. ACM Trans. Graph. (TOG) 31, 164 (2012)CrossRef Guenter, B., Finch, M., Drucker, S., Tan, D., Snyder, J.: Foveated 3D graphics. ACM Trans. Graph. (TOG) 31, 164 (2012)CrossRef
28.
Zurück zum Zitat Nehab, D., Sander, P.V., Lawrence, J., Tatarchuk, N., Isidoro, J.R.: Accelerating real-time shading with reverse reprojection caching. Graph. Hardw. 41, 61–62 (2007) Nehab, D., Sander, P.V., Lawrence, J., Tatarchuk, N., Isidoro, J.R.: Accelerating real-time shading with reverse reprojection caching. Graph. Hardw. 41, 61–62 (2007)
29.
Zurück zum Zitat Havran, V., Damez, C., Myszkowski, K., Seidel, H.P.: An efficient spatio-temporal architecture for animation rendering. In: ACM SIGGRAPH 2003 Sketches and Applications, p. 1. ACM (2003) Havran, V., Damez, C., Myszkowski, K., Seidel, H.P.: An efficient spatio-temporal architecture for animation rendering. In: ACM SIGGRAPH 2003 Sketches and Applications, p. 1. ACM (2003)
30.
Zurück zum Zitat Adelson, S.J., Hodges, L.F.: Generating exact ray-traced animation frames by reprojection. IEEE Comput. Graph. Appl. 15, 43–52 (1995)CrossRef Adelson, S.J., Hodges, L.F.: Generating exact ray-traced animation frames by reprojection. IEEE Comput. Graph. Appl. 15, 43–52 (1995)CrossRef
31.
Zurück zum Zitat Tawara, T., Myszkowski, K., Seidel, H.P.: Exploiting temporal coherence in final gathering for dynamic scenes. In: Proceedings of the Computer Graphics International, pp. 110–119. IEEE (2004) Tawara, T., Myszkowski, K., Seidel, H.P.: Exploiting temporal coherence in final gathering for dynamic scenes. In: Proceedings of the Computer Graphics International, pp. 110–119. IEEE (2004)
32.
Zurück zum Zitat Sitthi-amorn, P., Lawrence, J., Yang, L., Sander, P.V., Nehab, D., Xi, J.: Automated reprojection-based pixel shader optimization. ACM Trans. Graph. (TOG) 27, 127 (2008)CrossRef Sitthi-amorn, P., Lawrence, J., Yang, L., Sander, P.V., Nehab, D., Xi, J.: Automated reprojection-based pixel shader optimization. ACM Trans. Graph. (TOG) 27, 127 (2008)CrossRef
33.
Zurück zum Zitat Kang, S.B.: Geometrically valid pixel reprojection methods for novel view synthesis. ISPRS J. Photogramm. Remote Sens. 53, 342–353 (1998)CrossRef Kang, S.B.: Geometrically valid pixel reprojection methods for novel view synthesis. ISPRS J. Photogramm. Remote Sens. 53, 342–353 (1998)CrossRef
35.
Zurück zum Zitat Cunningham, D.W., Wallraven, C.: Experimental Design: From User Studies to Psychophysics. CRC Press, Boca Raton (2011)CrossRef Cunningham, D.W., Wallraven, C.: Experimental Design: From User Studies to Psychophysics. CRC Press, Boca Raton (2011)CrossRef
36.
Zurück zum Zitat McKee, S.P., Klein, S.A., Teller, D.Y.: Statistical properties of forced-choice psychometric functions: implications of probit analysis. Percept. Psychophys. 37, 286–298 (1985)CrossRef McKee, S.P., Klein, S.A., Teller, D.Y.: Statistical properties of forced-choice psychometric functions: implications of probit analysis. Percept. Psychophys. 37, 286–298 (1985)CrossRef
37.
Zurück zum Zitat Borg, M., Johansen, S.S., Krog, K.S., Thomsen, D.L., Kraus, M.: Using a graphics turing test to evaluate the effect of frame rate and motion blur on telepresence of animated objects. In: GRAPP/IVAPP, pp. 283–287 (2013) Borg, M., Johansen, S.S., Krog, K.S., Thomsen, D.L., Kraus, M.: Using a graphics turing test to evaluate the effect of frame rate and motion blur on telepresence of animated objects. In: GRAPP/IVAPP, pp. 283–287 (2013)
Metadaten
Titel
Calibrating, Rendering and Evaluating the Head Mounted Light Field Display
verfasst von
Anne Juhler Hansen
Jákup Klein
Martin Kraus
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-12209-6_1