Skip to main content
Top

2016 | OriginalPaper | Chapter

Foveated Path Tracing

A Literature Review and a Performance Gain Analysis

Authors : Matias Koskela, Timo Viitanen, Pekka Jääskeläinen, Jarmo Takala

Published in: Advances in Visual Computing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Virtual Reality (VR) places demanding requirements on the rendering pipeline: the rendering is stereoscopic and the refresh rate should be as high as 95 Hz to make VR immersive. One promising technique for making the final push to meet these requirements is foveated rendering, where the rendering effort is prioritized on the areas where the user’s gaze lies. This requires rapid adjustment of level of detail based on screen space coordinates. Path tracing allows this kind of changes without much extra work. However, real-time path tracing is fairly new concept. This paper is a literature review of techniques related to optimizing path tracing with foveated rendering. In addition, we provide a theoretical estimation of performance gains available and calculate that 94% of the paths could be omitted. For this reason we predict that path tracing can soon meet the demanding rendering requirements of VR.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Abrash, M.: What VR could, should, and almost certainly will be within two years Steam Dev Days, Seattle (2014) Abrash, M.: What VR could, should, and almost certainly will be within two years Steam Dev Days, Seattle (2014)
2.
go back to reference Wald, I., Benthin, C., Boulos, S.: Getting rid of packets - efficient SIMD single-ray traversal using multi-branching BVHs. In: Proceedings of the IEEE Symposium on Interactive Ray Tracing (2008) Wald, I., Benthin, C., Boulos, S.: Getting rid of packets - efficient SIMD single-ray traversal using multi-branching BVHs. In: Proceedings of the IEEE Symposium on Interactive Ray Tracing (2008)
3.
go back to reference Laine, S., Karras, T., Aila, T.: Megakernels considered harmful: wavefront path tracing on GPUs. In: Proceedings of the High-Performance Graphics (2013) Laine, S., Karras, T., Aila, T.: Megakernels considered harmful: wavefront path tracing on GPUs. In: Proceedings of the High-Performance Graphics (2013)
4.
go back to reference Garanzha, K., Premože, S., Bely, A., Galaktionov, V.: Grid-based SAH BVH construction on a GPU. Vis. Comput. 27(6–8), 697–706 (2011)CrossRef Garanzha, K., Premože, S., Bely, A., Galaktionov, V.: Grid-based SAH BVH construction on a GPU. Vis. Comput. 27(6–8), 697–706 (2011)CrossRef
5.
go back to reference Pantaleoni, J., Luebke, D.: HLBVH: hierarchical LBVH construction for real-time ray tracing of dynamic geometry. In: Proceedings of the High-Performance Graphics (2010) Pantaleoni, J., Luebke, D.: HLBVH: hierarchical LBVH construction for real-time ray tracing of dynamic geometry. In: Proceedings of the High-Performance Graphics (2010)
6.
go back to reference Karras, T.: Maximizing parallelism in the construction of BVHs, octrees, and k-d trees. In: Proceedings of the High-Performance Graphics (2012) Karras, T.: Maximizing parallelism in the construction of BVHs, octrees, and k-d trees. In: Proceedings of the High-Performance Graphics (2012)
7.
go back to reference Keely, S.: Reduced precision hardware for ray tracing. In: Proceedings of the High-Performance Graphics (2014) Keely, S.: Reduced precision hardware for ray tracing. In: Proceedings of the High-Performance Graphics (2014)
8.
go back to reference Wald, I., Woop, S., Benthin, C., Johnson, G.S., Ernst, M.: Embree: a kernel framework for efficient CPU ray tracing. ACM Trans. Graph. 33(4), 143 (2014)CrossRef Wald, I., Woop, S., Benthin, C., Johnson, G.S., Ernst, M.: Embree: a kernel framework for efficient CPU ray tracing. ACM Trans. Graph. 33(4), 143 (2014)CrossRef
9.
go back to reference Parker, S.G., Bigler, J., Dietrich, A., Friedrich, H., Hoberock, J., Luebke, D., McAllister, D., McGuire, M., Morley, K., Robison, A., et al.: Optix: a general purpose ray tracing engine. ACM Trans. Graph. 29(4), 66 (2010)CrossRef Parker, S.G., Bigler, J., Dietrich, A., Friedrich, H., Hoberock, J., Luebke, D., McAllister, D., McGuire, M., Morley, K., Robison, A., et al.: Optix: a general purpose ray tracing engine. ACM Trans. Graph. 29(4), 66 (2010)CrossRef
12.
go back to reference Zwicker, M., Jarosz, W., Lehtinen, J., Moon, B., Ramamoorthi, R., Rousselle, F., Sen, P., Soler, C., Yoon, S.E.: Recent advances in adaptive sampling and reconstruction for monte carlo rendering. Comput. Graph. Forum 34(2), 667–681 (2015)CrossRef Zwicker, M., Jarosz, W., Lehtinen, J., Moon, B., Ramamoorthi, R., Rousselle, F., Sen, P., Soler, C., Yoon, S.E.: Recent advances in adaptive sampling and reconstruction for monte carlo rendering. Comput. Graph. Forum 34(2), 667–681 (2015)CrossRef
13.
go back to reference Deering, M.F.: A photon accurate model of the human eye. In: ACM SIGGRAPH Papers (2005) Deering, M.F.: A photon accurate model of the human eye. In: ACM SIGGRAPH Papers (2005)
14.
go back to reference Wandell, B.A.: Foundations of Vision. Sinauer Associates (1995) Wandell, B.A.: Foundations of Vision. Sinauer Associates (1995)
15.
go back to reference Reddy, M.: Perceptually optimized 3D graphics. IEEE Comput. Graph. Appl. 21(5), 68–75 (2001)CrossRef Reddy, M.: Perceptually optimized 3D graphics. IEEE Comput. Graph. Appl. 21(5), 68–75 (2001)CrossRef
16.
go back to reference Bowman, D.A., Kruijff, E., LaViola Jr., J.J., Poupyrev, I.: 3D User Interfaces: Theory and Practice. Addison-Wesley, New York (2004) Bowman, D.A., Kruijff, E., LaViola Jr., J.J., Poupyrev, I.: 3D User Interfaces: Theory and Practice. Addison-Wesley, New York (2004)
17.
go back to reference Benko, H., Ofek, E., Zheng, F., Wilson, A.D.: Fovear: combining an optically see-through near-eye display with projector-based spatial augmented reality. In: Proceedings of the ACM Symposium on User Interface Software and Technology (2015) Benko, H., Ofek, E., Zheng, F., Wilson, A.D.: Fovear: combining an optically see-through near-eye display with projector-based spatial augmented reality. In: Proceedings of the ACM Symposium on User Interface Software and Technology (2015)
18.
go back to reference Hua, H.: Integration of eye tracking capability into optical see-through head-mounted displays. In: Proceedings of SPIE (2001) Hua, H.: Integration of eye tracking capability into optical see-through head-mounted displays. In: Proceedings of SPIE (2001)
19.
go back to reference Stengel, M., Grogorick, S., Eisemann, M., Eisemann, E., Magnor, M.A.: An affordable solution for binocular eye tracking and calibration in head-mounted displays. In: Proceedings of the ACM International Conference on Multimedia (2015) Stengel, M., Grogorick, S., Eisemann, M., Eisemann, E., Magnor, M.A.: An affordable solution for binocular eye tracking and calibration in head-mounted displays. In: Proceedings of the ACM International Conference on Multimedia (2015)
20.
go back to reference Salvucci, D.D., Goldberg, J.H.: Identifying fixations and saccades in eye-tracking protocols. In: Proceedings of the Eye Tracking Research and Applications (2000) Salvucci, D.D., Goldberg, J.H.: Identifying fixations and saccades in eye-tracking protocols. In: Proceedings of the Eye Tracking Research and Applications (2000)
21.
go back to reference Ohshima, T., Yamamoto, H., Tamura, H.: Gaze-directed adaptive rendering for interacting with virtual space. In: Proceedings of the VR Annual International Symposium (1996) Ohshima, T., Yamamoto, H., Tamura, H.: Gaze-directed adaptive rendering for interacting with virtual space. In: Proceedings of the VR Annual International Symposium (1996)
22.
go back to reference Shic, F., Scassellati, B., Chawarska, K.: The incomplete fixation measure. In: Proceedings of the 2008 Symposium on Eye Tracking Research and Applications (2008) Shic, F., Scassellati, B., Chawarska, K.: The incomplete fixation measure. In: Proceedings of the 2008 Symposium on Eye Tracking Research and Applications (2008)
23.
go back to reference Ji, Q., Yang, X.: Real time visual cues extraction for monitoring driver vigilance. In: Schiele, B., Sagerer, Gerhard (eds.) ICVS 2001. LNCS, vol. 2095, pp. 107–124. Springer, Heidelberg (2001). doi:10.1007/3-540-48222-9_8 CrossRef Ji, Q., Yang, X.: Real time visual cues extraction for monitoring driver vigilance. In: Schiele, B., Sagerer, Gerhard (eds.) ICVS 2001. LNCS, vol. 2095, pp. 107–124. Springer, Heidelberg (2001). doi:10.​1007/​3-540-48222-9_​8 CrossRef
24.
go back to reference Murphy, H.A., Duchowski, A.T., Tyrrell, R.A.: Hybrid image/model-based gaze-contingent rendering. ACM Trans. Appl. Percept. 5(4), 22 (2009)CrossRef Murphy, H.A., Duchowski, A.T., Tyrrell, R.A.: Hybrid image/model-based gaze-contingent rendering. ACM Trans. Appl. Percept. 5(4), 22 (2009)CrossRef
25.
go back to reference Siekawa, A., Mantiuk, S.R.: Gaze-dependent ray tracing. In: Proceedings of Central European Seminar on Computer Graphics (non-peer-reviewed) (2014) Siekawa, A., Mantiuk, S.R.: Gaze-dependent ray tracing. In: Proceedings of Central European Seminar on Computer Graphics (non-peer-reviewed) (2014)
27.
go back to reference Guenter, B., Finch, M., Drucker, S., Tan, D., Snyder, J.: Foveated 3D graphics. ACM Trans. Graph. 31(6), 164 (2012)CrossRef Guenter, B., Finch, M., Drucker, S., Tan, D., Snyder, J.: Foveated 3D graphics. ACM Trans. Graph. 31(6), 164 (2012)CrossRef
28.
go back to reference Zhang, X., Chen, W., Yang, Z., Zhu, C., Peng, Q.: A new foveation ray casting approach for real-time rendering of 3D scenes. In: Proceedings of the Computer-Aided Design and Computer Graphics (2011) Zhang, X., Chen, W., Yang, Z., Zhu, C., Peng, Q.: A new foveation ray casting approach for real-time rendering of 3D scenes. In: Proceedings of the Computer-Aided Design and Computer Graphics (2011)
29.
go back to reference Fujita, M., Harada, T.: Foveated real-time ray tracing for virtual reality headset. Technical report, Light Transport Entertainment Research (2014) Fujita, M., Harada, T.: Foveated real-time ray tracing for virtual reality headset. Technical report, Light Transport Entertainment Research (2014)
30.
go back to reference Swafford, N.T., Iglesias-Guitian, J.A., Koniaris, C., Moon, B., Cosker, D., Mitchell, K.: User, metric, and computational evaluation of foveated rendering methods. In: Proceedings of the ACM Symposium on Applied Perception (2016) Swafford, N.T., Iglesias-Guitian, J.A., Koniaris, C., Moon, B., Cosker, D., Mitchell, K.: User, metric, and computational evaluation of foveated rendering methods. In: Proceedings of the ACM Symposium on Applied Perception (2016)
31.
go back to reference Luebke, D., Hallen, B.: Perceptually driven simplification for interactive rendering. In: Proceedings of the Eurographics Workshop (2001) Luebke, D., Hallen, B.: Perceptually driven simplification for interactive rendering. In: Proceedings of the Eurographics Workshop (2001)
32.
go back to reference Vlochos, A.: Advanced VR rendering Game Developers Conference, San Francisco (2015) Vlochos, A.: Advanced VR rendering Game Developers Conference, San Francisco (2015)
33.
go back to reference Sen, P., Darabi, S.: Implementation of random parameter filtering. Technical report (2011) Sen, P., Darabi, S.: Implementation of random parameter filtering. Technical report (2011)
34.
go back to reference Lee, W.J., Shin, Y., Lee, J., Kim, J.W., Nah, J.H., Jung, S., Lee, S., Park, H.S., Han, T.D.: SGRT: A mobile GPU architecture for real-time ray tracing. In: Proceedings of the High-Performance Graphics (2013) Lee, W.J., Shin, Y., Lee, J., Kim, J.W., Nah, J.H., Jung, S., Lee, S., Park, H.S., Han, T.D.: SGRT: A mobile GPU architecture for real-time ray tracing. In: Proceedings of the High-Performance Graphics (2013)
35.
go back to reference Aila, T., Laine, S., Karras, T.: Understanding the efficiency of ray traversal on GPUs-Kepler and Fermi addendum. Technical report, NVIDIA Corporation (2012) Aila, T., Laine, S., Karras, T.: Understanding the efficiency of ray traversal on GPUs-Kepler and Fermi addendum. Technical report, NVIDIA Corporation (2012)
36.
go back to reference Pohl, D., Johnson, G.S., Bolkart, T.: Improved pre-warping for wide angle, head mounted displays. In: Proceedings of the ACM Symposium on VR Software and Technology (2013) Pohl, D., Johnson, G.S., Bolkart, T.: Improved pre-warping for wide angle, head mounted displays. In: Proceedings of the ACM Symposium on VR Software and Technology (2013)
Metadata
Title
Foveated Path Tracing
Authors
Matias Koskela
Timo Viitanen
Pekka Jääskeläinen
Jarmo Takala
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-50835-1_65

Premium Partner