Skip to main content
Top

2016 | OriginalPaper | Chapter

Creating Feasible Reflectance Data for Synthetic Optical Flow Datasets

Authors : Burkhard Güssefeld, Katrin Honauer, Daniel Kondermann

Published in: Advances in Visual Computing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Optical flow ground truth generated by computer graphics has many advantages. For example, we can systematically vary scene parameters to understand algorithm sensitivities. But is synthetic ground truth realistic enough? Appropriate material models have been established as one of the major challenges for the creation of synthetic datasets: previous research has shown that highly sophisticated reflectance field acquisition methods yield results, which various optical flow methods cannot distinguish from real scenes. However, such methods are costly both in acquisition and rendering time and thus infeasible for large datasets. In this paper we find the simplest reflectance models (RM) for different groups of materials which still provide sufficient accuracy for optical flow performance analysis. It turns out that a spatially varying Phong RM is sufficient for simple materials. Normal estimation combined with Anisotropic RM can handle even very complex materials.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? The kitti vision benchmark suite. In: Conference on Computer Vision and Pattern Recognition (CVPR) (2012) Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? The kitti vision benchmark suite. In: Conference on Computer Vision and Pattern Recognition (CVPR) (2012)
2.
go back to reference Kondermann, D., Nair, R., Meister, S., Mischler, W., Güssefeld, B., Honauer, K., Hofmann, S., Brenner, C., Jähne, B.: Stereo ground truth with error bars. In: Cremers, D., Reid, I., Saito, H., Yang, M.-H. (eds.) ACCV 2014. LNCS, vol. 9007, pp. 595–610. Springer, Heidelberg (2015). doi:10.1007/978-3-319-16814-2_39 Kondermann, D., Nair, R., Meister, S., Mischler, W., Güssefeld, B., Honauer, K., Hofmann, S., Brenner, C., Jähne, B.: Stereo ground truth with error bars. In: Cremers, D., Reid, I., Saito, H., Yang, M.-H. (eds.) ACCV 2014. LNCS, vol. 9007, pp. 595–610. Springer, Heidelberg (2015). doi:10.​1007/​978-3-319-16814-2_​39
3.
go back to reference Butler, D.J., Wulff, J., Stanley, G.B., Black, M.J.: A naturalistic open source movie for optical flow evaluation. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7577, pp. 611–625. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33783-3_44 CrossRef Butler, D.J., Wulff, J., Stanley, G.B., Black, M.J.: A naturalistic open source movie for optical flow evaluation. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7577, pp. 611–625. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-33783-3_​44 CrossRef
4.
go back to reference Mac Aodha, O., Humayun, A., Pollefeys, M., Brostow, G.J.: Learning a confidence measure for optical flow. IEEE Trans. Pattern Anal. Mach. Intell. 35(5), 1107–1120 (2012)CrossRef Mac Aodha, O., Humayun, A., Pollefeys, M., Brostow, G.J.: Learning a confidence measure for optical flow. IEEE Trans. Pattern Anal. Mach. Intell. 35(5), 1107–1120 (2012)CrossRef
5.
go back to reference Vaudrey, T., Rabe, C., Klette, R., Milburn, J.: Differences between stereo and motion behaviour on synthetic and real-world stereo sequences. In: Proceedings of the 23rd International Conference on Image and Vision Computing New Zealand (2008) Vaudrey, T., Rabe, C., Klette, R., Milburn, J.: Differences between stereo and motion behaviour on synthetic and real-world stereo sequences. In: Proceedings of the 23rd International Conference on Image and Vision Computing New Zealand (2008)
6.
go back to reference Meister, S., Kondermann, D.: Real versus realistically rendered scenes for optical flow evaluation. In: ITG Conference on Electronic Media Technology (2011) Meister, S., Kondermann, D.: Real versus realistically rendered scenes for optical flow evaluation. In: ITG Conference on Electronic Media Technology (2011)
7.
go back to reference Schwartz, C., Sarlette, R., Weinmann, M., Klein, R.: Dome II: a parallelized BTF acquisition system. In: Eurographics Workshop on Material Appearance Modeling: Issues and Acquisition, pp. 25–31. Eurographics Association (2013) Schwartz, C., Sarlette, R., Weinmann, M., Klein, R.: Dome II: a parallelized BTF acquisition system. In: Eurographics Workshop on Material Appearance Modeling: Issues and Acquisition, pp. 25–31. Eurographics Association (2013)
8.
go back to reference Güssefeld, B., Kondermann, D., Schwartz, C., Klein, R.: Are reflectance field renderings appropriate for optical flow evaluation? In: IEEE International Conference on Image Processing (ICIP), Paris, France. IEEE (2014) Güssefeld, B., Kondermann, D., Schwartz, C., Klein, R.: Are reflectance field renderings appropriate for optical flow evaluation? In: IEEE International Conference on Image Processing (ICIP), Paris, France. IEEE (2014)
9.
go back to reference Heeger, D.: Model for the extraction of image flow. J. Opt. Soc, Am. 4, 1455–1471 (1987)CrossRef Heeger, D.: Model for the extraction of image flow. J. Opt. Soc, Am. 4, 1455–1471 (1987)CrossRef
10.
go back to reference Baker, S., Scharstein, D., Lewis, J.P., Roth, S., Black, M.J., Szeliski, R.: A database and evaluation methodology for optical flow. Int. J. Comput. Vis. 92, 1–31 (2011)CrossRef Baker, S., Scharstein, D., Lewis, J.P., Roth, S., Black, M.J., Szeliski, R.: A database and evaluation methodology for optical flow. Int. J. Comput. Vis. 92, 1–31 (2011)CrossRef
11.
go back to reference Martull, S., Peris, M., Fukui, K.: Realistic CG stereo image dataset with ground truth disparity maps. In: 2012 21st International Conference on Proceedings of The 3rd International Workshop on Benchmark Test Schemes for AR/MR Geometric Registration and Tracking Method (TrakMark2012). Pattern Recognition (ICPR) (2012) Martull, S., Peris, M., Fukui, K.: Realistic CG stereo image dataset with ground truth disparity maps. In: 2012 21st International Conference on Proceedings of The 3rd International Workshop on Benchmark Test Schemes for AR/MR Geometric Registration and Tracking Method (TrakMark2012). Pattern Recognition (ICPR) (2012)
12.
go back to reference Haltakov, V., Unger, C., Ilic, S.: Framework for generation of synthetic ground truth data for driver assistance applications. In: Weickert, J., Hein, M., Schiele, B. (eds.) GCPR 2013. LNCS, vol. 8142, pp. 323–332. Springer, Heidelberg (2013). doi:10.1007/978-3-642-40602-7_35 CrossRef Haltakov, V., Unger, C., Ilic, S.: Framework for generation of synthetic ground truth data for driver assistance applications. In: Weickert, J., Hein, M., Schiele, B. (eds.) GCPR 2013. LNCS, vol. 8142, pp. 323–332. Springer, Heidelberg (2013). doi:10.​1007/​978-3-642-40602-7_​35 CrossRef
13.
14.
go back to reference Nicodemus, F.E.: Directional reflectance and emissivity of an opaque surface. Appl. Opt. 4, 767–775 (1965)CrossRef Nicodemus, F.E.: Directional reflectance and emissivity of an opaque surface. Appl. Opt. 4, 767–775 (1965)CrossRef
15.
go back to reference Matusik, W., Pfister, H., Brand, M., McMillan, L.: A data-driven reflectance model. ACM Trans. Graph. 22, 759–769 (2003)CrossRef Matusik, W., Pfister, H., Brand, M., McMillan, L.: A data-driven reflectance model. ACM Trans. Graph. 22, 759–769 (2003)CrossRef
16.
go back to reference Dana, K.J., van Ginneken, B., Nayar, S.K., Koenderink, J.J.: Reflectance and texture of real-world surfaces. ACM Trans. Graph. 18, 1–34 (1999)CrossRef Dana, K.J., van Ginneken, B., Nayar, S.K., Koenderink, J.J.: Reflectance and texture of real-world surfaces. ACM Trans. Graph. 18, 1–34 (1999)CrossRef
17.
go back to reference Weinmann, M., Gall, J., Klein, R.: Material classification based on training data synthesized using a BTF database. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8691, pp. 156–171. Springer, Heidelberg (2014). doi:10.1007/978-3-319-10578-9_11 Weinmann, M., Gall, J., Klein, R.: Material classification based on training data synthesized using a BTF database. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8691, pp. 156–171. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-10578-9_​11
18.
go back to reference Phong, B.T.: Illumination for computer generated pictures. Commun. ACM 18, 311–317 (1975)CrossRef Phong, B.T.: Illumination for computer generated pictures. Commun. ACM 18, 311–317 (1975)CrossRef
19.
go back to reference Ward, G.J.: Measuring and modeling anisotropic reflection. SIGGRAPH Comput. Graph. 26, 265–272 (1992)CrossRef Ward, G.J.: Measuring and modeling anisotropic reflection. SIGGRAPH Comput. Graph. 26, 265–272 (1992)CrossRef
20.
go back to reference Cook, R.L., Torrance, K.E.: A reflectance model for computer graphics. ACM Trans. Graph. 1, 7–24 (1982)CrossRef Cook, R.L., Torrance, K.E.: A reflectance model for computer graphics. ACM Trans. Graph. 1, 7–24 (1982)CrossRef
21.
go back to reference Ngan, A., Durand, F., Matusik, W.: Experimental analysis of BRDF models. In: Proceedings of the Eurographics Symposium on Rendering, pp. 117–226. Eurographics Association (2005) Ngan, A., Durand, F., Matusik, W.: Experimental analysis of BRDF models. In: Proceedings of the Eurographics Symposium on Rendering, pp. 117–226. Eurographics Association (2005)
22.
go back to reference Lafortune, E.P., Willems, Y.D.: Using the modified phong reflectance model for physically based rendering. Technical report (1994) Lafortune, E.P., Willems, Y.D.: Using the modified phong reflectance model for physically based rendering. Technical report (1994)
23.
go back to reference Geisler-Moroder, D., Dür, A.: A new ward BRDF model with bounded albedo. Comput. Graph. Forum 29, 1391–1398 (2010)CrossRef Geisler-Moroder, D., Dür, A.: A new ward BRDF model with bounded albedo. Comput. Graph. Forum 29, 1391–1398 (2010)CrossRef
24.
go back to reference Ashikhmin, M., Shirley, P.: An anisotropic phong BRDF model. J. Graph. Tools 5, 25–32 (2000)CrossRef Ashikhmin, M., Shirley, P.: An anisotropic phong BRDF model. J. Graph. Tools 5, 25–32 (2000)CrossRef
25.
go back to reference Prados, E., Faugeras, O.: Shape from shading. In: Paragios, N., Chen, Y., Faugeras, O. (eds.) Handbook of Mathematical Models in Computer Vision, pp. 375–388. Springer, New York (2006) Prados, E., Faugeras, O.: Shape from shading. In: Paragios, N., Chen, Y., Faugeras, O. (eds.) Handbook of Mathematical Models in Computer Vision, pp. 375–388. Springer, New York (2006)
26.
go back to reference Hart, J.C.: Perlin noise pixel shaders. In: Proceedings of the ACM SIGGRAPH/EUROGRAPHICS Workshop on Graphics Hardware, HWWS 2001, pp. 87–94. ACM, New York (2001) Hart, J.C.: Perlin noise pixel shaders. In: Proceedings of the ACM SIGGRAPH/EUROGRAPHICS Workshop on Graphics Hardware, HWWS 2001, pp. 87–94. ACM, New York (2001)
27.
go back to reference Xu, L., Jia, J., Matsushita, Y.: Motion detail preserving optical flow estimation. IEEE Trans. Pattern Anal. Mach. Intell. 34, 1744–1757 (2012)CrossRef Xu, L., Jia, J., Matsushita, Y.: Motion detail preserving optical flow estimation. IEEE Trans. Pattern Anal. Mach. Intell. 34, 1744–1757 (2012)CrossRef
28.
go back to reference Horn, D.K.P., Schunck, B.G.: Determining optical flow. Artif. Intell. 17, 185–203 (1981)CrossRef Horn, D.K.P., Schunck, B.G.: Determining optical flow. Artif. Intell. 17, 185–203 (1981)CrossRef
29.
go back to reference Gottfried, J., Kondermann, D.: Charon suite software framework. Image Processing Online (IPOL) (2012) Gottfried, J., Kondermann, D.: Charon suite software framework. Image Processing Online (IPOL) (2012)
Metadata
Title
Creating Feasible Reflectance Data for Synthetic Optical Flow Datasets
Authors
Burkhard Güssefeld
Katrin Honauer
Daniel Kondermann
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-50835-1_8

Premium Partner