Skip to main content
Erschienen in: Experiments in Fluids 4/2019

01.04.2019 | Research Article

Dense motion estimation of particle images via a convolutional neural network

verfasst von: Shengze Cai, Shichao Zhou, Chao Xu, Qi Gao

Erschienen in: Experiments in Fluids | Ausgabe 4/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we propose a supervised learning strategy for the fluid motion estimation problem (i.e., extracting the velocity fields from particle images). The purpose of this work is to design a convolutional neural network (CNN) for estimating dense motion field for particle image velocimetry (PIV), which allows to improve the computational efficiency without reducing the accuracy. First, the network model is developed based on FlowNetS, which is recently proposed for end-to-end optical flow estimation in the computer vision community. The input of the network is a particle image pair and the output is a velocity field with displacement vectors at every pixel. Second, a synthetic dataset of fluid flow images is generated to train the CNN model. To our knowledge, this is the first time a CNN has been used as a global motion estimator for particle image velocimetry. Experimental evaluations indicate that the trained CNN model can provide satisfactory results in both artificial and laboratory PIV images. The proposed estimator is also applied to the experiment of turbulent boundary layer. In addition, the computational efficiency of the CNN estimator is much superior to those of the traditional cross-correction and optical flow methods.

Graphical abstract

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
The original FlowNetS receives RGB images as input, hence six channels in all are required. However, PIV images are typically created using monochrome cameras. Therefore, two-channel input for this CNN is also sufficient.
 
Literatur
Zurück zum Zitat Adrian R, Westerweed J (2011) Particle image velocimetry. Cambridge University Press, Cambridge Adrian R, Westerweed J (2011) Particle image velocimetry. Cambridge University Press, Cambridge
Zurück zum Zitat Brox T, Bruhn A, Papenberg N, Weickert J (2004) High accuracy optical flow estimation based on a theory for warping. In: Proceedings of the European conference on computer vision, pp 25–36 Brox T, Bruhn A, Papenberg N, Weickert J (2004) High accuracy optical flow estimation based on a theory for warping. In: Proceedings of the European conference on computer vision, pp 25–36
Zurück zum Zitat Bruhn A, Weickert J, Schnörr C (2005) Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods. Int J Comput Vis 61(3):211–231CrossRef Bruhn A, Weickert J, Schnörr C (2005) Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods. Int J Comput Vis 61(3):211–231CrossRef
Zurück zum Zitat Cai S, Mémin E, Dérian P, Xu C (2018) Motion estimation under location uncertainty for turbulent fluid flows. Exp Fluids 59(1):8CrossRef Cai S, Mémin E, Dérian P, Xu C (2018) Motion estimation under location uncertainty for turbulent fluid flows. Exp Fluids 59(1):8CrossRef
Zurück zum Zitat Champagnat F, Plyer A, Le Besnerais G, Leclaire B, Davoust S, Le Sant Y (2011) Fast and accurate PIV computation using highly parallel iterative correlation maximization. Exp Fluids 50(4):1169–1182CrossRef Champagnat F, Plyer A, Le Besnerais G, Leclaire B, Davoust S, Le Sant Y (2011) Fast and accurate PIV computation using highly parallel iterative correlation maximization. Exp Fluids 50(4):1169–1182CrossRef
Zurück zum Zitat Chen X, Zillé P, Shao L, Corpetti T (2015) Optical flow for incompressible turbulence motion estimation. Exp Fluids 56(1):1–14CrossRef Chen X, Zillé P, Shao L, Corpetti T (2015) Optical flow for incompressible turbulence motion estimation. Exp Fluids 56(1):1–14CrossRef
Zurück zum Zitat Chen L, Papandreou G, Kokkinos I, Murphy K, Yuille A (2018) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848CrossRef Chen L, Papandreou G, Kokkinos I, Murphy K, Yuille A (2018) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848CrossRef
Zurück zum Zitat Corpetti T, Mémin E, Pérez P (2002) Dense estimation of fluid flows. IEEE Trans Pattern Anal Mach Intell 24(3):365–380CrossRef Corpetti T, Mémin E, Pérez P (2002) Dense estimation of fluid flows. IEEE Trans Pattern Anal Mach Intell 24(3):365–380CrossRef
Zurück zum Zitat Corpetti T, Heitz D, Arroyo G, Mémin E, Santa-Cruz A (2006) Fluid experimental flow estimation based on an optical-flow scheme. Exp Fluids 40(1):80–97CrossRef Corpetti T, Heitz D, Arroyo G, Mémin E, Santa-Cruz A (2006) Fluid experimental flow estimation based on an optical-flow scheme. Exp Fluids 40(1):80–97CrossRef
Zurück zum Zitat Dao X, Collewet C (2012) Drag reduction of the plane poiseuille flow by partitioned visual servo control. In: Proceedings of the American control conference, pp 4084–4089 Dao X, Collewet C (2012) Drag reduction of the plane poiseuille flow by partitioned visual servo control. In: Proceedings of the American control conference, pp 4084–4089
Zurück zum Zitat Dosovitskiy A, Fischer P, Ilg E, Hausser P, Hazirbas C, Golkov V, Van der Smagt P, Cremers D, Brox T (2015) Flownet: learning optical flow with convolutional networks. In: Proceedings of the IEEE international conference on computer vision, pp 2758–2766 Dosovitskiy A, Fischer P, Ilg E, Hausser P, Hazirbas C, Golkov V, Van der Smagt P, Cremers D, Brox T (2015) Flownet: learning optical flow with convolutional networks. In: Proceedings of the IEEE international conference on computer vision, pp 2758–2766
Zurück zum Zitat Heitz D, Mémin E, Schnörr C (2010) Variational fluid flow measurements from image sequences: synopsis and perspectives. Exp Fluids 48(3):369–393CrossRef Heitz D, Mémin E, Schnörr C (2010) Variational fluid flow measurements from image sequences: synopsis and perspectives. Exp Fluids 48(3):369–393CrossRef
Zurück zum Zitat Horn B, Schunck B (1981) Determining optical flow. Artif Intell 17(1–3):185–203CrossRef Horn B, Schunck B (1981) Determining optical flow. Artif Intell 17(1–3):185–203CrossRef
Zurück zum Zitat Ilg E, Mayer N, Saikia T, Keuper M, Dosovitskiy A, Brox T (2017) Flownet 2.0: evolution of optical flow estimation with deep networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, vol 2 Ilg E, Mayer N, Saikia T, Keuper M, Dosovitskiy A, Brox T (2017) Flownet 2.0: evolution of optical flow estimation with deep networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, vol 2
Zurück zum Zitat Kingma D, Ba J (2014) Adam: a method for stochastic optimization. In Proceedings of the 3rd international conference on learning representations (ICLR) Kingma D, Ba J (2014) Adam: a method for stochastic optimization. In Proceedings of the 3rd international conference on learning representations (ICLR)
Zurück zum Zitat Krizhevsky A, Sutskever I, Hinton G (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25(2):1097–1105 Krizhevsky A, Sutskever I, Hinton G (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25(2):1097–1105
Zurück zum Zitat Lee Y, Yang H, Yin Z (2017) PIV-DCNN: cascaded deep convolutional neural networks for particle image velocimetry. Exp Fluids 58(12):171CrossRef Lee Y, Yang H, Yin Z (2017) PIV-DCNN: cascaded deep convolutional neural networks for particle image velocimetry. Exp Fluids 58(12):171CrossRef
Zurück zum Zitat Liu T, Merat A, Makhmalbaf H, Fajardo C, Merati P (2015) Comparison between optical flow and cross-correlation methods for extraction of velocity fields from particle images. Exp Fluids 56(8):166CrossRef Liu T, Merat A, Makhmalbaf H, Fajardo C, Merati P (2015) Comparison between optical flow and cross-correlation methods for extraction of velocity fields from particle images. Exp Fluids 56(8):166CrossRef
Zurück zum Zitat Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3431–3440 Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3431–3440
Zurück zum Zitat Mayer N, Ilg E, Fischer P, Hazirbas C, Cremers D, Dosovitskiy A, Brox T (2018) What makes good synthetic training data for learning disparity and optical flow estimation? Int J Comput Vis 1:1–19 Mayer N, Ilg E, Fischer P, Hazirbas C, Cremers D, Dosovitskiy A, Brox T (2018) What makes good synthetic training data for learning disparity and optical flow estimation? Int J Comput Vis 1:1–19
Zurück zum Zitat Perlman E, Burns R, Li Y, Meneveau C (2007) Data exploration of turbulence simulations using a database cluster. In Proceedings of the 2007 ACM/IEEE conference on supercomputing Perlman E, Burns R, Li Y, Meneveau C (2007) Data exploration of turbulence simulations using a database cluster. In Proceedings of the 2007 ACM/IEEE conference on supercomputing
Zurück zum Zitat Raffel M, Willert C, Wereley S, Kompenhans J (2007) Particle image velocimetry: a practical guide. Springer, Berlin Raffel M, Willert C, Wereley S, Kompenhans J (2007) Particle image velocimetry: a practical guide. Springer, Berlin
Zurück zum Zitat Resseguier V, Mémin E, Chapron B (2017) Geophysical flows under location uncertainty, part II: quasigeostrophic models and efficient ensemble spreading. Geophys Astrophys Fluid Dyn 111(3):177–208MathSciNetCrossRef Resseguier V, Mémin E, Chapron B (2017) Geophysical flows under location uncertainty, part II: quasigeostrophic models and efficient ensemble spreading. Geophys Astrophys Fluid Dyn 111(3):177–208MathSciNetCrossRef
Zurück zum Zitat Scarano F (2002) Iterative image deformation methods in PIV. Meas Sci Technol 13(13):R1CrossRef Scarano F (2002) Iterative image deformation methods in PIV. Meas Sci Technol 13(13):R1CrossRef
Zurück zum Zitat Stanislas M, Okamoto K, Kähler CJ, Westerweel J (2005) Main results of the second international PIV challenge. Exp Fluids 39(2):170–191CrossRef Stanislas M, Okamoto K, Kähler CJ, Westerweel J (2005) Main results of the second international PIV challenge. Exp Fluids 39(2):170–191CrossRef
Zurück zum Zitat Stanislas M, Okamoto K, Kähler CJ, Westerweel J, Scarano F (2008) Main results of the third international PIV challenge. Exp Fluids 45(1):27–71CrossRef Stanislas M, Okamoto K, Kähler CJ, Westerweel J, Scarano F (2008) Main results of the third international PIV challenge. Exp Fluids 45(1):27–71CrossRef
Zurück zum Zitat Sun D, Roth S, Black M (2010) Secrets of optical flow estimation and their principles. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 2432–2439 Sun D, Roth S, Black M (2010) Secrets of optical flow estimation and their principles. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 2432–2439
Zurück zum Zitat Sun Y, Wang X, Tang X (2013) Deep convolutional network cascade for facial point detection. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 3476–3483 Sun Y, Wang X, Tang X (2013) Deep convolutional network cascade for facial point detection. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 3476–3483
Zurück zum Zitat Tieleman T, Hinton G (2012) Lecture 6.5-rmsprop: divide the gradient by a running average of its recent magnitude. COURSERA: Neural Netw Mach Learn 4(2):26–31 Tieleman T, Hinton G (2012) Lecture 6.5-rmsprop: divide the gradient by a running average of its recent magnitude. COURSERA: Neural Netw Mach Learn 4(2):26–31
Zurück zum Zitat Wereley S, Gui L, Meinhart C (2002) Advanced algorithms for microscale particle image velocimetry. AIAA J 40(40):1047–1055CrossRef Wereley S, Gui L, Meinhart C (2002) Advanced algorithms for microscale particle image velocimetry. AIAA J 40(40):1047–1055CrossRef
Zurück zum Zitat Xu C, Schuster E, Vazquez R, Krstic M (2008) Stabilization of linearized 2D magnetohydrodynamic channel flow by backstepping boundary control. Syst Control Lett 57(10):805–812MathSciNetCrossRef Xu C, Schuster E, Vazquez R, Krstic M (2008) Stabilization of linearized 2D magnetohydrodynamic channel flow by backstepping boundary control. Syst Control Lett 57(10):805–812MathSciNetCrossRef
Metadaten
Titel
Dense motion estimation of particle images via a convolutional neural network
verfasst von
Shengze Cai
Shichao Zhou
Chao Xu
Qi Gao
Publikationsdatum
01.04.2019
Verlag
Springer Berlin Heidelberg
Erschienen in
Experiments in Fluids / Ausgabe 4/2019
Print ISSN: 0723-4864
Elektronische ISSN: 1432-1114
DOI
https://doi.org/10.1007/s00348-019-2717-2

Weitere Artikel der Ausgabe 4/2019

Experiments in Fluids 4/2019 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.