Solenoidal filtering of volumetric velocity measurements using Gaussian process regression

A number of methods have recently been proposed in the literature to filter out spurious divergence from 3C-3D velocity measurements. We have identified three general approaches, based on different principles.

Helmholtz representation theorem The first approach is based on the Helmholtz representation theorem. This states that any finite, twice differentiable vector field \({\mathbf {u}}\) can be decomposed into a solenoidal vector field \({\mathbf {u}}_{\rm sol}\) plus an irrotational vector field \({\mathbf {u}}_{\rm irrot}\) (Segel 2007):where \({\mathbf {a}}\) is a vector potential and \(\psi\) is a scalar potential. Taking the divergence on both sides of Eq. 1 and applying \(\nabla \cdot {\mathbf {u}}_{\rm sol}=0\) gives a Poisson equation:Solving Eq. 2 gives \(\psi\), from which the solenoidal velocity field can be obtained using Eq. 1. Difficulties arise in the specification of the boundary conditions, as in the absence of walls the boundary conditions are unknown. One extreme is to specify \(\nabla \psi \cdot {\mathbf {n}}={\mathbf {u}}\cdot {\mathbf {n}}\), i.e., the irrotational velocity normal to the boundary is equal to the measured velocity. As a consequence, the solenoidal velocity field normal to the boundary will be zero. The other extreme is to specify \(\nabla \psi \cdot {\mathbf {n}}=0\); the irrotational velocity normal to the boundary is zero, meaning that the solenoidal velocity normal to the boundary is equal to the measured velocity. This will result in an ill-posed PDE if the measured velocity field is not globally mass conserving. An additional complication arises when the vorticity field is to be calculated, because the vorticity of the solenoidal velocity is equal to that of the measured velocity (an irrotational velocity field has vanishing curl). Since the measured velocity field is contaminated by noise, the vorticity field of the solenoidal field will not be improved. A number of authors have followed the approach of the Helmholtz representation theorem in filtering velocity measurements (Song et al. 1993; Suzuki et al. 2009; Worth 2012; Yang et al. 1993).

Least-squares variational filters The second approach is to define a minimization problem. Liburdy and Young (1992) and Sadati et al. (2011) defined an unconstrained minimization problem, where the objective function consists of three terms: (1) the discrepancy between the measured and filtered velocity field, expressed as a sum of squared differences; (2) the smoothness of the velocity gradients; (3) the divergence of the velocity field . The latter two terms are multiplied with weighting parameters that must be supplied by the user. Sadati et al. (2011) proposed using generalized cross-validation to find optimum weights.

de Silva et al. (2013) defined a constrained minimization problem, thereby avoiding the use of weights in the objective function. They called their method the divergence correction scheme (DCS). The objective function is only the discrepancy between the measured and filtered velocity fields, expressed as a sum of squared differences. The divergence-free condition is introduced as a linear equality constraint. The method was applied to a tomographic PIV experiment, and an improvement in the prediction of turbulence statistics was shown. However, it turns out that DCS is equivalent to a discretized Helmholtz Theorem in that the vorticity of the solenoidal velocity field is equal to that of the measured velocity field. A proof of this is given in the Appendix 1. Despite this, the advantage of DCS is that it does not require the user to specify boundary conditions since no Poisson equation needs to be solved.

Reconstruction with a solenoidal basis A third approach is to use a solenoidal basis, which by construction will return solenoidal velocity fields. There are several possible choices of basis. Solenoidal wavelets were proposed by Battle and Federbush (1993). Narcowich and Ward (1994) devised solenoidal radial basis functions (RBF). Lowitzsch (2005) subsequently derived a density theorem stating that any sufficiently smooth solenoidal function can be approximated arbitrarily closely by a linear combination of solenoidal RBFs. Therefore any incompressible flow may be represented by this construction. Solenoidal wavelets and RBFs have been applied in computational fluid dynamics to solve incompressible flows (Deriaz and Perrier 2006; Schräder and Wendland 2011; Urban 1996; Wendland 2009). Applications of these methods to reconstruct solenoidal velocity fields from velocity measurements have been reported as well (Busch et al. 2013; Ko et al. 2000; Vennell and Beatson 2009). A method closely related to RBF interpolation is Kriging or Gaussian process regression (GPR) (Rasmussen and Williams 2006). In this context, the radial basis functions are referred to as covariance functions because they represent the covariance between spatial locations, since the underlying field is assumed to come from a stochastic process. Scheuerer and Schlather (2012) derived a solenoidal covariance function for Kriging. In the following, the solenoidal version of Kriging will be referred to as SGPR (solenoidal Gaussian process regression).

Another choice of basis is described in the work by Schiavazzi et al. (2014), who introduced a method, referred to in the following as solenoidal waveform reconstruction (SWR), where vortices around the edges of the measurement grid are placed, ensuring a solenoidal velocity field on a finite-volume level. It works as follows: After creating a Voronoi tessellation associated with the measurement grid, the measured velocities are converted to face fluxes. Vortices are defined around the face edges, resulting in an ill-posed linear system for their strengths. This system is solved in a least-squares sense. Once the vortex strengths have been found, the new face fluxes are converted back to nodal velocities. The basis functions used in this method are the smallest possible solenoidal waveforms compatible with the measurement grid. The advantage of this is that large local measurement errors only disturb reconstructed velocities at neighboring grid points. The disadvantage of this minimal support is that it becomes difficult to reconstruct gappy fields, i.e., regions with missing data.

A first contribution of this paper is to derive SGPR from a Bayesian perspective, which is the subject of Sect. 2. We use this perspective since it provides a natural framework to fuse prior (physical) knowledge, in this case mass conservation, with observations while taking into account the uncertainties that arise from both worlds. Using this framework is particularly apposite considering recently developed tools that allow the a posteriori quantification of measurement uncertainty from PIV (Charonko and Vlachos 2013; Sciacchitano et al. 2013; Timmins et al. 2012; Wieneke and Prevost 2014).

A second contribution is implementing SGPR efficiently to handle large data sets, which is the subject of Sect. 3. Gaussian process regression is known to be an expensive method. This is particularly important for the present application where the data sets are large. In addition, as will be shown in the next section, including the divergence-free condition results in a larger system of equations that needs to be solved. For data sets on regular and near-regular grids as is the case for PIV, the system matrix is seen to have a multilevel block-Toeplitz structure. The Toeplitz structure allows speeding up matrix-vector multiplications, required by the conjugate gradient method, from \(O(N^2)\) computations to \(O(N\log N)\) computations through the use of fast Fourier transforms (FFTs). The block structure allows parallelization of these multiplications. By using an iterative solver instead of a direct solver, these speedups also hold when spatially varying measurement uncertainty is included.

The third contribution is comparing SGPR with two other recently proposed solenoidal filters, namely DCS and SWR. From this follow the final two contributions: showing how applying a solenoidal filter results in more accurate PIV-based pressure reconstructions; showing how the inclusion of local measurement uncertainty with SGPR results in a divergence-free velocity field that follows the measurements more faithfully. DSC and SWR are described in more detail in the Appendices 1 and 2, in addition to their specific implementation in the present paper. Section 4 applies the filters to synthetic test cases. Real data from two tomographic PIV experiments are used in Sect. 5. Conclusions are drawn in Sect. 6.

Consider an unobservable Gaussian process with mean \(\mu\) and covariance function \(\phi\) (Rasmussen and Williams 2006):where \({\mathbf {x}}\in {\mathbb {R}}^3\) is the spatial coordinate and \(\pmb {\chi }\in {\mathbb {R}}^{q}\) are hyperparameters. Discretizing the process at n spatial locations gives a multivariate normal random-variableIts realization is the state vector \({\mathbf {f}}\in {\mathbb {R}}^n\). We assume a stationary process, i.e., the correlation between two points \({\mathbf {x}}^i\) and \({\mathbf {x}}^j\) depends only on their separation, \({\mathbf {x}}^i-{\mathbf {x}}^j\), and not their absolute positions. The covariance function then simplifies to \(\phi \left( r^{ij}\right)\), where \(r^{ij}\) is the Euclidian distance between the points \({\mathbf {x}}^i\) and \({\mathbf {x}}^j\), defined as:where parameter \(\gamma _k\) is the correlation length in the direction k. This will be the prior.

The statistical model for the observations is defined as \({\mathbf {y}}=H{\mathbf {f}}+\pmb {\epsilon }\), where \({\mathbf {y}}\in {\mathbb {R}}^m\) contains the m observations, H is the observation matrix and \(\pmb {\epsilon }\sim {\mathcal {N}}\left( {\mathbf {0}},R\right)\) (assuming unbiased noise). Therefore, \({\mathbf {Y}}|{\mathbf {f}}\sim {\mathcal {N}}\left( H{\mathbf {f}},R\right)\), the likelihood. The matrix R is known as the observation error covariance matrix, representing the measurement uncertainty. We are interested in the distribution of the true state given the observed data \(p\left( {\mathbf {f}}|{\mathbf {y}}\right)\), i.e., the posterior. According to Bayes’ rule, the posterior distribution is proportional to the prior \(p\left( {\mathbf {f}}\right)\) times the likelihood \(p\left( {\mathbf {y}}|{\mathbf {f}}\right)\). The posterior is therefore normally distributed as well with mean and covariance (Wikle and Berliner 2007): In the following, we will assume the prior mean to be a constant field and in particular we will set \(\pmb {\mu }=0\). This is acceptable since the complexity of the field that can be reconstructed is contained in the prior covariance P used (Jones et al. 1998). Also, we are primarily interested in the posterior mean. Azijli et al. (2015) use the posterior covariance to propagate the uncertainty from the measured velocity field through the Navier–Stokes equations, allowing a posteriori uncertainty quantification of PIV-derived pressure fields. The term \(R+HPH'\) will be referred to as the gain matrix A. In the present paper, Eq. 4 therefore reduces to:

To illustrate the importance of including accurate, local measurement uncertainty, we present an artificial one-dimensional reconstruction problem. Consider the true functionobserved at eleven equally spaced measurement locations on the interval \(\left[ 0,1\right]\) with added noise. The measurements do not all have the same noise level (a common situation in e.g., PIV). For simplicity, we set the (co)variance of the measurement uncertainty R to a diagonal matrix (i.e., uncorrelated), where the elements on the diagonal are represented by the vectorNotice that the measurements at the boundaries of the interval are more accurate than measurements in the center. We use a Gaussian covariance functionwith \(\gamma =0.15\). Equations 6 and 5 are then used to reconstruct the true function given the eleven measurements, and the (known) error covariance. Figure 1 shows the result. We have taken \(n=101\), uniformly distributed over the domain, so the function is evaluated at significantly more points than the measurement grid. H is a sparse matrix with a few 1’s picking the 11 measurement points from the 101 points. We have considered three cases in terms of our prior knowledge of the measurement uncertainty: (1) \(R=0\) (see Fig. 1a), wrongfully assuming that the measurements are perfect. As a result, the reconstructed function interpolates exactly the observed points. At these locations, the posterior uncertainty is zero. Notice that due to our overconfidence in the accuracy of the measurements, the true function is well outside the ±3 standard deviations region for a large part of the interval; (2) (see Fig. 1b), taking into account measurement uncertainty but wrongfully assuming that all measurements have equal uncertainty. The reconstructed function is more accurate than in the first case. Furthermore, the posterior uncertainty does not become zero at the measurement locations. Since we assume homogeneous measurement uncertainty and the observations are equally spaced, the confidence interval is very homogeneous throughout the interval; (3) (see Fig. 1c), taking into account the correct measurement uncertainty. This gives the most accurate reconstructed function of all three cases. Notice also that the process realizes the large uncertainty in the center of the interval and as a result relies more on the prior. This is reflected by the large bounds of the confidence interval in this region.

In the context of reconstructing measured velocity fields using GPR, previous works took the route of reconstructing the velocity components independently from each other, precluding enforcement of the mass conservation equation or other physical constraints (de Baar et al. 2014; Gunes and Rist 2008; Inggs and Lord 1996; Lee et al. 2008). In these works, the state is chosen aswhere \({\mathbf {u}}_k\) are the Cartesian velocity components. The m observations are defined by \({\mathbf {y}}=\begin{pmatrix}{\mathbf {u}}_{\text {PIV},1}&{\mathbf {u}}_{\text {PIV},2}&{\mathbf {u}}_{\text {PIV},3}\end{pmatrix}'\in {\mathbb {R}}^{3m}\). The covariance matrix \(P\in {\mathbb {R}}^{3n\times 3n}\) is a \(3\times 3\) block diagonal matrix, with elements \(P_k\), \(k=1,2,3\) on the diagonal. The off-diagonal blocks are zero by assumption of uncorrelated velocity components.

In our case, for an incompressible flow the density is constant in space and time, giving a mass conservation equation: \(\nabla \cdot {\mathbf {u}}=0\). From vector calculus identities, it is known that the curl of a vector potential \({\mathbf {a}}\) is divergence-free. We therefore choose the state vectorwhere \({\mathbf {a}}_k\) are the Cartesian vector potential components. The observation matrix \(H\in {\mathbb {R}}^{3m\times 3n}\), when multiplied with the vector potential, should return its curl, therefore ensuring that the resulting vector will be divergence-free:where \(\partial _k\) is the partial derivative with respect to \(x_k\). The covariance matrix \(P\in {\mathbb {R}}^{3n\times 3n}\) is again a \(3\times 3\) block diagonal matrix, with elements \(P_k\), \(k=1,2,3\) on the diagonal. However, it now represents the covariance between the components of the vector potential, not the velocity. Again, the off-diagonals of the covariance matrix are zero. But the reason for this now is that the different components of the vector potential, not the velocity, are assumed to be uncorrelated. In the most general case, there is no a priori physical knowledge to assume that there is a relation between them. The component \(HPH'\) of the gain matrix is equal toIt can easily be verified that the columns and rows of Eq. 8 are divergence-free. By taking the same covariance function for all directions of the vector potential (\(P_1=P_2=P_3\)) and assuming perfect measurements (\(R=0\)), Eq. 8 reduces to:This turns out to be proportional to the operator constructed by Narcowich and Ward (1994) in the context of RBF interpolation. Our method can therefore be seen as a generalization of their method that allows different covariance functions to be used for the different vector potential components, and that includes measurement uncertainty in the reconstruction via R. This latter property is a natural consequence of the Bayesian approach we followed.

Now that we have shown how SGPR is a generalization of divergence-free RBF interpolation, we exploit the latter to express how the velocity vector can be evaluated analytically at any point \({\mathbf {x}}\) in the field using the following expression:where \({\mathbf {c}}=A^{-1}{\mathbf {y}}\) (see Eq. 6). \(\phi _{kl,i}\) indicates the second partial derivative of \(\phi\) with respect to the coordinate directions k and l, and represents the covariance between point \({\mathbf {x}}\) and a measurement point \({\mathbf {x}}^i\).

To evaluate the divergence-free velocity field at any point (see Eq. 10), one first has to solve the linear system \(A{\mathbf {c}}={\mathbf {y}}\), where \(A\in {\mathbb {R}}^{3m\times 3m}\). This is the most expensive component of SGPR. The gain matrix is per definition symmetric. For scattered observations, this requires storing \(3m\left( 3m+1\right) /2\) entries. If the covariance function used is positive definite, the matrix will also be positive definite (Narcowich and Ward 1994). The Cholesky factorization, with a computational complexity of \(O(27m^3)\), can therefore be used as a direct solver. Alternatively, the conjugate gradient (CG) method, with a computational complexity of \(O\left( 9k\cdot m^2\right)\) (k is the number of iterations required to reach a given tolerance), can be used as an iterative solver. The dominant operation per iteration is the matrix-vector multiplication \(A{\mathbf {c}}\).

For large data sets, the cost of SGPR therefore becomes prohibitive. One approach to deal with this is to use a covariance function with local support: \(\phi \left( r\ge r_d\right) =0\), where \(r_d\) is the support radius. If the support radius is much smaller than the size of the measurement domain, the gain matrix will be sparse, resulting in storage and computational savings. However, the optimum support radius may be large for a given flow field (Schaback 1995), and we do not wish to be limited by computational considerations.

If the measurements are (1) available on a regular grid, as is the case in scanning PIV and tomographic PIV; and (2) all observations have equal measurement uncertainty, then the gain matrix will have a small displacement rank (Kailath et al. 1979), allowing memory and time savings. To be more specific, the gain matrix will have a Toeplitz structure. For the present problem, it is a \(3\times 3\) block matrix where each block is a 3-level symmetric Toeplitz matrix. It is a 3-level Toeplitz matrix as we are dealing with a three-dimensional space, and the \(3\times 3\) block structure is due to the structure of Eq. 8. A 3-level symmetric Toeplitz matrix T is defined as follows:where \(m=m_1m_2m_3\) and \(m_k\), \(k=1,2,3\), is the number of observations in the k-direction. The gain matrix can now be stored using 3m entries. Fast and superfast direct solvers of complexity \(O\left( 9m^2\right)\) and \(O\left( 3m\log ^2\left( 3m\right) \right)\), respectively, are available (Ammar and Gragg 1988).

If the measurement uncertainty is not the same at all points, the gain matrix will have arbitrary displacement rank and no fast direct solvers are available for such a system (Ng and Pan 2010). However, when the CG method is used, accelerations can be achieved. First, the gain matrix A is decomposed into a diagonal matrix D, containing the unequal measurement uncertainties, and a \(3\times 3\) block matrix G, where each block \(G_i\) is a 3-level symmetric Toeplitz matrix:The multiplication \(D{\mathbf {c}}\) can be carried out in \(O\left( 3m\right)\) operations. The matrix-vector multiplication \(G{\mathbf {c}}\) can be accelerated by embedding each 3-level Toeplitz matrix \(G_i\in {\mathbb {R}}^{m\times m}\) into a 3-level circulant matrix \(C_i\in {\mathbb {R}}^{8m\times 8m}\) and then using 3D FFTs to carry out matrix-vector multiplications at a cost of \(O\left( 8m\log \left( 8m\right) \right)\) (Chan and Jin 2007). The computational complexity of the CG algorithm now becomes \(O\left( 72k\cdot m\log \left( 8m\right) \right)\). Normally, the CG method is used in combination with a preconditioner to speed up convergence. Unfortunately, Capizzano (2002) has shown that preconditioners for multilevel Toeplitz matrices are not superlinear. So in the present paper, we have implemented SGPR without a preconditioner.

Note that the assumption of observations on a regular grid should not be seen as a significant limitation. Consider two common situations where we have (1) a regular measurement grid with missing data (e.g., from removed outliers); (2) an irregularly scattered data set that can be approximated as a subset of a regular grid. In these cases, we can set the values of the unobserved points equal to the mean of the observations (either global or local) and specify a large measurement uncertainty at these points. The size of the gain matrix increases, but this may be out weighted by the benefits of having a Toeplitz structure.

If it is not possible or efficient to exploit the Toeplitz structure, one can use the Fast Multipole Method (FMM) to speed up matrix-vector multiplications (Greengard and Rokhlin 1987), which is valid for arbitrary grids. The idea is to make use of analytical manipulations of series to achieve fast summation. The cost of a matrix-vector multiplication is similar to the FFT method, i.e., \(O\left( N\log N\right)\) for matrices of size \(A\in {\mathbb {R}}^{N\times N}\). The drawbacks of this method are that the implementation is complex and the constant in the order of its complexity may be large and thus several tricks must be used to reduce it (Darve 2000). Two notable examples of using FMM for GPR are by Billings et al. (2002) and Memarsadeghi et al. (2008).

The most important factors that influence the condition number of the gain matrix, \(\kappa \left( A\right)\), are the covariance function, the separation distance of the data, the correlation length and the observation error (Davis and Morris 1997; Narcowich and Ward 1994). Decreasing the separation distance, increasing the correlation length and decreasing the measurement uncertainty all increase the condition number. An ill-conditioned gain matrix causes inaccurate results (in the form of numerical noise in the reconstruction) and reduces the convergence speed of the CG method. In fact, the gain matrix can become so ill-conditioned that it stops being numerically positive definite (i.e., in finite-precision arithmetic), even though it will always be analytically positive given a positive definite covariance function. Since our solution methods, Cholesky and CG, both rely on positive-definiteness, they cannot be applied. We therefore aim to avoid ill-conditioning by a suitable choice of the covariance function \(\phi\). Table 1 summarizes at which correlation length \(\kappa \left( A\right)\) becomes \(10^{15}\). The functions \(\phi _{d,k}\), \(k=1,2,3,4\) are the Wendland functions with smoothness \(C^{2k}\) and spatial dimension d (Wendland 2005). The Gaussian (\(\phi _G\)), an infinitely smooth function, is defined as \(\phi _G(r) = \exp \left( -\alpha ^2r^2\right)\). The constant \(\alpha\) was set to 3.3 to make it resemble \(\phi _{d,3}\) as closely as possible. Unlike the Gaussian, the Wendland functions have compact support: \(\phi _{d,k}=0\) for \(r\ge 1\). The Gaussian covariance function appears to be the most ill-conditioned, a property attributed to the fact that it is infinitely differentiable (Davis and Morris 1997). The smoother the Wendland function, the more it approaches the Gaussian (Chernih et al. 2014). The idea that the level of differentiability is related to the conditioning of the gain matrix (Chernih et al. 2014) is supported by the observation that for the Wendland functions, the gain matrix for SGPR becomes numerically not-positive definite at a larger \(\gamma\). The reverse happens for the Gaussian. For SGPR, the covariance function is differentiated twice (see Eqs. 8 and 10), reducing the level of differentiability of the resulting function for the Wendland functions, explaining the better conditioning of the matrix. Clearly, \(\phi _G\) limits our choice of correlation length, whereas Wendland functions are always suitable.

The Taylor vortex is defined in 2D (Panton 2013). The velocity field is solenoidal and in addition satisfies the Navier–Stokes equations. The tangential velocity is defined as:where H is the amount of angular momentum in the vortex, r is the radial distance from the center of the vortex, \(\nu\) is the kinematic viscosity and t is time. The vorticity is given by the following expression:The pressure is given by:where \(\rho\) is the fluid density and \(p_{\infty }\) is the pressure at an infinite distance from the vortex center. For the present problem, we take \(H=1\times 10^{-6}\text { m}^2\), \(\nu =1\times 10^{-6}\text { m}^2\text { s}^{-1}\), \(\rho =1000\text { kg m}^{-3}\). The domain size is \(-L_0\le x_i\le L_0\), \(i=1,2\), where \(L_0=1\times 10^{-3}\text { m}\). We use a regular grid with 101 points in both directions, totaling 10,201 observation points. Using a regular grid allows us to solve the linear system efficiently by exploiting its Toeplitz structure. Samples are taken between \(t=0.05\,\text {s}\) and \(t=0.30\,\text {s}\) with a sampling frequency of 100 Hz. These same settings were also used by Charonko et al. (2010), who investigated the effect of a number of factors, among others measurement noise, on PIV-based pressure reconstruction.

For simplicity, we use the same correlation length in both directions. Since the whole domain contains one vortex, we set its value equal to the size of the domain: \(\gamma =\gamma _1=\gamma _2=2L_0\). Table 2 shows the noise reduction Q for the velocity magnitude, vorticity and pressure fields, averaged over the 26 time frames. Comparing SGPR with the other filters, we see that it provides the highest noise reduction for all fields. Comparing \(\text {BOX}_{3\times 3}\) with DCS and SWR, we see that \(\text {BOX}_{3\times 3}\) returns a more accurate vorticity field, but less accurate velocity and pressure fields. Notice that for DCS the noise in the vorticity field is not reduced, so the vorticity of the solenoidal field is equal to that of the observed field. This indicates that it is equivalent to the Helmholtz representation theorem. Comparing the three solenoidal filters, SGPR has the highest noise reduction, followed by SWR and then DCS.

To get a qualitative impression of the reconstructed fields, we refer to Fig. 2. First of all, notice that the noise we have added to represent the PIV noise is indeed spatially correlated. The fields returned by SGPR do indeed look better than the ones obtained with the other filters, especially when looking at the velocity and vorticity fields. The improvement in the pressure field is less noticeable, as verified from Table 2.

The correlation length we used was determined based on the fact that the field contains one vortex that encompasses the entire domain, so we set \(\gamma /L_0=2\). Figure 3 shows how the noise reduction for the velocity, vorticity and pressure fields is influenced by the correlation length. The three graphs share the following characteristics: (1) There is an optimum noise reduction inside the interval; (2) small values of the correlation length lead to an abrupt decrease in noise reduction; (3) around the optimum, the graph is relatively flat. The optimum correlation length is around \(\gamma /L_0=9\), resulting in noise reductions of 78, 93 and 93 % for velocity, vorticity and pressure, respectively. Though our choice of correlation length was therefore suboptimal, the a priori physical knowledge we used has still given us better noise reduction than the other filters. It is only when we would have chosen a length smaller than \(\gamma /L_0=0.45\) that SWR would have been better. The fact that the graphs are relatively flat around the optimum is a desirable property as it implies robustness of SGPR. As long as the user makes an educated guess for the correlation length based on a priori physical knowledge, SGPR is relatively insensitive to the exact value chosen.

The vortex ring has become a popular test case to numerically assess reconstruction methods in tomographic PIV (Elsinga et al. 2006; Novara and Scarano 2013). The displacement field used for it is a Gaussian, which does not result in a divergence-free velocity field. Therefore, we have used a different model proposed by Kaplanski et al. (2009). They derived analytical expressions for the velocity and vorticity fields by linearizing the vorticity equation for incompressible flows. Figure 4 shows an isosurface of the vorticity magnitude and the velocity field at the symmetry plane. The axial (\(u_a\)) and radial (\(u_r\)) velocities are defined as: where \(J_0\) and \(J_1\) are Bessel functions. The functions \(F\left( \mu ,\eta \right)\) and \(\tilde{F}\left( \mu ,\eta \right)\) are defined as follows: The parameters \(\sigma\), \(\eta\) and \(\theta\) are defined as:We take \(R_0=0.0067\) and \(l=0.0031\). The vorticity is given by the following expression:where \(I_1\) is the modified Bessel function. We take \({\varGamma }_0=4\pi R_0\). The domain size is \(-2.5R_0\le x_1\le 2.5R_0\) and \(-5R_0\le x_2,x_3\le 5R_0\). The coordinate direction 1 is taken as the axial direction. We take a regular grid with 21 data points in the 1-direction and 41 data points in the 2- and 3-directions. So there are 35,301 data points in total. We use a correlation length of \(10R_0\) in each direction. So the support radius spans the complete vortex ring. Table 3 shows the noise reduction for the velocity and vorticity magnitude. Again, \(\text {BOX}_{3\times 3}\) results in the lowest noise reduction for the velocity field. However, as for the previous test case, it returns more accurate vorticity fields than DCS and SWR, where DCS again leaves the measured vorticity field unchanged. SGPR results in the highest noise reduction for the vorticity field, but for the velocity field SWR is marginally better. To get a qualitative impression of the methods, Fig. 5 compares the true vortex ring with the filtered ones. Figure 6 shows how the noise reduction is influenced by the choice of correlation length. The value we chose (\(\gamma /R_0=10\)) is close to the optimum at \(\gamma /R_0=14\). At this value, the noise reduction in velocity and vorticity is 30.4 and 23.2 %, respectively. Similar to the Taylor vortex, the current graph has three characteristics, namely an optimum inside the interval, a large decrease in noise reduction for small correlation lengths and a relatively flat curve around the optimum.

Figure 7 shows the circular jet in water. The jet velocity at the nozzle exit is 0.5 m/s, so assuming incompressible flow is an excellent approximation. The jet periodically creates vortex rings, as can clearly be seen from Fig. 7. The data set consists of 289,328 vectors and is defined on a regular grid, with 107 vectors in the jet direction and 52 vectors in the cross directions. Since we are considering experimental data, there is no perfect reference solution. To make a quantitative performance assessment of the solenoidal filters, we use a recent method that estimates a posteriori random uncertainty for measurements locally (Sciacchitano 2015). It is also applicable for tomographic PIV. It expresses the distribution of error for each vector component in terms of standard deviation (1 sigma). Figure 8 shows isosurfaces of the standard deviation at a velocity magnitude of 0.035 (m/s). Clearly, the measurement uncertainty varies in space. Also notice how the uncertainty is localized inside the jet, as opposed to outside where the flow is practically at rest. In particular, we can identify ring shapes (compare with the vortex rings in Fig. 7). These are regions with strong velocity gradients, so it is reasonable to expect larger uncertainties there (Sciacchitano et al. 2013). When using SGPR, we consider two scenarios. In the first, we do not include the a posteriori measurement uncertainty in the reconstruction. In the second scenario, we take it into account in R.

The covariance function we use is given by Eq. 13. The correlation length we use spans 15 vectors in each direction, which is approximately the diameter of a vortex ring, i.e., \(d_\text {vortex}=15h\). To investigate the influence of the correlation length on the reconstructed velocity field, we under sample the data set by halving the measurement resolution in each direction. The data points in between are taken as validation, which we then use to calculate the root-mean-square error. Figure 9 shows the result. The behavior is very similar to what we found for the synthetic data sets in the previous section: (1) There is an optimum correlation length inside the interval; (2) small values of the correlation length lead to an abrupt increase in root-mean-square error; (3) around the optimum, the graph is relatively flat . Again, we emphasize that the latter characteristic is a desirable one from a robustness point of view. It turns out that our choice of correlation length \(\gamma / d_\text {vortex}=1\) was a very good one. Not only are we in the flat region, we are at the beginning of it. This is advantageous since a smaller correlation length leads to a better conditioned gain matrix, resulting in faster convergence. Note that we have only under sampled to understand the relation between reconstruction accuracy and correlation length. In the following, we use the full data set.

Figure 10a shows isosurfaces of the velocity divergence at 15 (1/s). Before removing the spurious divergence, we first quantify how far from divergence-free the data set is. The following metric is due to Zhang et al. (1997):The mean of \(\delta\) will lie between 0 and 1. When \(\bar{\delta }=0\), the velocity field is exactly divergence-free. When \(\bar{\delta }=1\), the velocity components are independent, random variables. Zhang et al. (1997) showed that smoothing of the data can significantly reduce this value. For a turbulent flow measurement in a square duct using hybrid holographic PIV, they showed how using a Gaussian filter decreased \(\bar{\delta }\) from 0.74 to 0.50. For the data set used in the present paper, we found that \(\bar{\delta }=0.66\). Figure 10b shows the isosurfaces of velocity divergence after applying SGPR. The mean of the normalized divergence is \(\bar{\delta }=0.09\). Note that even though SGPR defines an analytically divergence-free field, we see some spurious divergence. This is because it was calculated using finite differencing to compare with the original data set. Therefore, the spurious divergence we observe for SGPR is completely due to truncation error. So the spurious divergence observed in the data set is for a large part not due to truncation error, but other sources that arise from measurements, like random measurement errors. The reason that we do not show the velocity divergence after applying DCS or SWR is because they are defined to return divergence-free fields on a finite-difference and finite-volume level, respectively. So, the divergence calculated with these methods at the data points is zero.

We quantify the performance of the filters by using the following metric:where \(u_{{\rm sol},i}\left( {\mathbf {x}}\right)\) is the solenoidal velocity field in the i-direction, obtained with DCS, SWR or SGPR and \(u_{{\rm exp},i}\left( {\mathbf {x}}\right)\) is the experimental velocity in the i-direction. The a posteriori standard deviation of the random uncertainty in the i-direction is given by \(\sigma _i\left( {\mathbf {x}}\right)\). Ideally, all reconstructed data points should have \(\xi _i\le 3\), i.e., the error should be within 3 standard deviations of the measurement uncertainty (99.7 % certainty). Figure 11 shows the cumulative distribution of \(\xi _1\). The plots for the other two directions look very similar. The results for DCS and SWR are practically identical. When the a posteriori measurement uncertainty information is not included (1), SGPR is only slightly better than the other filters. However, when this information is included in the reconstruction (2), the method is clearly better in reconstructing a solenoidal velocity field within the measurement uncertainty. At \(\xi _i=3\), \(F(\xi _i)\) is 1, whereas for DCS and SWR the value is around 0.9, meaning that 10 % of the data points have a deviation from the measurements greater than 3 standard deviations. With regard to the average \(\xi _1\), DCS and SWR are equal to 2.0. For SGPR, it is 1.8 when no measurement uncertainty is included, but it reduces to 0.3 when this information is incorporated. In conclusion, when including local measurement uncertainty, SGPR is able to return a divergence-free velocity field that follows the measured velocity field more faithfully.

For this data set, the free stream velocity is 10 m/s, so incompressible flow is again an excellent approximation. The data set consists of 185,484 vectors and is defined on a regular grid, with 58 vectors in streamwise (x)-direction, 123 vectors in the spanwise (z)-direction and 26 vectors in the wall-normal (y) direction. Since the particle images were not available to us, we were unable to use the approach by Sciacchitano (2015) to estimate the measurement uncertainty, as was done in the first experimental test case. Therefore, for SGPR the observation error covariance matrix R is set to the identity matrix multiplied with \(\lambda =10^{-2}\). We again use Eq. 13 as the covariance function. Recall that for the circular jet in water, we chose the correlation length equal to the diameter of the vortex ring. The present turbulent boundary layer does not have such a distinguishable feature. One can suggest to use the boundary layer thickness for this and set the correlation length equal to it. However, the boundary layer thickness is approximately 9.4 mm and the height of the measurement volume is 4.2 mm, so the measurement volume is completely immersed in the boundary layer. For this reason, we simply chose the correlation length equal to the height of the measurement volume H. Indeed, as was explained before, larger correlation length results in a more ill-conditioned system matrix, which increases the computational time. To investigate the influence of the correlation length on the reconstructed velocity field, we again under sample the data set by halving the measurement resolution in each direction. The data points in between are taken as validation, which we then use to calculate the root-mean-square error. Figure 12 shows the result. We observe that the chosen correlation length of \(\gamma /H=1\) is close to the optimum. Before applying SGPR, \(\bar{\delta }=0.74\). After application of this filter, it reduces to \(\bar{\delta }=0.03\).

Contrary to the previous experimental test case, no a posteriori estimates of random uncertainty for the velocity measurements are available. Instead, to quantify the reconstruction accuracy of the solenoidal filters, we derive pressure fields from the time-resolved velocity field measurements and compare the results with a pinhole microphone located on the wall. The boundary conditions imposed are the same as discussed in Pröbsting et al. (2013), so Neumann boundary conditions at all sides except the top side closest to the free stream, where the pressure is prescribed (Dirichlet boundary condition). Three approaches are followed to evaluate the acceleration, required for the pressure calculation: (1) the Eulerian scheme (eul), where the material acceleration is evaluated with respect to a stationary reference frame; (2) the “standard” Lagrangian scheme (lag), where the material acceleration is calculated by following a fluid particle. The specific method used is that mentioned by van Oudheusden (2013), i.e., a first-order reconstruction of the particle track with a central difference scheme for the material acceleration at the next and previous time instances; (3) a least-squares regression of the fluid parcel’s velocity using a first-order polynomial basis (\(\text {lsr}_{N}\)), as proposed by Pröbsting et al. (2013). Here, N is the number of velocity fields over which the particle trajectory is followed. The two latter approaches are both Lagrangian methods. According to Violato et al. (2011), Lagrangian methods are more accurate for convection dominated flows, like boundary layer flows. For the synthetic test case of the (non-convecting) Taylor vortex (Sect. 4.1), we only used the Eulerian scheme. To determine the microphone location on the wall (the particle images were not available), we cross-correlated the time series of the microphone measurement with the PIV-derived pressure fields. Figure 13 shows the cross-correlation coefficient taken at a region where we believed the microphone was located. We clearly see a peak and this is where the microphone is most likely located.

Following Pröbsting et al. (2013), we show the pressure time series for a subset of the data in Fig. 14. Both the microphone and PIV-derived pressure signals were band pass-filtered over the range 300 Hz to 3 kHz. We have not shown the signals obtained with the other solenoidal filters to avoid obscuring the plots; however, they are very similar to SGPR. As expected, the worst reconstruction is obtained with the Eulerian scheme. Improvements are obtained by switching to the Lagrangian scheme. The best results are obtained when using the least-squares regressor, where 9 velocity fields were used for the particle trajectory. Comparing the results before and after applying SGPR, we clearly see that SGPR improves the reconstruction. The improvement is most noticeable for the Eulerian scheme and the least for the least-squares regressor with 9 velocity fields, in which case the random errors seem to be sufficiently suppressed, leaving out mainly bias errors. However, we emphasize that using many velocity fields to reconstruct a particle trajectory is in principle undesirable since this results in a larger number of particles to fall outside the measurement domain, potentially cropping a large part of the reconstructed pressure field. Therefore, it is indeed an important advantage that the solenoidal filters result in a significant improvement when using the Eulerian and standard Lagrangian schemes. For completeness, Table 4 shows the cross-correlation coefficients achieved using the various solenoidal filters and the various acceleration calculation schemes. As stated previously, the solenoidal filters return similar results and they always result in an improved pressure signal. This is independent of which scheme is used to calculate the acceleration, though the gain becomes less noticeable as more velocity fields are used to reconstruct a particle trajectory using lsr.