Difference between revisions of "Analysis of Step 4"

From CFD Benchmark
Jump to: navigation, search
(Comparing results at spatial resolution of 256^3)
 
(One intermediate revision by the same user not shown)
Line 1: Line 1:
 
'''Step 4''' is definitely the most complex but also the most interesting case to compare '''high-fidelity codes''' for '''turbulent reacting flows''', since it contains all the features relevant for '''turbulent combustion'''. Therefore, a more detailed analysis is useful. The comparisons will involve:
 
'''Step 4''' is definitely the most complex but also the most interesting case to compare '''high-fidelity codes''' for '''turbulent reacting flows''', since it contains all the features relevant for '''turbulent combustion'''. Therefore, a more detailed analysis is useful. The comparisons will involve:
  
1. The '''evolution of maximum temperature''' versus '''time''', as depicted in Fig. 10;
+
1. The '''evolution of maximum temperature''' versus '''time''';
  
2. '''Velocity fields''' at <math>t = 2 \tau_{ref} = 0.5 ms</math> along the centerlines of the domain, as shown in Fig. 11;
+
2. '''Velocity fields''' at <math>t = 2 \tau_{ref} = 0.5 ms</math> along the centerlines of the domain;
  
3. '''Profiles of temperature''', '''heat release''' and '''mass fractions''' of <math>H_2</math>, <math>O_2</math> and <math>OH</math> at <math>t = 2 \tau_{ref} = 0.5 ms</math> along the
+
3. '''Profiles of temperature''', '''heat release''' and '''mass fractions''' of <math>H_2</math>, <math>O_2</math> and <math>OH</math> at <math>t = 2 \tau_{ref} = 0.5 ms</math> along the centerline of the domain.
centerline of the domain, as illustrated in Figs. 12 and 13.
+
  
 
The simulations of '''YALES2''', '''DINO''' and '''Nek5000''' are presented in the following subsections for two different
 
The simulations of '''YALES2''', '''DINO''' and '''Nek5000''' are presented in the following subsections for two different
 
resolutions in space (<math>256^3</math> and <math>512^3</math>), in order to check the impact of the '''spatial resolution''' on the results. Additional data for other grids are also available (<math>384^3</math>
 
resolutions in space (<math>256^3</math> and <math>512^3</math>), in order to check the impact of the '''spatial resolution''' on the results. Additional data for other grids are also available (<math>384^3</math>
for both '''YALES2''' and '''DINO''', and 7683 only for '''DINO'''). They are not discussed at length in the text and in separate figures in the interest of space, but the corresponding values are included in the Tables 4 and 5 summarizing all results of '''Step 4'''. Additionally, all results at all grid resolutions are available online in the benchmark repository <ref name="TGV-coria-cfd">[https://benchmark.coria-cfd.fr benchmark.coria-cfd.fr]</ref>.
+
for both '''YALES2''' and '''DINO''', and <math>768^3</math> only for '''DINO'''). They are not discussed at length in the text and in separate figures in the interest of space, but the corresponding values are included in the Tables 4 and 5 summarizing all results of '''Step 4'''. Additionally, all results at all grid resolutions are available online in the benchmark repository <ref name="TGV-coria-cfd">[https://benchmark.coria-cfd.fr benchmark.coria-cfd.fr]</ref>.
 
Starting with the evolution of maximum temperature versus time, a perfect visual agreement between all three
 
Starting with the evolution of maximum temperature versus time, a perfect visual agreement between all three
codes is observed at all resolutions, as shown in Fig. 10 (with a resolution of <math>512^3</math>
+
codes is observed at all resolutions. This quantity does not appear to be difficult to predict correctly, as already observed previously for the non-reacting flow in '''Step 3''', provided that the pressure variation due to the heat release is correctly taken into account.
). This quantity does not appear
+
to be difficult to predict correctly, as already observed previously for the non-reacting flow in '''Step 3''', provided that the pressure variation due to the heat release is correctly taken into account.
+
  
 
== Comparing results at spatial resolution of <math>256^3</math> ==
 
== Comparing results at spatial resolution of <math>256^3</math> ==
Line 21: Line 18:
 
for '''YALES2'''
 
for '''YALES2'''
 
and '''DINO''' and 2523
 
and '''DINO''' and 2523
for '''Nek5000'''. The corresponding results for '''velocity''' (Fig. 11) and '''temperature''' (Fig. 12, left)
+
for '''Nek5000'''. The corresponding results for '''velocity''' and '''temperature''' at time <math>t = 2 \tau_{ref} = 0.5 ms</math> along the centerlines of the domain show visually a perfect agreement. Nevertheless, the three codes show slight differences concerning heat release and some '''mass fractions profiles''' (in particular <math>O_2</math> and <math>OH</math>) around the center of the domain. These differences – though small
at time <math>t = 2 \tau_{ref} = 0.5 ms</math> along the centerlines of the domain show visually a perfect agreement. Nevertheless, the
+
three codes show slight differences concerning heat release and some '''mass fractions profiles''' (in particular <math>O_2</math> and <math>OH</math>)
+
around the center of the domain, as it can be observed from Figs. 12 (right) and 13. These differences – though small
+
 
– are larger than those experienced in the non-reacting case. Note that there is originally no oxygen in this region,
 
– are larger than those experienced in the non-reacting case. Note that there is originally no oxygen in this region,
 
explaining why the mass fraction of <math>O_2</math> is still smaller than the mass fraction of <math>OH</math> there. One reason behind these
 
explaining why the mass fraction of <math>O_2</math> is still smaller than the mass fraction of <math>OH</math> there. One reason behind these
Line 59: Line 53:
 
Only the quantities showing visible discrepancies at a resolution of <math>256^3</math>
 
Only the quantities showing visible discrepancies at a resolution of <math>256^3</math>
 
(heat release, <math>Y_{O_2}</math>, <math>Y_{OH}</math>) are discussed here in the interest of brevity, since all other quantities already revealed a perfect agreement for the previous resolution.
 
(heat release, <math>Y_{O_2}</math>, <math>Y_{OH}</math>) are discussed here in the interest of brevity, since all other quantities already revealed a perfect agreement for the previous resolution.
It can be observed in Figs. 14 and 15 that doubling the spatial resolution in each direction did not improve the
+
It can be observed in the figures below that doubling the spatial resolution in each direction did not improve the
 
comparisons in a clear way; marginal differences still exist between the codes, and a convergence towards a unique
 
comparisons in a clear way; marginal differences still exist between the codes, and a convergence towards a unique
 
solution is not really visible. To discuss this issue in more detail, a refined analysis is necessary, as discussed in the
 
solution is not really visible. To discuss this issue in more detail, a refined analysis is necessary, as discussed in the

Latest revision as of 14:33, 26 August 2020

Step 4 is definitely the most complex but also the most interesting case to compare high-fidelity codes for turbulent reacting flows, since it contains all the features relevant for turbulent combustion. Therefore, a more detailed analysis is useful. The comparisons will involve:

1. The evolution of maximum temperature versus time;

2. Velocity fields at along the centerlines of the domain;

3. Profiles of temperature, heat release and mass fractions of , and at along the centerline of the domain.

The simulations of YALES2, DINO and Nek5000 are presented in the following subsections for two different resolutions in space ( and ), in order to check the impact of the spatial resolution on the results. Additional data for other grids are also available ( for both YALES2 and DINO, and only for DINO). They are not discussed at length in the text and in separate figures in the interest of space, but the corresponding values are included in the Tables 4 and 5 summarizing all results of Step 4. Additionally, all results at all grid resolutions are available online in the benchmark repository [1]. Starting with the evolution of maximum temperature versus time, a perfect visual agreement between all three codes is observed at all resolutions. This quantity does not appear to be difficult to predict correctly, as already observed previously for the non-reacting flow in Step 3, provided that the pressure variation due to the heat release is correctly taken into account.

Comparing results at spatial resolution of

The results shown in this section have been obtained for the same grid size than in Step 3, i.e. for YALES2 and DINO and 2523 for Nek5000. The corresponding results for velocity and temperature at time along the centerlines of the domain show visually a perfect agreement. Nevertheless, the three codes show slight differences concerning heat release and some mass fractions profiles (in particular and ) around the center of the domain. These differences – though small – are larger than those experienced in the non-reacting case. Note that there is originally no oxygen in this region, explaining why the mass fraction of is still smaller than the mass fraction of there. One reason behind these discrepancies might be the well-known stiffness of the chemical source terms, inducing different non-linear effects as a function of the underlying algorithms employed for integration in time. Another possible source of error is the employed spatial discretization, which might still be insufficient to perfectly capture the reaction front; in the present case, the typical cell size is approximately 25 µm. To check this last point, the simulations have been repeated with a finer spatial resolution, as discussed in the next subsection.

Vx x lm 256.png Vy y lm 256.png

Velocity at time for 3-D reacting case (Step 4) with grid points.

T y lm 256.png Hr y lm 256 withzoom.png

Temperature (left) and heat release profiles (right) at , , and time for 3-D reacting case (Step 4) with grid points.

Yh2 y lm 256.png Yo2 y lm 256 withzoom.png Yoh y lm 256 withzoom.png

Mass fraction profiles of , , and at </math>x = 0.5 L</math>, , and time for 3-D reacting case (Step 4) with grid points.

Comparing results at spatial resolution of

The present results have been obtained on a grid size of for YALES2 and DINO, while Nek5000 relies on similar discretization size of 5143 (57 spectral elements of order 9 in each direction). To reduce computational costs, the simulation is conducted only for the first of physical time. Only the quantities showing visible discrepancies at a resolution of (heat release, , ) are discussed here in the interest of brevity, since all other quantities already revealed a perfect agreement for the previous resolution. It can be observed in the figures below that doubling the spatial resolution in each direction did not improve the comparisons in a clear way; marginal differences still exist between the codes, and a convergence towards a unique solution is not really visible. To discuss this issue in more detail, a refined analysis is necessary, as discussed in the next subsection.

T y lm 512.png Hr y lm 512 withzoom.png

Temperature (left) and heat release profiles (right) at , , and time for 3-D reacting case (Step 4) with grid points.

Yo2 y lm 512 withzoom.png Yoh y lm 512 withzoom.png

Mass fraction profiles of (left), and (right) at , , and time for 3-D reacting case (Step 4) with grid points.

Quantitative comparisons at the center point at t = 0.5 ms

In Table 4 the values of different variables at the center of the numerical domain at time are presented and analyzed. These values have been obtained for the three different codes involved in the benchmark (from left to right, YALES2, DINO, Nek5000), for an increasing spatial resolution from left to right, but also with different timesteps. The controlling time-limiter (as a condition on maximum CFL or Fourier number with corresponding value) is also listed in the table; it depends on the retained criteria and on the explicit or implicit integration of the corresponding terms in the equations.

Values of different variables at the center of the domain at time
Code YALES2 YALES2 YALES2 DINO DINO DINO DINO Nek5000 Nek5000
Spatial resolution
Timestep control CFL=0.10 CFL=0.15 CFL=0.25 Fo=0.15 Fo=0.15 Fo=0.15 Fo=0.2 CFL=0.25 CFL=0.25
1752 1751 1750 1754 1755 1755 1758 1758 1758
1.553E-3 1.523E-3 1.523E-3 1.508E-3 1.500E-3 1.508E-3 1.521E-3 1.499E-3 1.506E-3
2.692E-3 2.714E-3 2.720E-3 2.764E-3 2.737E-3 2.720E-3 2.700E-3 2.681E-3 2.688E-3
1.852E-3 1.838E-3 1.831E-3 1.844E-3 1.851E-3 1.858E-3 1.873E-3 1.862E-3 1.861E-3
670.8 669.7 670.1 684.1 675.8 673.5 671.8 674.2 660.8

Looking separately at the values obtained by each code, it is not always easy to recognize the convergence toward a single value that would be expected for a grid-independence analysis. By a comparison between the last column for each code, a good agreement is overall observed, in spite of differences regarding algorithms, resolution in space and in time. Nevertheless, the agreement is never perfect, and trends can better be seen by computing differences. This is why, choosing arbitrarily the results of the implicit time integration at the highest spatial resolution with DINO (7683) as a reference, all corresponding relative errors have been computed.

Values of different variables at the center of the domain at time
Code YALES2 YALES2 YALES2 DINO DINO DINO DINO Nek5000 Nek5000
Spatial resolution
Controlling CFL/Fo CFL=0.10 CFL=0.15 CFL=0.25 Fo=0.15 Fo=0.15 Fo=0.15 Fo=0.2 CFL=0.25 CFL=0.25
−0.341 −0.398 −0.455 −0.228 −0.171 −0.171 0 [Ref] 0 0
2.104 0.131 0.131 −0.855 −1.381 −0.855 0 [Ref] −1.446 −0.986
−0.296 0.518 0.741 2.370 1.370 0.741 0 [Ref] −0.704 −0.444
−1.121 −1.869 −2.242 −1.548 −1.175 −0.801 0 [Ref] −0.587 −0.641
−0.149 −0.313 −0.253 1.831 0.595 0.253 0 [Ref] 0.363 −1.637

Analyzing in detail all the values, the following intermediate conclusions can be drawn:

• The overall agreement between the three completely independent high-resolution codes employed in the benchmark is very good, with typical relative differences of the order of 1% for the essential quantities used to analyze turbulent combustion (temperature, mass fractions, heat release). 23

• Compared to the differences observed in the previous verification step (errors below 0.03%), the variations are obviously much larger, typically by two orders of magnitude. This is a result of the far more challenging configuration, with additional physicochemical complexity, stiffer profiles, highly non-linear processes in space and time.

• Increasing further the spatial resolution (which is also connected to a reduction of the timestep) does not seem to increase much the observed agreement between the codes. For all considered grids in the analysis finer than , overall differences of the order of 1% are observed. Often, using a finer resolution leads to a better agreement for most of the indicators, but to a worse comparison for some other ones.

• Though this has been attempted, it was impossible to obtain meaningful predictions using the Richardson extrapolation [2][3], since the results of all codes are non-monotonic when increasing resolution in space.

• Somewhat unexpectedly, the observed uncertainty is in the same range for temperature, mass fractions of main species or of radicals, and heat release. Quantities that are typically considered more sensitive (radicals, heat release) do not lead to larger discrepancies in the analysis.

Finally, the central finding is that all codes employed in the benchmark deliver suitable results for this configuration, and this already at a typical grid resolution of for this particular case. An irreducible uncertainty of the order of 1% is observed for all quantities relevant for turbulent combustion. This uncertainty, noticeably larger than for cold flows, is apparently the result of stiff non-linear processes, of different splitting schemes, and of the different libraries/library versions employed for computing thermodynamic, diffusion, and reaction parameters. After this detailed analysis of uncertainty, it is necessary to quantify the corresponding numerical costs needed to get this level of accuracy.

References

  1. benchmark.coria-cfd.fr
  2. J.H. Ferziger, M. Peric, Computational Methods for Fluid Dynamics, Springer , 2012, Bibtex
    Author : J.H. Ferziger, M. Peric
    Title : Computational Methods for Fluid Dynamics
    In : Springer -
    Address :
    Date : 2012
  3. I.B. Celik, U. Ghia, P.J. Roache, C.J. Freitas, H. Coleman,, P.E. Raad, Procedure for estimation and reporting of uncertainty due to discretization in CFD applications, J. Fluids Eng. 130, 2008, Bibtex
    Author : I.B. Celik, U. Ghia, P.J. Roache, C.J. Freitas, H. Coleman,, P.E. Raad
    Title : Procedure for estimation and reporting of uncertainty due to discretization in CFD applications
    In : J. Fluids Eng. -
    Address :
    Date : 2008