Digital Simulation Verification and Validation

The paper considers the steps involved in building modern digital simulations, from a conceptual mathematical model to specific simulation settings, for example, meshing parameters. The paper presents a generalised approach to verification and validation of computer simulations and describes its main stages. The approach proposed is based on the assumption that the complex physical phenomena and objects to be simulated have a hierarchical structure that allows them to be split into constituent components (according to their design purpose, such as assemblies or parts, or according to the field of study, such as gas dynamics, combustion, heat transfer, etc.). Each element uses its own mathematical (or digital) model that will have undergone verification and validation. A complex computer simulation is verified and validated from the bottom up, that is, in the following order: individual parts, then assemblies, and finally the physical phenomenon or object under consideration. We consider a case study of verification and validation as pertaining to a comprehensive calculation of axial turbine parameters for a gas turbine engine. We also address issues concerning verification and certification of software used to develop digital simulations, as well as issues concerning verification and validation of digital product twins.

References

[1] Guide for verification and validation in computational solid mechanics. ASME, 2006. 28 p.

[2] Guide for the verification and validation of computational fluid dynamics simulations. AIAA-G-077-1998. AIAA, 1998. 44 p.

[3] Popper K.R. The logic of scientific discovery. Basic Books, 1959. 479 p.

[4] Carnap R. Testability and meaning. Philos. Sci., 1936, vol. 3, no. 4, pp. 419–471.

[5] Kleindorfer G.B., O’Neill L., Ganeshan R. Validation in simulation: various positions in the philosophy of science. Manage. Sci., 1998, vol. 44, no. 8, pp. 1021–1066, doi: https://doi.org/10.1287/mnsc.44.8.1087

[6] Balci O., Sargent R.G. A bibliography on the credibility assessment and validation of simulation and mathematical models. Simuletter, 1984, vol. 15, no. 3, pp. 15–27.

[7] Hamilton M.A. Model validation: an annotated bibliography. Commun. Stat. — Theory Methods, 1991, vol. 20, no. 7, pp. 2207–2266, doi: https://doi.org/10.1080/03610929108830628

[8] Oberkampf W.L. Bibliography for verification and validation in computational simulation. SAND98-2041. Sandia National Laboratories, 1998.

[9] GOST R 57700.1–2017. Chislennoe modelirovanie dlya razrabotki i sdachi v ekspluatatsiyu vysokotekhnologichnykh promyshlennykh izdeliy. Sertifikatsiya programmnogo obespecheniya. Trebovaniya [State standard GOST R 57700.1–2017. Numerical simulation for the development and commissioning of high-tech industrial products. Software certification. Requirements]. Moscow, Standartinform Publ., 2018. 10 p. (In Russ.).

[10] GOST R 57700.2–2017. Chislennoe modelirovanie dlya razrabotki i sdachi v ekspluatatsiyu vysokotekhnologichnykh promyshlennykh izdeliy. Sertifikatsiya programmnogo obespecheniya. Obshchie polozheniya [State standard GOST R 57700.2-2017. Numerical simulation for the development and commissioning of high-tech industrial products. Software certification. General provisions]. Moscow, Standartinform Publ. 2018. 5 p. (In Russ.).

[11] GOST R 57700.24–2020. Kompyuternye modeli i modelirovanie. Validatsionnyy basis [State standard GOST R 57700.24-2020. Computer models and simulation. Validation basis]. Moscow, Standartinform Publ., 2020. 5 p. (In Russ.).

[12] Vinogradov K.A., Kretinin G.V, Leshenko I.A. et al. Robust multiphysics optimization for fan blade aerodynamic efficiency, structural properties and flutter sensitivity. ASME Turbo Expo, 2018, vol. 2D, paper GT2018-76816, doi: https://doi.org/10.1115/GT2018-76816

[13] Salnikov A.V., Danilov M.A., Chistov K.A. et al. [Development of digital twin demonstrator for gas turbine engine]. ICAM-2020. T. 1 [ICAM-2020. Vol. 1]. Moscow, TsIAM im. P.I. Baranova Publ., 2021, pp. 231–234. (In Russ.).

[14] Temis Yu.M., Solovyeva A.V., Zhurenkov Yu.N. et al. Digital twin of rig for testing of centrifugal compressor for small-scale gas turbine engine. Aviatsionnye dvigateli [Aviation Engines], 2021, no. 1, pp. 5–16, doi: https://doi.org/10.54349/26586061_2021_1_5 (in Russ.).

[15] Salnikov A.V., Gordin M.V., Shmotin Yu.N. et al. Digital twins - a platform for aircraft engine lifecycle management. Izvestiya vysshikh uchebnykh zavedeniy. Mashinostroenie [BMSTU Journal of Mechanical Engineering], 2022, no. 4, pp. 60–72, doi: https://doi.org/10.18698/0536-1044-2022-4-60-72 (in Russ.).