CFD Vision 2030 Study: A Path to Revolutionary Computational Aerosciences

Page created by June Higgins
 
CONTINUE READING
CFD Vision 2030 Study: A Path to Revolutionary Computational Aerosciences
NASA/CR–2014-218178

CFD Vision 2030 Study: A Path to
Revolutionary Computational Aerosciences
Jeffrey Slotnick and Abdollah Khodadoust
Boeing Research & Technology, Huntington Beach, California

Juan Alonso
Stanford University, Stanford, California

David Darmofal
Massachusetts Institute of Technology, Cambridge, Massachusetts

William Gropp
National Center for Supercomputing Applications, Urbana, Illinois

Elizabeth Lurie
Pratt & Whitney, United Technologies Corporation, East Hartford, Connecticut

Dimitri Mavriplis
University of Wyoming, Laramie, Wyoming

March 2014
CFD Vision 2030 Study: A Path to Revolutionary Computational Aerosciences
NASA STI Program . . . in Profile

Since its founding, NASA has been dedicated to the          CONFERENCE PUBLICATION.
advancement of aeronautics and space science. The            Collected papers from scientific and
NASA scientific and technical information (STI)              technical conferences, symposia, seminars,
program plays a key part in helping NASA maintain            or other meetings sponsored or co-
this important role.                                         sponsored by NASA.

The NASA STI program operates under the                     SPECIAL PUBLICATION. Scientific,
auspices of the Agency Chief Information Officer.            technical, or historical information from
It collects, organizes, provides for archiving, and          NASA programs, projects, and missions,
disseminates NASA’s STI. The NASA STI                        often concerned with subjects having
program provides access to the NASA Aeronautics              substantial public interest.
and Space Database and its public interface, the
NASA Technical Report Server, thus providing one            TECHNICAL TRANSLATION.
of the largest collections of aeronautical and space         English-language translations of foreign
science STI in the world. Results are published in           scientific and technical material pertinent to
both non-NASA channels and by NASA in the                    NASA’s mission.
NASA STI Report Series, which includes the
following report types:                                  Specialized services also include organizing
                                                         and publishing research results, distributing
                                                         specialized research announcements and feeds,
   TECHNICAL PUBLICATION. Reports of                    providing information desk and personal search
    completed research or a major significant phase      support, and enabling data exchange services.
    of research that present the results of NASA
    Programs and include extensive data or               For more information about the NASA STI
    theoretical analysis. Includes compilations of       program, see the following:
    significant scientific and technical data and
    information deemed to be of continuing                  Access the NASA STI program home page
    reference value. NASA counterpart of peer-               at http://www.sti.nasa.gov
    reviewed formal professional papers, but
    having less stringent limitations on manuscript         E-mail your question to help@sti.nasa.gov
    length and extent of graphic presentations.
                                                            Fax your question to the NASA STI
   TECHNICAL MEMORANDUM. Scientific                         Information Desk at 443-757-5803
    and technical findings that are preliminary or of
    specialized interest, e.g., quick release reports,      Phone the NASA STI Information Desk at
    working papers, and bibliographies that contain          443-757-5802
    minimal annotation. Does not contain extensive
    analysis.                                               Write to:
                                                             STI Information Desk
   CONTRACTOR REPORT. Scientific and                        NASA Center for AeroSpace Information
    technical findings by NASA-sponsored                     7115 Standard Drive
    contractors and grantees.                                Hanover, MD 21076-1320
NASA/CR–2014-218178

CFD Vision 2030 Study: A Path to
Revolutionary Computational Aerosciences

Jeffrey Slotnick and Abdollah Khodadoust
Boeing Research & Technology, Huntington Beach, California

Juan Alonso
Stanford University, Stanford, California

David Darmofal
Massachusetts Institute of Technology, Cambridge, Massachusetts

William Gropp
National Center for Supercomputing Applications, Urbana, Illinois

Elizabeth Lurie
Pratt & Whitney, United Technologies Corporation, East Hartford, Connecticut

Dimitri Mavriplis
University of Wyoming, Laramie, Wyoming

National Aeronautics and
Space Administration

Langley Research Center                               Prepared for Langley Research Center
Hampton, Virginia 23681-2199                          under Contract NNL08AA16B

March 2014
The use of trademarks or names of manufacturers in this report is for accurate reporting and does not constitute an
official endorsement, either expressed or implied, of such products or manufacturers by the National Aeronautics
and Space Administration.

                                                 Available from:

                                    NASA Center for AeroSpace Information
                                           7115 Standard Drive
                                         Hanover, MD 21076-1320
                                               443-757-5802
Table of Contents

1  EXECUTIVE SUMMARY .............................................................................................................................. 1
2  INTRODUCTION ............................................................................................................................................ 4
3  VISION OF CFD IN 2030 ................................................................................................................................ 5
4  CURRENT STATE .......................................................................................................................................... 6
5  CFD TECHNOLOGY GAPS AND IMPEDIMENTS................................................................................... 9
   5.1 Effective Utilization of High-Performance Computing (HPC) ..................................................................9
       CASE STUDY 1: Current Utilization of HPC at NASA .........................................................................10
   5.2 Unsteady Turbulent Flow Simulations Including Transition and Separation...........................................12
       CASE STUDY 2: LES Cost Estimates and 2030 Outlook ......................................................................13
   5.3 Autonomous and Reliable CFD Simulation .............................................................................................15
       CASE STUDY 3: Scalable Solver Development.....................................................................................16
   5.4 Knowledge Extraction and Visualization .................................................................................................18
   5.5 Multidisciplinary/Multiphysics Simulations and Frameworks .................................................................18
6  TECHNOLOGY DEVELOPMENT PLAN ................................................................................................. 20
   6.1 Grand Challenge Problems .......................................................................................................................20
       CASE STUDY 4: Impact of CFD Tool Development on NASA Science and Space Exploration
       Missions ...................................................................................................................................................21
   6.2 Technology Roadmap ...............................................................................................................................22
7  RECOMMENDATIONS ............................................................................................................................... 27
   7.1 Development of a Comprehensive Revolutionary Computational Aerosciences Program ......................28
   7.2 Programmatic Considerations...................................................................................................................30
       CASE STUDY 5: Community Verification and Validation Resources .................................................32
   7.3 Strategic Considerations ...........................................................................................................................33
       CASE STUDY 6: Sponsored Research Institutes ....................................................................................34
8  CONCLUSIONS ............................................................................................................................................. 37
9  ACKNOWLEDGMENTS .............................................................................................................................. 37
10 REFERENCES ............................................................................................................................................... 37
APPENDIX A. HIGH PERFORMANCE COMPUTING TRENDS AND FORECAST FOR 2030 ............. 45

                                                                                 i
List of Figures

Figure 1.   Technology Development Roadmap ………………………………………………………………… .. 23
Figure 2.   Proposed Enhanced Revolutionary Computational Sciences Program ....................................................29
Figure 3.   Proposed New Revolutionary Computational Sciences (RCA) Program Structure .................................29
Figure 4.   Changing Predictions About Semiconductor Sizes ..................................................................................45

                                                             List of Tables

Table 1. Estimated Performance for Leadership-class Systems ................................................................................49

                                                                      ii
follow-up, a workshop was held with academic, industrial,
1    Executive Summary                                              and government participants from the general aerospace en-
                                                                    gineering community with a stake in simulation-based engi-
The ability to simulate aerodynamic flows using computa-
                                                                    neering. The results from the survey and workshop were syn-
tional fluid dynamics (CFD) has progressed rapidly during
                                                                    thesized and refined by the team, with considerable additions
the last several decades and has fundamentally changed the
                                                                    through internal discussions and feedback from sponsoring
aerospace design process. Advanced simulation capabilities
                                                                    NASA officials. The overall project spanned a period of 12
not only enable reductions in ground-based and in-flight
                                                                    months and resulted in a series of findings, a vision for the
testing requirements, but also provide added physical in-
                                                                    capabilities required in the year 2030, and a set of recom-
sight, enable superior designs at reduced cost and risk, and
                                                                    mendations for achieving these capabilities.
open new frontiers in aerospace vehicle design and perfor-
mance. Throughout the evolution of physics-based simula-            Findings
tion technologies in general, and computational fluid dy-
namics methods in particular, NASA’s Aeronautics Re-                1.   NASA investment in basic research and technology
search Mission Directorate has played a leading role in the              development for simulation-based analysis and de-
development and deployment of these technologies. How-                   sign has declined significantly in the last decade and
ever, today the aerospace CFD community finds itself at a                must be reinvigorated if substantial advances in
crossroads due to the convergence of several factors. In                 simulation capability are to be achieved. Advancing
spite of considerable successes, reliable use of CFD has                 simulation capabilities will be important for both na-
remained confined to a small but important region of the                 tional aeronautics and space goals, and has broad im-
operating design space due to the inability of current meth-             plications for national competitiveness. This will re-
ods to reliably predict turbulent-separated flows. At the                quire advances in foundational technologies, as well as
same time, High Performance Computing (HPC) hardware                     increased investment in software development, since
is progressing rapidly and is on the cusp of a paradigm shift            problem and software complexity continue to increase
in technology that may require a rethinking of current CFD               exponentially.
algorithms and software. Finally, during the last decade,           2.   HPC hardware is progressing rapidly and technolo-
government investment in simulation-based technology for                 gies that will prevail are difficult to predict. However,
aerospace applications has been significantly reduced and                there is a general consensus that HPC hardware is on the
access to leading-edge HPC hardware has been constrained                 cusp of a paradigm shift that will require significantly
both in government and industry. Sustaining future advanc-               new algorithms and software in order to exploit emerg-
es in CFD and related multidisciplinary analysis and opti-               ing hardware capabilities. While the dominant trend is
mization tools will be critical for achieving NASA’s aero-               toward increased parallelism and heterogeneous archi-
nautics goals, invigorating NASA’s space program, keeping                tectures, alternative new technologies offer the potential
industry competitive, and advancing aerospace engineering                for radical advances in computational capabilities, alt-
in general. The improvement of a simulation-based engi-                  hough these are still in their infancy.
neering design process in which CFD plays a critical role is        3.   The use of CFD in the aerospace design process is
a multifaceted problem that requires a comprehensive long-               severely limited by the inability to accurately and re-
term, goal-oriented research strategy. The objective of this             liably predict turbulent flows with significant regions
report is to develop such a plan, based on factual infor-                of separation. Advances in Reynolds-averaged Navier-
mation, expert knowledge, community input, and in-depth                  Stokes (RANS) modeling alone are unlikely to over-
experience.                                                              come this deficiency, while the use of Large-eddy simu-
This report represents the findings and recommendations of a             lation (LES) methods will remain impractical for various
multidisciplinary team that was assembled in response to a               important applications for the foreseeable future, barring
NASA Research Announcement (NRA) with the goal of                        any radical advances in algorithmic technology. Hybrid
formulating a knowledge-based forecast and research strate-              RANS-LES and wall-modeled LES offer the best pro-
gy for developing a visionary CFD capability in the notional             spects for overcoming this obstacle although significant
year 2030. The diverse team members bring together deep                  modeling issues remain to be addressed here as well.
expertise in the areas of aerodynamics, aerospace engineer-              Furthermore, other physical models such as transition
ing, applied mathematics, and computer science, and the                  and combustion will remain as pacing items.
team includes members with extensive experience from in-            4.   Mesh generation and adaptivity continue to be signif-
dustry, academia, and government. A multipronged strategy                icant bottlenecks in the CFD workflow, and very lit-
was adopted for gathering information and formulating a                  tle government investment has been targeted in these
comprehensive research plan. Input from the broader interna-             areas. As more capable HPC hardware enables higher
tional technical community was sought, and this was ob-                  resolution simulations, fast, reliable mesh generation and
tained initially through the development and compilation of              adaptivity will become more problematic. Additionally,
an online survey that garnered more than 150 responses. As a             adaptive mesh techniques offer great potential, but have

                                                                1
not seen widespread use due to issues related to software           Seamlessly integrates with other disciplinary codes for
     complexity, inadequate error estimation capabilities, and            enabling complex multidisciplinary analyses and opti-
     complex geometries.                                                  mizations.
5.   Revolutionary algorithmic improvements will be re-                 The Vision includes a much higher level of integration be-
     quired to enable future advances in simulation capa-               tween advanced computational methods and improved
     bility. Traditionally, developments in improved discreti-          ground-based and flight test techniques and facilities in order
     zations, solvers, and other techniques have been as im-            to best advance aerospace product development efforts and
     portant as advances in computer hardware in the devel-             reduce technical risk in the future.
     opment of more capable CFD simulation tools. Howev-
     er, a lack of investment in these areas and the supporting         A number of Grand Challenge (GC) problems are used that
     disciplines of applied mathematics and computer science            constitute the embodiment of this vision of the required CFD
     have resulted in stagnant simulation capabilities. Future          capabilities in 2030, and cover all important application areas
     algorithmic developments will be essential for enabling            of relevance to NASA’s aeronautics mission as well as im-
     much higher resolution simulations through improved                portant aspects of NASA’s space exploration mission. Four
     accuracy and efficiency, for exploiting rapidly evolving           GC problems have been identified:
     HPC hardware, and for enabling necessary future error              1.   Wall resolved LES simulation of a full powered air-
     estimation, sensitivity analysis, and uncertainty quantifi-             craft configuration in the full flight envelope
     cation techniques.                                                 2.   Off-design turbofan engine transient simulation
6.   Managing the vast amounts of data generated by                     3.   Multidisciplinary Analysis and Optimization (MDAO)
     current and future large-scale simulations will con-                    of a highly flexible advanced aircraft configuration
     tinue to be problematic and will become increasingly               4.   Probabilistic analysis of a powered space access con-
     complex due to changing HPC hardware. These in-                         figuration
     clude effective, intuitive, and interactive visualization of       These Grand Challenge problems are chosen because they
     high-resolution simulations, real-time analysis, man-              are bold and will require significant advances in HPC us-
     agement of large databases generated by simulation en-             age, physical modeling, algorithmic developments, mesh
     sembles, and merging of variable fidelity simulation data          generation and adaptivity, data management, and multidis-
     from various sources, including experimental data.                 ciplinary analysis and optimization to become feasible. In
                                                                        fact, they may not be achievable in the 2030 time frame, but
7.   In order to enable increasingly multidisciplinary                  are used as drivers to identify critical technologies in need
     simulations, for both analysis and design optimiza-                of investment and to provide benchmarks for continually
     tion purposes, advances in individual component                    measuring progress toward the long-term goals of the re-
     CFD solver robustness and automation will be re-                   search program.
     quired. The development of improved coupling at high
     fidelity for a variety of interacting disciplines will also        Recommendations
     be needed, as well as techniques for computing and cou-            In order to achieve the Vision 2030 CFD capabilities, a
     pling sensitivity information and propagating uncertain-           comprehensive research strategy is developed. This is for-
     ties. Standardization of disciplinary interfaces and the           mulated as a set of recommendations which, when consid-
     development of coupling frameworks will increase in                ered together, result in a strategy that targets critical disci-
     importance with added simulation complexity.                       plines for investment, while monitoring progress toward the
Vision                                                                  vision. Two types of recommendations are made: a set of
                                                                        specific programmatic recommendations and a series of
A knowledge-based vision of the required capabilities of                more general strategic recommendations. The programmat-
state-of-the-art CFD in the notional year 2030 is developed             ic recommendations avoid the identification of specific
in this report. The Vision 2030 CFD capability is one that:             technologies and the prescription of funding levels, since
 Is centered on physics-based predictive modeling.                     these decisions are difficult at best given the long-range
                                                                        nature of this planning exercise. Rather, long-range objec-
 Includes automated management of errors and uncer-
                                                                        tives are identified through the vision and GC problems,
  tainties.
                                                                        and a set of six general technology areas that require sus-
 Provides a much higher degree of automation in all steps
                                                                        tained investment is described. A mechanism for prioritiz-
  of the analysis process.
                                                                        ing current and future investments is suggested, based on
 Is able to effectively leverage the most capable HPC                  the periodic evaluation of progress toward the GC prob-
  hardware of the day.                                                  lems.
 Has the flexibility to tackle large-scale capability tasks
  in a research environment but can also manage large
  numbers of production jobs for database applications.

                                                                    2
Programmatic Recommendation 1: NASA should devel-                     reallocation of resources, sharing with other NASA mission
op, fund, and sustain a base research and technology                  directorates, leveraging other government agency HPC as-
(R&T) development program for simulation-based analy-                 sets, or through any combination of these approaches.
sis and design technologies. The presence of a focused base
                                                                      Programmatic Recommendation 4: NASA should lead
R&T program for simulation technologies is an essential
                                                                      efforts to develop and execute integrated experimental
component of the strategy for advancing CFD simulation
                                                                      testing and computational validation campaigns. System-
capabilities. This recommendation consists of expanding the
                                                                      atic numerical validation test datasets and effective mecha-
current Revolutionary Computational Aerosciences (RCA)
                                                                      nisms to disseminate validation results are becoming more
program and organizing it around six technology areas identi-
                                                                      important as CFD complexity increases. NASA is ideally
fied in the findings:
                                                                      positioned to lead such efforts by leveraging its unique exper-
    1.   High Performance Computing (HPC)                             imental facilities in combination with its extensive in-house
    2.   Physical Modeling                                            CFD expertise, thus contributing valuable community re-
    3.   Numerical Algorithms                                         sources that will be critical for advancing CFD technology.
    4.   Geometry and Grid Generation                                 The development of new experimental testing technologies
    5.   Knowledge Extraction                                         and facilities is expected to play a continuing role not just in
    6.   MDAO                                                         aerospace product development, but increasingly in computa-
                                                                      tional method validation.
The physical modeling area represents an expansion of the
current turbulence modeling area under the RCA program                Strategic Recommendation 5: NASA should develop, fos-
to encompass other areas such as transition and combustion,           ter, and leverage improved collaborations with key re-
while the numerical algorithms area corresponds to a cur-             search partners and industrial stakeholders across disci-
rent emphasis in the RCA program that must be broadened               plines within the broader scientific and engineering
substantially. The other areas constitute new, recommended            communities. In an environment of limited resources,
thrust areas within the RCA program.                                  achieving sustained critical mass in the necessary simulation
                                                                      technology areas will require increased collaborations with
Programmatic Recommendation 2: NASA should devel-
                                                                      other stakeholders. Mutually beneficial collaborations are
op and maintain an integrated simulation and software
                                                                      possible between NASA mission directorates, as well as with
development infrastructure to enable rapid CFD technol-
                                                                      other US government agencies with significant ongoing in-
ogy maturation. A leading-edge in-house simulation capa-
                                                                      vestments in computational science. Tighter collaboration
bility is imperative to support the necessary advances in CFD
                                                                      with industry, specifically in simulation technology areas,
required for meeting the 2030 vision. Maintaining such a
                                                                      would also be beneficial to both parties and a joint Computa-
capability will be crucial for understanding the principal
                                                                      tional Science Leadership team is proposed to coordinate
technical issues and overcoming the impediments, for inves-
                                                                      such collaborations. At the same time, investments must look
tigating new techniques in a realistic setting, and for engag-
                                                                      beyond the traditional aerospace engineering disciplines to
ing with other stakeholders. In order to be sustainable, dedi-
                                                                      drive substantial advances in simulation technology, and
cated resources must be allocated toward the formation of a
                                                                      mechanisms for engaging the wider scientific community,
streamlined and improved software development process that
                                                                      such as focused research institutes that engage the broader
can be leveraged across various projects, lowering software
                                                                      academic community, should be explored.
development costs, and releasing researchers and developers
to focus on scientific or algorithmic implementation aspects.         Strategic Recommendation 6: NASA should attract
At the same time, software standards and interfaces must be           world-class engineers and scientists. The ability to achieve
emphasized and supported whenever possible, and open                  the long-term goals for CFD in 2030 is greatly dependent on
source models for noncritical technology components should            having a team of highly educated and effective engineers and
be adopted.                                                           scientists devoted to the advancement of computational sci-
                                                                      ences. Mechanisms for engaging graduate and undergraduate
Programmatic Recommendation 3: NASA should utilize
                                                                      students in computational science with particular exposure to
and optimize HPC systems for large-scale CFD develop-
                                                                      NASA aeronautics problems must be devised. These include
ment and testing. Access to large-scale HPC hardware is
                                                                      student fellowships, as well as visiting programs and intern-
critical for devising and testing the improvements and novel
                                                                      ships, which may be facilitated through external institutes
algorithms that will be required for radically advancing CFD
                                                                      and centers.
simulation capabilities. Although the current NASA para-
digm favors computing for many small, production jobs
(“capacity”) over larger, proof-of-concept jobs (“capability”),
a mechanism must be found to make large-scale HPC hard-
ware available on a regular basis for CFD and multidiscipli-
nary simulation software development at petascale to ex-
ascale levels and beyond. This may be done through internal

                                                                  3
2    Introduction                                                      through the development of advanced algorithms within the
                                                                       same time frame.1,16-18
The rapid advance of computational fluid dynamics (CFD)
                                                                       However, the last decade has seen stagnation in the capabili-
technology during the last several decades has fundamentally
                                                                       ties used in aerodynamic simulation within the aerospace
changed the aerospace design process. Aggressive use of
                                                                       industry, with RANS methods having become the high-
CFD is credited with drastic reductions in wind tunnel time
                                                                       fidelity method of choice and advances due mostly to the use
for aircraft development programs1-4, as well as lower num-
                                                                       of larger meshes, more complex geometries, and more nu-
bers of experimental rig tests in gas turbine engine develop-
                                                                       merous runs afforded by continually decreasing hardware
ment programs.5-6 CFD has also enabled the design of high-
                                                                       costs.19-23 At the same time, the well-known limitations of
speed, access-to-space, and re-entry vehicles in the absence
                                                                       RANS methods for separated flows have confined reliable
of suitable ground-based testing facilities.7-9 In addition to
                                                                       use of CFD to a small region of the flight envelope or operat-
reducing testing requirements, physics-based simulation
                                                                       ing design space.24 Simultaneously, algorithmic development
technologies such as CFD offer the added potential of deliv-
                                                                       has been substantially scaled back within NASA and access
ering superior understanding and insight into the critical
                                                                       to leading-edge HPC hardware has been constrained, both at
physical phenomena limiting component performance, thus
                                                                       NASA and within industry.25 In some sense, current CFD has
opening new frontiers in aerospace vehicle design.10-11
                                                                       become a commodity based on mature technology, suitable
Physics-based simulations in general, and CFD in particular,           only for commodity hardware and reliable only for problems
are front and center in any aerospace research program since           for which an extensive experience base exists.
these are crosscutting technologies that impact all speed re-
                                                                       Continued advances in physics-based simulation technolo-
gimes and all vehicle classes. This is evidenced in the Na-
                                                                       gies in general, and CFD in particular, are essential if NASA
tional Research Council (NRC) commissioned decadal sur-
                                                                       is to meet its aeronautics research goals, as well as for suc-
vey on aeronautics12 which identifies five common themes
                                                                       cessfully advancing the outcomes in the National Aero-
across the entire aeronautics research enterprise, the first two
                                                                       nautics R&D plan.13 The required advances in fuel burn,
being physics-based simulation and physics-based design
                                                                       noise, emissions, and climate impact will only be realized
tools. Similarly, these technologies affect all of the outcomes
                                                                       with vastly more sophisticated analysis of future configura-
in the current National Aeronautics R&D Plan,13 and contin-
                                                                       tions. Beyond Aeronautics, NASA’s space missions rely
ued advances in these technologies will be critical for meet-
                                                                       heavily on computational tools developed within ARMD7-9,
ing the stated outcomes.                                               26-30
                                                                             and superior designs at lower cost and risk will require
Since the advent of scientific computing, NASA’s Aero-                 radical advances in new CFD tools.31 Additionally, the loss
nautics Research Mission Directorate (ARMD) has played a               of the leadership role NASA ARMD once played in the de-
leading role in the development and deployment of CFD                  velopment of simulation-based engineering technology has
technologies.14 Successive external reviews of NASA Aero-              larger implications for the aerospace industry in particular,
nautics programs during the last two decades by organiza-              and national competitiveness in general.17,32,33 Due to the
tions such as the National Academy of Engineering (NAE)                long lead times and high risk involved, industry must rely on
and others12 have repeatedly praised the world-class status            government agencies to develop and demonstrate new simu-
and leading-edge technical contributions of the simulation-            lation technologies at large scale, after some investment in
based engineering tools developed under these programs. In             proof-of-concept at universities. In recent years, the National
fact, many algorithms, techniques, and software tools in use           Science Foundation (NSF) and Department of Energy (DOE)
today within and beyond the aerospace industry can trace               have led investing in computational science-based research
their roots back to NASA development or funding.                       and in deploying leading-edge HPC facilities, although with
                                                                       a different focus based more on scientific discovery rather
The development of computational aerodynamics has been
                                                                       than engineering product design.16, 18, 34-36 As noted by a blue-
characterized by a continual drive to higher fidelity and more
                                                                       ribbon panel report convened by the NSF, simulation-based
accurate methods from the 1970s to the 1990s, beginning
                                                                       engineering is fundamentally different from science-based
with panel methods, proceeding to linearized and nonlinear
                                                                       simulation and is in danger of being neglected under the cur-
potential flow methods, inviscid flow (Euler) methods, and
                                                                       rent scenario, with important implications for national com-
culminating with Reynolds-averaged Navier-Stokes (RANS)
                                                                       petitiveness.37, 38
methods. These advances were arrived at through sustained
investment in methodology development coupled with acqui-              Thus, there is a national imperative to reinvigorate the in-
sition and deployment of leading edge High Performance                 vestment in physics-based engineering simulation tools in
Computing (HPC) hardware made available to researchers.15              general, and in CFD in particular, and NASA is uniquely
While Moore’s law has held up remarkably well, delivering a            positioned to fill this role. In addition to enhancement of
million-fold increase in computational power during the last           CFD technology, effective use of existing, and potentially
20 years, there is also ample evidence that equivalent or              new, ground-based testing facilities will be required to pro-
greater increases in simulation capabilities were achieved             vide a complementary set of tools to best advance aerospace

                                                                   4
product development efforts and reduce technical risk in the          3    Vision of CFD in 2030
future. Sustaining future advances in CFD and related multi-
disciplinary analysis and optimization tools along with strong        Given the inherent difficulties of long-term predictions, our
support of ground-based and flight testing technologies and           vision for CFD in 2030 is grounded on a desired set of capa-
facilities will be key for achieving NASA next generation             bilities that must be present for a radical improvement in
aeronautics goals, keeping industry competitive, invigorating         CFD predictions of critical flow phenomena associated with
NASA’s space program, and advancing aerospace engineer-               the key aerospace product/application categories, including
ing. With investment, the resulting engineering design pro-           commercial and military aircraft, engine propulsion, ro-
cess would decrease risk, reduce time-to-market, improve              torcraft, space exploration systems, launch vehicle programs,
products, and facilitate truly revolutionary aerospace vehicles       air-breathing space-access configurations, and spacecraft
through the ability to consider novel designs. Without such           entry, descent, and landing (EDL).
an investment, the engineering design process will look much
the same in 2030 as it does today and act as a barrier to revo-
lutionary advances in aerospace and other industries of na-
tional importance.
The improvement of a simulation-based engineering design
process in which CFD plays a critical role is a multifaceted
problem. Having relied on mature algorithms and ridden the
wave of ever-decreasing commodity computer hardware
costs, the CFD development community now finds itself
poorly positioned to capitalize on the rapidly changing HPC
                                                                      This set of capabilities includes not only the accurate and
architectures, which include massive parallelism and hetero-
                                                                      efficient prediction of fluid flows of interest, but also the
geneous architectures.38-40 New paradigms will be required to
                                                                      usability of CFD in broader contexts (including uncertainty
harness the rapidly advancing capabilities of new HPC hard-
                                                                      quantification, optimization, and multidisciplinary applica-
ware.41, 42 At the same time, the scale and diversity of issues
                                                                      tions) and in streamlined/automated industrial analysis and
in aerospace engineering are such that increases in computa-
                                                                      design processes. To complicate things further, CFD in 2030
tional power alone will not be enough to reach the required
                                                                      must effectively leverage the uncertain and evolving envi-
goals, and new algorithms, solvers, physical models, and
                                                                      ronment of HPC platforms that, together with algorithmic
techniques with better mathematical and numerical properties
                                                                      improvements, will be responsible for a large portion of the
must be developed.1,16-18 Finally, software complexity is in-
                                                                      realized improvements.
creasing exponentially, slowing adoption of novel techniques
into production codes and shutting out production of new              The basic set of capabilities for Vision 2030 CFD must in-
software development efforts, while simultaneously compli-            clude, at a minimum:
cating the coupling of various disciplinary codes for multi-
                                                                      1.   Emphasis on physics-based, predictive modeling. In
disciplinary analysis and design.43 The development of a
                                                                           particular, transition, turbulence, separation, chemically
long-range research plan for advancing CFD capabilities
                                                                           reacting flows, radiation, heat transfer, and constitutive
must necessarily include all these considerations, along with
                                                                           models must reflect the underlying physics more closely
the larger goal of comprehensive advances in multidiscipli-
                                                                           than ever before.
nary analysis and optimization capabilities.
                                                                      2.   Management of errors and uncertainties resulting from
The objective of this study is to develop such a plan, based               all possible sources: (a) physical modeling errors and
on factual information, expert knowledge, and the in-depth                 uncertainties addressed in item #1, (b) numerical errors
experience of the team and the broader community. The                      arising from mesh and discretization inadequacies, and
strategy begins by defining the required capabilities for CFD              (c) aleatory uncertainties derived from natural variabil-
in the notional year 2030. By contrasting this vision with the             ity, as well as epistemic uncertainties due to lack of
current state, we identify technical impediments and formu-                knowledge in the parameters of a particular fluid flow
late a technology development plan. This in turn is used to                problem.
develop a research strategy for achieving the goals of the            3.   A much higher degree of automation in all steps of the
Vision 2030 CFD capability. The outcome of the research                    analysis process is needed including geometry creation,
plan is a set of recommendations formulated to enable the                  mesh generation and adaptation, the creation of large da-
successful execution of the proposed strategy.                             tabases of simulation results, the extraction and under-
                                                                           standing of the vast amounts of information generated,
                                                                           and the ability to computationally steer the process. In-
                                                                           herent to all these improvements is the requirement that
                                                                           every step of the solution chain executes high levels of
                                                                           reliability/robustness to minimize user intervention.

                                                                  5
Critical Flow Phenomena Addressed in This Study

     •   Flow separation: e.g., smooth-body, shock-induced, blunt/bluff body   • Wake hazard reduction and avoidance
     •   Laminar to turbulent boundary layer flow transition/reattachment      • Wind tunnel to flight scaling
     •   Viscous wake interactions and boundary layer confluence               • Rotor aero/structural/controls, wake and multirotor interactions, acoustic
     •   Corner/junction flows                                                   loading, ground effects
     •   Icing and frost                                                       • Shock/boundary layer, shock/jet interactions
     •   Circulation and flow separation control                               • Sonic boom
     •   Turbomachinery flows                                                  • Store/booster separation
     •   Aerothermal cooling/mixing flows                                      • Planetary retro-propulsion
     •   Reactive flows, including gas chemistry and combustion                • Aerodynamic/radiative heating
     •   Jet exhaust                                                           • Plasma flows
     •   Airframe noise                                                        • Ablator aerothermodynamics
     •   Vortical flows: wing/blade tip, rotorcraft                            • Plasma flows

4.       Ability to effectively utilize massively parallel, hetero-                sufficiently predictive and automated to be used in criti-
         geneous, and fault-tolerant HPC architectures that will                   cal/relevant engineering decisions by the non-expert user,
         be available in the 2030 time frame. For complex physi-                   particularly in situations where separated flows are present.
         cal models with nonlocal interactions, the challenges of
                                                                                   Additionally, the Vision includes a much higher level of in-
         mapping the underlying algorithms onto computers with
                                                                                   tegration between advanced computational methods and im-
         multiple memory hierarchies, latencies, and bandwidths
                                                                                   proved ground-based and flight test techniques and facilities
         must be overcome.
                                                                                   in order to best advance aerospace product development ef-
5.       Flexibility to tackle capability- and capacity-computing
                                                                                   forts and reduce technical risk in the future.
         tasks in both industrial and research environments so
         that both very large ensembles of reasonably-sized solu-                  Finally, as part of our vision, we define a set of Grand Chal-
         tions (such as those required to populate full-flight enve-               lenge (GC) problems (as shown in the graphic on the next
         lopes, operating maps, or for parameter studies and de-                   page) that are bold and in fact may not be solvable in the
         sign optimization) and small numbers of very-large-                       2030 timeframe, but are used as drivers to identify critical
         scale solutions (such as those needed for experiments of                  technologies in need of investment, and to serve as bench-
         discovery and understanding of flow physics) can be                       marks for continually measuring progress toward the long-
         readily accomplished.                                                     term development goals. These GC problems were chosen
                                                                                   to embody the requirements for CFD in 2030, and cover all
6.       Seamless integration with multidisciplinary analyses that
                                                                                   important application areas of relevance to NASA’s aero-
         will be the norm in 2030 without sacrificing accuracy or
                                                                                   nautics mission, as well as important aspects of NASA’s
         numerical stability of the resulting coupled simulation,
                                                                                   space exploration mission. Details on the GC problems are
         and without requiring a large amount of effort such that
                                                                                   presented in Section 6.
         only a handful of coupled simulations are possible.

Included in this desired set of capabilities is a vision for how
CFD in 2030 will be used: a vision of the interaction between
                                                                                   4    Current State
the engineer/scientist, the CFD software itself, its framework                     At present, CFD is used extensively in the aerospace industry
and all the ancillary software dependencies (databases, mod-                       for the design and analysis of air and space vehicles and
ules, visualization, etc.), and the associated HPC environ-                        components. However, the penetration of CFD into aero-
ment. A single engineer/scientist must be able to conceive,                        space design processes is not uniform across vehicle types,
create, analyze, and interpret a large ensemble of related sim-                    flight conditions, or across components. CFD often plays a
ulations in a time-critical period (e.g., 24 hours), without                       complementary role to wind tunnel and rig tests, engine certi-
individually managing each simulation, to a pre-specified                          fication tests, and flight tests by reducing the number of test
level of accuracy. There should be less emphasis on the me-                        entries and/or reducing testing hours.3-5 But, in many circum-
chanics of running and collecting the information, and more                        stances, CFD provides the only affordable or available source
emphasis on interpreting and understanding the results of the                      of engineering data to use in product design due to limita-
work. Like the predictive nature of large-scale, finite-                           tions either with model complexity and/or wind tunnel capa-
element-based, linear structural analyses that are assumed in                      bility, or due to design requirements that cannot be addressed
the aerospace industry, information derived from computa-                          with ground-based testing of any kind.8, 10, 31 As a result, CFD
tions of fluid flow must carry the same stamp of approval or,                      technology development has been critical in not only mini-
at least, a reasonable estimate of possible errors contained in                    mizing product design costs, but also in enabling the design
the information provided. At the moment, CFD is not yet                            of truly novel platforms and systems.

                                                                               6
Grand Challenge Problems

 GC1 LES of powered aircraft configuration
     across the full
     flight envelope

 GC2 Off-design turbofan engine transient
     simulation

 GC3 MDAO of a highly-flexible advanced
     aircraft configuration

                                                                                                                                   255606.002.ppt
 GC4 Probabilistic analysis of a powered
     space access configuration

Generally, the design process is composed of three key phas-             CFD is often used to gain important insight into flow phys-
es: conceptual design, preliminary and detailed design, and              ics (e.g., multiple plume interactions) used to properly lo-
product validation. The current usage of CFD tools and pro-              cate external components on the surface of launch vehicles
cesses in all three of these design phases is summarized be-             or spacecraft.9,27,29 CFD is also increasingly providing sub-
low.                                                                     stantial portions of the aero and propulsion performance
                                                                         database.7,9,30 In many cases, wind tunnel data is used only
  Conceptual Design. CFD is often used in the early, con-
                                                                         to anchor the CFD data at a few test points to provide con-
  ceptual design of products where it has been both previous-
                                                                         fidence in the CFD database. CFD is the primary source of
  ly calibrated for similar applications using data-morphing
                                                                         data for the hypersonic flight regime when ground testing
  techniques, as well as for new configurations where little
                                                                         is limited or does not exist.8, 44
  or no engineering data is available to guide design deci-
  sions. Simplified models are typically used during the con-            Product Validation and Certification. As the product
  ceptual optimization phase to allow reasonably accurate                development process moves into the validation phase and
  trades to be made between drag, fuel consumption, weight,              certification testing, CFD is often used to confirm perfor-
  payload/range, thrust, or other performance measures. Use              mance test results, assess the redesign of components that
  of simplified models is necessary to allow often time-                 show potential for improved performance, and to answer
  consuming optimization processes to be used in the overall             any other questions that arise during product testing. Typi-
  design effort, but inherently places conservatism into the             cally, product configurations evolve over the testing period
  final design. This conservatism derives from the use of                based on a combination of measured results and engineer-
  models that are too similar within the existing product de-            ing judgment bolstered by the best simulation capability
  sign space, other geometric simplifications, or the use of             available. In general, CFD modeling capability grows to
  low-fidelity CFD tools that trade off flow physics model-              capture the required scope and physics to answer the ques-
  ing accuracy for execution speed.                                      tions raised during testing. The expense of responding to
                                                                         often unplanned technical surprises—which results in more
  Preliminary/Detailed Design. Once a product develop-
                                                                         time on the test stand or in flight test, or changes in hard-
  ment program is launched, CFD is a necessary and uni-
                                                                         ware—drives conservatism into aerospace designs and is a
  formly present tool in the detailed configuration design
                                                                         significant motivation for improving the accuracy and
  process. For example, CFD is indispensable in the design
                                                                         speed of CFD. If CFD is sufficiently accurate and fast, en-
  of cruise wings in the presence of nacelles for commercial
                                                                         gineers can move from their traditional design space with
  airplanes, and for inlet and nozzle designs; wind tunnels
                                                                         greater confidence and less potential risk during testing.
  are used to confirm the final designs.1,4 In both military and
  commercial aircraft design processes, CFD is the primary             For each of these design phases, the performance (in terms
  source of data for aircraft load distributions and ground ef-        of numerical efficiency and solution accuracy) of CFD is of
  fect estimations.10 Similarly, gas turbine engine manufac-           critical importance. A high-level view of the current state of
  turers rely on CFD to predict component design perfor-               CFD in several key technical areas is given below.
  mance, having reduced the number of single-component
                                                                         High Performance Computing (HPC). The effectiveness
  rigs substantially as CFD capability has become more ma-
                                                                         and impact of CFD on the design and analysis of aerospace
  ture.5,6 Increasingly, multicomponent and multiphysics
                                                                         products and systems is largely driven by the power and
  simulations are performed during the design cycle, but the
                                                                         availability of modern HPC systems. During the last dec-
  long clock times often associated with these processes re-
                                                                         ades, CFD codes were formulated using message passing
  stricts their widespread adoption. For space exploration,

                                                                   7
(e.g., MPI) and thread (e.g., OpenMP) software models for           curs in areas where the design work is routine and the in-
expressing parallelism to run as efficiently as possible on         vestment in automation makes business sense; single-
current generation systems. However, with the emergence             prototype designs and novel configurations continue to
of truly hierarchical memory architectures having numer-            suffer the pacing limits of human-in-the-loop workflows
ous graphical processing units (GPUs) and coprocessors,             because the payoff for automating is not evident. This is-
new CFD algorithms may need to be developed to realize              sue is not unique to the aerospace industry.
the potential performance offered by such systems. Gov-
                                                                    Solution Uncertainty and Robustness. In practice, CFD
ernment labs, such as Oak Ridge National Lab (ORNL),
                                                                    workflows contain considerable uncertainty that is often
Argonne National Lab (ANL), and the NASA Advanced
                                                                    not quantified. Numerical uncertainties in the results come
Supercomputing (NAS) facility at NASA Ames Research
                                                                    from many sources, including approximations to geometry,
Center, have often led the way with the acquisition and
                                                                    grid resolution, problem setup including flow modeling
testing of new hardware. Much research on testing and tai-
                                                                    and boundary conditions, and residual convergence. Alt-
loring of CFD algorithms takes place on these platforms
                                                                    hough NASA and professional organizations such as
with heavy participation from academia, national labs and
                                                                    ASME and AIAA have created standards for the verifica-
to some extent industry as well. Government computing
                                                                    tion and validation of CFD and heat transfer analyses52-54,
resources are also used to tackle large-scale calculations of
                                                                    such techniques are not widely used in the aerospace in-
challenge problems, such as the detailed direct numerical
                                                                    dustry. With a few notable exceptions, CFD is carried out
simulation (DNS) of spray injector atomization or high fi-
                                                                    on fixed grids that are generated using the best available
delity simulations of transition and turbulent separation in
                                                                    practices to capture expected flow features, such as at-
turbomachinery. However, because of the high cost of
                                                                    tached boundary layers.55 Such approaches cannot reliably
these leadership-class systems, industry and academia of-
                                                                    provide adequate resolution for flow features when loca-
ten purchase smaller commodity clusters utilizing similar
                                                                    tions are not known a priori, such as shocks, shear layers,
types of processors when the latest hardware technology is
                                                                    and wakes. Although grid refinement is often seen as a
fully demonstrated on CFD problems and other important
                                                                    panacea to addressing grid resolution issues, it is seldom
applications.
                                                                    done in practice (with the exception of a few workshop test
Turbulence Modeling. Current practices for CFD-based                cases) because uniform refinement is impractical in 3D.
workflows utilize steady Reynolds-average Navier-Stokes             Adaptive mesh refinement strategies offer the potential for
(RANS) with 1- or 2-equation turbulence models,46-48 alt-           superior accuracy at reduced cost, but have not seen wide-
hough hybrid unsteady RANS/LES methods are increas-                 spread use due to robustness, error estimation, and soft-
ingly common for certain classes of simulations in which            ware complexity issues. Achieving consistent and reliable
swirling and intentionally separated flows are dominant,            flow solver or residual convergence remains problematic in
such as combustors. Techniques to combine near-wall                 many industrial cases. Although many CFD codes are able
RANS regions and outer flow field, large-eddy simulation            to demonstrate convergence for a few simple problems, for
(LES) regions in these hybrid methods are immature.                 many flows involving difficult flow physics and/or com-
Many CFD design processes include an estimation of                  plex geometries such as an aircraft in high-lift configura-
boundary layer transition, using a range of models, from            tion, many of the current solver techniques employed are
purely empirical to coupled partial-differential equation           not strong enough to ensure robust convergence.56 Engi-
(PDE) solutions of stability equations.49, 50 Both approach-        neering judgment is required to interpret results that are not
es involve much empiricism, may be missing some                     well converged, which introduces conservatism into deci-
modes of transition, and are evolving. As a result, no              sion-making. Furthermore, the use of steady-state flow
generalized transition prediction capability is in wide-            solvers itself is in question for many flows of engineering
spread use in Navier-Stokes CFD, and the default prac-              interest.
tice is to run the codes “fully turbulent”. Steady-state
                                                                    Multidisciplinary Analysis and Optimization (MDAO).
CFD accounts for a vast majority of simulations; unsteady
                                                                    Although the basic concepts of MDAO are fairly well ac-
flow predictions are inherently more expensive and not yet
                                                                    cepted in the community, the routine use of MDAO meth-
uniformly routine in the design process, with some excep-
                                                                    ods is not, by any means, pervasive. At moderate levels of
tions.51
                                                                    fidelity (commensurate with analyses conducted during the
Process Automation. Current CFD workflows are often                 conceptual design phase), it is common industrial practice
paced by the geometry preprocessing and grid generation             to perform coupled multidisciplinary analyses (MDA) of
phases, which are significant bottlenecks. In some cases,           the most tightly integrated disciplines in a design. Aero-
where the design effort involves components of similar              structural analyses, conjugate heat transfer calculations,
configurations, specialized, automated processes are built          and aero-acoustic simulations all tend to take place in air-
that considerably reduce set-up time, execution of the              craft, spacecraft, jet engine, and rotorcraft analysis and de-
CFD solver, and post-processing of results. This process            sign processes. High fidelity CFD is not routinely used in
to production capability of the CFD workflow only oc-               such MDAs, although recent years have witnessed a signif-

                                                                8
icant rise in the coupling of state-of-the-art CFD with addi-         5.1 Effective Utilization of High-Performance
    tional disciplines. While frameworks for the coupling of              Computing (HPC)
    disciplinary analyses are widely available,57-60 the ability to
    couple CFD with other high fidelity descriptions of partic-           CFD in 2030 will be intimately related to the evolution of the
    ipating disciplines is limited by the availability of coupling        computer platforms that will enable revolutionary advances
    software and, more fundamentally, by a lack of general                in simulation capabilities. The basic framework for Vision
    methodologies for accurate, stable, and conservative                  2030 CFD must map well to the relevant future programming
    MDAs. The application of optimization techniques in in-               paradigms, which will enable portability to changing HPC
    dustry is mostly limited to single-discipline simulations.            environments and performance without major code rework.41
    Although conceptual design tools have long benefited from             However, the specific architecture of the computing plat-
    multidisciplinary optimization (MDO) approaches (with                 forms that will be available is far from obvious. We can,
    various modules at the lowest fidelity levels), high fidelity         however, speculate about the key attributes of such machines
    CFD-based optimizations are still rare. During the past               and identify key technology gaps and shortcomings so that,
    decade, the development of advanced surrogate modeling                with appropriate development, CFD can perform at future
    techniques and the introduction of adjoint-based optimal              exascale levels on the HPC environments in 2030.
    shape design techniques have enabled the use of CFD in                Hybrid computers with multiple processors and accelerators
    aerodynamic optimization of aircraft and gas turbine com-             are becoming widely available in scientific computing and,
    ponents. However, the use of optimization with multiple               although the specific composition of a future exascale com-
    disciplines treated using high-fidelity methods is still with-        puter is not yet clear, it is certain that heterogeneity in the
    in the realm of advanced research and is by no means a                computing hardware, the memory architecture, and even the
    routine practice.                                                     network interconnect will be prevalent. Future machines
                                                                          will be hierarchical, consisting of large clusters of shared-
5      CFD Technology Gaps and Impedi-                                    memory multiprocessors, themselves including hybrid-chip
       ments                                                              multiprocessors combining low-latency sequential cores
                                                                          with high-throughput data-parallel cores. Even the memory
Given the current state of CFD technology, tools, and pro-                chips are expected to contain computational elements,
cesses described above, necessary research and develop-                   which could provide significant speedups for irregular
ment to address gaps and overcome impediments in CFD                      memory access algorithms, such as sparse matrix operations
technology are fundamental to attaining the vision for CFD                arising from unstructured datasets. With such a running
in 2030 outlined earlier. Five key technical areas were iden-             target on the horizon, the description of 2030 CFD is
tified during this Vision 2030 study and rose to the highest              grounded on a target supercomputer that incorporates all of
level of importance as identified from a user survey and                  the representative challenges that we envision in an ex-
workshop of a large international community of CFD re-                    ascale supercomputer. These challenges are certainly relat-
searchers and practitioners. In the subsections below, the                ed to heterogeneity, but more concretely, may include mul-
effective utilization of HPC is first considered. This in-                ticore CPU/GPU interactions, hierarchical and specialized
cludes both the implications of future computing platforms                networks, longer/variable vector lengths in the CPUs,
and the requirements imposed by potential emerging future                 shared memory between CPU and GPUs, and even a higher
programming paradigms to deal with exascale challenges.                   utilization of vector units in the CPUs. Research must be
Next, we describe the desired level of capability (in 2030)               conducted so that we are ready to tackle the specific chal-
for the prediction of unsteady, turbulent flows including                 lenges presented.
transition and separation. We continue with a discussion of
research topics in autonomous and reliable CFD simulation                 The wildcard in predicting what a leading edge HPC system
techniques that aim at providing both a high level of auto-               will look like is whether one or more of several current nas-
mation in the analysis process and the required algorithms                cent HPC technologies will come to fruition. Radical new
(both for meshing and the solution process) to ensure confi-              technologies such as quantum computing, superconducting
dence in the outcomes. Then, in order to derive useful in-                logic, low-power memory, massively parallel molecular
formation from the simulations, the discussion on smart                   computing, next generation “traditional” processor technol-
knowledge extraction from large-scale databases and simu-                 ogies, on-chip optics, advanced memory technologies (e.g.,
lations considers the research required to automate the pro-              3D memory) have been proposed but are currently at very
cess of sifting through large amounts of information, often               low technology readiness levels (TRL). Many of these
at a number of different geographic locations, and extract-               revolutionary technologies will require different algorithms,
ing patterns and actionable design decisions. Finally, we                 software infrastructures, as well as different ways of using
end with a discussion on multidisciplinary and multiphysics               results from CFD simulations.61
simulations that describes the research work required to
perform seamless, accurate, and robust simulations of mul-
tiphysics problems in which CFD would be an integral part.

                                                                      9
You can also read