High-Fidelity Simulation V&V for Air Mobility Agile Systems and Software Essentials Training by Tonex
This intensive 2-day course provides systems and software engineers with the knowledge and skills to apply high-fidelity simulation techniques for Verification and Validation (V&V) in Agile development environments. You will explore how to leverage simulation and modeling tools to validate system behavior, assess performance, and support decision-making under evolving requirements and rapid iteration cycles.
Designed for complex systems and mission-critical software, this course integrates Model-Based Systems Engineering (MBSE), simulation-driven design, and Agile V&V workflows. Emphasis is placed on aligning simulation fidelity with V&V goals, verifying software in continuous integration pipelines, and validating system behavior across development increments.
Learning Objectives
By the end of this course, participants will be able to:
- Understand the principles of high-fidelity simulation in complex systems and software.
- Apply NASA’s V&V standards and the Systems Engineering Handbook to simulation-based development.
- Integrate Agile practices with V&V processes for iterative simulation validation.
- Implement DoD VV&A methodologies to ensure simulation credibility and accreditation.
- Design and execute validation against real-world performance benchmarks.
- Perform verification to ensure the simulation is correctly built and functions per requirements.
Target Audience
- Systems and software engineers
- Simulation and modeling professionals
- QA/V&V specialists
- Program managers and technical leads
- NASA and aerospace contractor staff
Prerequisites
- Basic knowledge of systems engineering and software development lifecycle.
- Familiarity with Agile concepts is helpful but not mandatory.
Course Agenda:
DAY 1: Foundations and Planning
Module 1: Introduction to High-Fidelity Simulation
- Definitions and levels of fidelity
- Use cases in aerospace, defense, and critical systems
- Benefits and risks
- NASA examples (e.g., Orion, Mars missions)
- Understanding Fidelity: Fidelity refers to the accuracy of a model or simulation when compared to the real world.
- Components of Fidelity Dimensions
- Resolution: The level of detail in the simulation.
- Accuracy: The closeness of simulation outcomes to real-world data.
- Sensitivity: How simulation outputs respond to variations in input parameters.
- Precision: The consistency of simulation results under unchanged conditions.
- Capability: The extent to which the simulation can replicate the behaviors of the real-world system.
Module 2: Simulation in Systems and Software Development
- Integration in Model-Based Systems Engineering (MBSE)
- Software-in-the-loop (SIL), Hardware-in-the-loop (HIL)
- Simulation lifecycle alignment with product lifecycle
Module 3: NASA V&V Standards Overview
- NASA-STD-7009: Standards for Models and Simulations
- NASA-STD-8739.8: Software Assurance and Software Safety
- How V&V supports mission assurance
- Verification vs. validation in the NASA context
Module 4: V&V Planning
- V&V Plan vs. Test Plan vs. QA Plan
- Key elements of a simulation V&V strategy
- Stakeholder involvement and requirements traceability
- Work session: Draft a high-level simulation V&V plan using NASA templates
DAY 2: Agile Integration and V&V Execution
Module 5: V&V Execution Techniques for Simulations
- Data integrity, initialization, and assumptions
- Model validation against real-world data
- Numerical accuracy, robustness, and sensitivity analysis
- Use of test oracles and scenario-based testing
Module 6: Agile and Iterative V&V
- V&V in Agile sprints and increments
- Agile backlog integration of simulation V&V tasks
- Continuous integration of simulations
- NASA Agile guidance for SE and V&V
Module 7: Case Study – NASA Simulation V&V
- Overview of a NASA project (e.g., simulation for Mars Entry, Descent, and Landing)
- V&V challenges and outcomes
- Lessons learned in Agile vs. traditional V&V
Module 8: V&V Reporting and Closure
- Reporting results in technical reviews (PDR, CDR, TRR)
- Metrics for simulation validation
- Residual risk and uncertainty
- Final review exercise: Prepare a V&V summary for a hypothetical mission-critical simulation
Deliverables
Participants receive:
- Simulation V&V Planning Template (NASA-aligned)
- Sample Agile sprint board with integrated V&V tasks
- V&V Criteria Checklist for high-fidelity models
- Case study briefs and solutions
Interactive Exercises and Group Workshops
- Interactive Exercise 1: Simulation Fidelity Scale Mapping
- Participants evaluate 3 example models and classify them as low/medium/high fidelity. Discuss implications for V&V scope and complexity.
- Systems & Software Simulation Lifecycle
- Integration with MBSE
- SIL, PIL, HIL systems
- Mini-Lab 1: Simulation Thread Mapping
- Use a NASA mission scenario (e.g., Mars lander or robotic arm) and identify software and system simulation interdependencies.
- Exercise: V/V/A Identification Roleplay
- Participants analyze a simulation scenario and roleplay as V/V or Accreditation authorities. Groups develop a consensus on acceptability.
- Group Workshop: Develop a V&V Plan Outline
- Use a provided simulation scenario (e.g., satellite orbital dynamics sim) and build an outline plan:
- Objectives
- V&V techniques
- Acceptance criteria
- Team roles
- Mini-Lab 2: Fault Injection Walkthrough
- Participants use provided logs from a simulation run with and without fault injection to spot V&V gaps.
- Agile Simulation Sprint Board Exercise
- Participants organize tasks from a backlog into Agile sprints, integrating V&V into:
- Acceptance criteria
- Daily test planning
- Incremental validation points
- Simulation V&V Closure and Reporting
- Technical reviews (CDR, TRR, PDR)
- V&V reporting
- Accreditation statements
- Match real-world systems to simulation types (HIL, SIL, physics-based models) and assess fidelity needs and risks.
- Simulation V&V Planning Workshop:
- Build a traceability matrix linking simulation requirements to validation criteria and verification tests.
- Case Exercise:
- Analyze a case study simulation from DAU’s archive and determine whether it is validation-complete, verification-complete, or requires further work.
- Capstone Group Project:
- Build and present a simulation V&V closeout report. Include:
- Verification test results summary
- Validation evidence package
- Accreditation recommendation
- Final judgment of simulation credibility
- Fidelity Assessment in Validation
- Avoiding Oversimplification
- Validation Metrics
- Fidelity Impact Analysis: Participants will evaluate how variations in each fidelity component affect the validation outcomes of a simulation, using real-world data sets for comparison.
- Fidelity in Accreditation Decisions: Exploring how fidelity assessments inform accreditation decisions and the acceptance of simulations for specific applications.
- Risk Management: Understanding how deficiencies in fidelity components can introduce risks, and developing strategies to mitigate these risks.
- Interactive Exercise:
- Accreditation Case Study: Participants will review a case study where fidelity assessments played a crucial role in the accreditation process, identifying best practices and lessons learned.
- Optional Exam: Certified High-Fidelity Simulation V&V Professional (CFHSV) – Certificate in High-Fidelity Simulation V&V Program by Tonex
- Validated through completion of practical labs, group activities, and a final report exercise.