System Verification and Validation Training

System Verification and Validation (V&V) Training

System Verification and Validation Training, V&V Training, TONEX Verification and Validation training provides all aspects of the system engineering discipline employing a rigorous methodology for evaluating and assessing the correctness and quality of system and software throughout the system/software life cycle.

System Verification and Validation Training covers all aspects of systems engineering related processes to verification, validation and testing.

System Verification and Validation Training  details validation and verification processes. Validation process  is concerned with checking that the system will meet the customer’s actual needs based on defined requirements and needs, while verification is concerned with whether the system is built correctly and it is well-engineered, error-free, reliable, secure and so on.

Verification is the process of determining whether or not the products of a given phase of the system/software life cycle fulfill the requirements established during the preceding phase.

Validation is the process of determining that the requirements are the correct requirements and that they form a complete set of requirements this is done in the early stages of the development process. Validation of the end product or system determines if the system meets the user’s needs.

Learning Objectives

After the completion of this course, the students will be able to:

• Describe system/software verification and validation and to discuss the distinction between them
• List V&V Techniques and Methods
• Describe the testing and inspection process and its role in V & V
• Explain Life Cycle V&V Tasks
• Explain static analysis as a verification technique

Who Should Attend

Verification and Validation Training course is intended for systems engineers, product managers,  and product developers, program managers, project and product managers, and other discipline engineers. The attendees will learn the techniques and best practices used to verify and validate system solutions.

NASA Definitions of V&V

Source: www.nasa.gov

Validation is defined as: The process of determining the degree to which a model is an accurate representation of the real world from the perspective of the intended uses of the model. (AIAA G-077-1998) Verification is defined as: The process of determining that a model implementation accurately represents the developer’s conceptual description of the model and the solution to the model. (AIAA G-077-1998)

Course Topics

System and Software Verification and Validation (V&V) Concepts

• Introduction to V&V Techniques and Principles
• V&V Definitions
• V&V Techniques and Methods
• Planning for V&V Life Cycle V&V Tasks
• Measurements Applied to V&V
• Verification Assessment
• Validation Assessment

Systems Engineering (SE) Principals and Role of V&V

• SEMP
• ConOps
• System Definition
• Requirements Development [System and Sub-system Level Requirements]
• High Level Design [Project Level Architecture]
• Component Level Detailed Design
• System Development and Implementation
• Hardware/Software Development and Unit Test
• Integration [Sub-system and System Level Integration]
• Verification [Sub-system and system level verification]
• Initial System Deployment
• Validation, Operations & Maintenance, Changes & Upgrades
• System Validation
• Validation and assessment of the operational system
• Ensuring the intended purpose and needs of system’s owner and stakeholders
• Operations & Maintenance
• Changes & Upgrades
• System Retirement/Replacement

Overview of Testing principals

• Human-based testing
• Formal correctness proofs
• Machine-based testing
• Testing Techniques
• Black-Box
• White-Box
• Levels or Phases of Testing
• Unit testing
• Component testing
• Product testing
• System testing
• Functional (black-box) tests
• Structural (white-box) tests
• Unit level toward the system level tests
• Integration testing
• Regression testing
• Re-testing to detect problems caused by the adverse effects of program change
• Acceptance testing
• Alpha testing
• Beta testing
• System Test Acceptance
• Soak testing
• Smoke (build verification) test
• Lights out test

Plan-Based Testing Process Activities

• Test Planning
• Test Design
• Test Implementation
• Test Execution
• Execution Analysis
• Result Documentation
• Final Reporting
• Testing in Incremental (e.g. Agile) System/Software Development
• Test-Driven Development (TDD)

Why V&V

• Important to conduct V&V in its interactions with the system of which it is part.
• Planning for V&V
• Scope of work
• Software Integrity Levels
• Development of the Software V&V Plan (SVVP)
• Cost of V&V

Life Cycle V&V Tasks

• Acquisition V&V
• Supply V&V
• Development V&V (Concept, Requirements, Design, Implementation)
• Development V&V (Test)
• Development V&V (Installation and Checkout)
• Operation V&V
• Maintenance V&V

Development of the Software V&V Plan (SVVP)

• V&V Techniques and Methods
• Audits, Reviews, and Inspection
• Analytic Techniques
• Dynamic Techniques
• Formal Verification
• The structure of a test plan
• The testing process
• Requirements traceability
• Tested items
• Testing schedule
• Test recording procedures
• Hardware and software requirements
• Constraints

Verification [Sub-system and system level verification]

• The Verification process
• Inputs
• Concept of Operations
• System and Sub-system Requirements
• Design Specifications
• Integration Plan [optional]
• Deployment Strategy [optional]
• Control
• Project Plan/Systems Engineering Management Plan [SEMP]
• Configuration Management Plan

Verification Enablers

• Stakeholder involvement
• Technical Reviews
• Traceability to the verification plan & procedures
• Verification Master Plan
• Verification Plan documents
• Verification Procedures
• Verification Reports
• Verified sub-system/system

Verification Process Activities

• Plan verification activities in SEMP / Project Plan
• Develop Verification Plan
• Trace between specifications and test cases
• Develop Verification Procedures
• Perform verification
• Document verification results
• Key stages of verification
• Sub-system Verification
• System Verification step
• Sub-system and system verification
• Commissioning
• Verification techniques
• Inspection
• Analysis
• Demonstration
• Test

System/Software Verification Overview

• The Inspection Process
• Requirements Inspections
• Design Inspections
• Code Inspections
• Test Inspections
• Measurement Attributes
• IEEE Software Metrics Framework

System Validation

• Description of System Validation
• The system’s owner and stakeholders
• Objective of System Validation
• Assessment of the operational system
• Needs of system’s owner and stakeholders
• Validation process three primary activities
• Planning
• Stakeholder involvement
• The plan
• Validation Master Plan
• Systems Engineering Management Plan [SEMP]
• Validation strategy
• Perform validation
• System acceptance
• Planning & strategy and the assessment results

System Validation Process

• Process context
• Inputs
• Concept of Operations
• Goals, objectives, and needs to be assessed
• Control
• Validation Documents Template
• Plans to lay out the specific validation efforts
• Reports on the results of the validation activity
• Validation Plan Template
• IEEE 1012-1998, Software Verification and Validation
• Checklist – Critical Information
• Validation Conduct
• Activities
• Categories of verification and validation
• Quality control process and Quality assurance process
• Prospective validation
• Full scale validation
• Partial validation
• Cross-validation
• Re-validation/Locational or Periodical validation

Software Validation Overview

• Testing and Acceptance
• Levels of Testing
• Methods of Testing
• Goals and Objectives of Testing
• Unit Testing
• Integration Testing
• Validation Testing
• Software Validation Testing
• Test Planning
• Test Estimation and Development
• Test Execution
• Measurement Applied to V&V Measurement Methods
• Software Structural Metrics
• Statistics-Based Measurements
• Trend Analysis
• Prediction-Based Measurement

Integration [Sub-system and System Level Integration]

• Integration as the process of successfully combining hardware and software components, sub-systems, and systems into a complete and functioning whole
• Integration planning
• Integration Process