| 4.4.12-5-1 Ensure the integration and verification test environments include all elements and are fully implemented and validated |
Phase C |
Phase D1 |
Phase D2 |
Phase D3 |
|
Ensure all elements (e.g., test beds, test facilities, simulators, emulators, test drivers, test data generators, automated test tools, and other test tools, as necessary) are fully implemented and validated before the respective integration or verification testing begins. Ensure that the integration and verification test environments can support a robust integration and verification testing program for all software-related requirements.
|
NA
|
NA
|
TOR-2006(8506)-5749, Mission Assurance Tasks for Software; Mission Assurance Guide, TOR-2007(8546)-6018, Rev B, Software Mission Assurance Chapter
|
| 4.4.12-5-2 Ensure robust integration and testing activities are performed for all levels of integrated software and hardware |
Phase C |
Phase D1 |
Phase D2 |
Phase D3 |
|
Ensure integration consider all levels (e.g., subsystem, element, segment and system levels, as appropriate to the program). Monitor integration testing events to ensure the testing is disciplined and performed according to documented test procedures.
|
NA
|
NA
|
TOR-2006(8506)-5749, Mission Assurance Tasks for Software; Mission Assurance Guide, TOR-2007(8546)-6018, Rev B, Software Mission Assurance Chapter
|
| 4.4.12-5-3 Ensure assessment of higher level software-related requirements verification activities |
Phase C |
Phase D1 |
Phase D2 |
Phase D3 |
|
Ensure contractor's higher level requirements verification activities for all software-related requirements at the subsystem, element, segment and system level (as appropriate to the program). Monitor requirements verification events to ensure the testing process is disciplined and the testing is performed according to the test procedures. Review verification reports for all verification methods (I, A, D, T). Participate in requirements verification decisions. Ensure that all software and software interface requirements that were unable to be verified at the software level have been fully verified in a higher level test event. Ensure that all software-related higher level requirements are fully verified.
|
NA
|
NA
|
TOR-2006(8506)-5749, Mission Assurance Tasks for Software; Mission Assurance Guide, TOR-2007(8546)-6018, Rev B, Software Mission Assurance Chapter
|
| 4.4.12-5-4 Ensure adequacy of contractor's software testing after loading operational flight constants |
Phase D1 |
Phase D2 |
Phase D3 |
|
Post design completion, ensure the contractor's test activities includes appropriate software regression testing is performed after the operational flight constants are loaded into the actual flight hardware and after any changes to the operational flight constants are loaded. Assure Flight algorithms are developed and loaded.
|
SFWC 2.1.3.1.4
|
NA
|
TOR-2006(8506)-5749, Mission Assurance Tasks for Software; Mission Assurance Guide, TOR-2007(8546)-6018, Rev B, Software Mission Assurance Chapter; TR-2004(8583)-1, Rev. A, Test Requirements for Launch, Upper Stage, and Space Vehicles; SFWC 2.1.3.1.4
|
| 4.4.12-5-5 Ensure assessment of flight subsystem hardware/software testing |
Phase D1 |
Phase D2 |
Phase D3 |
|
Ensure contractor's test activities for computer hardware and software in the subsystem's operational hardware-software configuration can meet the subsystem's functional and performance requirements under worse-case conditions. Assess the contractor's test activities to ensure that the computer hardware and software in the subsystem can meet the required subsystem functional and performance requirements over the full temperature range of the subsystem's unit temperature requirements.
|
NA
|
NA
|
TOR-2006(8506)-5749, Mission Assurance Tasks for Software; Mission Assurance Guide, TOR-2007(8546)-6018, Rev B, Software Mission Assurance Chapter; TR-2004(8583)-1, Rev. A, Test Requirements for Launch, Upper Stage, and Space Vehicles
|
| 4.4.12-5-6 Ensure assessment of contractor's software test activities |
Phase B |
Phase C |
Phase D1 |
Phase D2 |
Phase D3 |
|
Ensure results of contractor performance of software test activities are observed and verified. Evaluate that all test levels are conducted rigorously in accordance with documented test plans, procedures and required configuration management and test processes. Evaluate that analysis of test results is rigorous and adequate to detect test failures. Assessment to include all test activities described by software test plans: unit tests, software integration tests, and software qualification tests. Ensure regression testing of all affected test cases is performed after any change to previously tested software. Ensure that modifications to flight software on orbit are tested to the same degree of fidelity as new code before the modifications are uploaded to the space vehicle.
|
NA
|
NA
|
TOR-2006(8506)-5749, Mission Assurance Tasks for Software, Mission Assurance Guide, TOR-2007(8546)-6018, Rev B , Software Mission Assurance Chapter, TOR-2004(3909)-3537, Rev B, Software Development Standard for Space Systems, TR-2004(8583)-1, Rev. A, Test Requirements for Launch, Upper Stage, and Space Vehicles
|
| 4.4.12-5-7 Ensure assessment of contractor's software installation activities |
Phase B |
Phase C |
Phase D1 |
Phase D2 |
Phase D3 |
|
Ensure the results of contractor performance of software installation and checkout activities are observed and verified. Assessment to include all installation activities described by software installation plans. Ensure the checkout activities demonstrate that the installed software performs as required.
|
NA
|
NA
|
TOR-2006(8506)-5749, Mission Assurance Tasks for Software, Mission Assurance Guide, TOR-2007(8546)-6018, Rev B, Software Mission Assurance Chapter, TOR-2004(3909)-3537, Rev B, Software Development Standard for Space Systems
|
| 4.4.12-5-8 Ensure assessment of independent verification and validation contractor's implementation and progress |
Phase B |
Phase C |
Phase D1 |
Phase D2 |
|
Ensure assessment of the Independent Verification and Validation (IV&V) contractor's implementation and progress in accordance with IV&V Plan. Ensure that progress is in line with schedule for IV&V work. Ensure that results are reported by the IV&V contractor in a timely fashion and are made available to the development contractor.
|
NA
|
Independent Verification and Validation (IV&V) Plan
|
TOR-2006(8506)-5749, Mission Assurance Tasks for Software, Mission Assurance Guide, TOR-2007(8546)-6018, Rev B , Software Mission Assurance Chapter and Appendix A3-14, IEEE Std 1012(TM)-2004, IEEE Standard for Software Verification and Validation, TOR-2001(1465)-0934e, Software Independent Verification and Validation
|