| 2.1.1-1-1 Ensure government involvement with contractor design implementation and verification process that considers all disciplines involved, and all interface organizations |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
Ensure systems engineering is responsible for and has the power to control systems engineering functions in all program phases and governing all interfaces, components and performance and MA specification generation and verification. Ensure contractor has allocated resources for tasks, including tailoring and execution of the MA Standards.
|
NA
|
Systems Engineering Management Plan (SEMP); Mission Assurance Plan (MAP)
|
Mission Assurance Guide, TOR-2007(8546)-6018, Rev B , Program Assurance Chapter
|
| 2.1.1-1-2 Ensure impact of any critical issue associated with the system is addressed with a timely execution plan |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
Ensure tracking and resolution activities are documented for any critical issues, as defined by the program. Ensure issues have closeout mitigation plans with schedules and resources that show acceptable closing for successful program execution within cost and schedule constraints.
|
NA
|
Program Management Plan
|
Space Vehicle Systems Engineering Handbook, TOR-2006(8506)-4494
|
| 2.1.1-1-3 Ensure that the program executability methodology incorporates independent analysis and/or reviews to validate design, build and final product |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
Ensure that independent reviews be considered for manufacturing issues, parts issues, and issues involving Functional Configuration Audits, Physical Configuration Audits. Ensure that independent reviews be considered for: Like-you-fly tests and exceptions, critical qualification margins, single point failures, first flight items, nonconformance items, anomalies, escapes, unverified failures, out of sequence work, extensive redesign, out-of-family measurements, general supplier issues in manufacturing, new design implementations, schedule and performance concerns, etc.
|
NA
|
Integrated Master Plan (IMP) ; Design Review Data Package
|
Space Vehicle Systems Engineering Handbook, TOR-2006(8506)-4494
|
| 2.1.1-1-4 Ensure performance tools, simulators, models, and test beds are planned, developed, validated, and shown to verify system-to-unit requirements as required |
Phase A |
Phase B |
Phase C |
|
Ensure that simulation and analysis resources and efforts are a planned effort for the system, elements, payload, bus, subsystems, units, and ensure analysis is performed to demonstrate conformance to those requirements that cannot be verified in test. Ensure that the simulation and analysis assets have a verification and validation plan that supports integration, developmental test and dedicated operational test. Ensure models and simulation tools used to support operational testing are accredited. Ensure modeling and simulation assets are documented, and have established credibility. If results from models and simulations are used to support fielding decisions, ensure proper authority approves its use in dedicated operational testing.
|
AFMAN 63-119 A17.3; AFMAN 63-119 A17.4; AFMAN 63-119 A17.4.1; AFMAN 63-119 A17.4.2; AFMAN 63-119 A17.4.3; AFMAN 63-119 A17.5; AFMAN 63-119 A22.7.1
|
Integrated Master Plan (IMP) ; Design Review Data Package; Verification Cross-Reference Matrix (VCRM)
|
Space Vehicle Systems Engineering Handbook, TOR-2006(8506)-4494; AFMAN 63-119 or equivalent
|
| 2.1.1-1-5 Ensure schedule for design, build and test is provided and is reasonable |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
Ensure contractor has identified appropriate resources, risks and mitigation plans that make schedule feasible within budget constraints. Ensure that a design and integration schedule is generated and supported by lower level development schedules. Ensure a risk matrix is generated for items that are on a critical path and mitigation plans to meet schedule is generated and tracked by systems engineering.
|
NA
|
Integrated Master Schedule (IMS)
|
Space Vehicle Systems Engineering Handbook, TOR-2006(8506)-4494
|
| 2.1.1-1-6 Ensure problem identification, failure review and corrective action processes are adequate |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
Ensure that the PMPCB (Parts, Materials, Processes Control Board) and Failure Review Board (FRB) processes are in place and implemented. Ensure anomaly resolution is addressed and resolved through FRB, PMPCB, and other activities. Ensure all anomaly identification and resolution packages and sell-off packages are documented and filed.
|
NA
|
NA
|
Space Vehicle Systems Engineering Handbook, TOR-2006(8506)-4494
|
| 2.1.1-1-7 Ensure lessons learned and alert systems are regularly reviewed for applicability to the system to ensure incorporation into design, manufacture/build, test and operations |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
Ensure lessons learned databases are reviewed and applied, as appropriate. Ensure interface exists to the problem alerting databases, including a surveillance process for relevant alerts.
|
NA
|
Mission Assurance Plan (MAP)
|
Space Vehicle Systems Engineering Handbook, TOR-2006(8506)-4494; Why Satellites Fail: Lessons for Mission Success, TOR-2009(8617)-8704
|
| 2.1.1-1-8 Ensure government talent required to manage the program is evaluated and planned |
Phase 0 |
Phase A |
Phase B |
Phase C |
|
Ensure the roles and responsibilities of the various program office entities and external interfaces are clearly defined, including the authorities and accountabilities associated with each. Critical in standing up the program office is determining the appropriate organizational structure and acquiring the right talent and resources. The roles and responsibilities should be revisited as the program progresses through later phases of the program to adjust program talent as needed.
|
NA
|
Integrated Master Plan (IMP)
|
Mission Assurance Guide, TOR-2007(8546)-6018, Rev B , Program Assurance Chapter; Pre-Milestone A and Early-Phase Systems Engineering, Air Force Studies Board, National Research Council, 2008.
|
| 2.1.1-1-9 Ensure quality of the contractor program execution plan including staffing plan is evaluated |
Phase 0 |
Phase A |
Phase B |
Phase C |
|
Ensure the evaluation of the contractor program execution plan including staffing plan against the integrated master plan, the integrated master schedule, the program management plan, and the contractor delivery requirements list. The contractor should have a plan in place to resource the development of the system with appropriate talent over the life of the program with a plan for steady stream of tangible successes, e.g., demonstrations of technologies, testing of parts, subassemblies, bread-boards, brass-boards, and overlay this with milestone reviews.
|
NA
|
Integrated Master Plan (IMP) ; Staffing Plan
|
Mission Assurance Guide, TOR-2007(8546)-6018, Rev B , Program Assurance Chapter; Pre-Milestone A and Early-Phase Systems Engineering, Air Force Studies Board, National Research Council, 2008.
|
| 2.1.1-1-10 Ensure effective communication channels are established with customer and user participation |
Phase 0 |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
Decisions made prior to milestone A should be supported by rigorous systems analysis and systems engineering process involving teams of users, acquirers, and industry representatives. Working together , government and industry can develop and explore solutions to arrive at an optimal systems solution . Continued involvement of customer and users through development is key to ensure that agreement of satisfaction of needs.
|
NA
|
Systems Engineering Management Plan (SEMP); Integrated Master Plan (IMP)
|
Mission Assurance Guide, TOR-2007(8546)-6018, Rev B , Program Assurance Chapter; Pre-Milestone A and Early-Phase Systems Engineering, Air Force Studies Board, National Research Council, 2008.
|
| 2.1.1-1-11 Ensure the use of Earned Value Management or equivalent, critical path management processes and technical performance measures |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
Ensure that cost and schedule issues are identified along with mitigation plans to reduce schedule effects.
|
NA
|
Integrated Master Plan (IMP) ; Integrated Master Schedule (IMS)
|
Space Vehicle Systems Engineering Handbook, TOR-2006(8506)-4494; Mission Assurance Guide, TOR-2007(8546)-6018, Rev B
|
| 2.1.1-1-12 Ensure that a Test Like You Fly Process Assessment is performed |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
One or more TLYF Process Assessments should be performed during lifecycle of the system to determine the shortfalls in the contractor's implementation of TLYF and associated risks that may impact the accomplishment of the intended mission.
|
NA
|
Design Review Data Package; Integration and Test Plans; System Test Plan
|
TLYF Process Assessments ATM-2015-04239 REV A; Test Like You Fly Process Guide for Space, Launch, and Ground Systems, TOR-2014-02537 Rev A, September 2016 (Section 5); TLYF
|