| 5.1-1-1 Ensure all major and minor Program Milestone Reviews (SRR, SDR, PDR, CDR, Sell Offs, etc.) have specific entrance and exit criteria |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
Ensure that all criteria are met for each review. Ensure that reviews are not approved without criteria satisfaction or Delta reviews scheduled to satisfy requirements. Ensure that costs and earned value type of reporting are part of periodic reviews. Ensure that plans required on program are delivered time: acknowledgement of commitment at SDR, preliminary at PDR, with finals at CDR.
|
NA
|
Mission Assurance Plan (MAP); Systems Engineering Management Plan (SEMP)
|
Space Vehicle Systems Engineering Handbook, TOR-2006(8506)-4494, Mission Assurance Guide, TOR-2007(8546)-6018, Rev B, Guidelines for Space Systems Critical Gated Events, TOR-2009(8583)-8545
|
| 5.1-1-2 Ensure government involvement with design implementation and verification process that considers all disciplines involved, and all interface organizations |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
Ensure an assessment of required government talent (including government personnel, FFRDC, contractors) is conducted, consistent with program execution. A government plan should be in place with defined resourcing and accountabilities for each phase of the program.
|
NA
|
Mission Assurance Plan (MAP); Systems Engineering Management Plan (SEMP)
|
Mission Assurance Guide, TOR-2007(8546)-6018, Rev B, TOR-2007(8546), Program Assurance Chapter
|
| 5.1-1-3 Ensure impact of any critical issue associated with the ground segments is addressed with a timely execution plan |
Phase B |
Phase C |
Phase D1 |
|
Ensure tracking and resolution activities are documented for any critical issues, as defined by the program. Ensure issues have closeout mitigation plans with schedules and resources that show acceptable closing for successful program execution within cost and schedule constraints.
|
NA
|
Mission Assurance Plan (MAP); Systems Engineering Management Plan (SEMP)
|
Space Vehicle Systems Engineering Handbook, TOR-2006(8506)-4494
|
| 5.1-1-4 Ensure that the program executability methodology incorporates independent analysis and/or reviews to validate design, build and final product |
Phase B |
Phase C |
Phase D1 |
|
Ensure that independent reviews be considered for manufacturing issues, parts issues, and issues involving Functional Configuration Audits, Physical Configuration Audits. Ensure that independent reviews be considered for: Like-you-fly tests and exceptions, critical qualification margins, single point failures, first flight items, nonconformance items, anomalies, escapes, unverified failures, out of sequence work, extensive redesign, out-of-family measurements, general supplier issues in manufacturing, new design implementations, schedule and performance concerns, etc.
|
NA
|
Mission Assurance Plan (MAP); Systems Engineering Management Plan (SEMP)
|
Space Vehicle Systems Engineering Handbook, TOR-2006(8506)-4494
|
| 5.1-1-5 Ensure schedule for design, build and test is provided and is realistic |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
Ensure review of contractor schedule for realistic allotted timeframes to accomplish tasks, based on historical data from similar programs and assumptions, plus margin for unexpected events
|
NA
|
Mission Assurance Plan (MAP); Systems Engineering Management Plan (SEMP)
|
Space Vehicle Systems Engineering Handbook, TOR-2006(8506)-4494
|
| 5.1-1-6 Ensure the problem identification, failure review and corrective action processes are in place and functional |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
Ensure that failure review board actions are in place and functional in accordance with ground hardware requirements flow down. Ensure anomaly resolution is addressed and resolved. Ensure all anomaly identification and resolution packages sell-off packages are documented and filed.
|
NA
|
Mission Assurance Plan (MAP); Systems Engineering Management Plan (SEMP)
|
Technical Reviews and Audits for Systems, Equipment and Computer Software, Volume 1, SMC Standard SMC-S-21, 15 September 2009 or equivalent & TOR-2007(8583)-6414, 30 January 2009
|
| 5.1-1-7 Ensure lessons learned are incorporated into design, manufacture/build and test |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
Ensure internal lessons learned and Corporate lessons databases are reviewed for applicability to the ground segment including software. These should be incorporated into design, manufacture/build and test.
|
NA
|
Mission Assurance Plan (MAP); Systems Engineering Management Plan (SEMP)
|
Space Vehicle Systems Engineering Handbook, TOR-2006(8506)-4494; Why Satellites Fail: Lessons for Mission Success, TOR-2009(8617)-8704
|
| 5.1-1-8 Ensure configuration management capability includes scheduled ground hardware configuration audits to ensure the accuracy of configured hardware |
Phase A |
Phase B |
Phase C |
|
Ensure the ground hardware configuration management capability includes scheduled audits to ensure the hardware configuration is built per approved configurations and other baseline documents. Ensure that the hardware configuration audit schedule and report preparation are consistent with the program needs and the reports are correct and complete.
|
NA
|
NA
|
Technical Reviews and Audits for Systems, Equipment and Computer Software, Volume 1, SMC Standard SMC-S-21, 15 September 2009 or equivalent & TOR-2007(8583)-6414, 30 January 2009
|
| 5.1-1-9 Ensure the configuration change control capability jointly assesses proposed changes with the software configuration change control capability |
Phase A |
Phase B |
Phase C |
|
Ensure the contractor's computer-related hardware configuration change control capability works in concert with the software configuration change control capability. Assess the program's process for submitting and reviewing change requests. Throughout the program review hardware change requests to evaluate the impacts caused by the hardware changes. Review the changes to ensure that any hardware changes made during the development phase remains consistent with the operational hardware configuration.
|
NA
|
Configuration Management Plan (CMP)
|
Technical Reviews and Audits for Systems, Equipment and Computer Software, Volume 1, SMC Standard SMC-S-21, 15 September 2009 or equivalent & TOR-2007(8583)-6414, 30 January 2009
|
| 5.1-1-10 Ensure review of the computer equipment procurement plan |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
Ensure government involvement with the review of the computer equipment procurement plan and the implementation and verification process that considers all disciplines involved, and all interface organizations. The computer equipment procurement plan will, over the life of the program, ensure all development organizations have adequate computing resources during the development, integration & test, and operational phases of the program. A government plan to support these activities should be in place with defined resourcing and accountabilities for each phase of the program. Government plan should detail required talent (including government personnel, FFRDC, consultants) to assess consistency with the strategy to execute over the life of the program.
|
NA
|
Hardware Development Plan (HDP)
|
Mission Assurance Guide, TOR-2007(8546)-6018, Rev B, Program Assurance Chapter
|
| 5.1-1-11 Ensure the computer equipment vendors have a well defined roadmap for the evolution of product lines |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
Ensure, the program periodically meets with the vendors to ensure the chosen product lines will continue to be developed and maintained per the roadmaps. Too many programs in the past have had issues with computer hardware vendors that have deviated from product line roadmaps and it has impacted software developments and projected performance measurements.
|
NA
|
NA
|
Technical Reviews and Audits for Systems, Equipment and Computer Software, Volume 1, SMC Standard SMC-S-21, 15 September 2009 or equivalent & TOR-2007(8583)-6414, 30 January 2009
|
| 5.1-1-12 Ensure computer equipment hardware refresh plans and budgets adequately address the risk of obsolescence and/or losing vendor's ability to maintain computer equipment |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
Ensure the ground system has budget and plans for refreshing the ground computer equipment at least every five years or as often as is required to avoid risk of obsolescence and/or losing vendor support. If the ground hardware is not refreshed, there is a risk the computer vendors will no longer maintain the computer equipment. If components begin to fail, finding replacements becomes very difficult after five years or maybe even sooner.
|
NA
|
NA
|
Technical Reviews and Audits for Systems, Equipment and Computer Software, Volume 1, SMC Standard SMC-S-21, 15 September 2009 or equivalent & TOR-2007(8583)-6414, 30 January 2009
|
| 5.1-1-13 Ensure configuration change control boards jointly assess proposed computer equipment changes with the software configuration change control board |
Phase B |
Phase C |
Phase D1 |
|
Ensure the process for submitting and reviewing change requests is documented. Monitor computer equipment change requests to evaluate the impacts caused by the hardware changes, and ensure they are reviewed by the software configuration control board to ensure compatibility and consistency. Review the changes to assure that any computer equipment changes made during the development phase remain consistent with the operational hardware configuration.
|
NA
|
Configuration Management/Audit Processes and Products
|
Technical Reviews and Audits for Systems, Equipment and Computer Software, Volume 1, SMC Standard SMC-S-21, 15 September 2009 or equivalent & TOR-2007(8583)-6414, 30 January 2009
|
| 5.1-1-14 Ensure computer equipment delivery plans meets the programs development and operations requirements |
Phase C |
Phase D1 |
|
Ensure the schedule for the delivery of computer equipment to all development sites support the needs of the development phase. Ensure the schedule for the delivery of computer equipment to the operational sites meets the needs of the program's integration and test milestones. Identify any risks associated with ground computer equipment. Ensure mitigation plans have been generated for risks exceeding the program's defined risk threshold, per the program's Risk Management Plan. Review mitigation plans to assure that the risks have realistic burn down plans that mitigate the risks in a timely fashion. If the mitigation plan requires significant effort, verify that the mitigation task has been added to the integrated master schedule (IMS). If the risk involves a hardware vendor's delivery of a product, investigate the causes of the schedule slip. For all schedule related risks assess impacts to other parts of the program. Monitor the status of risks throughout the program.
|
NA
|
Integrated Master Plan (IMP) ; Risk Management Plan; Integrated Master Schedule (IMS)
|
Technical Reviews and Audits for Systems, Equipment and Computer Software, Volume 1, SMC Standard SMC-S-21, 15 September 2009 or equivalent & TOR-2007(8583)-6414, 30 January 2009
|
| 5.1-1-15 Ensure National Environmental Policy Act (NEPA) and American with Disabilities Act (ADA) requirements are satisfied |
Phase A |
Phase B |
Phase C |
Phase D1 |
|
Ensure compliance to NEPA. For Air Force program ensure AF 813 form is processed. Ensure whether a Categorical Exclusion, Environmental Assessment, or Environmental Impact Statement is required. Ensure an assessment is completed that determines whether Americans with Disabilities Act (ADA) requirements apply. Ensure compliance through the design process.
|
NA
|
NA
|
National Environmental Policy Act (NEPA); Americans with Disabilities Act (ADA) Accessibility Guidelines
|
| 5.1-1-16 Ensure the facility is designed to meet the intent of federally mandated Green requirements |
Phase A |
Phase B |
Phase C |
|
Ensure Federal requirement and compliance with associated Leadership in Energy & Environmental Design requirements is assessed (silver is currently the minimum standard for most federal facilities). Ensure review of the applicability of the requirements to the facility and occupancy type.
|
NA
|
NA
|
United States Green Building Council; Leadership in Energy & Environmental Design
|
| 5.1-1-17 Ensure an independent commissioning agent determination is included in the project planning |
Phase A |
|
Ensure compliance to commissioning requirements as dictated by the Federally mandated Leadership in Energy & Environmental Design and sustainability requirements. A commissioning agent is hired as part of the project to make sure that all critical systems are certified and meet all the specs and requirements.
|
NA
|
NA
|
United States Green Building Council
|
| 5.1-1-18 Ensure an independent government cost estimate determination is included in the project planning |
Phase A |
|
Ensure compliance to mandated cost estimates; an Independent Cost Estimate (ICE)/Independent Government Estimate (IGE) or equivalent is typically required for all contracts exceeding $100,000. Ensure compliance with Federal Acquisition Regulations 36.203, Government Accounting Office, & Office of Management and Budget requirements.
|
NA
|
NA
|
Unified Facilities Criteria (UFC) 3-700-01 (Programming Cost Estimates for Military Construction); Unified Facilities Criteria (UFC) 3-700-02 (Pavement Design for Airfields)
|
| 5.1-1-19 Ensure an executable acquisition strategy & delivery methodology for facilities determination is included in the project planning |
Phase A |
|
Ensure the acquisition plan for facilities meets Federal Acquisition Regulations (FAR) requirements, United States Code (USC) & Office of Management (OMB) and Budget requirements, and acquisition limitations Operations & Maintenance (O&M), Unspecified Minor Military Construction (UMMC), and Military Construction (MILCON) funds. Ensure identification of the appropriate approval authority. For Air Force Programs/facilities, ensure AF Forms 332 and 1391 if MILCON vehicle is used.
|
NA
|
NA
|
Federal Acquisition Regulations (FAR)
|
| 5.1-1-20 Ensure cost estimate accounts for area factors and includes all applicable factors tailored to project |
Phase A |
Phase B |
Phase C |
|
Ensure cost estimate accounts for area factors and includes all applicable factors tailored to project
|
NA
|
NA
|
Unified Facilities Criteria (UFC) 3-740-05 (Handbook: Construction Cost Estimating)
|
| 5.1-1-21 Ensure cost estimate includes Supervision, Inspection, & Overhead escalation to mid-point year of construction, and land acquisition |
Phase A |
Phase B |
Phase C |
|
Ensure cost estimate includes Supervision, Inspection, & Overhead escalation to mid-point year of construction, and land acquisition (as applicable)
|
NA
|
NA
|
Unified Facilities Criteria (UFC) 3-740-05 (Handbook: Construction Cost Estimating)
|
| 5.1-1-22 Ensure cost estimate includes design and construction contingencies |
Phase A |
Phase B |
Phase C |
|
Ensure cost estimate includes design and construction contingencies
|
NA
|
NA
|
United Facilities Criteria (UFC) 3-730-01 (Programming Cost Estimates for Military Construction); Unified Facilities Criteria (UFC) 3-740-05 (Handbook: Construction Cost Estimating)
|
| 5.1-1-23 Ensure cost estimate includes allowances for commissioning, design costs, site improvements, permits, fees, inspections, and Environmental Assessment |
Phase A |
Phase B |
Phase C |
|
Ensure cost estimate includes allowances for commissioning, design costs, site improvements (as applicable), permits, fees, inspections, and Environmental Assessment (EA)
|
NA
|
NA
|
Unified Facilities Criteria (UFC) 4-030-01 (Sustainable Development); Unified Facilities Criteria (UFC) 3-740-05 (Handbook: Construction Cost Estimating)
|
| 5.1-1-24 Ensure schedule dependencies are accounted for and contingencies specified |
Phase A |
Phase B |
Phase C |
|
Ensure schedule dependencies are verified and accounted for (contingencies)
|
NA
|
Integrated Master Schedule (IMS)
|
Unified Facilities Criteria (UFC) 3-740-05 (Handbook: Construction Cost Estimating)
|