Coursework

L17-TestandEvaluationPlanning1.pdf

Home >Engineering homework help >Coursework

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Lesson Overview

The four stages of testing are: {1) Test Planning, ( 2) Conducting the T est, (3) Evaluating and Analyzing Test Results, and {4 ) Reporting Tes t Results. This lesson provides you with important infonnation about the first of the four stages of tes ting: Test Planning.

Upon completing this lesson, you'll be able to identify key aspects of Test Planning. This includes:

• Iden tifying the four stages of testing ;

• Describing the key elements of a Test Plan ;

• Recognizing how c apabilities are translated in to test c riteria ;

• Describing typical tes t planning metrics;

• I dentifying guidelines for test management;

• Identifying T&E W!PT key members and their roles;

• Creating an Outline Test Plan for a given system.

~ I P• ge1of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

The Test and Evaluation Process

As you have learned elsewhere in this course, the Test and Evaluation process is derived in part from the • scientific method". The process flow used for T&E consists of the steps shown here. These steps are:

T&E Process Flow • Identify Information Requirements;

• Pre-test Evaluation ;

• Conduct Test Ac tivi ties;

• Post-test Synthesis and Ev aluation ;

• Decision Maker Utilizes Data.

Select each step in the T est and Ev aluation Process Flow diagram shown here to learn more.

These steps can be simplified into the four stages of testing, as shown on the next screen.

...... I P• ge2of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

The Test and Evaluation Process

As you have learned elsewhere in this course, the Test and Evaluation process is derived in p art from the • scientific method". The process flow used for T&E consists of the steps shown here. These steps are:

T&E Process Flow • Identify Information Requirements;

• Pre-test Evaluation ;

• Conduct Test Ac tiviti.r-------~---- T& E step 1

• Post· test Synthesis During Step 1, T &E professionals review and

• Decision Maker Utiliz analyze sources of requirements, including requirements documents. The goal is to identify

Select each step in the Te the information needed by the decision· maker Flow diagram shown here t from the T&E program.

These steps can be simplified into the four stages of testing, as shown on the next screen.

...... I P• ge2of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

The Test and Evaluation Process

As you have learned elsewhere in this course, the Test and Evaluation process is derived in p art from the • scientific method". The process flow used for T&E consists of the steps shown here. These steps are:

T&E Process Flow • Identify Information Requirements;

• Pre - test Evaluation ;

• Conduct Test Activi t.ir-T_&_E_ st_ e_p_ _______ 2

• Post· test Synthesis During Step 2, T&E professionals develop

• Dec ision Maker Utiliz analy tical tools, estimate resul ts, and determine the types and quantities of data that will be

Select each step in the Te needed to satisfy the requirements set forth by Flow diagram shown here t the decision· maker.

These steps can be simplified into the four stages of testing, as shown on the next screen .

...... I P• ge2of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

The Test and Evaluation Process

T&E Process Flow • Identify Information Requirements;

• Pre-test Evaluation ;

• Conduct Test Ac ti vi ti1p.._-----~-----

• Post· test Synthesis T& E step 3

• Decision Maker Utiliz During Step 3, T&E professionals plan and conduct the test. Data management and test

Select each step in the T e reporting are also included in this step. Flow diagram shown here t:"'"'el!!'-11111!11'!!'_______________ ..

These steps can be simplified into the four stages of testing, as shown on the next screen.

...... I P• ge2of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

The Test and Evaluation Process

As you have learned elsewhere in this course, the Test and Evaluation process is derived in p art from the • scientific method". The process flow used for T&E consists of the steps shown here. These steps are:

T&E Process Flow • Identify Information Requirements;

• Pre-test Evaluation ;

• Conduct Test Ac ti vi ti1p.._-----~-----

• Post· test Synthesis T& E step S

• Decision Maker Utiliz During Step s, the decision - maker weighs t he information provided by the T&E program against

Select each step in the T e other program information. Flow diagram shown here t:"'"'el!!'-11111!11'!!'_______________ ..

These steps can be simplified into the four stages of testing, as shown on the next screen.

...... I P• ge2of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

The Test and Evaluation Process

As you have learned elsewhere in this course, the Test and Evaluation process is derived in p art from the • scientific method". The process flow used for T&E consists of the steps shown here. These steps are:

T&E Process Flow • Identify Information Requirements;

• Pre - test Evaluation ; • Conduct Test Activi t ii'.""""____________,..

T&E step 4 • Post· test Synthesis

During Step 4, T&E professionals compare • Dec ision Maker Utiliz expectations to outcomes, determine issues and conclusions, and prepare technical and

Select each step in the Te operational assessments.Flow diagram shown here t.,____________________ ..

These steps can be simplified into the four stages of testing, as shown on the next screen .

...... I P• ge2of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

The Test and Evaluation Process

As you have learned elsewhere in this course, the Test and Eval · · · · • scientifi Lo n g Description consists

I m age Ma p o f t h e Test and Eva lu ati o n Process Fl o w • Ide Note: Variations of this graphic will be shown throughout this lesson.

• Pre The image map has the five steps of the T & E Process flow as ho t spots :

• Co • T&E Step 1: I den ti fy I n formation Requiremen ts

• Pos • T&E Step 2: Pre- test Ev aluation • T&E S tep 3: Conduc t T es t

• De • T&E Step 4: Post- test Synthesis and Evalua tion • T&E Step 5 : Decision Maker Utilizes Data

Select ea Flow diag

There are arrows between each step pointing to the next step. Th ere is an additional arrow from Step 2 that points to Step 4 and a dotted arrow from Step 4 that pointsThese st up to Step 2.

testing, a

...... I P• ge2of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

The Four Stages of Testing

The steps in the Test and Ev aluation Process flow can be further simplified into the four stages of testing illustrated here.

Select each the bullets below for a summary description of each of them:

• Test plannjng Evaluation . .. · ·• Major Teat J Objectives _l I Objoetl•"•·.• Test Conduct

• Analysjs and Eyaluation M..aurod

• Test Reoortjng Feedback Outcomn I •

...... I P• gelof 40 ..... Back Ii Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Long Descript ion

T c Animation opens with the fiv e steps of the T & E Process flow: t• • T&E Step 1: Identify Information Requirements

• T&E Step 2 : Pre-test Ev aluation s • T&E Step 3 : Conduct Test d • T&E Step 4 : Post-test Synthesis and Ev aluation

• T&E Step 5 : Decision Maker Utilizes Data

There are arrow s betw een each step pointing to the nex t step . There is an additional arrow from Step 2 that points to Step 4 and a dotted arrow from Step 4 that points up to Step 2 . Betw een the arrow s are the outputs from each step :

• Betw een 1 and 2 : Ev aluation Objectiv es • Betw een 2 and 3 : Major Test Objectiv es • Betw een 3 and 4 : Measured Outcomes • Betw een 4 and 5 : Feedback

The animation is a series of boxes that appears abov e the steps with lines connecting them to the steps :

• Test Planning connects to Steps 1 and 2 . • Test Conduct connects to Step 3 . • Analysis & Ev aluation connects to Step 4 . • Test Reporting connects to Step 5

"-----------------------------------------------------------------------· ~ ....rl I ~Page3of40 Back i ) Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

The Four Stages of Testing

The steps in the Test and Ev aluation Process flow can be further simpli fied into the four s tages of testing illustrated here.

Select each the bullets below for a summary description of each of them:

• Test plannjng Evaluation . .. · ·• Major Teat J Objectives _l I Objoetl•"•·.• Test Conduct

• Analysjs and Eyaluation M..aurod

• Test Reoortjng Feedback Outcomn I

Test Planning •

T est Planning reviews the objectives of a T&E program, the planning process, review s sources of performance/ test criteria (suc h as Requirements documents), and establishes t e st management processes and test metrics t o be used by the program.

...... I P• gelof 40 ..... Back Ii Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

The Four Stages of Testing

The steps in the Test and Ev aluation Process flow can be further simpli fied into the four s tages of testing illustrated here.

Select each the bullets below for a summary description of each of them:

• Test plannjng Evaluation . .. · ·• Major Teat J Objectives _l I Objoell•"•·.• Test Conduct

• Analysjs and Eyaluation M..aurod

• Test Reoortjng Feedback Outcomn I •

Test Conduct

Conducting the Test covers the issu es associated wi th conducting the test a ctivities, including determining the types o f d ata collected during test events along with establishing typical pre- t est, test, and post- test activities.

...... I P• gelof 40 ..... Back Ii Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

The Four Stages of Testing

The steps in the Test and Ev aluation Process flow can be further simpli fied into the four s tages of testing illustrated here.

Select each the bullets below for a summary description of each of them:

• Test plannjng Evaluation . .. · ·• Major Teat J Objectives _l I Objoetl•"•·.• Test Conduct

• Analysjs and Eyaluation M..aurod

• Test Reoortjng Feedback Outcomn I

Analysis and Evaluation •

Analy sis and Evaluation identifies a ny i ssues associated wi th system requiremen ts a nd proposed evaluation processes, strategies, and techniques. Issues associated with managing test d ata outputs are also iden tified .

...... I P• gel of 40 ..... Back Ii Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

The Four Stages of Testing

The steps in the Test and Ev aluation Process flow can be further simpli fied into the four s tages of testing illustrated here.

Select each the bullets below for a summary description of each of them:

• Test plannjng Evaluation . .. · ·• Major Teat J Objectives _l I Objoetl•"•·.• Test Conduct

• Analysjs and Eyaluation M..aurod

• Test Reoortjng Feedback Outcomn I

Test Reporting •

T est Reporting reviews the types o f test reports a nd the required content of the typical DoD test report.

...... I P• gelof 40 ..... Back Ii Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Introduction t o Tes t Pl anning

The level of detail that goes into the planning process itself determines a g ood plan. Test planning should be a disciplined approach to organize a test program to reduce progra m risk a nd to provide data for decision makers to determine if the program is to proceed into the next phase.

Two different types of plans are developed for any test effort, an Ev aluation Plan and Test Plan.

The Ev aluation plan contains :

• Test requirements

• Measurable obj ec tives

• Data requirements

• Data reduction/analy sis plans

The Test Plan contains:

• Tests required to collect the data

• Instrumentation requirements

• Logical/incremental approaches

• Test resources required to accomplish the test

...... I P• ge 4of40 ..... Back fiO Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

What to Test

One of the first questions to ask is 'What should be tested?' Actually, it might be easier to find things to NOT test because in a successful testing program, everything that it takes to design, produce, and employ an effective and suitable system is tested.

In theory, all key system elements should be tested first in a controlled environment ( Dev elopmen tal Test) and then again in an operational environmen t ( Operational Test) .

Ex amples of i tems to t es t are :

• End Item;

• Maintenance;

• Support Equipment;

• Facilities;

• Personnel and Training;

• Supply;

• Technical Data.

...... I P•ge Sof40 ..... Back fiii Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

What to Test

In theory, all key system elements should be tested first in a controlled environment ( Developmental Test) and then again in an opera tional environment ( Operational Test) .

Lo ng Description Ex amples of i tems to tes

The animation shows a spinning question mark with the tex t : "What should be tested?". Nex t an image of the • End Item; SRAW and launcher appears.

• Maintenance;

• Support Equipment;

• Facilities;

• Personnel and Training,

• Supply;

• Technical Data.

...... I P•geSof 40 ..... Back fiii Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

How to Test

Effectiv e planning is essential to ensure the most efficient use of test resources . Proactiv e planning also ensures that all required information is obtained .

The most effectiv e testing is accomplished by a combination of:

• S truc tured Approac h

• Recursiv e/ Iterativ e Process

• Measurement Agains t Criteria

Additionally, a v ariety of tools can be used to help improv e the effectiv eness and efficiency of test efforts . Such automated tools are typically selected and employ ed by the respectiv e testing organization as enterprise- lev el resources . When properly integrated into the ov erall test effort, they can result in better use of test resources and improv ed efficiencies . Some generic examples of such tools can be found here .

....rl I ~Page6of 40 Back liiiii ) Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

How to Test

Effectiv e planning is essential to ensure the most efficient use of test resources . Proactiv e planning also ensures that all required information is obtained .

The most effectiv e testing is accomplished by a combination of:

• Structured Approach

• Recursiv e/ Iterativ e Process

• Measurement A~ structured Approach

Additionally, a v ariety c Use a Structured Approach : ficiency of test efforts . Such automate • Define requirements e testing organization as enterpri • Establish test and ev aluation criteria I test effort, they can result in better use • Collect data xamples of such tools can be found herE • Prov ide ev aluations to decision-makers

....rl I ~Page6of40 Back liiiii ) Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

How to Test

Effectiv e planning is essential to ensure the most efficient use of test resources . Proactiv e planning also ensures that all required information is obtained .

The most effectiv e testing is accomplished by a combination of:

• Structured Approach

• Recursiv e/ Iterativ e Process

• Measurement A~ Recu rsive/Iterat ive Process

Additionally, a v ariety c Testing is a Recursiv e/ Iterativ e Process : ficiency of test efforts . Such automate • Work from component to full sy stem e testing organization as enterpri • Laboratory to field env ironments I test effort, they can result in better use • Technical to operational test scenarios xamples of such tools can be found herE • Use modeling and simulation

....rl I ~Page6of40 Back liiiii ) Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

How to Test

Effectiv e planning is essential to ensure the most efficient use of test resources . Proactiv e planning also ensures that all require

Measu re m ent Against Crit eria

The most effectiv e tes Throughout the dev elopment process, testing and ev aluation will measure progress against attribute

• Structured A~~ro thresholds and objectiv es .

• Recursiv e tlterati Test ev ents are planned to provide operational stresses

• Measurement A~ and environments necessary to determine a sy stem's performance capability in relation to the trade space

Additionally, a v ariety c ( range ) betw een the threshold and objectiv e criteria ficiency of test efforts . Such automate (values ) . The PM budgets for design efforts that can e testing organization as enterpri achiev e at least the threshold v alues . I test effort, they can result in better use xamples of such tools can be found herE Test ev ents must be executed by contractor,

gov ernment, or user operators in accordance with the test event design to generate acceptable/valid data that can be provided for decision making .

Test reports must reflect sy stem performance at the time and under the conditions generated during test. Progress, lack of progress, and deficiencies should be accurately and concisely reported so that the reader deriv es the appropriate conclusions . The report should answer the question : Where am I v ersus where I ought to be relativ e to the threshold/ objectiv e?

....rl I ~Page6of 40 Back liiiii ) Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

The TEMP v s. Test Pl ans

The important test planning document to begin with is the TEMP (Test and Evaluation Master Plan), which should be aligned with the program's Systems Engineering Plan. From the TEMP, you can gather enough top- level information to ' set the stage' for the test program.

Then come the details that are c ri tical to the success of a test program. These test details w ill no t usually be contained in one test plan, but in potentially ten to a hundred or more of de tailed test plans for a given sy stem.

...... I P• ge 7of40 ..... Back 8 Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

The TEMP vs. Test Plans

The important test planning document to begin with is the TEMP (Test and Evaluation Master Plan) , which should be aligned with the program's Systems Engineering Plan. From the TEMP, you can gather enough t op- level information to ' set the stage' for the test program.

Then come the details that are critical to the success of a test program . These t es t details will not usually be contained in one tes an b• .i,t.iQ,,,llQ.J;P~I UU:"lCl..CQ...a.._....,..,...,.....o!...~==---- hundred or more of d Lo ng Descriptio n

Image of two books, with one titled "Systems Engineering Plan" and the other titled "Test and Evalua tion Master Plan (TEMP) ."

..... I P• ge 7of40 ..... Back 8 Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

The TEMP v s. Test Pl ans

Systems Engineering Pla n

A Systems Engineering Plan ( SEP) is a detailed formulation of actions that should guide all tec hnical aspects of an acquisition program. The SEP is intended to be a roadmap that supports program management by defining comprehensive systems engineering activities, addressing both government and contractor technical activities and responsibilities.

...... I P•ge 7of40 ..... Back 8 Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Test and Evaluati on Pl ans: Key I nfor mati on

Test Plans are normally dev eloped by the testing organization ( either contractor or gov ernment) . Test plans come in many sizes and are called by different titles depending on their purpose and the size of the test. Possible titles inc lude Detailed Test Plan, Test Design, Test Card .

An Ev aluation Plan for an indiv idual test ev ent may inc lude :

• Ev aluation issues or parameters to be tested ; • Performance criteria ( measurable thresholds/ objectiv es ) ; • Data requirements/ data source matrix; • Data reduction/ analy sis methodology .

A test plan must contain enough information to permit test conduct, inc luding :

• Test item description ; • Test objectiv es ( data requirements, sample size ) ; • Test conditions/ constraints/ limitations ; • Instrumentation ; • Test ev ent sequencing build-up ; • Test support resource ( equipment, personnel, funding ) .

More detailed suggested outlines of Test Plans and Ev aluation Plans can be found in the T&E Management Guide, av ailable v ia References . Additionally, service regulations and policies ( also av ailable v ia References ) prov ide service-specific guidance on these plans .

....rl I ~Page8of 40 Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning

Hierarchy of Documents

There is a hierarchy of documents that flow down to the Detailed Test Plans:

• The ICD, COD or CPD provide the best statement of the user's needs;

• The TEMP, Acquisition Program Baseline (APB), and system specification documents all make up the acquisition program; they are established to sa tisfy the COD capabili ties;

• The government then usually contracts with a company to develop the sy stem according to some program schedule and come up with an overall plan on how it is to be tested throughout the development life cycle ;

• The system test plan shows how the contractor will demonstrate performance at the system level;

• Detailed test plans go into ev en more detail on each area of testing for subsystems, configuration items, components and items;

• Data analysis plans go hand- in - hand with various detailed test plans and describe data analysis procedures .

RESOURCES I PR I NT I HELP

...... I P• ge Qof40 ..... Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Hi er ar chy of Documents

There is a hierarchy of documents that flow down to the Detailed Test Plans :

Long Descrip t ion

The animation builds the Hierarchy of Documents lev el by lev el. There are sev en lev els .

The top lev el is "!CD/ COD/ CPD". The second lev el has t w o boxes : "TEMP" and "APB". The third lev el has three boxes : "Sy stem Test Plan", "Sy stem Spec", and "Program Schedule". From ICD/ CDD/ CPD there are arrow s pointing to Temp, APB, and Sy stem Spec .

The fourth lev el has one box: "Detailed Test Plans & Data Analy sis Plans". The fifth lev el has one box: "Mission Planning". There are arrow s from all three boxes in the third lev el pointing to the Detailed Test Plans & Data Analy sis Plans . There is an arrow from Program Schedule pointing to Mission Planning . There is an arrow from Detailed Test Plans & Data Analy sis Plans pointing to Mission Planning .

The six th and sev enth lev el dim slightly after they appear. The six th lev el has one box: "Test Cards". The sev enth lev el has three boxes : "Test", "Analy ze", and Report". There is an arrow from Mission Planning pointing to Test Cards . There is an arrow from Test Cards pointing to Test. There are right arrow s betw een the three boxes in the sev enth lev el. There is an arrow from Analy ze pointing back to Mission Planning .

analy sis procedures .

....rl I ~Page9of40 Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning

Detailed Test Plans

Detailed Test Plans are more detailed than the System Test Plan and contain the information necessary to conduct the tests. There may be many detailed test plans, even for one component or element of a System Test Plan. Each of the Detailed Test Plans has a specific purpose and describes the test article configuration, the test techniques, and the test condi tions .

After the Detailed Tes t Plans are written, together with the Data Analy sis Plans, then the actual test missions, or events, are planned, scheduled, and performed. During a t es t mission, each test event may be described on a test "card" which in many cases is actually a kneeboard- sized card that contains notes and space for use by the test crew in setting up, executing, and capturing data for that test event.

Following each test mission, the data is analyzed. Some test events will be unsuccessful for v arious reasons and will need to be rescheduled for a subsequent mission. The data from successful tests continue through the evaluation process and eventually get reported in some form .

RESOURCES I PR I NT I HELP

..... I P•ge10of40 ..... Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Det ailed Test Plans

Detailed Test Plans are more detailed than the Sy stem Test necessary to Lo n g De scrip tio n many detaile or element 0 The animation builds the Hierarchy of Documents lev el by lev el. There are sev en

Detailed Tesl lev els . describes th techniques The top lev el is "ORD". The second lev el has t w o boxes : "T EMP and "APB". The

' third lev el has three boxes : "Sy stem Test Plan", "Sy stem Spec", and "Program After the De Schedule". From Ord there are arrow s pointing to Temp, APB, and Sy stem Spec .

with the Oat The fourth lev el has one box: "Detailed Test Plans & Data Analy sis Plans". Themissions, or fifth lev el has one box: "Mission Planning". There are arrow s from all three box in performed . D the third lev el pointing to the Detailed Test Plans & Data Analy sis Plans . There is may be desc an arrow from Program Schedule pointing to Mission Planning . There is an arrow cases is act from Detailed Test Plans & Data Analy sis Plans pointing to Mission Planning contains not

in setting up The six th lev el has one box: "Test Cards". The sev enth lev el has three boxes : test event. "Test", "Analy ze", and Report". There is an arrow from Mission Planning pointing to Test Cards . There is an arrow from Test Cards pointing to Test. There are Following ea right arrow s betw een the three boxes in the sev enth lev el. There is an arrow Some test e from Analy ze pointing back to Mission Planning . reasons and

subsequent continue thr All the boxes dim in the graphic except for Detailed Test Plans & Data Analy sis ev entually g lilllP• l•a.ns_ a•n•d• T• e• s• t• C• a• r•d•s ________________________

....rl I Pag e 10 of 40 ~ Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Translating Capabilities into Testable Criteria

Capabilities documents prov ide Key Performance Parameters ( KPPs ), Measures of Effectiv es ( MOEs ) and Measures of Suitability ( MOSs ) that are explicitly stated or deriv ed in some manner. Sy stems Engineering processes flo w these dow n and ultimately dev elop a " build-to" Sy stem Specification . Detailed Measures of Performance ( MOPs ) are dev eloped from MOEs and MOSs . These MOPs are allocated to low er-lev el sy stem components, as part of the expansion of the sy stem Work Breakdow n S truc ture CWBSl . Ev ent test designs are structured around these MOEs/ MOSs/ MOPs to deriv e the test criteria and associated data elements needed to answ er test objectiv es . This flo w -dow n or " dendritic" process is used to translate capability attributes into detailed traceable, measurable and testable criteria .

Testing (verification and v alidation ) starts at the low est lev el configuration item and is rolled up and then repeated as needed at each higher lev el as the sy stem is integrated . This incremental approach allow s T&E to focus on problem identification at low est lev el so that problems are identified as early as possible .

....rl I Page 11 of 40 ~ Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Translating Capabilities into Testable Criteria

Capabilities documents provide Key Performance Parameters ( KPPs ), Measures of Effectiv es ( MOEs ) and Measures of Suitability ( MOSs ) that are explicitly stated or deriv ed in some manner. Sy stems Engineering processes flow these down and ultimately dev elop a " build-to" Sy stem Specification . Detailed Measures of Performance ( MOPs ) ar to lower-lev el sy stem components, as part o Long Descript ion . Event test designs are structured associated data elements needed to an The flowchart illustrates the process used to translate used to translate capability attributes int capabilities into measurable criteria data elements ):

Testing (verification an Capabilities documents provide performance attributes is rolled up and then repeated as needed at and MOE that are explicitly stated or deriv ed for inclusion I approach allow s T&E to focus on proble in the sy stem specification, section 3 . The Sy stems as early as possible .

Engineering process flow s down performance measures during the contractor's design process and during the expansion of the Work Breakdown Structure ( MIL HDBK 881 ) . These populate the sy stem specification, section 4, Verification . Event test designs use the performance MOE/ MOP to deriv e the data elements necessary to answer test objectiv es . This dendritic process is used by all test designers/ ev aluators to translate capability attributes/ MOE into measurable, testable criteria .

....rl I Page 11 of 40 ~ Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Translating Capabilities into Testable Criteria

Capabilities documents prov ide Key Performance Parameters ( KPPs ), Measures of Effectiv es ( MOEs ) and Measures of Suitability ( MOSs ) that are explicitly stated or deriv ed in some manner. Sy stems Engineering processes flo w these dow n and ultimately dev elop a " build-to" Sy stem Specification . Detailed Measures of Performance ( MOPs ) are dev eloped from MOEs and MOSs . These MOPs are allocated to low er-lev el sy stem components, as part of the expansion of the sy stem Work Breakdow n S truc ture CWBSl . Ev ent test designs are structured around these MOEs/ MOSs/ MOPs to deriv e the test criteria and associated data elements needed to an e s This flo w -cia,w.r.:u;> r '\ciend · " used to translate

capability attributes int work Breakdown structu re (WBS)

Testing (verification an repeated as needed at T&E to focus on proble

A WBS is a product-oriented family tree composed of hardw are, softw are, services, data, and facilities . The family tree results from Sy stems Engineering efforts

is rolled up and then tal approach allow s

as early as possible .

during the acquisition of a defense materiel item . A WBS display s and defines the product, or products, to be dev eloped and/ or produced . It relates the elements of w ork to be accomplished to each other and to the end product.

....rl I Page 11 of 40 ~ Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Knowledge Review

From the statements below, select the answer you believe to be true.

The TEMP is the best place to go when determining the user's needs.

lJ To create the system spec i fication document, you must first gather all Detailed Test Plans for the system.

~ There may be many sets of Detailed Test Plans in a test program and once Detailed Test Plans are written, actual testing can start.

Check Answer

True, there m ay be many sets o f Detailed Test Pl a ns in a test program and o nce Detailed Test Plans are written, actual testing can start•

...... I P• ge12of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Systems Engineering Perspective

Testing does not take place on a whim. In-depth, detailed planning is essential. Such planning is an inherent part of the Systems Engineering processes being used on a DoD system. Systems Engineering processes address testing from two perspectives:

• Technical Planning, one of the Systems Engineering Technical Management Processes, ensures that Systems Engineering processes are properly applied. I t addresses the scope of technical effort required to develop the system. Ou tputs of the T echnical Planning process include the various plans used to manage sys t em development, among them the Systems Engineering Plan ( SEP) and the TEMP.

• Verification and Validation are two of the Systems Engineering T echnical processes . They are used t o ensure technical compliance of products to their design-to specifications (Verification) and assess their "fitness for use• or operational effectiveness. (Validation)

Test Planning must ensure that tests are developed that measure both the technical compliance and operational effectiveness of systems components.

..... I P• ge13of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Systems Engineering Perspective

• Technical Planning, one of the Sy stems Engineering Technical Management Processes, ensures that Systems

1~•.;'"d:t.d~"""""'""'..tbEngineering proc liica><di-1 _ _ _

scope of technic Technic al Manage m ent Processes Outputs of the T plans used to ma These processes are used to manage the technical Systems Enginee development of a system. They consist of: Technical

Planning, Requirements Management, Interface• Verification and Management, Risk Management, Configuration T e hni Management, Technical Data Management, Technicalcompliance of pr Assessment and Decision Analysis.(Verification) and

effectiveness. (va"""•~a~b~o·n . """................................

Test Planning must ensure that tests are developed that measure both the technical compliance and operational effectiveness of sy stems components.

...... I P• ge13of40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Systems Engineering Perspective

Testing does not take place on a whim. ln-depth, detailed planning is essential. Such planning is an inher ent part of the Systems Engineering processes being used on a DoD system. Systems Engineering processes address testing from two perspectives:

plans used to ma These processes are used to design the system, Systems Enginee subsystems, and components. Consist of: Stakeholder

• Verification and Requirements Definition, Requirements Analysis, JT~et£.th!.Cnilii;al..PJJ2J;~~ Architecture Design, Implementation, lntegration, compliance of pr Verification, Validation and Transition. (Verification) and""""'l!ll!I""""'_.""'...,""'"""'"',...,....,.......,...,.__ effectiveness. {Validation)

Test Planning must ensure that tests are developed that measure both the technical compliance and operational effectiveness of systems components.

...... I P• ge13of40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

What to Measure?

From a technical oerspective. measure for the perfonnance of the components and of the system as a whole. Look at the supportability of the system, including the :

• Reliability/Availability/Maint ainability;

• Producibility;

• Hardware and/or so ftw are performance.

From an opera tjonal perspec tiv e, de t ermine the overall operational e ffectiveness and sui tabili ty. This is generally accomplished through OT &E .

Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

What to Measure?

From a t ee the compon Technical Perspective

supportabili

• Reliab

• Produ

operational accomplish

Long Descript ion

The animation show s a draw ing of the SRAW. Various components fly out and are labeled : "Flight Module", "Warhead", and Sensor".

~ I Page14of 40 ~ Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

What to Measure?

From a technical oerspective. measure for the performance of the components and of the sys tem as a whole. Look at the supportability of the system, including the:

• Reliability/ Av O pe ratio na l Perspe ctive

• Producibility;

• Hardware an

From an Qo~wi.o.aaj operational effecti accomplished throu

Long Des crip tion

The anima tion shows a tank rolling by in the b ackground. In the foreground the SRAW is fired and destroys the t a nk .

Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Operational Environments

There are many different types of tests that can and should be performed on a sy stem . When examining how complete the contractor's test program is, consider the complete range of environmental conditions that the sy stem w ill be exposed to in operational use, then make sure that the sy stem responds to the full range of required operational environments during the dev elopment process . The environment that a sy stem w ill be exposed to can generally be broken out into natural environmental effects w hich are due to "mother nature", and induced environmental effects w hich are due to the specifics of operational use . Below are examples of different natural and induced environments that the contractor may subject the sy stem to, if required .

Natur a l Environ me nts I n duced Environ m ent s • Temperature

• Thermal Shock • Moisture/ Humidity

• Temperature/ Pressure • Rain, Snow, Sleet, Hail, Ice • Acceleration

• Dust, Sand, Grav el • Vibration

• Salt Sea Spray • Shock, Explosiv e Vapor

• Solar Radiation and • AcousticsDarkness • Corrosiv e Elements

• Lightning • Electromagnetic

• Insects, Birds, and Small Interference

Animals

These types of criteria are in great detail in military standards like MIL- STD- BlOG DOD Test Method Standard ; Environmental Engineering Considerations and Laboratory Tests . A link to this military standard is prov ided v ia the "Resources" button .

....rl I Pag e 15 of 40 ~ Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Joint Operational Environments: SRAW Example

Th e JCIDS guidance under which the SRAW has been developed specifically provides for j oint desig nations indica ting which programs must test against Joint Opera tional Concepts in joint warfighting environments.

The SRAW is a Marine Corps system, which, as a minimum, ough t to also be considering operations in conjunction with Navy organiza tions.

However, further analysis done as part of tes t planning indicates the SRAW c apabilities do not significantly a ffec t joint force opera tions. Therefore testing will be limi t ed t o just Marine Corps relevan t environments, not a join t one . Because of this, the SRAW PM would not have t o consider Army or Air Force operational environments as pot ential test conditions.

More information about joint operational testing is available via Resources.

...... I P• ge16of40 ..... Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Typical Test Sequence

What is tested and measured is also a function of w here the sy stem is in the acquisition life c y c le . It w ould be difficult to do realistic operational tests using prototype lab materials, just as it w ould be unrealistic to do much technical performance or producibility testing after the sy stem is already in production .

There is no real div iding line betw een the end of DT&E and the beginning of OT&E . Think of it as a continuous series of tests w here the type of test and emphasis shifts from technical to operational as the sv stem oroaresses throuah the acauisition life c v c le .

Ca pability Devotopment Full-R;rte Initial Ful Devotopmlf"ll Requestfor Production Operotion•I Oper•UOnal

Docl.lnenl(COD) Propos•ls (RFP) ( FRP) Cop• blllty C•P• bllly Validation Relwse Decision

Mo1811el Development o~-\r

Decision \ I T' & «>& Low-Ra1e Jnitial

Productton (LRJP)

\ \

' O T&E \ suminm.nt Dlopoo.1 Materiel Solution Analysts

Technotogy Mlturation &

Risk Reduction

Engineering & Milnufacturing Devetopment

Production & Deplafm•nt

Operations & Support

Developmental Test and Evaluation (OT&E)

Operational Test and Evaluation (OT&E)

....rl I Pag e 17 of 40 ~ Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Typical Test Sequence

What is tested and measured is also a function of where the sy stem is in the acquisition life c y cle . I t w ould be difficult to do realistic operational tests using prototype lab materials, just as it w ould be unrealistic to do much technical performance or producibility testing after the sy stem is already in production .

There is no real dividi, Lo ng De s criptio n 1k of it as a continuous series of1 o operational as the sv stem oroaresses th The graphic depicts the fiv e phases of the acquisition life

c y cle, as shown by fiv e boxes in a horizontal row: Capabi

Devoto_!'! ooc1.1nem • Materiel Solution Analy sis

Valida! • Technology Maturation and Risk Reduction Ma181111 \ • Engineering and Manufacturing Dev elopment

Development • Production and Deployment Decision

• Operations and Support

Beneath the fiv e boxes is a rounded rectangle divided in half diagonally . The top - left section is labeled, "Dev elopment Test & Ev aluation ( DT&E )", and the bottom - right section is labeled, "Operational Test & Ev aluation ( OT&E )". 1tnt Dlopoo.1

Matenet TechnolOgy Eng ineenng & Production & Operations & Support So lution Mlturation & Milnufacturing Deplafm•nt Anotysis Risk Devel0Jl111enl

Reduction

Developmental Test and Evaluation (DT&E)

Operational Test and Evaluation (OT&E)

....rl I Pag e 17 of 40 ~ Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Planning Considerations

There are a v ariety of considerations that planners need to take into account that impact the ov erall test planning effort. Some of these are long- lead items that must be planned for w ell in adv ance . Additionally, some of the best adv ice for good planning is to seek adv ice from others doing similar efforts and engage specialists ( e .g ., security, human sy stem integration, softw are reliability, etc . ) early in the planning process .

Select each graphic t o learn m ore.

Computer ResoulC<t Se<tk Resourcu Avallablllty Advice

....rl I Page 18 of 40 ..... Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Planning Considerations

There are a v ariety of considerations that planners need to take into account that impact the ov erall test planning effort. Some of these are long-lead items that must be planned for w ell in adv ance . Additionally, some of the best advice for good planning is to seek advice from others doing similar efforts and engage specialists ( e .g ., security, human sy stem integration, softw are reliability, etc . ) early in the planning process .

Select each graphic t o learn m ore.

Computer ResoulC<t Se<tk Resourcu Avallablllty Advice

Com p uter Resou rces

Computer Resources Computing capacity may be required for early modeling and simulations . Identify any high-speed computing assets required and compatibility requirements for range data collection, reduction and analy sis .

Additionally, the av ailability and planned use of any agency -specific test tools and their computer resource impacts should be considered to include license fees and any need for analy st training on them .

....rl I Page 18 of 40 ~ Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Pl anning Consi derations

There are a v ariety of considerations that planners need to take into account that impact the ov erall test planning effort. Some of these are long-lead items that must be planned for w ell in adv ance . Additionally, some of the best advice for good planning is to seek advice from others doing similar efforts and engage specialists ( e .g ., security, human sy stem integration, softw are reliability, etc . ) early in the planning process .

Select each graphic t o learn m ore.

Resou rce Availab ility

Program offices dev eloping resource estimates may contact MRTFB range operations offices for customer/ user guides, submit memorandum describing test objectiv es with a request for an estimate, or employ the Range Commander's Council Univ ersal Documentation Sy stem ( UDS ) to request dev elopment of test support resource estimates . Resource estimates for range time, personnel, and cost are dependent on, among other things, the :

• type of test data required ( onboard/ off board instrumentation, data collection, real time telemetry) • test environments in the test design • duration of test/sample size • data reduction/ processing needs

Estimates for planned testing ( from the TEMP ) can then be integrated by fiscal y ear to forecast budget requirements and matrixes in Part IV for monitoring and updating .

....rl I Page 18 of 40 ~ Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Pl anning Consi derations

Select each graphic t o learn m ore.

Computer ResoulC<t Se<tk Resourcu Avallablllty Advice

Seek Ad vice

Call a person w ho has been through a test program to ask adv ice . Ranges hav e ex tensiv e historical data on prev ious testing and expert adv ice av ailable to assist in test planning . Include relev ant range representativ es in the T&E WIPT planning process .

....rl I Page 18 of 40 ~ Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Plan for Contingencies

There are times when things may not go well in a test program. This is not unusual and should be addressed in your plans. Consider the following elements of a test program:

• Test Resoyrces

• Test Items

• Tes t processes

One way t o ensure that all contingencies are addressed and have the proper degree o f visibili ty to management is via a carefully planned and integrated test and evaluation schedule . Such a schedule should include contractor, government, and Modeling and Simulation activities . It should be developed by the T&E WIPT and should allow for adequate time for the appropriate amount of analysis, reporting, and regression testing. It is important that such a schedule be linked to key events in the overall program acquisition schedule as well as Systems Engineering Plan activities.

Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Plan for Contingencies

There are times when things may not go well in a test program. Thi s i s not unusual and should be addressed in your plans. Consider the following elements of a test program:

• Test Resoyrces

• Test Items

• Tes Test Resources

• Consider av ailability of instrumentation/ dataOne way t o ensure reduction/ analysis procedures have the proper de

• Estimate time necessary for data analysis carefully planned a • Consider av ailabili ty of test ranges, facilities, or otherSuch a schedule sh

resources such as the frequency spectrum needed for Modeling and Simul operating the system and executing the test the T&E WIPT and

appropriate amount , , testing. It i s important that such a schedule be linked to key events in the overall program acquisition schedule as well as Systems Engineering Plan activities.

Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Plan for Contingencies

Th ere are times when things may not g o well in a test program. Thi s i s not unusual a nd should be addressed in your plans. Consider the following elemen ts of a test program:

• Test Resoyrces

• Test Items

• Tes Test Ite ms

One way t o ensure Factor in time and/or resources for : have the proper de • Test item repairs carefully planned a • Re-testing activ ities Such a sc hedule sh

• Minor program changesModeling and Simu1...,__________________ _

the T&E WIPT and should allow for adequate time for the appropriate amount of analysis, reporting, and regression testing. It i s important that s uch a sch edule be linked to k ey ev ents in the overall program acquisition schedule as well as Systems Engineering Plan a ctivities.

Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Plan for Contingencies

Th ere are times when things may not go well in a test program. This is not unusual and should be addressed in your plans. Consider the following elements of a test program:

• Test Resoyrces

• Test Items

• Tes t processes

One way t o ensure Te st Pro c esses have the proper de carefully planned a • Ev aluate the impact of non· effec tive test events Such a schedule sh • Consider the need for additional testing

Modeling and Simu l.hl""":l'l~mli!!'!r."T!""!:l'~l!'l!''!!'!!""ll'lrtl'l!l"l~"''V"'-- the T&E WIPT and should allow for adequate time for the appropriate amount of analysis, reporting, and regression testing. It is important that such a sch edule be linked to k ey events in the overall program acquisition schedule as well as Systems Engineering Plan activities.

Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Planning Summary

When planning for testing, it is important to remember to :

• Define data requirements for each issue/ objective/ MOP/ MOE/MOS;

• De fine accuracy requiremen ts for data;

• Formulate early the test planning teams ( T&E WIPT) ;

• Design test ev ents to get required data ;

• Use modeling and simulation t o predict and re fine t es t points;

• Valida t e and prioritize test ev ents ;

• I dentify resource requirements ;

• Fac t or in constraints for time, resources, etc.;

• Develop a contingency plan;

• Use the available resources (d on' t r einv ent the wheel) .

...... I P• ge 20of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Program Participants

Managing a test program requires as much attention to detail as the documents you prep are. First of all, it is important to know who is involved in the test program. Test program participants, in essence, become the program's Test and Ev aluation WIPT.

The purpose of the WIPT is to :

• Develop and maintain the TEMP ;

• Act as a forum for T&E issues ;

• Plan and coordinate tests.

...... I P• ge21of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Program Parti cipants

Managing a test program requires as much attention to detail as the documents you prepare. First of all, it is important to know who is involved in the test program. Test program participants, in essence, become the program's Test and Ev aluation WIPT.

The purpose of the WIPT is to :

• Develop and main tain the TEMP ;

• Act as a forum for Lo ng Description

• Plan and coordina t

...... I P• ge21of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Role Definitions

The number of organizations and p ersonnel involved in any given test progra m c an be qui te large. Therefore, i t i s imperative that groups involved wi th the effort be managed appropriately and broken down int o smaller sub- groups with specific tasks to work out the details of the testing effort.

Some of the key groups and organizations involved can include:

• Program Office

• Developjng Contractor

• Test Organjza tjonCs l

• Opera t jonal Tes t Agency COT A)

• User Organjzatjons

• Participatina Agencies

• Training Command

• Other Contractors

..... I P•ge22 o f 40 ..... Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Rol e Definit i ons

The number of organizations and personnel inv olv ed in any giv en test program can be quite large . Therefore, it is imperativ e that groups inv olv ed with the effort be managed appropriately and broken dow n into smaller sub-groups with specific tasks to w ork out the details of the testing effort.

Some of the key groups and organizations inv olv ed can include :

• Program Office Prog ra m Office

• Developing Contrac t or The Program Office prov ides top-lev el

• Test Organization( s l management guidance for the entire program,

• Operational Test Agency COTA) and they coordinate the ov erall T&E !PT effort.

• User Organizations

• Participating Agencies

• Training Command

• Other Contrac t ors

....rl I Page 22 of 40 ~ Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Rol e Definit i ons

The number of organizations and personnel inv olv ed in any giv en test program can be quite large . Therefore, it is imperativ e that groups inv olv ed with the effort be managed appropriately and broken dow n into smaller sub-groups with specific tasks to w ork out the details of the testing effort.

Some of the key groups and organizations inv olv ed can inc lude :

• Program Office Developing Cont ractor

• Developing Contrac t or The Dev eloping Contractor conducts much ( and

• Test Organization( s l occasionally all ) of the DT&E effort and is

• Operational Test Agency COTA) accountable for deliv ering a sy stem that satisfies the contract requirements .

• User Organizations

• Participating Agencies

• Training Command

• Other Contrac t ors

....rl I Pag e 22 of 40 ~ Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Rol e Definit i ons

The number of organizations and personnel inv olv ed in any giv en test program can be quite large . Therefore, it is imperativ e that groups inv olv ed with the effort be managed appropriately and broken dow n into smaller sub- groups with specific tasks to w ork out the details of the testing effort.

Some of the key groups and organizations inv olv ed can inc lude :

• Program Office Test Organizatio n ( s )

• Developing Contrac t or The Test Organization( s ) prov ides top - lev el

• Test Organization( s l management guidance for the entire test effort

• Operational Test Agency COTA) on gov ernment ranges and facilities and executes that portion of the test program .

• User Organizations

• Participating Agencies

• Training Command

• Other Contrac t ors

....rl I Pag e 22 of 40 ~ Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Rol e Definit i ons

The number of organizations and personnel inv olv ed in any giv en test program can be quite large . Therefore, it is imperativ e that groups inv olv ed with the effort be managed appropriately and broken dow n into smaller sub-groups with specific tasks to w ork out the details of the testing effort.

Some of the key groups and organizations inv olv ed can include :

• Program Office Operat ional Test Agency (OTA)

• Developing Contrac t or The Operational Test Agency ( OTA) prov ides

• Test Organization( s l independent T&E to assess the effectiv eness and

• Operational Test Agency COTA) suitability of the sy stem .

• User Organizations

• Participating Agencies

• Training Command

• Other Contrac t ors

....rl I Page 22 of 40 ~ Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Rol e Definit i ons

The number of organizations and personnel inv olv ed in any giv en test program can be quite large . Therefore, it is imperativ e that groups inv olv ed with the effort be managed appropriately and broken dow n into smaller sub-groups with specific tasks to w ork out the details of the testing effort.

Some of the key groups and organizations inv olv ed can include :

• Program Office User Organizat ions

• Developing Contrac t or Within the services, a v ariety of User

• Test Organization( s l Organizations represent the end-user. These

• Operational Test Agency COTA) organizations prov ide typical user personnel and guidance to the T&E community as to how the

• User Organizations sy stem w ill be used in the "real w orld". Ideally this group should inv olv e the actual operators • Participating Agencies and maintainers of the new sy stem . If so, they

• Training Command can assist the initial T&E effort and later become part of the initial operational force .

• Other Contrac t ors

....rl I Page 22 of 40 ~ Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Rol e Definit i ons

The number of organizations and personnel inv olv ed in any giv en test program can be quite large . Therefore, it is imperativ e that groups inv olv ed with the effort be managed appropriately and broken dow n into smaller sub-groups with specific tasks to w ork out the details of the testing effort.

Some of the key groups and organizations inv olv ed can include :

• Program Office Participat ing Agencies

• Developing Contrac t or The Participating Agencies prov ide unique

• Test Organization( s l assistance related to their particular area of

• Operational Test Agency COTA) expertise . For example, the agency operating the w ind tunnel, climatic lab, or bombing range,

• User Organizations w ould assist with the planning and execution of tests in their respectiv e facilities . • Participating Agencies

• Training Command

• Other Contrac t ors

....rl I Page 22 of 40 ~ Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Rol e Definit i ons

The number of organizations and personnel inv olv ed in any giv en test program can be quite large . Therefore, it is imperativ e that groups inv olv ed with the effort be managed appropriately and broken dow n into smaller sub-groups with specific tasks to w ork out the details of the testing effort.

Some of the key groups and organizations inv olv ed can include :

• Program Office Training Com m and

• Developing Contrac t or The Training Command prov ides the expertise in

• Test Organization( s l ev aluating the training sy stem ( training aids and

• Operational Test Agency COTA) material ) for the sy stem under dev elopment.

• User Organizations

• Participating Agencies

• Training Command

• Other Contrac t ors

....rl I Pag e 22 of 40 ~ Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Rol e Definit i ons

The number of organizations and personnel inv olv ed in any giv en test program can be quite large . Therefore, it is imperativ e that groups inv olv ed with the effort be managed appropriately and broken dow n into smaller sub- groups with specific tasks to w ork out the details of the testing effort.

Some of the key groups and organizations inv olv ed can inc lude :

• Program Office Other Contracto rs

• Developing Contrac t or The Other Contractors prov ide unique assistance

• Test Organization( s l related to their area of expertise . This might be

• Operational Test Agency COTA) an independent rev iew er for critical softw are or a major subcontractor ( or critical subsy stem

• User Organizations contractor) for the sy stem under dev elopment.

• Participating Agencies

• Training Command

• Other Contrac t ors

....rl I Pag e 22 of 40 ~ Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Building a Test Team

With so many organizations involved in a test program it is only natural to conclude that the best way to accomplish the test program is by teaming with other players. - The team needs to be assembled be fore testing begins, and preferably comprised o f members who have previously worked toge ther prior to the start of the test and who are dedic ated t o the end t ask.

Onc e the t eam is assembled, e ffec tiv eness and effic iency o f the test program need to be the primary goal. If there are competing tasks that have the potential to drain time or resources ( inc luding people) away from the test, they need t o be dealt with before they become a problem.

..... I P• ge23of40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Building a Test Team

With so many organizations involved in a test program it is only natural to conclude that the best w ay to accomplish the test progra m is by teaming with other players. - The t eam needs to be assembled before testing begins, and preferably comprised o f members who hav e previously worked together prior to the start of the test and who are dedicated t o the end task .

Once the t eam is asse1rr-~~~~~~~~~~~~~~~~~~~~~~~~~~.,

efficiency o f the tes t p Lo ng Descriptio n primary goal. I f there a the potential to drain t The animation show s components of the SRAW coming together. people) away from the ......11.., u n:: y ........................... ............ ... with before they become a problem.

..... I P• ge23 of 40 ..... Back Next

----

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Program Management Guidelines

There are many questions that need to be answered when managing a test program. The following should be examined when managing a test program:

• Clearly defined management roles

• Program OfficeCTest Organization/Contractor roles

• Configuratjon control system and authority

• Test/deficjency reporting

• Mov ing to the next phase

• Dedicated test c rews

...... I P• ge24 of40 ..... Back Next

----

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Program Management Guidelines

There are many questions that need to be answered when managing a test program. The following should be examined when managing a test program:

• Clearly defined management roles

• Program OfficeCTest Organization/Contractor roles

• Configuratjon control system and authority

• Test/deficjency reporting

• Moving to the next phase

• Dedicated test c rews

Clearly d efined manage m e n t r o les

With all of the different organizations involved in a test effort, you need to clearly define the roles each will play. Who is in charge? When?

...... I P• ge24of40 ..... Back Next

----

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Program Management Guidelines

There are many questions that need to be answered when managing a test program. The following should be examined when managing a test program:

• Clearly defined management roles

• Program OfficeCTest Organization/Contractor roles

• Configuratjon control system and authority

• Test/deficjency reporting

• Moving to the next phase

• Dedicated test c rews

Program Office/ Test Organizatio n /Contractor roles

A common area for misunderstandings is the separation of responsibilities between the program office, test organization, and the developing contractor. Each needs to understand the limits of their authority when directing the execution of the test program.

...... I P• ge24 of40 ..... Back Next

----

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Program Management Guidelines

There are many questions that need to be answered when managing a test program. The following should be examined when managing a test program:

• Clearly defined management roles

• Program OfficeCTest Organization/Contractor roles

• Configuratjon control system and authority

• Test/deficjency reporting

• Moving to the next phase

• Dedicated test c rews

Configur ation control system and authority

Decide who will control the configuration of the test article and who has the authority to change the configuration. How will the recommended changes be implemented?

...... I P• ge24 of40 ..... Back Next

----

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Program Management Guidelines

There are many questions that need to be answered when managing a test program. The following should be examined when managing a test program:

• Clearly defined management roles

• Program OfficeCTest Organization/Contractor roles

• Configuratjon control system and authority

• Test/deficjency reporting

• Moving to the next phase

• Dedicated test c rews

Test/ d eficien cy reporting

Decide who will report deficiencies, when they will be reported, and precisely how they will be completed.

...... I P• ge24 of40 ..... Back Next

----

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Program Management Guidelines

There are many questions that need to be answered when managing a test program. The following should be examined when managing a test program:

• Clearly defined management roles

• Program OfficeCTest Organization/Contractor roles

• Configuratjon control system and authority

• Test/deficjency reporting

• Mov ing to the next phase

• Dedicated test c rews

Movin g to t h e n ext phase

Decide who approves movement from one phase of the test program t o the next. What information is needed for this decision to be made?

...... I P• ge24 of40 ..... Back Next

----

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Program Management Guidelines

There are many questions that need to be answered when managing a test program. The following should be examined when managing a test program:

• Clearly defined management roles

• Program OfficeCTest Organization/Contractor roles

• Configuratjon control system and authority

• Test/deficjency reporting

• Moving to the next phase

• Dedicated test c rews

Ded icated test crews

Find out if there is a reason to have dedicated test crews, or if anyone qualified can operate the test vehicle. Some tests may require all operational personnel to operate and maintain the system, where other tests may require a skilled test crew for a developmental test, and ye t other tests could be accomplished with a mix of c rew s. Dec ide this up front.

...... I P• ge24of40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Validity and Safety Reviews

A necessary part of any test planning effort is the review of the test for:

• Technical valjdjtv

• System Safety

These reviews are usually conduc ted by experienced personnel from the t es t agencies, who are not part of the test t eam. The process of conducting a review is called a Review Board . These reviews serve as a v aluable "second set of eyes" to try and prevent unnecessary risk and ev aluate the thoroughness of the t est planning effort.

..... I P• ge 2Sof 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Validity and Safety Reviews

A necessary part of any test planning effort is the review of the test for:

• Technical valjdjtv

• System Safety

Technical Validity

The Technical Review Board assesses technical aspects of:

• planned tests • test articles • test resources

..... I P• ge 2Sof 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Validity and Safety Reviews

A necessary part of any test planning effort is the review of the test for:

• Technical valjdjtv

• System Safety

These reviews are usually conduc ted by experienced personnel from the test agencies, who are not part of the test team. The process o f conducting a review is called a Review Board . These reviews serve as a valuable "second set of eyes" to try and prevent unnecessary risk and ev aluate the thoroughness of the test planning effort.

System Safety

The Safety Review Board assesses test-unique safety hazards and plans to mitigate the safety risks.

...... I P• ge2Sof40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 Test and Evaluation Planning RESOURCES I PR I NT I HELP

Knowledge Review

Match the following terms to the blanks in statements .

Te r m Sta tem e n t

A. Statement of Capability { SOC) 1. The _ _ often conducts much of the T&E effort. 8. DT&E 2. The purpose o f the _ _ is to develop and maintain C. Developing Contractor the _ ___ D. Test !PT 3 . __ organizations have combined many of their E. Program Introduc tion Document { PID ) func tions in order t o provide an in tegrated tes t F . TEMP organiza tion .

The correct order of terms is B, C, F, and E.

The correct order of terms is C, E, F, and D.

'.!/J The correct order of terms is C, D, F, and 8.

Check Answer

The correct o rder o f terms is c , D, F, a nd B .

..... I P• ge26of40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Knowledge Review

Match the sub-group of members of the IPT to their appropriate role.

Sub-g roup Role

1. Program Office A. Provides the T&E with guidance as to how the 2 . Developing Contractor, Test Organization(s), system will be used in the "real world."

Operational Tes t Agency 8. Roles may differ, but provides unique 3. User assistance related to their area of expertise. 4 . Participating Agencies, Other Contractors C. The c hair of the T&E !PT. 5 . Training Command D. Provides direc t management of the execution

o f the test program . E. Provides expertise in ev aluation of the training

1-C, 2-A, 3- D, 4- E, and 5- 8 sys t em.

1-C, 2-D, 3-8, 4- E, and 5- A

1-C, 2-D, 3-A, 4 -E and 5- 8

J.~ 1-C, 2-0, 3-A, 4 - B, a nd 5-E

Check Answer

1 - c, 2- 0, 3 - A, 4 - B, and 5- E is the correct sub-group o f member o f the IPT.

...... I P• ge27 of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

The Role of Metri cs

To effectively manage/ control the testing effort, you must always have answers for the following questions:

• How much has been done?

• How much remains t o be completed?

• How impor tan t, difficult, or time consuming are the remaining tes t events? . )

The use of me trics and measures can help to answer these types of ques tions. A metric is a quantification of a measured a t tribu te, in this case, some aspect of testing .

Metrics are tools that, used properly, can systematically indicate test program progress, identify potential test issues ? earty enough so they can be resolved in a timely manner, IJ a nd communicate status of the test effort to management. Choosing an appropriate set of me trics t o support the test program and ensuring the d ata needed t o g enerate them will be av ailable is a key part of test planning .

..... I P• ge 28of 40 ..... Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Exampl es of Metrics

Though there is no steadfast rule w hich dictates the type of metrics to use for a test program, there are sev eral ones in common use from w hich to choose . These types of metrics should be assessed and the appropriate ones chosen as part of the T&E planning process . These metrics may change ov er time, as the test program progresses . Also, test programs hav ing different objectiv es ( e .g ., DT&E v s. OT&E v s. LFT&E, etc . ) may require different measures of progress .

Just make sure that the metrics chosen are truly representativ e indicators of test program progress . Also it is important that the metrics hav e been agreed- to as v alid by both management and key test organizations before they are used .

Some examples of these types of metrics include :

• Earned v alue approac h

• Weighted ev ents t o tal

• Ev ent percentage comple tion pro file

• Days ahead/ behind timeline o f ev ents

....rl I ~Page 29 of 40 Bac k Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Examples of Metrics

Though there is no steadfast rule w hich dictates the type of metrics to use for a test program, there are sev eral ones in common use from w hich to choose . These types of metrics should be assessed and the appropriate ones chosen as part of the T&E planning process . These metrics may change ov er time, as the test program progresses . Also, test programs hav ing different objectiv es ( e .g ., DT&E v s . OT&E v s . LFT&E, etc . ) may require different measures of progress .

Just make sure that the metrics chosen are truly representativ e indicators of test program progress . Also it is important that the metrics hav e been agreed-to as v alid by both management and key test organizations before they are used .

Some examples of these types of metrics include :

• Earned v alue approac h

• Weighted ev ents t o tal

• Ev ent percentage comple tion pro file

• Days ahead/ behind timeline o f ev ents

Earned val ue approac h

Assign a v alue to each test ev ent based upon its "v alue" to the test program . You gain more credit for an important test ev ent v ersus a relativ ely unimportant ev ent.

....rl I ~Page 29 of 40 Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Exampl es of Metrics

Though there is no steadfast rule w hich dictates the type of metrics to use for a test program, there are sev eral ones in common use from w hich to choose . These types of metrics should be assessed and the appropriate ones chosen as part of the T&E planning process . These metrics may change ov er time, as the test program progresses . Also, test programs hav ing different objectiv es ( e .g ., DT&E v s . OT&E v s . LFT&E, etc . ) may require different measures of progress .

Just make sure that the metrics chosen are truly representativ e indicators of test program progress . Also it is important that the metrics hav e been agreed-to as v alid by both management and key test organizations before they are used .

Some examples of these types of metrics include :

• Earned v alue approac h Weight e d event s t o t al

• Weighted ev ents t o tal Number of ev ents completed times hours/value of

• Ev ent percentage comple tion pro file ev ent. More simplistic than the earned v alue approach .

• Days ahead/ behind timeline o f ev ents

....rl I ~Page 29 of 40 Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Examples of Metrics

Though there is no steadfast rule w hich dictates the type of metrics to use for a test program, there are sev eral ones in common use from w hich to choose . These types of metrics should be assessed and the appropriate ones chosen as part of the T&E planning process . These metrics may change ov er time, as the test program progresses . Also, test programs hav ing different objectiv es ( e .g ., DT&E v s . OT&E v s . LFT&E, etc . ) may require different measures of progress .

Just make sure that the metrics chosen are truly representativ e indicators of test program progress . Also it is important that the metrics hav e been agreed-to as v alid by both management and key test organizations before they are used .

Some examples of these types of metrics include :

• Earned v alue approac h

• Weighted ev ents t o tal

• Ev ent percentage comple tion pro file

• Days ahead/ behind timeline o f ev ents

Event percent age com plet ion profile

Percentage of T&E ev ents actually completed by date "X" compared against the planned profile of T&E ev ents that w ere expected to be completed by date "X."

....rl I ~Page 29 of 40 Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Examples of Metrics

Just make sure that the metrics chosen are truly representativ e indicators of test program progress . Also it is important that the metrics hav e been agreed-to as v alid by both management and key test organizations before they are used .

Some examples of these types of metrics include :

• Earned v alue approac h Days ahead /behind t i m eline of event s

• Weighted ev ents t o tal Day s ahead or behind the planned timeline .

• Ev ent percentage comple tion pro file

• Days ahead/ behind timeline o f ev ents

....rl I ~Page 29 of 40 Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Planning Quiz- 0 - Matic: Planning, for 1 00 Points

What type of testing tries to determine the overall operational effectiveness and sui tability of the system?

~ Operational Test

LJ Technical Tes t

JI ST3

Sample- based Self- Test

Check An swer

An O perational Test attempts t o determine the operational e ffec tiveness and suitability of a system to i ts intended environment.

..... I P• ge30 of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Planning Quiz- 0 - Matic: Planning, for 300 points

What type of testing measures the capabilities and limitations of a system under test?

Operational Test

~ Technical Test

JIST3

Check An swer

A Te chnical Test measures the c apabilities and limitations of a system .

..... I P• gellof40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Planning Quiz- 0 - Matic: Planning, for 500 points

What is an excellent planning resource to use when you need advice about test planning?

Operational Test

LJ Technical Tes t

~ T &.E WIPT

Check Answer

The TlllE WIPT is key t o the overall planning process.

...... I P• ge32of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Planning Qui z- 0 - Matic: Management, for 1 00 points

What type of plan incorporates the methods intended for use in reducing or analyzing the data obtained from a test?

~ Evaluation Plan

lJ TEMP

Systems Engineering Plan

Check Answer

An Evaluati o n Pla n provides the methods intended for use to reduce and analy ze the data obtained from a test.

..... I P• ge l3of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Planning Quiz- 0 - Matic: Management, for 300 points

Who chairs the T&E WlPT?

Development Contractor

~ Program Office

The user

Check Answer

The Program Office chairs the T&E WIPT.

...... I P• ge34 of40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Planning Quiz- 0 - Matic: Management, for 500 points

What is the combination of development and operational testing called?

Technical Testing

lJ Live Fire Testing

~ OT/OT

Check An swer

OT/OT is the combination of DT&E ( developmental) and OT&E (operational) testing functions.

...... I P• gel5 of40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Planning Qui z- 0 - Matic: Miscellaneous, for 100 Points

What metric uses the number of events completed times hours/ value of event?

~ Weighted Events Total

LJ Day Ahead Pro filed

Even ts Comple ted Profile

Check Answer

The weighted events total is a metric used to track number o f ev ents completed times hours divided by value of event.

..... I P• ge36of40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Planning Quiz- 0 - Matic: Miscellaneous, for 3 00 Points

Which one of these typically would be the basis for actual low level component testing activities ?

The TEMP

~ Detailed Tes t Plans

Systems Engineering Plan

Check Answer

Detail ed Te s t Pla ns are the de t ailed documents used to conduc t a t est.

..... I P• ge37 of 40 ..... Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PR I NT I HELP

Test Planning Quiz- 0 - Matic: Miscellaneous, for 5 00 Points

One of the key functions of the T&E WIPT is to?

Write the Systems Engineering Plan

lJ Perform Technical Testing

~ Help Prepare the TEMP

Check Answer

The T&E WIPT Hel ps Pr epare t h e TEMP, among its other many func tions.

..... I P• ge33of 40 ..... Back Next

TST102 Fundamentals of Test Evaluation

Lesson 17 - Test and Evaluation Planning RESOURCES I PRIMT I HELP

Lesson Summary

I n this lesson y ou hav e learned quite a bit of information about test plans . That there are many principles to remember w hen managing a test effort, but the most important is : Effectiv e planning is critical to the success of any test program . Plan y our w ork and w ork y our plan ! I n this lesson w e hav e specifically cov ered :

• The key elements of a Test Plan ;

• How capabilities are translated into test criteria ;

• Descriptions of typical test planning metrics ;

• Guidelines for test management;

• How threshold and objectiv e v alues are used ;

• Key T&E WI PT members and their roles .

The SRAW Test Plan exercise w ill enable y ou to practice y our skills by dev eloping a notional outline of a test plan for a SRAW CTP .

SRAW Ho mework Assignment: The first o f the t wo h o mework assignments for this course will be in the next lesso n . In it, you will be able t o demo nstrate your test pla nning skills b y dev elo ping a n a bbrev iated test pla n for a compo nent o f the SRAW . Yo u must e- mail this assignment t o your instructor for grading .

....rl I ~Page 39 of 40 Back Next

TST10 2 Fundam entals of Test Evaluation

Lesson 17 - Test an d Evalua tion Planning RESOURCES I PR I NT I HELP

Lesson Completion

You have completed the con tent for this lesson .

Please take the Lesson Exam before continuing to the nex t lesson .

I f you hav e closed or hidden the Table of Contents, click the Show T OC button at the t op in t he Atlas navigation bar.

..... I P• ge 40 of 40 ..... Back Next