Fundamentals of Test Evaluation
nancyj
TST102 Fundamentals of Test Evaluation
Lesson 19 - Assignment RIESOURCES I PRINT I IUlP
Homewolik Assignment 2: SRAW Test Data Analysis
IOT&E for the SRAW test program began four weeks ag·o in January and will be conducted in t hree phases . During· the fi rst phase ( 20 firing:s), there w ere reports of sy stem performance problems. Afte, 10 firings, the SRAW w as placed in "' l)EflCIErNCY STATIUS"' and alll testing w as suspended .
For y our t w o part homework assi.gnment , y ou w ill ana ly ze the same SIR.AW IOT&E tes t data from phase I from t wo dif ferent perspectiv es :
• Pe,rspective #1: You are the Operationa l Test Director fo r the SRAW test program . The head of the Operational T est Agency (OTA) has ins tructed y ou to anal yze t he data and prepare a brief for t he test team.,
• Per.spective #2.: You are the Progr am Manager for the SRAW test program . Your task is to rev iew the data and analy ze the situation ..,
I ::::::;:=P=age:::::::1=0=f=5===: ........ :;: Back Next
TST102 Fundamentals of Test Evaluation
Lesson 19 - Assignment
Homewolik Assignment 2: SRAW Test Data Analysis
IOT &E for t he SRAW tes t program began four weeks ag·o in January and will be conducted in three phases . During· the first phase ( 20 fi ring:s) , there w ere reports of sy stem performance prob lems. Af te, 10 fi rings, the SRAW w as placed in "' l)EflCIErNCY STATIUS"' and alll tes t ing w as suspended .
Deficiency status
Wlne ri, MCOT EA issues a message pllacing1 the sy stem in de fi ciency stali:us , the IOT &E is stopped, the sy stem is de-certified fo r IOT &E and a ful l re-certi.flca tfon of Readiness for JOT&E process must be accomplished. Program delay s may adiverse~ affect 1the production schedu l1e, contracting, procurement fund ing,, and the Ful ll Rate Production IDedsion Review schedul'e .. If equ ipment repa irs cause a del'ay in re- starting1IOT&E, there are s ignificant nega t iv e cost and sched'ul:e effects w hen all participants and equipment leav e the IOT&E tes t s ite .
:che same SRAW IOT &E
: t or for the SRAW t est OTA) has instructed tes t team.,
he SRAW test e t he situation..,
RIESOURCES I PRINT I IUlP
..... :;:I ::::::;:=P=age:::::::1=0=f=5===: ... Ba ck Next
TST102 Fundamentals of Test Evaluation
Lesson 19 - Assignment RIESOURCES I PRINT I IUlP
SR.AW Test Data Summary
Shot #
Time/Date (Jan)
TGT Range (1)
TGT Course (2)
TGT Spe,e d
(KM/HR)
Missile Launch?
Missile Arm?'
Hit Remarks
1 1000/ 04 453 090 0 YES YES YES 2 1100/ 06 213 270 25 YES YES YES 3 1300/ 07 637 210 10 YES N'O YES 4 2300/ 10 321 06:S 14 N'O NO NO HangFire :s 1500/ 15 587 2.25 8 YES YES YES High Winds 6 0300/ 16 I4 170 25 YES NO YES 7 2300/ 18 612 193 0 YES YES NO 8 1230/ 22 17 100 30 YES YES YES 9 0400/ 27 325 045 5 N'O N'O NO Sol'dier Inj . (3) 10 0330/ 29 292 280 10 YES YES YES
( 1) Dis tance in meters from the gunner t:o the target at time of miss ile launch . (2) A targ:et course of 090 means the t arg.et is mov ing· l.eft to right w ith a target compass heading o.f 90 degree s giv ing1the gunner a ful l broadside v iew. (3) Shot 9 is under investigation. Marine sev erely burned when fi ring1trigger pulled.. Witness all'eged that Marine kicked the milss ile sight w ith his right foot prior to picking missi l'e up .
..... ! Page2of5 ... Ba ck Next
TST102 Fundamentals of Test Evaluation
Lesson 19 - Assignment RIESOURCES I PRINT I IUlP
SR.AW CapabiHty Production Document KPPs, KSAs, and AddiUonal Attributes
Key P enormance Parameters Production Th.eshold Production Objective
IMinimmn range 17 M et,ers 17 M eters [Maxi!i:nnm range > 700 Meters > 800 Meters !Probability ofhit (stauomrry trurget)
.5 (600 meters) .8 (600 M eters)
[Ptobabilitv ofhit J
( crossing target) .5 (20 0 Meters)
.45 (2 50 Meters) .6 (200 _ lleters)
.55 (250 Meters)
Operauomi] Availability .95 .95
I\VarheadDefeat capability T-80 MBT w/ explosive ma.ewe ,alflliOr
T-80 !MBT w/ explosive reactive ,MmOr
Key System Attnbutes Production Threshold Production Objective
I eliability 0.95 0.95
Additional Att:nbutes
r\Veight
Length
Gunner' s exposmetiime tome
Production Threshold
9.1 Kg
1.01 M
10 seconds
Production Objective
6.8Kg
.9 lM
5 seconds
!Transition time: CM£Y tome 20 seconds 15 seconds
..... ! Page3of5 ... Ba c k Next
TST102 Fundamentals of Test Evaluation
Lesson 19 - Assignment RIESOURCES I PRINT I IUlP
Assignment for Operati:onal Test Director
You are the Operational Te.st Director ( OTD). From that perspectiv e, briefly ( t w o or three sentences for each question) answ er t he fol low ing t hree questions :
• Question #1: Frnm y our OT perspectiv e what are t he 3 most important conc lus i:ons you draw from y our analy sis of the data from the firs t 10 SR.AW firings?
• Question #2: Based' on the IOT&E data so far, what are y our top three reasons for pl:ac ing the SR.AW into de fi ciency status?·
• Question #3 : What options might y ou hav e cons idered other than placing the SRAW in deficiency status?·
To re·vi'ew the Slit.AW data again, sel1e:ct SRAW Te·st Data Summary.
SRAW Test Data Summary
Page4of 5 .... I ... Back Next
TST102 Fundamentals of Test Evaluation
Lesson 19 - Assignment RIESOURCES I PRINT I IUlP
Assignment for Operati:onal Test Director
ces for each ques You are tt SRAW Test Data Summary
Shot #
Tirne:/Date (Jaliil}
TGT Range
(1)
TGT Course
(2.}
TGT Speed
(KM/HR)
Mis.sire Launch?'
Missile Arm,?·
Hit Remar.ks
1 1000/ 04 453 090 0 YES YES YES
2 1100/ 06 213 270 25 YES YES YES
3 1300/ 07 637 210 10 YES NO YES
4 2300/ 10 321 065 14 NO NO NO HangFire
5 1500/ 15 587 22S 8 YES YES YES Hi.gh Winds
6 0300/ 16 14 170 25 YES NO YES
7 2300/ 18 612 193 0 YES YES NO
8 1230/ 22 17 100 30 YES YES YES
9 0400/ 27 325 045 s rNO NO NO Soldier Inj . ( 3 )
10 0330/ 29 292 280 10 YES YES YES
aw from yout
• Que
• Que ~ the SRA
ficiency stat
• Que
To re·vi'ev,i
SR.AW Tes
( 1) Distance in meters from the gunner to the target at t ime of miss il'e l·aunch... ( 2) A target course of 090 means the target is mov ing left to right w iith a targ·et compass heading of 90 degrees gi:ving1 the gunner a fulll brnadside view . ( 3) Shot 9 is. under inv estigation.. Marine severely burned when firing' t rig·ger pul l:ed. Wi,tness alleged that Marine .ki.cked the mi.ssi'le sight w ith his right foot pri:or toIpidcing· 111 iss il:e up .
Page4of 5 .... I ... Back Next
TST102 Fundamentals of Test Evaluation
Lesson 19 - Assignment RIESOURCES I PRINT I IUlP
Assignment for Pro-gram Mana,ger
You are the Program Manager {PM). From t hat perspective, briefly ( t w o or th ree sentences fo r each question) answ er the folJlo wing: three quest ions :
• Question #1: Frnm y our perspectiv e as an advocate of t he sy stem, what are the 3 most importan t conc lus ions. y ou draw fro m y our analy sis of t he data from t he first 10 SR.AW firings.? Cite spec ific firing resu lts to support y our answ ers .
• Question #2: The OTD be liev es there hav e been too many fa ilures already; do y ou agree? Why or why not? Use specific shots as examples to support y our assertion .
• Question #3: Based on ex tensive DT&E resul.ts , y ou recommended that SR.AW progress to IOT&E.. Does the data co llected t hus fa r in IOT &E reflect a prnb lem w ith the SR.AW, or w ith t he test plan and conduc t ? Prnv ide a short jus t ification for y our answer using specific test conditions and test data {shot numbers) ..
To review the SRAW data again, sel1ect SRAW Test Data Summary.
SRAW Test Data Summary
Submit your SRAW Te·sting Analysis vi'a e-mail to your instructor at their email address. The subje:ct line· of your e-mail should read: "SRAW Test Analys.is".
Page5of 5.... I ... Back Next
TST102 Fundamentals of Test Evaluation
Lesson 19 - Assignment RIESOURCES I PRINT I IUlP
Assignment for Pro-gram Mana,ger
You are jSllAW Test Data Summary questio
• Q C
fi
• Q
w
• Q
D C
{~
To re-vi
SRAW
Shot Tirne1Date TGT TGT TGT MissHe Mi'ssile Hilt Remarks # (Jan} Range Course Speed Launch? Arm?
(l} (2.) 1 1000/ 04 453 090
2 1100/ 06 213 270
3 B00/ 07 637 210
4 2300/ 10 321 065
5 1500/ 15 587 2.25
6 0300/16 14 170
7 2300/ 18 612 193
8 1230/ 22 17 100
9 0400/27 325 045
IO 0330/29 292 280
(KM/HR)
0 YES 25 YES rn YES 14 INO
8 YES 25 YES 0 YES
30 YES 5 NO
10 YES
YES YES YES YES NO YES IN:O IN:O
YES YES NO YES
YES N.O YES YES NO NO
YES YES
HangFire
High Winds
Soldier Inj. (3)
Submit subje:o
( 1) Distance in meters from the gunner to the target at t ime of miss ile 1:aunch.. ( 2 ) A targ.et course of 090 means. the target is. mov ing l'eft to, ri:ght:: w i,th a target compass heading o,f 90 degrees giv ing, the gunner a fuH bro,adside view.. (3) Shot 9 is under inves t i.gation . Marine sev erely bumed when firing1trigger pufled. Witness al leg·ed tha t Marine kicked the missil'e sigh t w ith his right foot pri.or t o pi·cking1 missil1e un. .1, le'
3ach
importan t 3pec ific
? Why or
J IOT&E.. st plan and
3St data
The
Page5of 5.... I ... Back Next