Table Top Exercise-Hurricane

profileParis555
339_toolkit.pdf

Public Health Emergency Exercise Toolkit

Planning, Designing, Conducting, and Evaluating Local Public Health Emergency Exercises

June 2006 COLUMBIA UNIVERSITY

School of Nursing | Center for Health Policy

Copyright © 2006 | Center for Health Policy | Columbia University School of Nursing | All rights reserved.

Table of Contents

About the Exercise Toolkit This toolkit is intended to guide local public health agency staff in (1) developing, implementing, and evaluating emergency drills and exercises, and (2) facilitating the public health aspects of larger, multi- agency emergency exercise events.

The toolkit provides essential guidance including templates, checklists, and forms to assist with every stage of the exercise process. Emphasis is on identification of objectives during the planning phase, a critical step for ensuring a meaningful postexercise evaluation.

The information in this document is consistent with the approaches recommended by the U.S. Department of Homeland Security’s (DHS) Office of Domestic Preparedness (ODP) and the Homeland Security Exercise and Evaluation Program (HSEEP).

Research and development was supported through Association of Teachers of Preventive Medicine/Centers for Disease Control and Prevention Cooperative Agreement #TS-1245. Kristine Gebbie, RN, DrPH, Principal Investigator Joan Valas, RN, PhD, Public Health Specialist

Introduction . . . . . . . . . . . . . . . . . . . . . . . 1

Exercise Planning and Principles in Public Health . . . . . . . . . . . . . . . . . . . . 2

Exercise Cycle and Organization . . . . . . 3 State Responsibilities Local Responsibilities

Types of Exercises . . . . . . . . . . . . . . . . . . 4 Discussion-based Exercise Operations-based Exercise

The Exercise Planning Process . . . . . . . 6 Organization of the Exercise Planning Team Identifying Overarching Goals and Objectives

Scenario Development Steps . . . . . . . . . 9 Discussion-based Exercise Operations-based Exercise

Developing an Evaluation Plan . . . . . . . 12 Pre-exercise Activities Evaluation Questions Evaluation Methods Selecting and Utilizing Evaluation Criteria

Developing Exercise Briefing Materials . . . . . . . . . . . . . . . . . . . . . . . . . 16

Conducting the Exercise . . . . . . . . . . . . 17

Moving from Observation to Evaluation . . . . . . . . . . . . . . . . . . . . . . . . 20

References and Resources . . . . . . . . . . 21

Appendices . . . . . . . . . . . . . . . . . . . . . . . 25

In tro

d u

c tio

n

1

n emergency preparedness exercise program is progressive, moving an agency toward even better emergency preparedness. It requires careful planning, including clearly identifying long-term improvement goals and specific exercise objectives and then

designing, developing, conducting, and evaluating each exercise accordingly. Following this process will provide insight into what does and does not work for each specific local public health agency (LPHA).

An exercise program enables an agency to test the implementation of emergency management procedures and protocols, fine-tune the internal coordination of the emergency plan, and practice coordinating with external response sectors. Depending on the scope and scale of the emergency preparedness exercises, they may involve many individuals, both internal (from within the LPHA) and external (from other response sectors).

The national framework for emergency preparedness began with Homeland Security Presidential Directive 5 (HSPD-5), which directed the development of the National Response Plan (NRP).This plan aligned federal coordination, capabilities, and resources into a multi- discipline, all-hazards approach under a comprehensive incident management system known as the National Incident Management System (NIMS).

HSPD-5 was followed by Homeland Security Presidential Directive 8 (HSPD-8), which put forth the following National Preparedness Goal: “establish mechanisms for improved delivery of Federal preparedness assistance to State and local governments” (www.LLIS.gov). Further, an interim National Preparedness Goal prescribes a capabilities-based planning approach for a wide range of threats and hazards. Among the capabilities-based planning tools available for use in developing emergency preparedness exercises are a suite of 15 National Planning Scenarios (Appendix D).

As a step toward strengthened preparedness, the Department of Homeland Security Office of Domestic Preparedness (DHS ODP) developed and implemented an Exercise Evaluation Program, HSEEP, to enhance and support prevention, response, and recovery capabilities at fed- eral, state, and local levels.The program seeks to “standardize the language and concepts used by various agencies and organizations in the exercise planning process” (DHS, 2002).This toolkit is based on and consistent with the national goals, plans, and principles outlined above.

Introduction

A

Exercise Planning and Principles in Public Health

E mergency preparedness exercises should be based on the NRP and NIMS, which focus on the public health responsibilities for emergency response. Exercises should be consis- tent with HSEEP, which stipulates federal doctrine as a framework for all emergency

response sectors and offers useful guidelines and formats for exercise development. Efforts should be made to coordinate exercise activities at the state and federal levels and with other partners and response sectors.

Exercise planning must include criteria that will allow assessment of how well an LPHA per- forms under the conditions of a specific public health emergency or disaster.They define vari- ous levels of response performance. Criteria define various levels of response performance. Measures of these criteria will provide the basis for additional planning, training, conducting, and evaluation of emergency response operations (Appendix B).

E x

e rc

is e

P la

n n

in g

a n

d P

r in

c ip

le s

in P

u b

lic H

e a

lth

2

HSEEP requires that each state define a cycle, mix, and range of exercises in a multiyear exercise plan that covers the wide range of natural and deliberately caused emergencies that might occur. State and local public health agencies should participate in multiagency exercises, particularly those exercises with public health significance. For example, the requirement for a statewide Strategic National Stockpile (SNS) plan would be demonstrated through a tabletop exercise, then a functional exercise, followed by a full-scale exercise (Types of Exercises, page 4).

State Responsibilities Each state is expected to develop its own exercise program based on the guidelines provided by DHS.The program must address all of the tasks laid out by the federal guidelines, including

Local Responsibilities States disseminate their requirements to local jurisdictions by two routes: through the local emergency response agency, which has a direct tie to the designated state Office of Emergency Management, and through the state health agency. On the local level, there are many response sectors with which the public health sector needs to plan and coordinate its exercise activities.These activities are common to all response sectors. In general, LPHAs are responsible for

Exercise Cycle and Organization

E x

e rc

is e

C y

c le

a n

d O

rg a

n iz

a tio

n

3

1. obtaining grants/funding

2. identifying roles and responsibilities for program development

3. designing, developing, implementing, and evaluating exercises

4. tracking improvements

5. monitoring whether the exercises conducted are consistent with HSEEP doctrine

6. designating a state-level agency/organiza- tion as the clearinghouse for all exercises conducted within the state

7. conducting an annual workshop to review the state exercise program, ensuring that the state objectives have been met and revising the multiyear exercise plan and schedule

1. coordinating activities with the state health agency

2. identifying goals and objectives for exercises consistent with local public health risk, vulnerability, and needs assessments, as well as DHS strategy

3. designing and conducting exercises that conform to HSEEP requirements

4. providing the plans, procedures, and per- sonnel to support the design, development, support, control, and evaluation of public health exercises

5. providing an Improvement Plan (IP) that is based on the recommendations made in the After Action Report (AAR), which is issued following the completion of an exercise

Types of Exercises

E xercise is the generic term for a range of activities that test emergency response readiness, evaluate an emergency response plan, and assess the success of training and development programs.The five basic categories of such exercises are as follows: orientation exercises,

tabletop exercises (TTX), drills, functional exercises (FE), and full-scale exercises (FSE).The first two categories are primarily discussion based, whereas the other three are action oriented.

A. Discussion-based Exercises Orientation Exercise (Workshops or Seminars) The purposes of an orientation exercise are to: (1) familiarize new staff with the agency’s emergency response plan and/or (2) familiarize experienced staff with new or changing information/procedures. An LPHA may carry out an orientation exercise under a variety of circumstances, including the initiation of a new plan, procedure, or mutual aid agreement, or in the event of new staffing, leadership, facilities, or risk(s).The focus is usually on a single function, with roles and responsibilities clearly identified. It typically requires a scheduled meeting of pertinent agency staff. No previous experience is needed, and minimal staff prepa- ration and lead time are required. Orientation exercises make use of various training techniques, including lectures, films, slides, videotapes, and panel discussions.

Tabletop Exercise (TTX) A TTX is a low-stress event to stimulate discussion of a simulated situation. Participants discuss issues in depth and make decisions using slow-paced problem-solving methods in contrast to the fast-paced, spontaneous decision making typical of actual or simulated emergency condi- tions.TTXs are designed as an early step along the way to functional and full-scale exercises. Constructive problem solving is the goal of such an exercise. A copy of the appropriate emer- gency plan and other pertinent materials are available for reference during a TTX. A staff person is assigned to act as recorder, documenting actions taken during a TTX; these notations serve as a reference tool for evaluating the exercise.

A TTX begins with a briefing by the facilitator to orient participants and simulators to the TTX objectives, ground rules, and communication and simulation procedures.The scenario narrative is then presented in an intelligence briefing.The scenario is generally invented and describes an event or emergency incident, bringing participants up to a simulated “present moment” in time.The selected event should be one that is realistic for the agency (e.g., a hur- ricane on the Eastern seaboard, a transportation event at a major railroad hub, etc.). Materials may be distributed to provide details about an imaginary jurisdiction, or participants may be instructed to use their knowledge of actual local resources.The facilitator announces the beginning and end of the exercise, and introduces the first problem, along with subsequent pacing messages, to the participants.

T y

p e

s o

f E x

e rc

is e

s

4

B. Operations-based Exercises Drill The purpose of a drill is to use repetition to instruct thoroughly. Drills can be used to test personnel training, response time, interagency cooperation and resources, and workforce and equipment capabilities. Drills optimally take place after orientation; staff should have an understanding of the agency function that will be tested in the drill and be given an opportu- nity to ask questions.

How a drill begins depends on the type of drill being conducted. Drill categories include but are not limited to notification, communication, command post, and evacuation. In most cases, a general briefing by the drill designer sets the scene and reviews the drill’s purpose and objectives. Operational procedures and safety precautions are reviewed before the drill begins. Personnel are required to report, either in person or by telephone or e-mail, to a designated drill site or contact location. Both planned and spontaneous messages sustain the drill’s action.

Functional Exercise (FE) The purpose of an FE is to test and evaluate the capabilities of an emergency response system. Events and situations that would actually occur over an extended period of time are depicted or described.Time transitions advance the activity while staying within the time allotted for the exercise (e.g., “It is now 24 hours later”).The objectives of an FE determine how it is to be organized. For example, a “no-notice” exercise does not have a start time; in such an exercise, the objectives would include testing staff members’ ability to move into their emergency response roles and activities quickly and efficiently. Other FEs, however, may be announced in advance.

Immediately before the start of the FE, participants are briefed on the objectives, procedures, time frame, and recording requirements. FEs depend on reaction to simulated information delivered by paper, telephone, or radio to individuals or agencies that must then coordinate responses with other players.These messages can be pre-scripted or developed by the simula- tion cell during the course of the exercise.

Full-scale Exercise (FSE) The purpose of an FSE is to test and evaluate a major portion of the emergency operations plan in an interactive manner over an extended period. FSEs typically involve more than one agency. As with an FE, the objectives of an FSE must be specified, and the actual exercise begins with a simulated event that prompts the initiation of the plan. An FSE differs from a functional drill in that field personnel from the participating agencies physically proceed to the location of the mock emergency.The FSE includes all of the activities taking place at the emergency operations center (EOC) as well as on-scene use of simulated victims, equipment, and workforce. Activities at the scene serve as input and require coordination with the EOC. An FSE combines the planned and spontaneous messages characteristic of FEs with actions from the field.

T y

p e

s o

f E x

e rc

is e

s

5

The Exercise Planning Process

I t is critical for all exercise participants to be able to recognize the terms used to describe various exercise roles and responsibilities as well as other important exercise terminology. See Appendix C, page 32, for exercise terminology definitions.

A. Organization of the Exercise Planning Team To begin, an LPHA should establish an Exercise Planning Team.The team’s overall responsibilities include

The team’s size will depend on the size of the LPHA and should be modified to fit the scope of a particular exercise.The roles and responsibilities for the planning team must be clearly defined and should include delegation of responsibilities among team members as described below.

Command Role. Assigns tasks and responsibilities, establishes the timeline, and guides and monitors exercise development.Typically, this role consists of a single team leader—often the health director or the bioterrorism (BT) coordinator. In cases where large departments or large-scale exercises are involved, other staff members may assist the team leader.

Operations Group. Ensures scenario accuracy and applicability, and develops the evalua- tion criteria. Participants in this group typically include departmental subject matter experts and technical experts (e.g., epidemiologists for surveillance activities, environmental health specialists for environmental health sampling, and public health nurses for mass prophylaxis and immunization clinic set up).

Planning Group. Collects and reviews all policies and procedures applicable to the exercise. Also develops simulation and injects (i.e., intermediate changes or challenges to the exercise participants) needed to sustain exercise flow. In small departments or for small-scale exercises, the planning group may be combined with the operations group.

T h

e E

x e

rc is

e P

la n

n in

g P

ro c

e s

s

6

1. setting a timeline for the planning process

2. defining the exercise’s purpose

3. selecting the scenario, goals, and objectives for the exercise (this step applies to all exercises, both local and multiagency); a scenario may be chosen from the Suite of National Planning Scenarios (Appendix D) as long as it is plausible for the jurisdiction

4. scheduling events, location, date, time, and duration of the exercise

5. defining the exercise control and preparing all documentation and exercise materials

6. facilitating exercise organization, including communication needs, rules of conduct, security and safety issues, and logistics, e.g., parking, assembly areas, transportation, rest- rooms, food/water for participants, maps and directions, etc.

7. providing training on the responsibilities/ activities of the team, exercise participants, and evaluator(s)

Logistics Group. Gathers all supplies, materials, equipment, services, and facilities required for the implementation of the exercise. For small-scale exercises, the logistics group may consist of a single senior administrative support person working closely with the planning group.

Administration/Finance Group. Keeps an account of the costs involved in conduct- ing an exercise. For small agencies, this group may consist of a single individual, who may be the same administrative support person assigned to the logistics role.

B. Identifying Overarching Goals and Objectives Agency-specific Goals There are no off-the-shelf documents that will define an LPHA’s specific emergency pre- paredness goals.Templates and guidelines cannot take into account the unique requirements of local environments. Developing an exercise program that matches those requirements is a sys- tematic process and the responsibility of the exercise planning team.

Given that the overarching goal of all exercises is improved preparedness, identifying goals for any one exercise is a process centered on one question:Why does an agency need to exercise? The answer may be staff demonstration or plan validation.The goals must also feed into an organization’s preparedness mission, support its preparedness plan, be realistic, and include objectives. For example, a sample preparedness mission might be: To serve the county by distributing mass prophylaxis to employees of a UPS facility that houses a biological detection system (BDS). A sample preparedness plan for such a mission might be: To set up a point of distribution (POD) clinic.

Objectives The objectives for any exercise must be challenging yet achievable and should support an LPHA’s overall mission and preparedness plan.Whether there is a single objective or several, they should be based on the following:

T h

e E

x e

rc is

e P

la n

n in

g P

ro c

e s

s

7

1. an agency’s current stage of emergency preparedness

2. gaps, weaknesses, or areas of concern affecting the agency’s performance as iden- tified through prior exercises

3. level of staff knowledge and understanding of emergency preparedness roles and responsibilities

4. applicability to emerging problems

Example

Draft Goal: Test activation of the county POD operational model

Potential Specific Objectives:

Test activation of the POD operational model through evaluation of POD lay- out and patient flow.

Provide staff with an opportunity to practice following the incident com- mand system (ICS) and the functional roles required for expeditiously receiving and dispensing appropriate medications.

Provide and maintain effective two-way communications to ensure a 24/7 flow of critical health information among public health departments, health care organizations, law enforcement, public officials, and others.

T h

e E

x e

rc is

e P

la n

n in

g P

ro c

e s

s

8

1

2

3

O nce the exercise goals and objectives have been formulated and the type of exercise selected, there are further considerations in the exercise planning process.These include developing support materials such as an exercise participant handbook/manual and

evaluation forms, and scheduling a training or briefing session. Such a session will ensure that all exercise participants, including the team conducting and evaluating the exercise, the players (e.g., “victims,” hotline callers, community members, etc.), and others are clearly informed about their roles in the exercise prior to its start.These steps are discussed more fully, includ- ing examples, on page 16 (Developing Exercise Briefing Materials).

The scenario is the foundation of an effective exercise. It lays the groundwork for develop- ment of exercise objectives and selection of public health emergency exercise criteria.The process for scenario development is the same, regardless of whether an exercise will be con- ducted entirely within an LPHA or as part of a larger multigency exercise. An LPHA may select a scenario from the Suite of 15 National Planning Scenarios,* as long as the chosen scenario is plausible for the jurisdiction.

When developing drills, or tabletop, functional, or full-scale exercises, follow these steps:

Scenario Development Steps

S c

e n

a r

io D

e v

e lo

p m

e n

t S te

p s

9

*These scenarios represent a range of potential natural disasters or deliberately caused events and are expected to be the basis of the National Exercise Program. Use of these scenarios can facilitate cross-agency collaboration or evaluation. See Appendix D.

†This is needed even if the exercise makes use of one of the National Planning Scenarios.

Use agency content experts to assist in scenario development.

Research and gather background infor- mation to make the scenario realistic.†

Draft and review the scenario with the exercise planning team.

Do a “talk-through” with the entire planning team to identify possible prob- lems and areas in need of improvement.

Finalize the scenario, including the development of simulations and injects needed for scenario flow if the exercise includes response to changing information.

1 4

52

3

Discussion-based Exercise

S c

e n

a r

io D

e v

e lo

p m

e n

t S te

p s

10

Gather the background and technical infor- mation needed to ensure that the scenario events are realistic and complete.This

includes the flow, proper timing, and integra- tion of the scenario elements.

The scenario should be broken up into dis- crete episodes called “moves.” Each move details the events that have transpired and the response actions that have taken place during a specific timeframe. Each one is sequenced and introduces the events in a chronological

order. First the scenario (narrative) back- ground is presented, followed by scenario moves: Scenario Move I Scenario Move II Scenario Move III

These are questions that the facilitator can verbally present to the group, which then dis- cusses them one at a time. Alternatively, the facilitator can provide written detailed events

(messages) and related discussion questions to individuals to answer from the perspective of their own organization and role.These are then discussed by the group.

The scenario should be reviewed several times to ensure that all technical aspects are covered and that the timeline is logical and realistic. Once this has been done, conduct a

talk-through at a working meeting of the planning team to make any changes and finalize the scenario.

1. Research

2. Draft the Scenario Components

3. Create Problem Statements and Messages

4. Finalize the Scenario

Operations-based Exercise

S c

e n

a r

io D

e v

e lo

p m

e n

t S te

p s

11

• Develop an outline, which will eventually become the narrative.

• Develop a timeline of major events.

• Add technical details to the timeline.These will help generate specific messages.

• Develop injects or messages to replicate actual events and to ensure and drive the

major events. Player responses should be anticipated and planned for. Draft a message summary, which is a chronological list of all events and expected player actions.This is sometimes called a Master Scenario Events List (MSEL).

The scenario should be reviewed several times to ensure that all technical aspects are covered and that the timeline flows and is realistic. Once this has been done, conduct a

talk-through at a working meeting of the planning team to make any changes and finalize the scenario.

1. Research This will be the same as for discussion-based exercises.

2. Draft the Scenario Components

3. Finalize the Scenario

T he most important step in planning an exercise is developing an exercise evaluation plan. An exercise is only as useful as the results of its evaluation. It is therefore critical to clarify evaluation criteria early on, which should include the following:

Pre-exercise Activities Consider the following pre-exercise activities when developing the evaluation plan.

D e

v e

lo p

in g

a n

E v

a lu

a tio

n P

la n

12

Developing an Evaluation Plan

Identify exactly what portion of public health emergency response will be acti- vated. Use the universal task list or a local planning decision to determine which specific response activities will be practiced.

Example: Set up LPHA EOC with com- plete telecommunications and radio con- nections with branches to the county EOC.

Identify all LPHA components that are expected to participate.

Example: Will logistics actually procure items or are they to be assumed? Will all branch offices participate, or only those selected?

Identify all functional roles to be acti- vated. Include those likely to be identified only if initial participants perform as desired.

Example: If the LPHA planning unit will be activated, there may be a need to exercise and evaluate field epidemiology.

Select specific LPHA-level criteria from the menu in Appendix B (or DHS sources, if available for your locale). If external criteria are unavailable, specify preferred performance using the follow- ing format: action verb; object; context; time. Identify all job action sheets (JAS) associated with those criteria.

Prepare observer documents. List criteria and JAS role evaluations to be observed.

1

4

3

5

2

• an LPHA’s exercise process

• an LPHA’s emergency plan

• an LPHA’s ability to fulfill the plan

• the speed with which an LPHA puts some portion of the plan into place

• the efficiency with which some portion of the plan can be carried out

• staff competency in specific roles

Evaluation Questions Some exercises work better than others to develop staff skills, demonstrate abilities, or test community communication. Examples of evaluation questions tailored to specific criteria include:

D e

v e

lo p

in g

a n

E v

a lu

a tio

n P

la n

13

• Did the plan anticipate all key needs, such as space, communication equipment, supplies?

• Did it anticipate all needed roles?

• Did the plan match the community’s expectations?

What happened when the plan was put into actual use?

• Did people go where they were supposed to?

• Were functional role assignments followed?

• Was the desired outcome achieved?

• Time to notify?

• Time to be in place?

• Other times as detailed in the action plan

• Down time?

• Repeated messages?

• Duplicate instructions?

• Conflicting instructions?

• Supplies wasted?

• Functional roles to be assessed need to be identified in advance.

• Competency statements and applicable JASs must be incorporated into the assessment.

1. Evaluating an LPHA’s Emergency Response Plan

2. Evaluating How Well an LPHA Fulfilled Its Plan

3. Evaluating the Speed with Which the Plan Is Put into Place

4. Evaluating the Efficiency of Plan Execution

5. Evaluating LPHA Staff Competency in Specific Functional Roles

Evaluation Methods Consider the following ways to evaluate. Any of these methods can be used, but each requires specific criteria for best effect.

EXTERNAL EVALUATOR PARTICIPANT

OBJECTIVE Checklist with stated objectives Post-event checklist

SUBJECTIVE Narrative of observations “Hot wash” comments

Selecting and Utilizing Evaluation Criteria Appendix B contains a menu of criteria for evaluating the performance of LPHA emergency drills and exercises.These public health–specific criteria follow the HSEEP observer docu- mentation format.‡ The exercise planning team should select applicable criteria from this menu, develop any additional criteria pertaining to the local plan or the nature of the exer- cise, and prepare observer forms that match the criteria selected.

For example, in an exercise where the objective is to assess the internal workings and throughput of a mass prophylaxis distribution site, the criteria selected from the menu might include:

Criteria for Mass Prophylaxis, Mass Immunization, and Pharmaceutical Stockpiles

D e

v e

lo p

in g

a n

E v

a lu

a tio

n P

la n

14

Adapt generic mass-dispensing strategy to specific event within 60 minutes of notification.

Staff dispensing site(s) with adequate and appropriate personnel for mass dispens- ing (including volunteer surge staff) prior to site opening.

Identify and request any “just-in-time” training needs—including use of person- al protective equipment (PPE)—at least 2 hours prior to site opening.

Ensure that system is fully in place for restocking supplies throughout duration of site activation.

1 3

42

‡ Other criteria to evaluate public health emergency exercises include

• The Universal Task List (UTL), developed by the Department of Homeland Security, which can be found through the Office for Domestic Preparedness (ODP) Secure Portal at www.llis.gov

• Emergency Preparedness Performance Measures from the Centers for Disease Control and Prevention, found in Appendix 4 of Cooperative Agreement Guidance for Public Health Emergency Preparedness at http://www.bt.cdc.gov/planning/guidance05/index.asp

In the case of an unannounced exercise that included the objective of assessing the process by which the LPHA moved to open a mass distribution site, including logistics, notification of staff, and just-in-time training, the evaluation criteria would also include the following:

Criteria for Communication

Once an LPHA identifies the functional roles to be activated, the expected duties of each role related to each objective can be inserted into the observer format, as illustrated in the Sample Role Evaluation Checklist for Clinic Manager (Flu), in Appendix F, pages 56–59.

D e

v e

lo p

in g

a n

E v

a lu

a tio

n P

la n

15

5 6Ensure that system is fully in place forrotating and/or relieving staff throughout duration of site activation.

Prepare and deliver all required record- keeping supplies to Site Coordinator prior to site opening.

Establish liaison with jurisdiction-wide Joint Information Center (JIC) within 15 minutes of notifying the Incident Commander (IC) that the JIC is operational.

Draft and approve public information for anticipated phases of response within 2 hours of establishing the agency’s EOC.

Identify key partners (e.g., other health jurisdictions, law enforcement, hospitals, etc.) and convey initial public health information to these partners no later than one (1) hour after approval of such information by the agency’s IC.

Establish a schedule to update partners on a regular basis.

Test backup communications procedures.

Identify a public health spokesperson whose expertise is applicable to the nature of the emergency (e.g., Health Director, Health Officer, Epidemiologist, etc.).

Develop and convey Single Overriding Communication Objective (SOCO) through the ICS structure.

Update and distribute the SOCO (e.g., posted to Situation Boards, etc.) as needed, but at least every 4 hours.

1

3

4 5 6

7

8

2

Developing Exercise Briefing Materials

B riefing materials convey critical information and instructions pertaining to the imple- mentation of a public health emergency exercise.These materials may be used in brief- ings conducted with exercise participants in a variety of roles (e.g., controllers, players,

actors, evaluators, and observers).The following elements should be included in any set of briefing materials.

Examples of Role-specific Briefing Materials

D e

v e

lo p

in g

E x

e rc

is e

B r

ie fin

g M

a te

r ia

ls

16

Exercise Objectives: To establish the purpose of the exercise and define the exercise’s goals.

Scenario: A realistic and comprehensive storyline that serves as the backdrop for the exercise and details the conditions and technical issues at play.

Scope of Play: The parameters in which the exercise will be conducted, including duration of the exercise, players involved, and level and details of involvement. Exercise activities are set within this scope to enable exercise participants to perform against the established objectives.

Simulations and Artificialities: Mechanisms used to artificially simulate events, activities, or actions within the sce- nario to allow for further exercise response (for example, a mock TV news broadcast).

Rules of Conduct and Safety Information: Vitally important information that provides for the safe conduct and protection of all persons involved in the exercise. Includes mechanisms for initiating and discontinuing the exercise. Also includes the mechanism for responding to actual emergencies or accidents should they occur during the implementation of an exercise.

Briefing materials for Players: JASs; details of where, when, and to whom the player(s) should report; exercise identification and identifying clothing

Briefing materials for Controllers, Observers, and Evaluators: Exercise documentation forms; exercise identification and identifying clothing

1 2

T he actual conduct of the exercise provides opportunity for assessment of agency capaci- ty, participant training, and validation of competency, depending on the goals of the specific event.The components of conducting an exercise consist of these general steps:

Advance Steps While this document has focused on the details of identifying goals, objectives, and criteria in order to assure a focused event that can be evaluated and used for agency improvement, there are other steps that must be taken in advance.The exercise planning group must:

Conducting the Exercise

C o

n d

u c

tin g

th e

E x

e rc

is e

17

briefings and preparations (distribute badges/clothing and other needed materials or equipment)

initiate, facilitate, and observe exercise activity

terminate play

hot wash/debrief participants

1 3

2 4

secure appropriate location with all essen- tial equipment, unless a pre-equipped Emergency Operations Center is to be used

secure space for management of evalua- tors and observers, with appropriate com- munications equipment, orientation materials, identification, and debriefing planned

secure space for assembling any “victims,” with instructions and transportation to exercise site, if needed

prepare any special signage to direct indi- viduals to assigned locations

arrange for equipment specific to the sce- nario and objectives (e.g., sample collec- tion equipment for an exercise with con- taminated water or food; mock medica- tions for a mass prophylaxis exercise)

secure staff to support the exercise process, including any needed assistance for set up or communications

1 4

2

3

5

6

Role of the Exercise Facilitator/Controller Advanced planning sets the stage for the smooth conduct of an exercise. Sample exercise planning checklists are located in Appendix E. It may be useful for the facilitator/controller to refer to this before the exercise is initiated.The facilitator/controller must assume responsibility for the conduct of the exercise. He/she must ensure that the exercise stays on track so that the agreed-upon objectives are tested.The facilitator/controller’s job is to

1. Conducting a Discussion-based Exercise The participants/players and the facilitator(s) are introduced.The tabletop exercise process and flow are briefly described. Ground rules usually address the exercise objectives, the importance of participating, and issues participants should consider during play, such as time, roles, and assumptions. Special instructions may be provided, such as how participants will respond and if they will break up into discussion groups.

Episodes in the exercise scenario are described as moves. Generally, there are three moves to a tabletop. At each move there is a facilitated discussion.The facilitator moves the participants through the scenario and participants respond with the decisions and actions they would take given the scenario. Each move takes the participants through the scenario chronologically.The tabletop conduct is concluded with an overall evaluation and findings, presented as the debriefing and an action planning session for improvements.

C o

n d

u c

tin g

th e

E x

e rc

is e

18

1. Present the players with the exercise- initiating narrative.

2. Announce the first event of the scenario.

3. Stimulate player responses, without inter- vening in a way that assumes control of the play, unless it appears likely that the objec-

tive(s) of the exercise have been side- tracked.

3. Manage the flow and pace of the exercise by introducing the remaining events in sequence through the use of control messages (injects).

2. Conducting an Operation-based Exercise These types of exercises allow actual demonstration of response capabilities and actions.The range and level of complexity depend on the objectives and scenario chosen to exercise.

The exercise begins with the briefings for the different participants who are either actors, players, or data collectors/observers. Briefing manuals are reviewed at this time. Participants are given their assignment locations. Emphasis is on safety, including:

Materials and/or equipment are distributed as necessary including instructions on how and where to return them.

Instructions are given for when and where to report for the hot wash (debriefing), held immediately at the end of the exercise.

Participants report to their assigned location. Exercise play is begun and terminated according to the exercise plan.

C o

n d

u c

tin g

th e

E x

e rc

is e

19

• where and when to report to the location

• how the exercise will be ended or terminated, if necessary

• whom to report to, and how to communi- cate with that person.

Moving from Observation to Evaluation

With an evaluation plan in place, the evaluation process begins with observing the exercises. Data collectors and evaluators will need to know what to look for, both general and specific. They must be aware of the exercise goals and objectives, the overall scenario, as well as what activities and actions will take place during the exercise. It is helpful if data collectors and evaluators have some subject matter expertise for the activities they will observe.They should also create written records, using a checklist or free-notes, to assist with data collection to ulti- mately derive the most value from the evaluation (Appendix F).

Evaluation is a common process in the public health sector, so the eight steps recommended by HSEEP, should be familiar.

M o

v in

g fro

m O

b s

e r

v a

tio n

to E

v a

lu a

tio n

20

Plan and organize the evaluation in advance. All data collectors/evaluators and controllers need a complete briefing on exercise and evaluation materials.

Observe the exercise and collect data using the materials provided (i.e., observer and data collector logs and workbooks, including the data collector/evaluator handbook).

Analyze data and assess performance at the task, departmental, discipline-of- function, and mission levels. Reconstruct the exercise events from logs, workbooks, hot wash, and other debriefings. Identify the root causes of differences using critical thinking to determine why things happened as they did.

Draft the After Action Report (AAR) (See Appendix F, page 53 for details).

Conduct the exercise debriefing/hot wash (See Appendix F, page 67). Depending on the size and complexity of the event, this process may consist of a single debriefing or a series of debriefings with various subgroups of exercise participants.

Identify opportunities for improvement and lessons learned. Update the plan accordingly.

Finalize the AAR, which should include an assessment of strengths and weaknesses. The AAR will in turn guide the develop- ment of the Improvement Plan (IP).

Develop the IP. This converts the lessons learned from the exercise into measurable steps that will result in improved response capabilities.Then track the implementation of the IP (See Appendix F, page 69).

1 5

2

3

4

6

7

8

Alexander, D. (2003).Towards the development of standards in emergency management train- ing and education. Disaster Prevention and Management, 12(2), 113.

Association of State and Territorial Health Officials (ASTHO). (2004). Exercising the strategic national stockpile: Lessons learned and tools for application. Washington, DC: ASTHO. Retrieved March 2006, from http://www.astho.org/pubs/Exercisingthestockpile.pdf.

Balog, J. N., Boyd, A., and Caton, J. E. (2003). The Public Transportation System Security and Emergency Preparedness Planning Guide. Washington, DC: U.S. Department of Transportation.

Beaton, R. D., Stevermer, A.,Wicklund, J., Owens, D., Boase, J., and Oberle, M.W. (2004). Evaluation of the Washington State national pharmaceutical stockpile dispensing exercise: Part II—dispensary site worker findings. Journal of Public Health Management & Practice, 10(1), 77–85.

Beaton, R. D.,Wicklund, J., Stevermer, A., Boase, J., and Owens, D. (2003). Evaluation of the Washington State pharmaceutical stockpile dispensing exercise: Part I—patient volunteer find- ings. Journal of Public Health Management Practice, 9(5), 368–376.

Brannen, D. E., and Stanley, S. A. (2004). Critical issues in bioterrorism preparedness: Before and after September 2001. Journal of Public Health Management & Practice, 10(4), 290–298.

Chen, K. C., Chien-Chih, C., and Tzong-Luen,W. (2002). Comparisons of efficiencies in recognition of hospital emergency incident command system by tabletop drill and real exer- cise. Annals of Disaster Medicine, 1(1), 29–35.

Chi, C. H., Chao,W. H., Chuang, C. C.,Tsai, M. C., and Tsai, M. L. (2001). Emergency med- ical technicians’ disaster training by tabletop exercise. American Journal of Emergency Medicine, 19(5), 433–436.

Christie, P. M., and Levary, R. R. (1998).The use of simulation in planning the transportation of patients to hospitals following a disaster. Journal of Medical Systems, 22(5), 289–300.

Classic, K. L., Knutson, A. H., and Smith, G. D. (2000). Radiation safety role in institutional disaster planning. Operational Radiation Safety, 78(2), 35–39.

Counts, C. S. (2001). Disaster preparedness: Is your unit ready? Nephrology Nursing Journal, 28(5), 491–499.

Emergency Management Institute. (1994). Mitigation and recovery exercises—earthquake. Retrieved December 2003, from http://training.fema.gov/EMIWeb/STCourses/nrcrssp.

References and Resources

R e

fe re

n c

e s

a n

d R

e s

o u

rc e

s

21

Emergency Management Institute. (1995). Flood mitigation and recovery—An interactive exercise for local governments. Retrieved December 2003, from http://training.fema.gov/ EMIWeb/STCourses/nrcrs.asp.

Emergency Management Institute. (1995). Mitigation and recovery exercise—hurricane. Retrieved December 2003, from http://training.fema.gov/EMIWeb/STCourses/nrcrs.asp.

Federal Emergency Management Agency. (1999). Pandemic Tabletop PowerPoint Slides. CD- ROM.

Federal Emergency Management Agency. (2000). Hazardous materials exercise evaluation methodology. Retrieved April 2005, from http://training.fema.gov/emiweb/downloads/ HMManualTOC.doc.

FitzGerald, D. J., Sztajnkrycer, M. D., and Crocco,T. J. (2003). Chemical weapon functional exercise—Cincinnati: Observations and lessons learned from a “typical medium-sized” city’s response to simulated terrorism utilizing weapons of mass destruction. Public Health Reports, 118, 205–214.

Gillis,T. K. (1996). Emergency Exercise Handbook: Evaluate and Integrate Your Company’s Plan. Tulsa, OK: PennWell.

Goodwin, C. (1986). Disaster drills. Topics in Emergency Medicine, 7(4), 20–33.

Henning, K. J., Brennan, P. J., Hoegg, C., O’Rourke, E., Dyer, B. D., and Grace,T. L. (2004). Health system preparedness for bioterrorism: Bringing the tabletop to the hospital. Infection Control & Hospital Epidemiology, 25(2), 146–155.

Hewlett P. L., Mitrani, J. E., Absili-Mills, P.,Tallarovic, J., et al. (1998). An analysis of chemical stockpile emergency preparedness program exercise results. In Volume 1:The CSEPP Exercise Results Database. Argone National Laboratory, Decision and Information Sciences Division; work sponsored by U.S. Department of the Army, Chemical and Biological Defense Command. Retrieved May 2004, from http://www.osti.gov/energycitations/servlets/ purl/656686-jEA4X8/webviewable/.

Hoffman, R. E., and Norton, J. E. (2000). Lessons learned from a full-scale bioterrorism exer- cise. Emerging Infectious Diseases, 6(6), 652–653.

Jarrett, D. (2003). Lessons learned:The “pale horse” bioterrorism response exercise. Disaster Management & Response, 1(4), 114–118.

R e

fe re

n c

e s

a n

d R

e s

o u

rc e

s

22

Lurie, N.,Wasserman, J., Stoto, M., Myers, S., Namkung, P., Fielding, J., et al. (2004, June 2). Local variation in public health preparedness: Lessons from California. Health Affairs. Retrieved September 2004, from http://content.healthaffairs.org/cgi/citmgr?gca=healthaff;hlthaff. w4.341v1.

National Response Team. (1990). Developing a hazardous materials exercise program: A hand- book for state and local officials. Retrieved December 2003, from http://ntl.bts.gov/DOCS/ 254.html.

Osaki, C. (2003). Hands-on training for public health emergencies: Facilitator’s manual for bioterrorist attack on food: A tabletop exercise. Northwest Center for Public Health Practice, University of Washington, in collaboration with the Washington State Department of Heath and the Centers for Disease Control and Prevention. Retrieved October 2003, from http://www.cdphe.state.co.us/bt/2003borderstates/presentations/osaki/FacilitatorsManual.pdf.

Perry, R.W., and Lindell, M. K. (2003). Preparedness for emergency response: Guidelines for the emergency planning process. Disasters, 27(4), 336–350.

Phreaner, D., Jacoby, I., Dreier, S., and McCoy, N. (1994). Disaster preparedness of home health care agencies in San Diego County. The Journal of Emergency Medicine, 12(6), 811–818.

Quarantelli, E. L. (1997).Ten criteria for evaluating the management of community disasters. Disasters, 21(1), 39–56.

Rekus, J. F. (1989). Disaster drills identify potential for problems in real emergencies. Occupational Health & Safety, 58(11) 50. 52–56.

Schweitzer, R. (2004, January 20). Hot wash debriefing format. Retrieved June 2005, from https://odp.esportals.com/member/libnew2/index.cfm (requires secure login ID).

Simpson, D. M. (2002). Earthquake drills and simulations in community-based training and preparedness programmes. Disasters, 26(1), 55–69.

Skowronski, S., and Townes, D. (2003, November). Using tabletop exercises and drills to reveal training needs. Paper presented at the Health Distance Learning Summit. Retrieved April 2004, from http://www.phppo.cdc.gov/phtn/2003DLSummit/TabletopEx-Skowronski.pdf.

Spain, E. L. (1995). Developing a simulated disaster. Nursing Management, 26(12), 48H.

Taylor, M. (2003). Doing the drill. Modern Healthcare, 33(20), 22.

R e

fe re

n c

e s

a n

d R

e s

o u

rc e

s

23

Turnball, J., Gesteland, P., and Gardner, R. (2002). Bioterror drills show need to revise emer- gency preparedness plans. Hospital Peer Review, 27(6), 73–76.

Turner, S. J. (1991). Preparation for a fire disaster in a long-term care facility: A staff develop- ment perspective. Journal of Nursing Staff Development, 7(3), 134–137.

U.S. Department of Energy Office of Transportation and Emergency Management. (2002). Guidance for planning, conducting and evaluating transportation emergency preparedness tabletops, drills and exercises. Retrieved December 2003, from http://web.em.doe.gov/otem/ 09072v2.pdf.

U.S. Department of Homeland Security. (2004, March). National Incident Management System.Washington, DC: http://www.nimsonline.com/nims_3_04/index.htm

U.S. Department of Homeland Security, Office for Domestic Preparedness. (2003). Homeland security exercise and evaluation program,Vol. I: Overview and doctrine. Retrieved December 2003, from http://www.ojp.usdoj.gov/odp/docs/HSEEPv1.pdf.

U.S. Department of Homeland Security, Office for Domestic Preparedness. (2003). Homeland security exercise and evaluation program,Vol. II: Exercise evaluation and improvement. Retrieved October 2003, from http://www.ojp.usdoj.gov/odp/docs/HSEEPv1.pdf.

U.S. Department of Homeland Security, Office for Domestic Preparedness. Homeland security exercise and evaluation program,Vol. III: Exercise program management and exercise planning process. Retrieved March 2005, from http://www.ojp.usdoj.gov/odp/docs/HSEEPv3.pdf.

R e

fe re

n c

e s

a n

d R

e s

o u

rc e

s

24

APPENDICES

Appendix A Exercise Flowchart

Appendix B Menu of Criteria for Evaluating the Performance of Local Public Health Agency Emergency Drills and Exercises

Appendix C Acronym Definitions

Appendix D The Suite of 15 National Planning Scenarios

Appendix E Exercise Planning Document Templates with Examples of Their Use

Appendix F Exercise Data Collection/Evaluation Forms with Examples of Their Use

Appendix G Sample Scenario, Full-scale Exercise Playbook, Tabletop Exercise Schedules, and Facilitator Questions

25

Appendix A:

Exercise Flowchart The exercise process begins with the selection of the type of exercise to be conducted.The flowchart below illustrates this process.

Determine Broad Goals

Audience Scenario

Establish Exercise Planning

Select Criteria

(may be concurrent w/scenario development)

Determine Objectives

• Focus of exercise • Scope • Scale • Extent of play (suggest type) • Format (type) • Evaluation method • Work plan • Resource needs

Complete Scenario

1. research 2. draft & integrate 3. review 4. talk-through 5. finalization

Identify Type of Exercise

Discussion-based or Operations-based

Prepare Briefing Materials

Conduct Exercise Briefings

Conduct Exercise

Conduct Hot Wash

Identify Functional Roles

to be tested for participating staff

Evaluation (Analyze Data)

Prepare After Action Report (AAR)

Develop Improvement Plan

Schedule Next Exercise

Monitor Ongoing Improvement Tracking

26

Appendix B:

Menu of Criteria for Evaluating the Performance of LPHA Emergency Drills and Exercises Note: Select these criteria based on their relevance to the type of exercise you will be conducting. Acronyms are defined in Appendix C.

Initial Response Command and Control

*activate = notified and in communication, not necessarily on-site.

27

Identify health department’s internal Incident Commander (IC) immediately upon notification that emergency man- agement will be used in response to an incident.

Identify and activate* all health depart- ment internal Incident Command System (ICS) positions (e.g., public informational officer, liaison, safety officer, appropriate section chiefs, etc.) within 30 minutes, regardless of time of day (24/7/365).

Centralize all initial/available/relevant information to agency’s ICS Planning Section using a situation board or equiva- lent within 15 minutes.

Establish a public health Incident Action Plan (IAP) within 30 minutes following the establishment of the department’s EOC, describing primary objectives and overall strategy to be accomplished by the health department in the first 24 hours of the incident.

Activate appropriate ICS general staff sec- tions within 60 minutes of initial activa- tion of internal ICS.

Retrieve and make available to ICS com- mand staff portions of state/local public health laws and codes pertaining to the specific emergency.

Activate plan for operating/closing rou- tine health department operations within 30 minutes of initial activation of internal ICS.

1 4

2

3

5

6

7

Communication

28

Establish liaison with the jurisdictional JIC within 15 minutes of notifying the IC that the JIC is operational.

Draft and approve public information for anticipated phases of response within 2 hours of establishing the agency’s EOC.

Identify key partners (e.g., other health jurisdictions, law enforcement, hospitals, etc.) and convey initial public health information to these partners no later than 1 hour after approval of such infor- mation by the agency’s IC.

Establish a schedule to update partners on a regular basis.

Test backup communications procedures.

Identify a public health spokesperson whose experience is applicable to the nature of the emergency (e.g., health director, health officer, epidemiologist, etc.).

Develop and convey SOCO through the ICS structure.

Update and distribute SOCO (e.g., post- ed to situation boards) as needed, but at least every 4 hours.

1 5

2

3

4

6

7

8

Early Recognition/Surveillance and Epidemiology

Establish event-specific surveillance with- in 60 minutes of establishing the EOC.

Establish a preliminary case definition.

Communicate adjustments to surveillance as needed to and from the internal public health IC.

Implement changes/enhancements in surveillance within 1 hour of approval by the internal public health IC.

Complete epidemiology investigation plan (including tools and forms) within 2 hours of establishing the agency’s EOC.

Prepare field staff prior to deployment, including PPE if needed.

Establish time interval(s) for updating epidemiology investigation plan based on reassessment of available information.

1 5

2

3

4

6

7

29

Sample Testing

Select laboratory resources and require- ments specific to agent/incident.

A. Develop targeted protocols and proce- dures for collection of samples within 60 minutes of notification of incident by the IC. Protocols and procedures should pertain to the specific emergency.

B. Disseminate developed protocols to involved staff prior to deployment.

Ensure that case investigators are appro- priately prepared and protected (via PPE) prior to deployment.

Deploy field workers to sites within 60 minutes of final IAP.

Pack and ship/transport samples in a manner consistent with laboratory requirements.

1 3

2 4

5

Evidence Management

Confirm evidentiary requirements with relevant agencies through jurisdiction- wide NIMS partners prior to collecting personal or environmental samples/speci- mens.

Establish arrangements for maintaining chain of evidence prior to collection of any samples/specimens.

1 2

Mass Prophylaxis, Mass Immunization, and Pharmaceutical Stockpiles

Adapt generic mass-dispensing strategy to specific event within 60 minutes of noti- fication.

Staff dispensing site(s) with adequate and appropriate personnel for mass dispensing (including volunteer surge staff) prior to site opening.

Identify and request any just-in-time training needs (including use of PPE) at least 2 hours prior to site opening.

Ensure that system is fully in place for restocking supplies throughout duration of site activation.

Ensure that system is fully in place for rotating and/or relieving staff throughout duration of site activation.

Prepare and deliver all required record- keeping supplies to site coordinator prior to site opening.

1 4

2

3

5

6

30

Mass Patient Care

Adapt generic mass patient-care strategy to specific event within 60 minutes of notification.

Staff mass care site(s) with adequate and appropriate personnel (including volun- teer surge staff) prior to site opening.

Identify and request any just-in-time training needs (including use of PPE) at least 2 hours prior to site opening.

Ensure that system is fully in place for restocking supplies throughout duration of site activation.

Ensure that system is fully in place for rotating and/or relieving staff throughout duration of site activation.

Prepare and deliver all required record- keeping supplies to site coordinator prior to site opening.

1 4

2

3

5

6

Environmental Surety

Develop/adapt strategy for control of environment rendered hazardous by the event within 30 minutes of site identifi- cation.

Identify specific characteristics of affected areas and report to IC within 30 minutes of arrival on site.

Establish PPE criteria for staff.1 3

2

Mass Fatality Management

Identify suitable facility (if needed) prior to dispatching pickup vehicles.

Develop plan for transporting bodies (including routes and expected time frames) prior to dispatching pickup vehicles.

1 2

Appendix C:

Acronym Definitions AAR After Action Report

BDS Biological Detection System

DHS Department of Homeland Security

EOC Emergency Operations Center

FE Functional Exercise

FSE Full-scale Exercise

HO Health Officer

HSEEP Homeland Security Exercise and Evaluation Program

IAP Incident Action Plan

IC Incident Commander

ICS Incident Command System

IP Improvement Plan

JAS Job Action Sheet

JIC Joint Information Center

LLIS Lessons Learned Information Sharing

LPHA Local Public Health Agency

MSEL Master Scenario Event List

NIMS National Incident Management System

NRP National Response Plan

POD Point of Distribution

PPE Personal Protective Equipment

ODP Office of Domestic Protection

SME Subject Matter Expert

SNS Strategic National Stockpile

SOCO Single Overriding Communications Objectives

TTX Tabletop Exercise

31

Terminology Definitions

After Action Report (AAR) Used to provide feedback on performance during an exercise. It summarizes what happened and analyzes the performance of critical tasks. It includes recommendations for improvements to be addressed in an improvement plan. It uses multiple sources of collected data, including observations and information.

Actors Volunteers or other members of the LPHA who act as patients or victims.

Briefing A meeting to inform participants on the ground rules of conduct and their roles and respon- sibilities. Briefings cover the exercise objectives and scope, the parameters and limits of play, simulations, and how and when the debriefing process will occur.They are held before an exercise begins. Actors, players, observers, and data collectors/evaluators usually attend separate briefings.

Controllers Monitor the flow of the drill or exercise.Their role is to ensure that the exercise is conducted in accordance with the scenario and the timeline and within established exercise scope and parameters. May or may not be from within the LPHA.

Data Collectors/Evaluators Observe and record player action during TTX, drills, and exercises, evaluating effectiveness based on defined objectives and evaluation criteria. May or may not be from within the LPHA, depending on the size and scale of the exercise. Usually evaluate an area consistent with their expertise.

Exercise Play The actual conduct of the exercise from initiation to termination.

Facilitators Lead TTX group discussions so that all scenario issues and questions are addressed.

Hot Wash An immediate debriefing session between players and members of the exercise planning team to discuss their preliminary observations.This information will inform the After Action Report.

Improvement Plan Converts the lessons learned from the exercise into measurable steps that will result in improvements in response capabilities.

32

Injects The terms inject and messages are used interchangeably and sometimes together.They are associated with the MSEL and link simulation to action and enhance the exercise.They are formatted and presented to reflect the data that would be observed in a real event. Message injects are instructions to controllers to insert information and/or begin simulations, actions, and contingency messages. Contingency messages are injects that are used when expected response actions do not occu.They redirect play so exercise goals can be met.

Master Scenario Events List (MSEL) A chronological list of all exercise events and designated scenario times, including the event synopsis, expected response, and exercise objective (where applicable). Events from the MSEL are called “moves” and are “injected” sequentially into exercise play by controllers to generate or prompt player actions to ensure that all objectives are met.

Move A discrete “event” within the exercise scenario (e.g., an emergency generator breaks down during the response).

Observers Invited guests who have no official role in the conduct of a tabletop, drill, or full-scale exercise, although they may be asked to submit their observations.

Participants All the people involved in carrying out the exercise. Includes actors, controllers, data collec- tors/evaluators, facilitators, and players. Does not include observers.

Player An individual or member of the response organization (LPHA personnel) who is playing a defined functional role during an exercise under the incident command system (ICS)/National Incident Management System (NIMS) model.

Scope and Extent of Play Establishes the parameters within which the exercise activity will be conducted; defines the duration, players’ involvement, level of detail and simulation, and extent of mobilization; informs whether exercise time and date will be announced or unannounced.

Simulation/Simulation Cell An umbrella term that refers to artificially produced conditions that replicate real-life emer- gencies.The cell is responsible for artificially duplicating or role playing response activities.

Time Keeper/Recorder Notes critical events and times during exercise.

33

Appendix D:

The Suite of 15 National Planning Scenarios This suite of scenarios for use in national, federal, state, and local exercise activities is available from the federal Homeland Security Exercise and Evaluation Program (HSEEP) program. These scenarios represent a range of potential natural disasters or deliberately caused events and are expected to be the basis of the National Exercise Program. Use of these scenarios can facilitate cross-agency collaboration or evaluation.

Each of these scenarios follows the same general outline.

34

a. General description

• Detailed scenario depicting various types of intentional events (e.g., biological, chemical, radiological, and other types of attacks) and natural disasters (e.g., hurri- cane, earthquake, etc.)

b. Planning considerations

• Geographical considerations/description

• Timeline/events dynamics

• Meteorological conditions (when applicable)

• Assumptions

• Mission areas activated

c. Implications

• Secondary hazards/events

• Fatalities/injuries

• Property damage

• Service disruption

• Economic impact

• Long-term health issues

1. Scenario Overview

a. Prevention/deterrence

b. Infrastructure protection

c. Preparedness

d. Emergency assessment/diagnosis

e. Emergency management/response

f. Hazard mitigation

g. Evacuation/shelter

h. Victim care

i. Investigation/apprehension

j. Recovery/remediation

2. Mission Areas

Scenario 1: Nuclear Detonation

Scenario 2: Biological Attack–Aerosol Anthrax

Scenario 3: Biological Disease Outbreak– Pandemic Influenza

Scenario 4: Biological Attack–Plague

Scenario 5: Chemical Attack–Blister Agent

Scenario 6: Chemical Attack–Toxic Industrial Chemicals

Scenario 7: Chemical Attack–Nerve Agent

Scenario 8: Chemical Attack–Chlorine Tank Explosion

Scenario 9: Natural Disaster–Major Earthquake

Scenario 10: Natural Disaster–Major Hurricane

Scenario 11: Radiological Attack– Radiological Dispersal Devices

Scenario 12: Explosives Attack–Bombing Using Improvised Explosive Devices

Scenario 13: Biological Attack–Food Contamination

Scenario 14: Biological Attack–Foreign Animal Disease (Foot and Mouth Disease)

Scenario 15: Cyber Attack

The Suite of 15 National Planning Scenarios

35

Appendix E:

1. Planning Checklist—Full-scale Exercise with Example of Use

2. Planning Checklist—Tabletop Exercise with Example of Use

3. Planning Template—Tabletop Exercise with Example of Use

4. Assignment and Location Form with Example of Use

5. Job Action Sheet (JAS) with Example of Use

36

Appendix E:

1. Exercise Planning Checklist—Full-scale Exercise

Purpose A list of items or tasks that must be addressed during the planning phase

How to use Fill in dates, names, and materials to be used for your specific exercise. Planning timeframe is dependent on the scale of exercise.

Sample Planning Checklist— Full-scale Exercise

1. PLANNING TEAM

Exercise Development Start Date End Date Assigned Staff Status Steps

Identify need for exercise

Determine structure of planning team

Develop work plan and schedule

Develop exercise evaluation plan

Develop public information plan

2. EXERCISE DESIGN

Identify overarching goals

Establish purpose

Establish scope and scale

Define extent of play

Develop objectives

Determine exercise type (format, e.g.,TTX, FSE, etc.)

Develop exercise scenario narrative summary

Develop concept of operations

Define exercise assumptions, artificialities

Develop security plan (exercise safety)

Develop exercise timeline, master scenario events list, injects, and simulations

Finalize scenario

Define resource requirements and logistics plan

Lydia Cook, John Gilbert, Odalis Diaz, Marion Bell, Ken Gricell

2/01/06

2/01/06

2/01/06

2/03/06

2/03/06

2/14/06

2/14/06

2/03/06

2/10/06

2/10/06

2/21/06

2/21/06

L. Cook complete

complete

complete

complete

complete

complete

J. Gilbert

O. Diaz

M. Bell

K. Gricell

Cook, Gilbert

Cook, Gilbert

Cook, Gilbert

Diaz

Diaz

Bell

Gricell

Cook, Gilbert, Diaz

Planning Checklist—Full-scale Exercise

1. PLANNING TEAM

Exercise Development Start Date End Date Assigned Staff Status Steps

Identify need for exercise

Determine structure of planning team

Develop work plan and schedule

Develop exercise evaluation plan

Develop public information plan

2. EXERCISE DESIGN

Identify overarching goals

Establish purpose

Establish scope and scale

Define extent of play

Develop objectives

Determine exercise type (format, e.g.,TTX, FSE, etc.)

Develop exercise scenario narrative summary

Develop concept of operations

Define exercise assumptions, artificialities

Develop security plan (exercise safety)

Develop exercise timeline, master scenario events list, injects, and simulations

Finalize scenario

Define resource requirements and logistics plan

Exercise Development Start Date End Date Assigned Staff Status Steps

Develop briefing materials (exercise handbooks and forms):

Controller/facilitator

Evaluator/data collector

Note taker/scribe

Player

Observer guidelines

Exercise roster

3. CONDUCT THE EXERCISE

Conduct senior management pre-exercise briefings

Conduct controller/facilitator, data collector/evaluator, observer, player training

Conduct data collector/ evaluator, observer, player pre-exercise briefing

Conduct exercise

4. EVALUATE THE EXERCISE

Conduct participant hot wash

Conduct controller, data collector/evaluator critique

Collect exercise observation/ data collection forms (notes)

Develop initial after action report (AAR)

Coordinate and evaluate findings

Conduct senior management post-exercise briefing

Prepare final AAR

5. POST EXERCISE

Develop improvement plan

Track corrective actions

Share lessons learned

Planning Checklist—Full-scale Exercise (cont’d)

39

Appendix E:

2. Exercise Planning Checklist—Tabletop Exercise

Purpose A list of items or tasks that must be addressed during the planning phase

How to use Fill in dates, names, and materials to be used for your specific exercise. “X” indicates steps needed for tabletop exercise.

Sample Planning Checklist—Tabletop Exercise

1. PLANNING TEAM

Exercise Development Start Date End Date Assigned Staff Status Steps

Identify need for exercise

Determine structure of planning team

Develop work plan and schedule

Develop exercise evaluation plan

Develop public information plan

2. EXERCISE DESIGN

Identify overarching goals

Establish purpose

Establish scope and scale

Define extent of play

Develop objectives

Determine exercise type (format, e.g.,TTX, FSE, etc.)

Develop exercise scenario narrative summary

Develop concept of operations

Define exercise assumptions, artificialities

Develop security plan (exercise safety)

Develop exercise timeline, master scenario events list, injects, and simulations

Finalize scenario

Define resource requirements and logistics plan

FILL IN NAMES

2/01/06

2/01/06

n/a

n/a

n/a

2/16/06

2/03/06

2/03/06

2/10/06

Add Names complete

complete

complete

complete

complete

Sample Planning Checklist— Tabletop Exercise (cont’d)

40

Exercise Development Start Date End Date Assigned Staff Status Steps

Develop briefing materials (exercise handbooks and forms):

Controller/facilitator

Evaluator/data collector

Note taker/scribe

Player

Observer guidelines

Exercise roster

3. CONDUCT THE EXERCISE

Conduct senior management pre-exercise briefings

Conduct controller/facilitator, data collector/evaluator, observer, player training

Conduct data collector/ evaluator, observer, player pre-exercise briefing

Conduct exercise

4. EVALUATE THE EXERCISE

Conduct participant hot wash

Conduct controller, data collector/evaluator critique

Collect exercise observation/ data collection forms (notes)

Develop initial after action report (AAR)

Coordinate and evaluate findings

Conduct senior management post-exercise briefing

Prepare final AAR

5. POST EXERCISE

Develop improvement plan

Track corrective actions

Share lessons learned

X

X

X

X

X

X

X

X

X

X

X

X

X

X

Planning Checklist—Tabletop Exercise

1. PLANNING TEAM

Exercise Development Start Date End Date Assigned Staff Status Steps

Identify need for exercise

Determine structure of planning team

Develop work plan and schedule

Develop exercise evaluation plan

Develop public information plan

2. EXERCISE DESIGN

Identify overarching goals

Establish purpose

Establish scope and scale

Define extent of play

Develop objectives

Determine exercise type (format, e.g.,TTX, FSE, etc.)

Develop exercise scenario narrative summary

Develop concept of operations

Define exercise assumptions, artificialities

Develop security plan (exercise safety)

Develop exercise timeline, master scenario events list, injects, and simulations

Finalize scenario

Define resource requirements and logistics plan

Exercise Development Start Date End Date Assigned Staff Status Steps

Develop briefing materials (exercise handbooks and forms):

Controller/facilitator

Evaluator/data collector

Note taker/scribe

Player

Observer guidelines

Exercise roster

3. CONDUCT THE EXERCISE

Conduct senior management pre-exercise briefings

Conduct controller/facilitator, data collector/evaluator, observer, player training

Conduct data collector/ evaluator, observer, player pre-exercise briefing

Conduct exercise

4. EVALUATE THE EXERCISE

Conduct participant hot wash

Conduct controller, data collector/evaluator critique

Collect exercise observation/ data collection forms (notes)

Develop initial after action report (AAR)

Coordinate and evaluate findings

Conduct senior management post-exercise briefing

Prepare final AAR

5. POST EXERCISE

Develop improvement plan

Track corrective actions

Share lessons learned

Planning Checklist—Full-scale Exercise (cont’d)

43

Appendix E:

3. Planning Template—Tabletop Exercise

Purpose This preset format is used to guide the planning process.

How to use Fill in dates, names, and materials as required for your specific exercise.

Sample Planning Template—Tabletop Exercise

Tabletop Exercise

Date Scheduled: Initiation Time: Duration of Exercise:

Facilitator: Site:

Purpose:

Scope:

Objectives:

Players:

Narrative:

Scenario Development (Move I)

Exercise Anytown Flood

November 10, 20xx

John Smithe

The purpose of this exercise is to give the participants an opportunity to evaluate their current emergency response plans and capabilities for responding to a flood in Anytown. This exercise will focus on key local public health emergency responder coordination, critical decisions, and the integration of other response sectors necessary to protect the public’s health and save lives following a [type of disaster/emergency] event.

The scope of this exercise will focus on Anytown Health Department’s role in response to the potential consequences of a flood emergency. More important than minute details are processes and decision making. The emphasis should be on coordina- tion, integration, problem identification, and problem resolution.

On Monday afternoon, after two weeks of rainy weather, Anytown’s rivers are at high levels. Weather forecasters are indicating that a strong storm front is rapidly approaching the region. Heavy rains are predicted to start by Tuesday early morning…. Write opening narrative for scenario here.

By 11 AM on Tuesday, the Anytown river begins to overflow its banks…. The scenario and the chronological events continue here.

Participants will demonstrate the ability to: 1. Identify priorities and responsibilities 2. Reorder priorities based on new information 3. Develop priorities in response to unexpected events

Health Officer, Public Health Nurse, Epidemiologist

3rd floor Conference Room

10 AM 4 hours

Sample Planning Template— Tabletop Exercise (cont’d)

44

Tabletop Exercise

Problem Statements:

Scenario Development (Move II)

Problem Statements:

Scenario Development (Move III)

Problem Statements:

These are questions that the facilitator can verbally present which are then discussed, one at a time, by the group. Or written detailed events (messages) and related discussion questions can be given to individuals to answer from the perspective of their own organization and role, and then discussed in the group. (example)

A. Public health nursing What are your priorities and responsibilities? What are the time constraints you face?

B. Health Officer As Incident Commander, what are your priorities and responsibilities?

At 12 noon on Tuesday, floodwaters reach the Anytown waste treatment facility…. The scenario and the chronological events continue here.

Health Officer How will you adjust your priorities based on this new information?

By Tuesday morning, shelters are operating in two regional high schools. However, at around 1 PM, rapidly rising floodwaters overtake a bus headed for a shelter, filled with patients from the Anytown Rehabilitation Centre. Before rescuers can reach the bus, several elderly and immunocompromised evacuees are exposed to contaminated floodwater…. The scenario and chronological events continue here.

Epidemiologist What are your priorities in response to this exposure?

Planning Template—Tabletop Exercise

Tabletop Exercise

Date Scheduled: Initiation Time: Duration of Exercise:

Facilitator: Site:

Purpose:

Scope:

Objectives:

Players:

Narrative:

Scenario Development (Move I)

Tabletop Exercise

Problem Statements:

Scenario Development (Move II)

Problem Statements:

Scenario Development (Move III)

Problem Statements:

Planning Template—Tabletop Exercise (cont’d)

Appendix E:

4. Assignment and Location List

Purpose Used to develop an assignment list and locations for exercise participants—that is, role players, controllers, and evaluators.

How to use During the exercise planning phase, fill in as illustrated. Use as a reference for conducting the exercise.

Sample Assignment and Location Form

47

Location Name

Response Site

Assignment Contact and Phone

POD Site EOC

Anytown HS

EOC/HS

Anytown HS

Controller

POD Manager

Transport

Greeter

POD Registration Section Chief

POD Evaluation Section Chief

POD Distribution Section Chief

Elaine Morrow Cell 5-6786

Doug Weiss Nextel 5-7845

Rodolfo Delano Nextel 5-3423

Norma Markson Contact through POD

manager

Assignment and Location Form

Location Name

Response Site

Assignment Contact and Phone

Appendix E:

5. Job Action Sheet

Purpose A written statement listing the elements of a particular functional role in the exercise. Include this form in exercise manuals for role players.

How to use Job action sheets are developed for the various functional roles played in an exercise. They list the elements of a particular job or occupation (e.g., purpose, duties, equipment used, qualifications, training, physical and mental demands, working conditions).

Sample Job Action Sheet

49

Job Action Sheet

Role:

You Report to:

Qualifications:

Mission:

Location Assigned:

Immediate Actions:

Task Completed Time

POD Site Manager

Edwin Lewis, County Administrator

General knowledge of ICS and community resources

Provide overall site command for POD location. Assure communication is maintained with the County Administrator, Anytown Situation Room, and local EOC.

Anytown High School Auditorium

Report to Edwin Lewis Clarify role and functions

Review Job Action Sheet. 8:25 AM Meet with command staff officers to review plans and activities. 8:30 Meet with chiefs from each of the four sections to review plans and activities. 9:00 Communicate with safety officer and section chiefs on an ongoing basis. Schedule

every 2 hours

Job Action Sheet

Role:

You Report to:

Qualifications:

Mission:

Location Assigned:

Immediate Actions:

Task Completed Time

Appendix F:

Data Collection/Evaluation Forms with Examples of Their Use

1. Data Collector Observation Log

2. Role Evaluation Checklist with Example for Role of Clinic Manager (Flu Scenario)

3. Station-Specific Throughput Timesheet

4. Actor-Specific Throughput Timesheet

5. Participant Feedback Form

6. Hot Wash/Debriefing

7. After Action Report

8. Tracking Improvement Checklist

51

Appendix F:

Data Collection and Evaluation Forms

Purpose These sample forms can be used to collect the data required to evaluate the exercise and to create an improvement plan.

How to Use These Forms

52

Used to collect the observations in the field during the exercise. Player action is observed. The data collector determines if the criteria selected by the planning team were met or not met, not observed, or not applicable during their observation. Observation meth- ods are Look, Listen, and Ask (but do not interfere with operations being conducted during the exercise). Data collectors record when, where, and what is happening.

Step 1. Data collector fills out his/her name and contact information (important if he/she must be contacted for clarifica- tion).The planning team should complete both the location/site (where the data collector is assigned) and LPHA contact information in advance.

Step 2. Data collector fills out the date of the exercise, the time he/she started observing, and the time he/she stopped observing.

Step 3.The list of criteria and expected actions is periodically reviewed and checked as completed, met, not met, not observed, or not applicable.

Step 4.The last page of the evaluation form is used for comments or to docu- ment specific observations about prob- lems encountered by the exercise partici- pants and suggestions or solutions for improvement.

1. Data Collector Observation Log

Intended for use at a Mass Care or POD Exercise.The sheet is carried by each patient actor to note the time of arrival and depar- ture as they travel from station to station in the mass care facility or POD. It documents

the time required for a “patient” to travel through the site, if he/she was directed prop- erly, and helps to gauge site capacity.

4. Actor-Specific Throughput Timesheet

For use at a Mass Care or Point of Distribution (POD) Exercise.The sheet is utilized at each station to note the time of arrival and departure from that particular

station. It helps to determine if there are problems related to moving patients through the established mass care facility or POD.

3. Station-Specific Throughput Timesheet

Used by the data collector or evaluator to doc- ument their observations during the exercise.

2. Role Evaluation Checklist

53

Used after the exercise to capture the results from players and participants to improve future exercises.The hot wash is conducted by a facilitator and guided by discussion

points.The proceedings are documented by a note-taker or recorded, then analyzed by the exercise team.

6. Hot Wash/Debriefing

Used to gather specific feedback from exercise participants.This feedback data is analyzed for

improving future exercises.

5. Participant Feedback Form

Used to document the outcome of an exer- cise.This is the responsibility of the exercise team (or consultant if one is used).This is a

standard format for organizing evaluation data that has been collected and analyzed.

7. After Action Report

Catalogues items or tasks to be considered for improving the emergency preparedness

plan based on the After Action Report.

8. Tracking Improvement Checklist

Appendix F:

1. Data Collector Observation Log

Sample Data Collector Observation Log

54

Data Collector Observation Log

Date: Location:

Name: Assignment:

Time Event Description/Assessment

EOC

Renata F.

8:00 AM Phone call received from Hospital A of unusual death from flu-like symptoms. Call received by (name/role of staff member).

8:15 AM Health director/officer makes decision to activate the departmental EOC.

8:20 AM Departmental IC notifies state department of health.

Command

Data Collector Observation Log

Date: Location:

Name: Assignment:

Time Event Description/Assessment

56

Appendix F:

2. Role Evaluation Checklist

Sample Role Evaluation Checklist

Role Evaluation Checklist

Role Being Evaluated:

Incident:

Outcome: Location:

Response Element: Jurisdiction:

Evaluator: LPHA Contact:

Date of Exercise: Start Time: End Time:

Part I. For each criterion, check the appropriate column and add comments as appropriate.

LPHA Criteria Met Not Not N/A Comments/ Met Observed Recommendations

Clinic Manager (Exercise Scenario-FLU)

Mass prophylaxis point of distribution (POD)

Protection

PH staff and volunteers Anytown Municipal District

John Smith

4/14/06

1. Generic mass-dispensing strategy adapted to specific event within 60 minutes of notification.

X Exceeded limit within “exercise time frame”

2. Dispensing site(s) staffed with ade- quate and appropriate personnel for mass dispensing (including volunteer surge staff) prior to site opening time.

X

3. Just-in-time training (including use of PPE) identified and requested at least 2 hours prior to site opening.

X Took more than time allotted

4. System in place to restock sup- plies throughout duration of site activation.

X Restocking delayed due to transport not able to get through

5. System in place to rotate or relieve staff throughout duration of site activation.

X

6. All required record-keeping sup- plies prepared and delivered to site coordinator prior to site opening.

X

8:00 AM 4:00 PM

Site Commander

Anytown High School

Sample Role Evaluation Checklist (cont’d)

57

Role Evaluation Checklist

Job Action Sheet (JAS) Criteria:

Part II. Job Action Evaluation

Mission: Met Not Not N/A Comments/ Met Observed Recommendations

Clinic Manager (Flu Scenario)

Oversee all POD functions.

1. Read entire JAS. X

2. Obtained briefing from mass care unit leader.

X

3. Obtained list of assigned staff and site location.

X Noted and recorded

4. Ensured that all assigned staff were present at work site.

X All staff were in atten- dance.

5. Briefed all POD staff on the cur- rent situation; communicated the Incident Action Plan (IAP).

X

6. Assigned JAS and tasks to the POD staff.

X

7. Ensured that all necessary paper- work and supplies were in place at work site in advance.

X

8. Received and forwarded all requests for additional personnel, equipment, supplies, and trans- portation.

X

9. Continually reassessed work flow and patient flow.

X

58

Sample Role Evaluation Checklist (cont’d) Role Evaluation Checklist

Job Action Sheet (JAS) Criteria:

Part II. Job Action Evaluation

Mission: Met Not Not N/A Comments/ Met Observed Recommendations

Clinic Manager (Flu Scenario)

Oversee all POD functions.

10. Ensured that time and attendance were communicated to mass care unit leader using appropriate forms.

X

11. Maintained written log of all activities and communications.

X Fell behind in this

12. Briefed the assistant clinic man- agers—clinical services and logistics —on POD issues on a periodic basis.

X

13. Ensured that issues of concern were related to mass care unit leader ASAP.

X

14. Monitored staff for signs of stress and fatigue.

X

15. Monitored supplies. X Resulted in failure of supply chain

16. Prepared end-of-shift report for mass care director and incoming clinic manager.

X

17. Planned for the possibility of extended deployment.

X

59

Sample Role Evaluation Checklist (cont’d) Role Evaluation Checklist

Part III. Please provide additional comments here, including problems identified:

There was insufficient information coming to the clinic manager from operations staff. The EOC was slow to help in contacting operations staff.

Role Evaluation Checklist

Role Being Evaluated:

Incident:

Outcome: Location:

Response Element: Jurisdiction:

Evaluator: LPHA Contact:

Date of Exercise: Start Time: End Time:

PART I. For each criterion, check the appropriate column and add comments as appropriate.

LPHA Criteria Met Not Not N/A Comments/ Met Observed Recommendations

Role Evaluation Checklist (cont’d)

Job Action Sheet (JAS) Criteria:

PART II. Job Action Evaluation

Mission: Met Not Not N/A Comments/ Met Observed Recommendations

Role Evaluation Checklist (cont’d)

PART III. Please provide additional comments here, including problems identified:

3. Station-Specific Throughput Timesheet

Station ID: Date:

Actor ID Time In Time Out Comments

4. Actor-Specific Throughput Timesheet

Actor ID: Date:

Station ID Time Time Evaluator Comments In Out Initials

5. Participant Feedback Name of Exercise:

Participant Name:

Agency:

Role: ❑ Player ❑ Observer ❑ Facilitator Date:

Part I. Recommendations and Action Steps

1. Based on today’s exercise and tasks identified, list important issues and/or areas for improvement.

2. Identify the steps needed to address the identified issues. For each one, rate it is a high, medium, or low priority.

3.What action steps should be taken in your area of responsibility?

4.What policies, plans, and procedures should be reviewed, revised, or developed? List in order and indicate the priority level for each.

Participant Feedback (cont’d)

Part II. Design and Conduct of Exercise

1. Please rate the following on a scale of 1 to 5, with 1 indicating strong disagreement with the statement and 5 indicating strong agreement.

Assessments

The exercise was well organized and structured. 1 2 3 4 5

The exercise scenario was realistic. 1 2 3 4 5

The briefing and/or presentation helped me understand and become engaged in the scenario. 1 2 3 4 5

The facilitator(s)/controller(s) was knowledgeable about the material and kept the exercise on target. 1 2 3 4 5

The exercise handbook used during the exercise was a valuable tool throughout the exercise. 1 2 3 4 5

Participation in the exercise was appropriate for my role. 1 2 3 4 5

The level and mix of disciplines and participants included the right people for this exercise. 1 2 3 4 5

2. How would you improve this exercise? What changes would you make?

Hot Wash/Debriefing Format OVERVIEW

• Date/Location:

• Hot Wash:

DISCUSSION POINTS

1. Expectations:

2. After Action Items:

3. Exercise Design:

4. Other:

67

[Jurisdiction] hosted a [Type of Exercise] on [Date]. Attendees included representatives from: [List Attendees].

After the exercise’s conclusion, exercise planners met briefly to discuss the exercise conduct and planning process. Discussion primarily focused on three aspects: expectations, after-action items, and the planning process.

Planning group members emphasized the following issues as critical to the After Action Report/Improvement Plan’s success:

Exercise planners noted the following about the exercise planning process:

The planning group also noted the following:

Appendix F:

6. Hot Wash/Debriefing

Sample Hot Wash/Debriefing Format

68

Appendix F:

7. After Action Report

Sample After Action Report Format

After Action Report Format

1. Executive Summary:

2. Exercise Overview: (who participated, including departments, agencies, jurisdictions; dates of play; location, etc.)

3. Exercise Goals and Objectives:

4. Synopsis of the Events:

5. Analysis of Outcomes:

6. Analysis of Critical Task Performance:

7. Conclusion (including Improvement Plan):

69

Appendix F:

8. Tracking Improvement Checklist

Sample Tracking Improvement Checklist

1. PLANNING TEAM:

ITEMS FOR ACTION CORRECTIVE ACTIONS

P = Primary Responsibility S = Secondary/Support O = Oversight C = Coordination Role

C O

M M

A N

D

O P

E R

A T

IO N

S

L O

G IS

T IC

S

P L

A N

N IN

G

F IN

A N

C E

/ A

D M

IN

Improve communication with EOC

P O Steps taken to purchase new cell phones

Improve POD plan layout

O P C Medical evaluation section will be moved to improve flow

Improve methods for maintaining chain of evidence

C P Training scheduled for 4/1/06

Improve mechanism of delivery of supplies

S C P Revise contracts with delivery vendors

Improve site selection P O Meet with community members for selection of future sites

Tracking Improvement Checklist

1. PLANNING TEAM:

ITEMS FOR ACTION CORRECTIVE ACTIONS

P = Primary Responsibility S = Secondary/Support O = Oversight C = Coordination Role

C O

M M

A N

D

O P

E R

A T

IO N

S

L O

G IS

T IC

S

P L

A N

N IN

G

F IN

A N

C E

/ A

D M

IN

Appendix G:

Exercise Playbook and Scenario

1. Sample Scenario

2. Sample Full-scale Exercise Playbook

3. Tabletop Exercise Suggested Schedule

4. Tabletop Exercise Sample Facilitator Guidance/Questions/Problem Statements

71

Appendix G:

1. Sample Scenario

At [Hospital name]’s emergency department, a doctor sees his first patient, a 22-year-old male student.The patient’s father states he has been complaining of weakness and chills and devel- oped a temperature of 105 F.The father adds that during the past two days, the patient has experienced increased difficulty breathing and has a past medical history of severe asthma. Nothing in the patient’s recent history accounts for this sudden illness.The father thinks he may have caught a “bug” from one of his friends.The patient is admitted, but is unresponsive to medications.

The male student admitted to the hospital earlier in the day develops severe respiratory com- plications and dies just after [time of day]. Hospital officials notify the medical examiner’s office. An autopsy is scheduled to determine the cause of his death.

Due to the rapidly increasing number of patients presenting with unusual symptoms, some of whom have died, notifications of such have taken place within the emergency response, med- ical, and public health communities.

Many of the patients do not seem to respond to decongestants, analgesics, antibiotics, or antiviral medication therapy.The lack of response to the initial treatment regimens and grow- ing number of patients prompt physicians to seek advice and consultation from the public health department.The local health department alerts the state department of health.

By late [time], approximately [number] patients have reported to area hospitals and clinics with this severe, flu-like syndrome.The most severe cases have been hospitalized; however, there are many more waiting in emergency rooms. Some hospitals have gone on diversion sta- tus. Some patients have died since admission. As a result, the medical examiner’s office has been called in to perform a growing number of autopsies.

A story reporting the increase in flu-like illnesses and related deaths appears in the local news. Public health department officials and their public information officers (PIOs) begin meeting to develop their public information strategy.

72

Appendix G:

2. Sample Full-scale Exercise Playbook

Sample components have been included.These will vary by the role of the player or participant.

Name

Date

Site of Exercise

Player (e.g., POD Site Manager) or Participant (e.g., Data Collector)

Purpose The purpose of this exercise is to give the participants an opportunity to evaluate their cur- rent emergency response plans and capabilities for responding to a [type] event in the [your health department/community’s name].This exercise will focus on key local public health agency emergency response coordination, critical decisions, and the integration of other response sectors as necessary to protect the public’s health and save lives following a [type of disaster/emergency event].

Scope The scope of this exercise will focus on [your agency’s name] role in response to the potential consequences of a [type of disaster/emergency event]. More important than minute details are processes and decision making.The emphasis should be on coordination, integration, problem identification, and problem resolution.

Objectives The exercise will focus on the following objectives:

• Increase bioterrorism awareness

• Assess level of emergency preparedness in the health department and its ability to respond during a public health emergency

• Identify triggers for activating the incident command system (ICS)

• Evaluate effectiveness of ICS policies, procedures, and staff roles

• Update and revise the emergency management plan from lessons learned during the full-scale exercise.

Roles and Responsibilities Players respond to the situation presented based on expert knowledge of response procedures and current plans and procedures in place in their agency or their community.

Observers support the exercise and its planning team by offering insight; however, they do not participate in the exercise.

Data Collectors/Evaluators are involved in drills and exercises as well as TTX.They are responsible for observing player action and evaluating effectiveness based on defined objectives and evaluation criteria.They may or may not be from within the LPHA, depending on the size and scale of the exercise.They usually evaluate an area consistent with their expertise and will record and note the actions of the players.

73

Assumptions Assumptions and artificialities may be necessary to complete play in the time allotted. During this exercise, the following apply:

• The scenario is plausible, and events occur as they are presented.

• Everyone receives information at the same time.

• Local exercise players will concentrate on the local response, assuming that federal and state responders have their own plans, procedures, and protocols in place and operating.

Simulations and Artificialities Fill in the mechanisms used to artificially simulate events, activities, or actions within the sce- nario to allow for further exercise response.

Rules of Conduct and Safety Information This should include vitally important information that provides for the safe conduct and pro- tection of all persons involved in the exercise. Include mechanisms for initiating and discon- tinuing the exercise. Also include the mechanism for responding to actual emergencies or accidents should they occur during the implementation of an exercise. In addition, it should include the following information for exercise players:

• Respond based on your own knowledge and training of your LPHA’s current plans and capabilities; use only existing assets.

• Make decisions based on the circumstances presented.

• Assume the cooperation and support of other exercise players/responders and agencies.

• The written material (including simulations or injects provided by the controller) should serve as the basis for discussion.

74

Appendix G:

3. Tabletop Exercise

Suggested Schedule 1

[Time] Welcome and introduction

[Time] Player and participant briefings [Time] Exercise begins

[Time] Lunch

[Time] Exercise ends. Submit any exercise materials to [specify name]

[Time] Hot wash begins—report to: [site] [Time] Closing comments

Suggested Schedule 2

[Time] Welcome and introduction

[Time] Module I Situation briefing Facilitated discussion

[Time] Module II Initial response Situation update Breakout groups

[Time] Lunch

[Time] Module III Response and recovery Situation update Breakout groups Facilitated discussion

[Time] Review and conclusion [Time] Closing comments

75

Appendix G:

4. Tabletop Exercise

Sample Facilitator Guidance/Questions/Problem Statements

1. If the number of cases escalates, what actions will be taken to manage the increase in cases, given a scenario in which the scale of the public health emergency has not yet been defined?

2. What epidemiological and environmental expertise is needed to identify and contain the source of this public health emergency? Where and from whom would you seek assistance? Who will coordinate information?

3. When would clinical or environmental samples be collected? When would you expect to have the results back and how would you track them?

4. Are the area laboratories adequate to identify suspected biological agents? If not, where would you seek assistance? Who will coordinate this information?

5. Have you anticipated the kind of inquiries expected from the public and the media?

6. Identify your agency’s established method of health surveillance.What other agencies will be involved in this effort?

7. Are there provisions for collecting data on new cases from private practice physicians and community health care agencies? How will this information be shared with the medical community?

76

<< /ASCII85EncodePages false /AllowTransparency false /AutoPositionEPSFiles true /AutoRotatePages /All /Binding /Left /CalGrayProfile (Dot Gain 20%) /CalRGBProfile (sRGB IEC61966-2.1) /CalCMYKProfile (U.S. Web Coated \050SWOP\051 v2) /sRGBProfile (sRGB IEC61966-2.1) /CannotEmbedFontPolicy /Warning /CompatibilityLevel 1.4 /CompressObjects /Tags /CompressPages true /ConvertImagesToIndexed true /PassThroughJPEGImages true /CreateJDFFile false /CreateJobTicket false /DefaultRenderingIntent /Default /DetectBlends true /ColorConversionStrategy /LeaveColorUnchanged /DoThumbnails false /EmbedAllFonts true /EmbedJobOptions true /DSCReportingLevel 0 /SyntheticBoldness 1.00 /EmitDSCWarnings false /EndPage -1 /ImageMemory 1048576 /LockDistillerParams false /MaxSubsetPct 100 /Optimize true /OPM 1 /ParseDSCComments true /ParseDSCCommentsForDocInfo true /PreserveCopyPage true /PreserveEPSInfo true /PreserveHalftoneInfo false /PreserveOPIComments false /PreserveOverprintSettings true /StartPage 1 /SubsetFonts true /TransferFunctionInfo /Apply /UCRandBGInfo /Preserve /UsePrologue false /ColorSettingsFile (None) /AlwaysEmbed [ true ] /NeverEmbed [ true ] /AntiAliasColorImages false /DownsampleColorImages true /ColorImageDownsampleType /Bicubic /ColorImageResolution 200 /ColorImageDepth -1 /ColorImageDownsampleThreshold 1.50000 /EncodeColorImages true /ColorImageFilter /DCTEncode /AutoFilterColorImages true /ColorImageAutoFilterStrategy /JPEG /ColorACSImageDict << /QFactor 0.15 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /ColorImageDict << /QFactor 0.15 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /JPEG2000ColorACSImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /JPEG2000ColorImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /AntiAliasGrayImages false /DownsampleGrayImages true /GrayImageDownsampleType /Bicubic /GrayImageResolution 200 /GrayImageDepth -1 /GrayImageDownsampleThreshold 1.50000 /EncodeGrayImages true /GrayImageFilter /DCTEncode /AutoFilterGrayImages true /GrayImageAutoFilterStrategy /JPEG /GrayACSImageDict << /QFactor 0.15 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /GrayImageDict << /QFactor 0.15 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /JPEG2000GrayACSImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /JPEG2000GrayImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /AntiAliasMonoImages false /DownsampleMonoImages true /MonoImageDownsampleType /Bicubic /MonoImageResolution 800 /MonoImageDepth -1 /MonoImageDownsampleThreshold 1.50000 /EncodeMonoImages true /MonoImageFilter /CCITTFaxEncode /MonoImageDict << /K -1 >> /AllowPSXObjects false /PDFX1aCheck false /PDFX3Check false /PDFXCompliantPDFOnly false /PDFXNoTrimBoxError true /PDFXTrimBoxToMediaBoxOffset [ 0.00000 0.00000 0.00000 0.00000 ] /PDFXSetBleedBoxToMediaBox true /PDFXBleedBoxToTrimBoxOffset [ 0.00000 0.00000 0.00000 0.00000 ] /PDFXOutputIntentProfile () /PDFXOutputCondition () /PDFXRegistryName (http://www.color.org) /PDFXTrapped /Unknown /Description << /FRA <FEFF004f007000740069006f006e00730020007000650072006d0065007400740061006e007400200064006500200063007200e900650072002000640065007300200064006f00630075006d0065006e00740073002000500044004600200064006f007400e900730020006400270075006e00650020007200e90073006f006c007500740069006f006e002000e9006c0065007600e9006500200070006f0075007200200075006e00650020007100750061006c0069007400e90020006400270069006d007000720065007300730069006f006e00200061006d00e9006c0069006f007200e90065002e00200049006c002000650073007400200070006f0073007300690062006c0065002000640027006f00750076007200690072002000630065007300200064006f00630075006d0065006e007400730020005000440046002000640061006e00730020004100630072006f0062006100740020006500740020005200650061006400650072002c002000760065007200730069006f006e002000200035002e00300020006f007500200075006c007400e9007200690065007500720065002e> /JPN <FEFF3053306e8a2d5b9a306f30019ad889e350cf5ea6753b50cf3092542b308000200050004400460020658766f830924f5c62103059308b3068304d306b4f7f75283057307e30593002537052376642306e753b8cea3092670059279650306b4fdd306430533068304c3067304d307e305930023053306e8a2d5b9a30674f5c62103057305f00200050004400460020658766f8306f0020004100630072006f0062006100740020304a30883073002000520065006100640065007200200035002e003000204ee5964d30678868793a3067304d307e30593002> /DEU <FEFF00560065007200770065006e00640065006e0020005300690065002000640069006500730065002000450069006e007300740065006c006c0075006e00670065006e0020007a0075006d002000450072007300740065006c006c0065006e00200076006f006e0020005000440046002d0044006f006b0075006d0065006e00740065006e0020006d00690074002000650069006e006500720020006800f60068006500720065006e002000420069006c0064006100750066006c00f600730075006e0067002c00200075006d002000650069006e0065002000760065007200620065007300730065007200740065002000420069006c0064007100750061006c0069007400e400740020007a0075002000650072007a00690065006c0065006e002e00200044006900650020005000440046002d0044006f006b0075006d0065006e007400650020006b00f6006e006e0065006e0020006d006900740020004100630072006f0062006100740020006f0064006500720020006d00690074002000640065006d002000520065006100640065007200200035002e003000200075006e00640020006800f600680065007200200067006500f600660066006e00650074002000770065007200640065006e002e> /PTB <FEFF005500740069006c0069007a006500200065007300740061007300200063006f006e00660069006700750072006100e700f5006500730020007000610072006100200063007200690061007200200064006f00630075006d0065006e0074006f0073002000500044004600200063006f006d00200075006d00610020007200650073006f006c007500e700e3006f00200064006500200069006d006100670065006d0020007300750070006500720069006f0072002000700061007200610020006f006200740065007200200075006d00610020007100750061006c0069006400610064006500200064006500200069006d0070007200650073007300e3006f0020006d0065006c0068006f0072002e0020004f007300200064006f00630075006d0065006e0074006f0073002000500044004600200070006f00640065006d0020007300650072002000610062006500720074006f007300200063006f006d0020006f0020004100630072006f006200610074002c002000520065006100640065007200200035002e0030002000650020007300750070006500720069006f0072002e> /DAN <FEFF004200720075006700200064006900730073006500200069006e0064007300740069006c006c0069006e006700650072002000740069006c0020006100740020006f0070007200650074007400650020005000440046002d0064006f006b0075006d0065006e0074006500720020006d006500640020006800f8006a006500720065002000620069006c006c00650064006f0070006c00f80073006e0069006e006700200066006f00720020006100740020006600e50020006200650064007200650020007500640073006b00720069006600740073006b00760061006c0069007400650074002e0020005000440046002d0064006f006b0075006d0065006e0074006500720020006b0061006e002000e50062006e006500730020006d006500640020004100630072006f0062006100740020006f0067002000520065006100640065007200200035002e00300020006f00670020006e0079006500720065002e> /NLD <FEFF004700650062007200750069006b002000640065007a006500200069006e007300740065006c006c0069006e00670065006e0020006f006d0020005000440046002d0064006f00630075006d0065006e00740065006e0020007400650020006d0061006b0065006e0020006d00650074002000650065006e00200068006f0067006500720065002000610066006200650065006c00640069006e00670073007200650073006f006c007500740069006500200076006f006f0072002000650065006e0020006200650074006500720065002000610066006400720075006b006b00770061006c00690074006500690074002e0020004400650020005000440046002d0064006f00630075006d0065006e00740065006e0020006b0075006e006e0065006e00200077006f007200640065006e002000670065006f00700065006e00640020006d006500740020004100630072006f00620061007400200065006e002000520065006100640065007200200035002e003000200065006e00200068006f006700650072002e> /ESP <FEFF0055007300650020006500730074006100730020006f007000630069006f006e006500730020007000610072006100200063007200650061007200200064006f00630075006d0065006e0074006f0073002000500044004600200063006f006e0020006d00610079006f00720020007200650073006f006c00750063006900f3006e00200064006500200069006d006100670065006e00200070006100720061002000610075006d0065006e0074006100720020006c0061002000630061006c006900640061006400200061006c00200069006d007000720069006d00690072002e0020004c006f007300200064006f00630075006d0065006e0074006f00730020005000440046002000730065002000700075006500640065006e00200061006200720069007200200063006f006e0020004100630072006f00620061007400200079002000520065006100640065007200200035002e003000200079002000760065007200730069006f006e0065007300200070006f00730074006500720069006f007200650073002e> /SUO <FEFF004e00e4006900640065006e002000610073006500740075007300740065006e0020006100760075006c006c006100200076006f0069006400610061006e0020006c0075006f006400610020005000440046002d0061007300690061006b00690072006a006f006a0061002c0020006a006f006900640065006e002000740075006c006f0073007400750073006c00610061007400750020006f006e0020006b006f0072006b006500610020006a00610020006b007500760061006e0020007400610072006b006b007500750073002000730075007500720069002e0020005000440046002d0061007300690061006b00690072006a0061007400200076006f0069006400610061006e0020006100760061007400610020004100630072006f006200610074002d0020006a00610020004100630072006f006200610074002000520065006100640065007200200035002e00300020002d006f0068006a0065006c006d0061006c006c0061002000740061006900200075007500640065006d006d0061006c006c0061002000760065007200730069006f006c006c0061002e> /ITA <FEFF00550073006100720065002000710075006500730074006500200069006d0070006f007300740061007a0069006f006e00690020007000650072002000630072006500610072006500200064006f00630075006d0065006e00740069002000500044004600200063006f006e00200075006e00610020007200690073006f006c0075007a0069006f006e00650020006d0061006700670069006f00720065002000700065007200200075006e00610020007100750061006c0069007400e00020006400690020007300740061006d007000610020006d00690067006c0069006f00720065002e0020004900200064006f00630075006d0065006e00740069002000500044004600200070006f00730073006f006e006f0020006500730073006500720065002000610070006500720074006900200063006f006e0020004100630072006f00620061007400200065002000520065006100640065007200200035002e003000200065002000760065007200730069006f006e006900200073007500630063006500730073006900760065002e> /NOR <FEFF004200720075006b00200064006900730073006500200069006e006e007300740069006c006c0069006e00670065006e0065002000740069006c002000e50020006f00700070007200650074007400650020005000440046002d0064006f006b0075006d0065006e0074006500720020006d006500640020006800f80079006500720065002000620069006c00640065006f00700070006c00f80073006e0069006e006700200066006f00720020006200650064007200650020007500740073006b00720069006600740073006b00760061006c0069007400650074002e0020005000440046002d0064006f006b0075006d0065006e00740065006e00650020006b0061006e002000e50070006e006500730020006d006500640020004100630072006f0062006100740020006f0067002000520065006100640065007200200035002e00300020006f0067002000730065006e006500720065002e> /SVE <FEFF0041006e007600e4006e00640020006400650020006800e4007200200069006e0073007400e4006c006c006e0069006e006700610072006e00610020006e00e40072002000640075002000760069006c006c00200073006b0061007000610020005000440046002d0064006f006b0075006d0065006e00740020006d006500640020006800f6006700720065002000620069006c0064007500700070006c00f60073006e0069006e00670020006f006300680020006400e40072006d006500640020006600e50020006200e400740074007200650020007500740073006b00720069006600740073006b00760061006c0069007400650074002e0020005000440046002d0064006f006b0075006d0065006e00740065006e0020006b0061006e002000f600700070006e006100730020006d006500640020004100630072006f0062006100740020006f00630068002000520065006100640065007200200035002e003000200065006c006c00650072002000730065006e006100720065002e> /ENU <FEFF005500730065002000740068006500730065002000730065007400740069006e0067007300200074006f0020006300720065006100740065002000500044004600200064006f00630075006d0065006e0074007300200077006900740068002000680069006700680065007200200069006d0061006700650020007200650073006f006c007500740069006f006e00200066006f007200200069006d00700072006f0076006500640020007000720069006e00740069006e00670020007100750061006c006900740079002e0020005400680065002000500044004600200064006f00630075006d0065006e00740073002000630061006e0020006200650020006f00700065006e00650064002000770069007400680020004100630072006f00620061007400200061006e0064002000520065006100640065007200200035002e003000200061006e00640020006c0061007400650072002e> >> >> setdistillerparams << /HWResolution [1600 1600] /PageSize [612.000 792.000] >> setpagedevice