Evaluation Plan for Youthworks ML2
finewinesneed
evaluation_plan_outline.docxAppendix F
Individual Evaluation Plan Outline
{State Program Name}
Individual Evaluation Plan
{Name of evaluation candidate}
Prepared by:
{Names}
{Affiliation}
{Date}
Learning and Growing through Evaluation Module 1 Draft
Module 1 Draft Asthma Program Evaluation Guide
Appendix F Page F-2
Page F-3 Individual Evaluation Plan Outline
1. Introduction
This section provides information about the purpose of the evaluation, and what stakeholders are––or need to be––involved in the evaluation.
Evaluation Purpose
What does this evaluation strive to achieve?
What is the purpose of this evaluation?
How will findings from the evaluation be used?
Stakeholders
Who are the stakeholders for this evaluation?
This section of the plan corresponds with Chapter 3, Step 1, of the State Asthma Program Evaluation Guide
What role did they play in developing this individual evaluation plan?
How do you plan to engage these stakeholders when implementing the individual evaluation plan (e.g., participate in collecting data, help to interpret findings)?
Table F.1. Stakeholder Assessment and Engagement Plan
|
Stakeholder Name |
Stakeholder Category |
Interest or Perspective |
Role in the Evaluation |
How and When to Engage |
|
|
{Primary, secondary, tertiary} |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2. Description of What is Being Evaluated
This section provides detailed information about what you are evaluating. In this section describe the need, context, target population, and stage of development of what is being evaluated. You will also provide information on inputs, activities, outputs, and outcomes and will develop a logic model (graphical depiction) of what you are evaluating.
This section of the plan corresponds with Chapter 3, Step 2 of the State Asthma Program Evaluation Guide
Need
What is the need for what you are evaluating?
Context
What context/environment exists for what is being evaluated? (i.e., what environmental factors may affect the performance of what is being evaluated)
Target Population
Who is the target population? (if applicable)
Stage of Development
How long has what is being evaluated been in place?
Is it in the planning or implementation stage?
Resources/Inputs
What resources are available to support what is being evaluated (e.g., staff, money, space, time, partnerships, technology, etc.)?
Activities
What specific activities are undertaken (or planned) to achieve the outcomes?
Outputs
What products (e.g., materials, units of services delivered) are produced by your staff as a result of the activities performed?
Outcomes
What are the program’s intended outcomes (intended outcomes are short-term, intermediate, or long-term)?
What do you ultimately want to change as a result of your activities (long-term outcomes)?
What occurs between your activities and the point at which you see these ultimate outcomes (short-term and intermediate outcomes)?
Table F.2. Program Description Template
|
Resources/Inputs |
Activities |
Outputs |
Outcomes |
||
|
|
Initial |
Subsequent |
|
Short-Term/Intermediate |
Long-Term |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Logic Model
Provide a logic model for what is being evaluated.
3. Evaluation Design
This section of the plan corresponds with Chapter 3, Step 3 of the State Asthma Program Evaluation Guide
This section provides information on how you will design your evaluation. Provide information on evaluation questions, stakeholder information needs emerging from the evaluation, and the evaluation design.
Evaluation Questions
What specific questions do you intend to answer through this evaluation?
Stakeholder Needs
Who will use the evaluation findings?
What do they need to learn from the evaluation?
How will the findings be used?
What do intended users view as credible information?
Evaluation Design
What is the design for this evaluation? (e.g., experimental, pre-post with comparison group, time-series, case study, post-test only)
Why was this design selected?
4. Data Collection
This section of the plan corresponds with Chapter 3, Step 4 of the State Asthma Program Evaluation Guide
This section provides information on how you will collect/compile data for your evaluation. Provide information on methods by which you will collect/compile data, and how those methods are related to the evaluation questions you identified.
Data Collection Methods
Will new data be collected/compiled to answer the evaluation questions or will secondary data be used?
What methods will be used to collect or acquire the data?
Will a sample be used? If so, how will the sample be selected?
How will data collection instruments be identified and tested?
How will the quality and utility of existing data be determined?
From whom or from what will data be collected (source of data)?
How will the data be protected?
Data Collection Method – Evaluation Question Link
How does each data collection method relate to the evaluation questions proposed?
Table F.3: Evaluation Questions and Associated Data Collection Methods
|
Evaluation Question |
Data Collection Method |
Source of Data |
|
1. |
|
|
|
|
|
|
|
2. |
|
|
|
|
|
|
|
|
|
|
5. Data Analysis and Interpretation
This section of the plan corresponds with Chapter 3, Steps 4 and 5 of the State Asthma Program Evaluation Guide
In this section provide information on what indicators and standards you will use to judge success, how you will analyze your evaluation findings, and how you will interpret and justify your conclusions.
Indicators and Standards
What are some measurable or observable elements that can tell you about the performance of what is being evaluated?
What constitutes “success”? (i.e., by what standards will you compare your evaluation findings?)
Table F.4. Indicators and Success
|
Evaluation Question |
Criteria or Indicator |
Standards (What Constitutes “Success”?) |
|
1. |
|
|
|
|
|
|
|
2. |
|
|
|
|
|
|
|
|
|
|
Analysis
What method will you use to analyze your data (e.g., descriptive statistics, inferential statistics, content analysis)?
Provide example table shells, if applicable.
Interpretation
Who will you involve in drawing, interpreting, and justifying conclusions?
What are your plans to involve them in this process?
6. Communication and Reporting
This section of the plan corresponds with Chapter 3, Step 6 of the CDC State Asthma Program Evaluation Guide
This section provides information about how information from the individual evaluation plan process and results will be used and shared.
Use
What actions will be taken to promote evaluation use?
How will evaluation findings be used?
Who is responsible for implementing evaluation recommendations?
Communication
Which evaluation stakeholders will you communicate with and why (e.g., update on status of evaluation, invite to meetings, share interim or final findings)?
What methods (e.g., in-person meetings, emails, written reports, presentations) will you use to communicate with evaluation stakeholders?
Why are these methods appropriate for the specific evaluation stakeholder audience of interest?
7. Evaluation Management
This section provides information about how the individual evaluation will be managed and implemented and who will participate in what capacity. It will also provide a timeline for conducting activities related to this evaluation. You may find that some of the tables suggested here fit better in other sections of the plan. Regardless of how you structure your plan, it is important that you carefully think about each of these implementation steps and who is responsible for doing what by when.
This section of the plan corresponds with Chapter 3 of the CDC State Asthma Program Evaluation Guide (section on Pulling It All Together)
Develop several tables that summarize the major activities included in implementing the evaluation, the persons involved in this implementation, and associated timelines.
Evaluation Team
Who will implement this evaluation?
Table F.5. Roles and Responsibilities of the Evaluation Team Members
|
Individual |
Title or Role |
Responsibilities |
|
|
|
|
|
|
|
|
|
|
|
|
Data Collection Management
What data will be collected?
What activities are needed to carry out the data collection successfully? When should each of these activities be completed?
Who is responsible for conducting each activity?
Table F.6. Data Collection Plan
|
Evaluation Questions |
Data Collection Method |
Activities Needed |
Person(s) Responsible |
Due Date |
|
1. |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2. |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Data Analysis Management
What data will be analyzed, how, and when?
Who is responsible for conducting the analyses?
Table F.7. Data Analysis Plan
|
Analysis to Be Performed |
Data to Be Analyzed |
Person(s) Responsible |
Due Date |
|
|
|
|
|
|
|
|
|
|
Communicating and Reporting Management
What are the target audiences for reporting the progress made on the evaluation and/or evaluation findings?
What is the purpose of the communications with this audience?
What is the most appropriate type of communication method to use with this audience, for this purpose?
When will the communication take place?
Table F.8. Communication and Reporting Plan
|
Audience 1: {insert name of audience} |
||||
|
Applicable? |
Purpose of Communication |
Possible Formats |
Timing/Dates |
Notes |
|
Yes/No |
Include in decision making about evaluation design/activities |
|
|
|
|
|
Inform about specific upcoming evaluation activities |
|
|
|
|
|
Keep informed about progress of the evaluation |
|
|
|
|
|
Present initial/interim findings |
|
|
|
|
|
Present complete/final findings |
|
|
|
|
|
Document the evaluation and its findings |
|
|
|
Adapted from Russ-Eft and Preskill, 2001, pp. 354–357.
Timeline
When will planning and administrative tasks occur?
When will any pilot testing occur?
When will formal data collection and analysis tasks occur?
When will information dissemination tasks occur?
Upon mapping all of the above on a single timeline, are there any foreseeable bottlenecks or sequencing issues?
Evaluation Budget
What is the cost for this evaluation?
Where will the monetary resources come from to support the evaluation?
Are any in-kind, volunteer, or partner resources being contributed?
NOTES
