Project

PHE 423 Final Project Guidelines and Rubric

Overview Your final project for this course is the creation of a mock program evaluation plan using the Centers for Disease Control and Prevention (CDC) Framework for Program Evaluation in Public Health. The mock evaluation plan will correspond to the CDC framework steps, including identifying stakeholders, describing the program that will be evaluated, selecting the evaluation design, suggesting credible evidence, and summarizing how these potential findings will be communicated.

Program evaluation in the public health field is a systematic investigation into the quality, value, or importance of a public health program. Evaluation methods provide the framework for public health practitioners to determine if a program is operating as expected or needs improvement, and to determine if the program has an impact on the short- and long-term health outcomes targeted. As a public health practitioner, you may be called upon to design a program evaluation and/or to review existing program evaluations to understand the strengths and weaknesses of a selected program.

For the final assessment in this course, you will have a chance to participate in the program evaluation process by creating a mock program evaluation plan. Your mock program evaluation plan will correspond to most of the CDC framework steps, including identifying stakeholders, describing the program that will be evaluated, selecting the evaluation design, suggesting credible evidence, and summarizing how these potential findings will be communicated. You may select one of the following public health programs below:

 GHWIC: Good Health and Wellness in Indian County (located under Healthy Tribes)

 HOP: High Obesity Program (located under Division of Nutrition, Physical Activity, and Obesity)

 REACH: Racial and Ethnic Applications to Community Health (located under Division of Nutrition, Physical Activity, and Obesity)

 SRCP: Sodium Reduction in Communities Program (located under Division of Heart Disease and Stroke Prevention)

 WISEWOMAN (located under Division of Heart Disease and Stroke Prevention) Ideally, the program you select to evaluate from the list above should be on a health topic in which you have an interest and see yourself using in the future, or one that has been used in a population on which you plan to focus. Visit the CDC website to learn more about each program. When visiting the site, click on the ‘+’ under the section name provided in the list above to find a link to the program. Please Note: Although there are published evaluations of communities funded by the programs above (i.e. you will read one for REACH in one of your readings), these are to be used ONLY as a reference or guidance on how to complete your own “mock evaluation” rather than be submitted as original work, as this would reflect plagiarism. Once you have identified a program, you will need to narrow down what you are evaluating by identifying a specific community (population or city) where your chosen program is being implemented. Review the Community Examples list (located in Module One), which provides some options of actual cities/populations that you could use for your evaluation.

This assessment addresses the following course outcomes:

 Develop evidence-based goals for evaluating public health programs that are designed to reach public health audiences

 Analyze specific communities through different social and behavioral lenses for informing program evaluations of public health programs

 Determine evaluation design components appropriate for evaluating the effectiveness of public health programs  Develop valid and reliable measurement strategies to be used in evaluating public health programs in specific communities

The project is divided into two milestones, which will be submitted at various points throughout the course to scaffold learning and ensure quality final submissions. These milestones will be submitted in Modules Two and Four. The final mock program evaluation plan will be submitted in Module Seven.

Prompt Conduct research on the program you selected and create a plan for evaluating the success of the program. You should use at least four relevant sources to support your evaluation plan. Your evaluation plan must address the following critical elements:

I. Program Evaluation Background: In this section, you will distill the background research you conducted on the public health issue that was targeted by the program you selected.

A. Provide an overview of the issue targeted by the selected program, including the affected community, using current published literature. Be sure to support your response with any relevant programs, evaluations, campaigns, and/or studies that have addressed your selected issue.

B. Discuss what you are hoping to accomplish or determine by conducting an evaluation of the selected program and what audience(s) this evaluation would be most relevant for.

C. Develop goals for conducting your evaluation. Justify the appropriateness and relevance of your goals using current published literature. D. Analyze social theories, behavior models, health disparities, and social determinants of health for how they impact program evaluations for affected

communities. 1. Explain the social theories or health behavior models that apply to the selected program and affected community. Be sure to support your

explanation with specific examples from credible sources. 2. Describe how health disparities in the selected community will impact the conduct of this program evaluation. 3. Describe how social determinants of health within your selected community will impact the conduct of the program evaluation.

II. Program Evaluation Design: In this section, you will define and defend how you have focused your evaluation process, including what questions you intend

to answer in your investigation. A. Explain the type of evaluation you will use when evaluating the selected program, and justify why this type of evaluation will help you meet the

goals you have identified. B. Discuss the types of evaluation questions that can be addressed using your selected evaluation design. C. Defend how the evaluation type you have selected will ensure use of the findings and provide lessons learned that will continue to improve

programs targeting this issue.

III. Program Evaluation Methods: In this section, you will explain how you plan to collect the data you need to complete your evaluation of your chosen public health program.

A. Develop a measurement strategy for your program evaluation that defines the general methods and specific tools you will use to collect data. Consider: Will you use focus groups and/or surveys? What kinds of measurement tools are most appropriate for this evaluation?

B. Justify your measurement strategy in terms of validity. Be sure to address both the internal and external validity. C. Justify your measurement strategy using the concepts of reliability. Be sure to address both the internal consistency and stability of your

measurement strategy.

IV. Conclusion: Develop goals for communicating your findings to a variety of potential audiences. Consider: If you are communicating with a scientific audience, what information from your findings would you include? If you were meeting with community stakeholders, what would you prepare, and how would you communicate the information? Justify the appropriateness of your goals using current published literature.

Milestones Final Project Milestone One: The Program and Community Setting for the Evaluation In Module Two, you will summarize the program and community that you chose to focus on for your final project. You should describe the program in terms of the theoretical basis and evidence base for program effectiveness. Community needs will be described in terms of socio-demographic characteristics, the distribution of the health issue, and disparities and social determinants that impact risk and health outcomes. The purpose of this activity is to provide the program and community context for your final project. This submission will be graded with the Milestone One Rubric.

Final Project Milestone Two: Program Evaluation Design In Module Four, you will determine the most important evaluation questions and the evaluation design that you will use for your final program evaluation plan. The evaluation focus will depend on the program stage of development as well as what stakeholders want to learn about the program. The evaluation questions will be described in terms of the evaluation standards of utility, feasibility, propriety, and accuracy. The evaluation design will be described in terms of implementation, outcome, or mixed methods. The purpose of this milestone is to establish the priorities and methods that will be used to evaluate the program. This submission will be graded with the Milestone Two Rubric.

Final Project Submission: Program Evaluation Plan In Module Seven, you will submit your final mock program evaluation plan. It should correspond to the CDC framework steps, including identifying community stakeholders, describing the public health issue in the community and the program that will be evaluated, selecting the evaluation design, suggesting credible evidence that can be gathered, and summarizing how these potential findings will be communicated.

Note: The final program evaluation plan should include a revised introduction, along with a section on Program Evaluation Methods (Critical Element III) in which you will explain how you plan to collect the data needed to complete the evaluation of your chosen public health program (you prepared for this in the Module Five Short Essay task). In addition, the final program evaluation plan should include a conclusion (Critical Element IV) in which you develop goals for communicating your findings to a variety of potential audiences.

Be sure to incorporate all instructor feedback from your milestone assignments before you submit the final project. This submission will be graded with the Final Project Rubric (below).

Final Project Rubric Guidelines for Submission: Your program evaluation plan should be 8–10 pages (not including a cover sheet or reference page), use at least 4 current and relevant sources, 12-point Times New Roman font, double spacing, and must adhere to APA guidelines for formatting and for citing sources.

Critical Elements Exemplary (100%) Proficient (85%) Needs Improvement (55%) Not Evident (0%) Value

Program Evaluation

Background: Overview of the

Issue

Meets “Proficient” criteria and demonstrates sophisticated understanding of the issues targeted by the selected program, including the affected community

Provides an overview of the issue targeted by the selected program, including the affected community with support from current published literature about any relevant programs, evaluations, campaigns, or studies

Provides an overview of the issue targeted by the selected program, including the affected community, but overview is cursory or is not supported using current published literature about any relevant programs, evaluations, campaigns, or studies

Does not provide an overview of the issue targeted by the selected program, including the affected community

6

Program Evaluation

Background: Accomplish

Meets “Proficient” criteria and makes cogent connections among the evaluation and what audience(s) this evaluation would be most relevant for

Discusses what will be accomplished or determined by conducting an evaluation of the selected program and what audience(s) this evaluation would be most relevant for

Discusses what will be accomplished or determined by conducting an evaluation of the selected program and what audience(s) this evaluation would be most relevant for, but discussion is cursory or illogical

Does not discuss what will be accomplished or determined by conducting an evaluation of the selected program or what audience(s) this evaluation would be most relevant for

6

Program Evaluation

Background: Goals

Meets “Proficient” criteria and makes cogent connections among the goals for conducting the evaluation and the selected program and targeted issue

Develops goals for conducting the evaluation that are justified using current published literature

Develops goals for conducting the evaluation, but goals are illogical, unrealistic, or are not justified using current published literature

Does not develop goals for conducting the evaluation

6

Program Evaluation

Background: Impact: Social

Theories or Health Behavior Models

Meets “Proficient” criteria and demonstrates sophisticated understanding of the applicable social theories or health behavior models

Explains the social theories or health behavior models that apply to the selected program and affected community with support from specific examples from credible sources

Explains the social theories or health behavior models that apply to the selected program and affected community, with support from specific examples from credible sources, but explanation is cursory, illogical, contains inaccuracies about the applicable social theories or health behavior models, or examples used are not relevant

Does not explain the social theories or health behavior models that apply to the selected program and affected community

7.9

Program

Evaluation Background:

Impact: Health Disparities

Meets “Proficient” criteria and makes cogent connections among health disparities in the selected community and the program evaluation

Describes how health disparities in the selected community will impact the conduct of the program evaluation

Describes how health disparities in the selected community will impact the conduct of the program evaluation, but description is cursory or illogical

Does not describe how health disparities in the selected community will impact the conduct of the program evaluation

7.9

Program Evaluation

Background: Impact: Social

Determinants of Health

Meets “Proficient” criteria and makes cogent connections among social determinants of health within the selected community and the program evaluation

Describes how social determinants of health within the selected community will impact the conduct of the program evaluation

Describes how social determinants of health within the selected community will impact the conduct of the program evaluation, but description is cursory or illogical

Does not describe how social determinants of health within the selected community will impact the conduct of the program evaluation

7.9

Program Evaluation Design:

Evaluating the Selected Program

Meets “Proficient” criteria and makes cogent connections among the type of evaluation and the identified goals of the evaluation

Explains the type of evaluation that will be used when evaluating the selected program and justifies why this type will help meet the identified goals of the evaluation

Explains the type of evaluation that will be used when evaluating the selected program and justifies why this type will help meet the identified goals of the evaluation, but explanation is cursory, illogical, or contains inaccuracies

Does not explain the type of evaluation that will be used when evaluating the selected program or justify why this type will help meet the identified goals of the evaluation

7.9

Program Evaluation Design:

Evaluation Questions

Meets “Proficient” criteria and demonstrates sophisticated understanding of the types of evaluation questions that can be addressed using the selected evaluation design

Discusses the types of evaluation questions that can be addressed using the selected evaluation design

Discusses the types of evaluation questions that can be addressed using the selected evaluation design, but discussion is cursory or illogical

Does not discuss the types of evaluation questions that can be addressed using the selected evaluation design

7.9

Program Evaluation Design: Ensure Use of the

Findings

Meets “Proficient” criteria and makes cogent connections among the selected evaluation type and ensuring use of the findings and providing lessons learned that will continue to improve programs targeting this issue

Defends how the selected evaluation type will ensure use of the findings and provide lessons learned that will continue to improve programs targeting this issue

Defends how the selected evaluation type will ensure use of the findings and provide lessons learned that will continue to improve programs targeting this issue, but defense is cursory or illogical

Does not defend how the selected evaluation type will ensure use of the findings and provide lessons learned that will continue to improve programs targeting this issue

7.9

Program

Evaluation Methods:

Measurement Strategy

Meets “Proficient” criteria and demonstrates sophisticated ability to develop a measurement strategy for a program evaluation

Develops a measurement strategy for the program evaluation that defines the general methods and specific tools that will be used to collect data

Develops a measurement strategy for the program evaluation that defines the general methods and specific tools that will be used to collect data, but strategy is illogical or contains inaccuracies

Does not develop a measurement strategy for the program evaluation that defines the general methods or specific tools that will be used to collect data

7.9

Program Evaluation

Methods: Validity

Meets “Proficient” criteria and demonstrates sophisticated understanding of both the internal and external validity

Justifies the measurement strategy in terms of both internal and external validity

Justifies the measurement strategy in terms of validity, but justification is cursory or illogical or does not address both internal and external validity

Does not justify the measurement strategy in terms of validity

7.9

Program Evaluation Methods: Reliability

Meets “Proficient” criteria and demonstrates sophisticated understanding of the concepts of reliability

Justifies the measurement strategy using the concepts of reliability and addresses both the internal consistency and stability of the measurement strategy

Justifies the measurement strategy using the concepts of reliability, but justification is cursory or illogical or does not address both the internal consistency and stability of the measurement strategy

Does not justify the measurement strategy using the concepts of reliability

7.9

Conclusion: Communicating

Findings

Meets “Proficient” criteria and makes cogent connections among communicating the findings and the needs of potential audiences

Develops goals for communicating findings to a variety of potential audiences that are justified using current published literature

Develops goals for communicating findings to a variety of potential audiences, but goals are illogical, irrelevant, or are not justified using current published literature

Does not develop goals for communicating findings to a variety of potential audiences

6

Articulation of Response

Submission is free of errors related to citations, grammar, spelling, syntax, and organization and is presented in a professional and easy-to-read format

Submission has no major errors related to citations, grammar, spelling, syntax, or organization

Submission has major errors related to citations, grammar, spelling, syntax, or organization that negatively impact readability and articulation of main ideas

Submission has critical errors related to citations, grammar, spelling, syntax, or organization that prevent understanding of ideas

4.9

Total 100%