615 assignment

Lesson Week Four

As you work through the NPS surveys you are reviewing the collection methods for the data to investigate the effectiveness of their programs. The data was collected to support the evaluation plan suggested by the evaluation sponsor and refined by the evaluator taking into consideration input from other stakeholders. Our next area of consideration is once you have found the data, how do you report it? Your data will answer the questions asked by the sponsors. It may be what they wanted to hear, it may not. Either way, you must report it. You may also note that we did not cover the statistical analysis models in depth (statistical significance, standardized mean difference, odds ratio, etc.) In such a short class we can't cover all aspects but if you are interested APUS offers statistical analysis classes which can supplement these concepts.

Back to the report. The way you report the findings is just as important as the findings themselves. Take a look at the readings for the week. They are examples of what should be in a program evaluation/analysis report. It is important to note the executive summary. As much as you would like others to read your findings from start to finish, in reality the executive summary is going to be the only part many of your sponsors will read. It is important that you put a great deal of time into that part of the evaluation report. The background generally follows so that someone not familiar with the report or someone that reads it later understands why and how it was done. Your assumptions and limitations are included there so all understand the conditions under which it was performed. You will then discuss your methodology, your results, and finally your recommendations if that was part of the initial request for services for the evaluation itself. When making your recommendations make sure to include references to all stakeholders of the organization/agency. Finally, the questionnaires, surveys, tabulated results, and interview transcripts will be appendices. 

​Not only is the information important but the format and visuals are important as well. A graph can make a much greater impression than a narrative in many circumstances. Color can draw the reader's attention to important concepts or data. As you prepare for the presentation of your data for this class, take some time to watch the Ted Talk "Hans Rosling: Let my dataset Change your Mindset." While you are viewing the video, stop occasionally and think, do I understand this better because of the use of graphs? Do I believe him more easily when this data is portrayed in a way I can understand it? Does it lose anything in this translation? Is his comment on providing data for free for the general public something you think will catch on? See how he shows what happens in the world using his data? Will your presentation demonstrate your outcomes based on your data?

If you are interested, Ted talks has other talks on presentation skills such as one by Nancy Duarte at https://www.ted.com/talks/nancy_duarte_the_secret_structure_of_great_talks . The report is comprised of solid data, good presentation of data in the form of the report, and finally good presentation of the findings by the evaluator to the sponsor and stakeholders. Together these skills are all important to "sell" your report results to your audience.