Astronomy- Case Studies
Freckles73
assessment_case_studies.docx
|
Assessment Case Studies #2: Assessing & Improving Research Projects Used with permission from "Engaging in Astronomical Inquiry", by Stephanie Slater, Timothy Slater, and Daniel Lyons. Copyright W.H. Freeman and Company, New York, 2010 Big Idea: Designing a fruitful plan for conducting research has many pitfalls. By assessing the research reports of others, scientists can improve their own ability to design attractive research plans. With better research designs, researchers can improve the support for the claims they make with better and better evidence. Goal: Students will assess a series of research reports and then select one project to redesign and conduct in order to more productively pursue the original research question. Assess Research Projects & Identify Inconsistencies in their Lines of Inquiry Your task is to improve research projects similar to those you have already completed. Work improving only on one research report at a time. Make sure to specify which report you are using by completely writing out the research question. Answer each of the questions by selecting yes, no, or maybe, and then provide a short, but detailed, explanation of your reasoning citing specific information from the provided research reports.
First Case Study
PSU update move review panel 1. Specific research question:
PSU update move review panel 2. What list of things might you observe to pursue this research question?
PSU update move review panel 3. Step-by-Step Procedure to Collect Evidence: Is the plan presented going to yield the necessary evidence needed to fully answer the listed research question? Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
PSU update move review panel 4. Conclusions Drawn from Data Table and/or Results of Evidence. Has enough evidence been collected for this specific research question? Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
PSU update move review panel 5. Have they claimed more than the evidence supports? Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered Yes or Maybe.
PSU update move review panel 6. Evidence-based Conclusion Statement. Have assumptions impacted their results? Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered Yes or Maybe.
PSU update move review panel 7. Does the claim directly answer the original research question? Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
PSU update move review panel 8. Precisely, what should the researchers have done or reported differently to improve their inquiry research project?
Second Case Study
PSU update move review panel 9. Specific research question:
PSU update move review panel 10. What list of things might you observe to pursue this research question?
PSU update move review panel 11. Step-by-Step Procedure to Collect Evidence: Is the plan presented going to yield the necessary evidence needed to fully answer the listed research question? Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
PSU update move review panel 12. Conclusions Drawn from Data Table and/or Results of Evidence. Has enough evidence been collected for this specific research question? Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
PSU update move review panel 13. Have they claimed more than the evidence supports? Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered Yes or Maybe.
PSU update move review panel 14. Evidence-based Conclusion Statement. Have assumptions impacted their results? Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered Yes or Maybe.
PSU update move review panel 15. Does the claim directly answer the original research question? Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
PSU update move review panel 16. Precisely, what should the researchers have done or reported differently to improve their inquiry research project?
Third Case Study
PSU update move review panel 17. Specific research question:
PSU update move review panel 18. What list of things might you observe to pursue this research question?
PSU update move review panel 19. Step-by-Step Procedure to Collect Evidence: Is the plan presented going to yield the necessary evidence needed to fully answer the listed research question? Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
PSU update move review panel 20. Conclusions Drawn from Data Table and/or Results of Evidence. Has enough evidence been collected for this specific research question? Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
PSU update move review panel 21. Have they claimed more than the evidence supports? Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered Yes or Maybe.
PSU update move review panel 22. Evidence-based Conclusion Statement. Have assumptions impacted their results? Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered Yes or Maybe.
PSU update move review panel 23. Does the claim directly answer the original research question? Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
PSU update move review panel 24. Precisely, what should the researchers have done or reported differently to improve their inquiry research project?
Choose One Research Project to Redesign, Improve, and Conduct
Your task is to choose one of the research projects (either report 22 or report 23 ONLY) to redesign and carry out. You should re-use the exact same research question as the previous researchers, but make sure to improve the research design so that you eliminate all the problems you were able to identify. At the end, check over your research by answering the assessment questions about your own inquiry report.
Your Redesigned Research Report: PSU update move review panel 25. Specific research question:
PSU update move review panel 26. Step-by-step procedure, with sketches if needed, to collect evidence. (Do NOT include generic nonspecific steps such as "analyze data" or "present conclusions" -- these are meaningless filler. Be specific!)
PSU update move review panel 27. Data table and/or results:
PSU update move review panel 28. Evidence-based conclusion statement:
REDESIGNED RESEARCH REPORT
PSU update move review panel 29. Have assumptions impacted your results? Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered Yes or Maybe.
PSU update move review panel 30. Does the claim directly answer the original research question? Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
PSU update move review panel 31. Precisely, what has been done or reported differently improving the original inquiry research project?
Phase VI - Summary
PSU update move review panel 32. Write a 50 word summary of what makes a solid inquiry research project. Include reason(s) why you elected to improve the project you did, explain what the biggest problems were, and how you corrected them. Be sure to describe details about how your changes improved the line of inquiry.
PSU update move review panel 33. In general, what are some common problems you need to avoid in designing a solid research project?
PSU update move review panel 34. In general, what are some important things to consider about assumptions you make in your research design?
|
1.
Specific research question:
2.
What list of things might you observe to pursue this research question?
3.
Step-by-Step Procedure to Collect Evidence:
Is the plan presented going to yield the necessary evidence needed to fully answer the listed research question?
Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
4.
Conclusions Drawn from Data Table and/or Results of Evidence.
Has enough evidence been collected for this specific research question?
Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
5.
Have they claimed more than the evidence supports?
Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered Yes or Maybe.
6.
Evidence-based Conclusion Statement.
Have assumptions impacted their results?
Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered Yes or Maybe.
7.
Does the claim directly answer the original research question?
Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
8.
Precisely, what should the researchers have done or reported differently to improve their inquiry research project?
9.
Specific research question:
10.
What list of things might you observe to pursue this research question?
11.
Step-by-Step Procedure to Collect Evidence:
Is the plan presented going to yield the necessary evidence needed to fully answer the listed research question?
Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
12.
Conclusions Drawn from Data Table and/or Results of Evidence.
Has enough evidence been collected for this specific research question?
Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
13.
Have they claimed more than the evidence supports?
Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered Yes or Maybe.
14.
Evidence-based Conclusion Statement.
Have assumptions impacted their results?
Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered Yes or Maybe.
15.
Does the claim directly answer the original research question?
Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
16.
Precisely, what should the researchers have done or reported differently to improve their inquiry research project?
17.
Specific research question:
18.
What list of things might you observe to pursue this research question?
19.
Step-by-Step Procedure to Collect Evidence:
Is the plan presented going to yield the necessary evidence needed to fully answer the listed research question?
Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
20.
Conclusions Drawn from Data Table and/or Results of Evidence.
Has enough evidence been collected for this specific research question?
Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
21.
Have they claimed more than the evidence supports?
Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered Yes or Maybe.
22.
Evidence-based Conclusion Statement.
Have assumptions impacted their results?
Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered Yes or Maybe.
23.
Does the claim directly answer the original research question?
Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
24.
Precisely, what should the researchers have done or reported differently to improve their inquiry research project?
Choose One Research Project to Redesign, Improve, and Conduct
Your task is to choose one of the research projects (either report 22 or report 23 ONLY) to redesign and carry out. You should re-use the exact same research question as the previous researchers, but make sure to improve the research design so that you eliminate all the problems you were able to identify. At the end, check over your research by answering the assessment questions about your own inquiry report.
Your Redesigned Research Report:
25.
Specific research question:
26.
Step-by-step procedure, with sketches if needed, to collect evidence. (Do NOT include generic nonspecific steps such as "analyze data" or "present conclusions" -- these are meaningless filler. Be specific!)
27.
Data table and/or results:
28.
Evidence-based conclusion statement:
REDESIGNED RESEARCH REPORT
29.
Have assumptions impacted your results?
Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered Yes or Maybe.
30.
Does the claim directly answer the original research question?
Type one of the following in the large text box below: Yes, Maybe, or No? Include a detailed explanation only if you answered No or Maybe.
31.
Precisely, what has been done or reported differently improving the original inquiry research project?
Phase VI - Summary
32.
Write a 50 word summary of what makes a solid inquiry research project. Include reason(s) why you elected to improve the project you did, explain what the biggest problems were, and how you corrected them. Be sure to describe details about how your changes improved the line of inquiry.
33.
In general, what are some common problems you need to avoid in designing a solid research project?
34.
In general, what are some important things to consider about assumptions you make in your research design?
