Thesis Proposal

profiletippy0410
Material-QuantitativeResearchEvaluationToolforArticlesintheSocialSciencesv8.docx

Quantitative Research Evaluation Tool

for Articles in the Social Sciences

Use this Quantitative Research Evaluation Tool as a guide to help you:

1. Assess if you are looking at a quantitative research article (i.e., it attempts to count, measure, and generalize findings, has an abstract, makes references to other academic articles, is in a peer-reviewed journal, includes a doi number, has elements of the following questions, etc.).

2. Evaluate the quality of the research article (i.e., in general, the more explicit these elements are detailed in the article, the more confidence you can have of its quality).

This tool is not intended to be comprehensive nor address all research variations. There is not a magic number for how many of these must be present in a “good” article, but more make it easier to evaluate and potentially apply to research or practice. Learning how to assess and evaluate research takes time, effort, and guidance, and this checklist is intended to help in that process.

Front Matter

1. Is the title focused and engaging?

2. Does the author have qualifications to be a credible authority?

3. Are there keywords that fit the study?

Abstract

4. Is the context for the study mentioned?

5. Is the purpose clear?

6. Are the methodology and method stated?

7. Is there a brief summary and interpretation of the results?

8. Is the significance or implications mentioned?

Introduction

9. Is the problem that led to this research clearly stated?

10. Does background information / literature situate the problem in context?

11. Are there gaps or problems identified in the literature?

12. Is the significance or importance for this study detailed?

13. Is there a clear purpose or aim for this research?

14. Is there a theory or theories presented that will be tested?

Literature Review

15. Is there a section devoted to the (peer-reviewed) literature to contextualize the research?

16. Does the literature provide various sides of an issue?

17. Does the literature detail a gap that requires this research?

18. Is the literature cited current (within 5 years of the article)?

19. Are classic studies or authors in the research area referenced?

20. Are there in-text citations with few or no direct quotes?

21. Does the literature naturally build to the research questions?

22. Are all in-text citations matched in the reference list?

23. Is there a summary to help the reader understand applications?

Methodology and Method

24. Is the research design (methodology and methods) described in detail?

25. Is the research question(s) explicit and realistic?

26. Is the methodology (e.g., survey, experiment, etc.) detailed and appropriate for the research question?

27. Were clearly defined hypotheses given?

Data Collection

28. Were the data collections methods piloted?

29. Were ethical issues and consent addressed?

30. Is the sample size adequate for the methodology and statistical test?

31. Is it clear how the data was collected from the participants?

32. Was the location for gathering the data described?

33. If instruments were used, were they developed for this study or did they previously exist?

34. Were samples of the instrument provided as examples of what were asked and collected?

35. How were validity (it measures what it claims to measure) and reliability (consistent results over time) addressed?

36. How were controls used, if included?

Data Analysis

37. Were the steps in data analysis clearly described?

38. Were variables identified and described?

39. Did the data analysis process flow from the methodology?

40. How was a statistical analysis conducted?

41. Was the statistical test or treatment appropriate?

42. Are there sufficient and meaningful charts and tables to express how the data were analyzed?

Discussion of Findings

43. Did the findings flow from the statistical analysis?

44. Was the explanation of the findings easily understood?

45. Do the findings answer the research questions or support / reject the hypotheses?

46. Are the findings objective?

47. Are the findings generalizable, and if so to whom?

48. Are limitations stated?

Implications / Next Steps

49. Are implications for practice identified?

50. Are next steps for future research offered?

References

51. Was there a Reference List?

52. Did the items in the references match the in-text citations throughout the study?

Quantitative Research Evaluation Tool for Articles in the Social Sciences v8 1

©2013 Jeffrey M. Keefer. Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License

Quantitative Research Evaluation Tool for Articles in the Social Sciences v8 2

©2013 Jeffrey M. Keefer. Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License