Complete the checklist below for the study/article you are to evaluate.
Define topic and need.
· What phenomenon does the study investigate?
· Is the phenomenon a problem, an opportunity, or a dilemma?
· What symptoms (easily observable signs) indicate that it is a problem, opportunity or a dilemma?
· How do people who know this organization explain these symptoms? What do administrators want to know about the phenomenon?
· How can it be expressed in manageable terms?
Assess relevant knowledge.
· How much is already known?
· Is additional background information necessary? Should this research be conducted?
· Is the topic a special case of a broader, more fundamental and important problem?
Identify variables and measures, and research questions and hypotheses.
· What variables associated with the phenomenon are investigated? How are the variables measured?
· What are the research questions?
· What specific hypotheses are formulated?
Identify and analyze the research design.
· What is the research design—exploratory, descriptive, or causal research? Is this non-experimental, quasi-experimental, or experimental research? What is the nature of data—primary or secondary?
· What is the source of data—interviews, questionnaires, existing databases? Are answers obtained through interviews and questionnaires objective?
Analyze the sample.
· What is the population from which the respondents have been selected? How large is the sample?
· Is it random, stratified, or other sample?
Gather data.
· How are data gathered?
· Does the procedure of gathering data ensure objectivity?
Analyze data.
· Are the data words (qualitative data) or numbers (quantitative)? How are qualitative data analyzed?
· How are quantitative data recorded and checked for accuracy? What statistical methods are used to analyze data?
Assess results.
· What are the answers to research questions? Are hypotheses supported?
· What evidence did the study produce that helps answer research questions or support/refute hypotheses?
Evaluate recommendations.
What recommendations can be made on the basis of results?
What recommendations are made that cannot be supported with results?
Evaluate the study.
· What limitations does the study have?
· What improvements in research design can be recommended?
Page 3 of 3
Research Methods in Health Administration
© 2013 South University