Quiz: Meta-Analysis and Survey Research Attempt History
Attempt Time Score
LATEST Attempt 1 Time:32 minutes Score:119 out of 120
Question 1 5 / 5 pts
The fact that a meta-analysis quantifies findings from many studies is a frequently mentioned
advantage. Another strong advantage of the metaanalysis over the normal review paper is
the description of the coding of study characteristics and the criteria for excluding studies
Question 2 5 / 5 pts
When a national poll reports that its survey has a margin of error of 3%, it is referring to error
due to
sampling
Question 3 5 / 5 pts
Choose the correct sequence for developing a questionnaire.
determining objectives, delimiting the sample, writing items, pilot testing Question 4
5 / 5 pts
Consider the following questionnaire item (which uses a yes/no format): "Do you use objective
test items or essay items?" What rule regarding item construction does it violate?
Do not use items that have two or more separate ideas in the same item.
Question 5 5 / 5 pts
The inclusion criteria in a meta-analysis are very much like
delimitations
Question 6 5 / 5 pts
In calculating ES for a treatment effect between a pretest and a posttest, the text recommends
the use of which standard deviation?
the pretest standard deviation
Question 7 5 / 5 pts
The most frequent and severe criticism of meta-analysis is that
the studies represent wide differences in methodologies, designs, and measurements
Question 8 5 / 5 pts
In a meta-analysis, the researcher found that the mean for the experimental group in a study
was 14, and the mean for the control group was 10. The standard deviation of the control group
was 5. Based on these data, what is the ES?
0.80
Question 9 5 / 5 pts
Scaled responses to questionnaire items such as strongly agree, agree, no opinion, and so on
are referred to as ________ scale items.
Likert-type
Question 10 5 / 5 pts
In a meta-analysis of 100 studies that compared boys' and girls' knowledge of performance
enhancing substances, an average ES of 0.50 was found. This number represents
a difference of 0.50 standard deviation units
Question 11 5 / 5 pts
It is common when looking at a distribution to encounter extreme or unusual scores that could
have a misleading effect on the results. These extreme scores are termed
outliers
Question 12 5 / 5 pts
A survey technique that asks a jury of experts to respond to a series of questionnaires in order
to reach a consensus about important issues is the
Delphi survey method
Question 13 5 / 5 pts
In a meta-analysis, the results of various studies on a topic are quantified using a standard
measure (ES) that is called
effect size
Question 14 5 / 5 pts
A major difference in the purpose of a meta-analysis and a review of literature for a research
paper is that the meta-analysis uses the literature
for empirical and theoretical conclusions
Question 15
5 / 5 pts
A researcher tests the knowledge that 10,000 school children from the southwestern United
States have about nutrition, and the scores are transformed into percentiles by grade level. This
type of research is a ________ survey study.
normative
Question 16 5 / 5 pts
The first step in conducting a questionnaire survey is to
list specific objectives to be achieved
Question 17 5 / 5 pts
To help ensure an acceptable return rate in a questionnaire study, the researcher should
b and c only
Question 18 5 / 5 pts
The practice of selecting a small random sample of a survey's nonrespondents is primarily
intended to
determine whether the nonrespondents are a different population from the respondents
Question 19 5 / 5 pts
In a meta-analysis, the ES for the experimental versus control groups was 0.68, which
represents a percentile equivalent of 75. This means that
the average score of the experimental group was better than 75% of the control group's scores
Question 20 5 / 5 pts
Which of the following are most difficult to analyze in a questionnaire study?
open-ended items
Question 21 9 / 10 pts
Contrast the electronic questionnaire with the personal interview in terms of advantages or
disadvantages in sampling, validity of responses, and administrative considerations (time,
expense, helpers) (10pts).
Your Answer:
Electronic questionnaires and personal interviews each have distinguished advantages and
limitations in research design. In terms of sampling, electronic questionnaires make it possible
to reach large and diverse populations quickly, which improves efficiency and breadth of data
collection. In contrast, personal interviews are limited to smaller samples due to the time and
labor involved, but they allow researchers to gather richer and more detailed responses.
Regarding validity of responses, electronic questionnaires may reduce social desirability bias
because participants can respond anonymously, though the also risk superficial or incomplete
answers. Personal interviews often produce more valid and in depth data since interviewers can
clarify questions, probe for detail, and adapt to the participants responses, but interviewer bias
can threaten objectivity. Finally, in administrative considerations, electronic questionnaires are
generally less expensive once created, can be distributed widely without extensive staff, and
allow participants to response on their own time. Personal interviews are resource intensive,
requiring trained interviewers, scheduling, and more time to collect and transcribe data.
Question 22 10 / 10 pts
In a paragraph or two, explain the purpose and procedures of a metaanalysis to someone who
has never heard of the research technique (10pts).
Your Answer:
A meta-analysis is a research technique used to combine the results of multiple individual
studies that all address the same question. Its purpose is to provide a clearer and more precise
estimate of the overall effect that any single study could offer. Because individual studies my
produce different, or even conflicting results, meta-analysis systematically reviews the available
research, evaluates study quality, and then uses statistical procedures to integrate the findings.
This increases statistical power, improves the ability to detect true effects, and allows
researchers to generalize findings to larger populations.
The procedure of a meta-analysis follows a systematic and reproducible process. Researchers
first define a clear research questions, then search for all relevant studies, using a strict
inclusion and exclusion criteria to decide which studies to analyze. Each study is carefully
appraised, and data are extracted in a consistent manner. The results are the combined
statistically to produce an overall effect size or summary measure. In physical activity research,
this process is particularly valuable for making sense of a large body of literature and guiding
evidence based practice. Although metaanalysis is time consuming and depends on the quality
of the studies included, it remains one of the most powerful tools for drawing reliable
conclusions from existing research.
Excellent job hitting all the key points. The standard metric (effect size) is imperative.
Quiz Score: 119 out of 120