DB # 4 Students Post
Chapter 9:
Survey Research
1
© 2018 Cengage Learning. All Rights Reserved.
Learning Objectives • Understand that survey research involves the administration of
questionnaires in a systematic way to a sample of respondents selected from some population
• Describe how survey research is especially appropriate for descriptive or exploratory studies of large populations
• Describe examples of surveys as the method of choice for obtaining victimization and self-reported offending data
• Summarize differences between open-ended or closed-ended questions, and offer examples of the advantages and disadvantages of each
• Recognize how bias in questionnaire items encourages respondents to answer in a particular way or to support a particular point of view
2
© 2018 Cengage Learning. All Rights Reserved.
Learning Objectives, cont.
• Describe different ways to administer questionnaires, and offer examples of how they can be varied
• Recognize why it is important for interviewers to be neutral in face-to-face surveys
• Provide examples of the advantages and disadvantages of each method of survey administration
• Discuss how survey data can be somewhat artificial and potentially superficial
• Understand how specialized interviews with a small number of people and focus groups are different from surveys as examples of collecting data by asking questions
3
© 2018 Cengage Learning. All Rights Reserved.
Introduction
• Survey research is perhaps the most frequently used mode of observation in sociology and political science, and surveys are often used in criminal justice research as well
• You have no doubt been a respondent in some sort of survey, and you may have conducted a survey yourself
4
© 2018 Cengage Learning. All Rights Reserved.
Survey Research Topics
• Counting Crime: asking people about victimization counters problems of data collected by police
• Self-Reports: dominant method for studying the etiology of crime – Frequency/type of crimes committed – Prevalence (how many people commit crimes)
committed by a broader population
5
© 2018 Cengage Learning. All Rights Reserved.
Survey Research Topics, cont.
• Perceptions and Attitudes: To learn how people feel about crime and CJ policy
• Targeted Victim Surveys: Used to evaluate policy innovations and program success
• Other Evaluation Uses: e.g., measuring community attitudes, citizen responses, etc. – Chicago Community Policing Evaluation Consortium
• General Purpose Crime Surveys
6
© 2018 Cengage Learning. All Rights Reserved.
Guidelines for Asking Questions
• How questions are asked is the single most important feature of survey research
• Open-Ended: Respondent is asked to provide his or her own answer
• Closed-Ended: Respondent selects an answer from a list – Choices should be exhaustive and mutually exclusive
• Questions and Statements: Likert scale
7
© 2018 Cengage Learning. All Rights Reserved.
Guidelines for Asking Questions, cont.
• Make Items Clear: Avoid ambiguous questions; do not ask “double-barreled” questions
• Short Items are Best: Respondents like to read and answer a question quickly
• Avoid Negative Items: Leads to misinterpretation
• Avoid Biased Items and Terms: Do not ask questions that encourage a certain answer
• Designing Self-Report Items: Use of computer- assisted interviewing techniques
8
© 2018 Cengage Learning. All Rights Reserved.
Questionnaire Construction
• General questionnaire format: critical, must be laid out properly and uncluttered
• Contingency Questions: Relevant only to some respondents—answered only based on the previous response
• Matrix Questions: Same set of answer categories used in multiple questions
9
© 2018 Cengage Learning. All Rights Reserved.
Ordering Questions
• Ordering may affect the answers given • Estimate the effect of question order • Perhaps devise more than one version • Begin with most interesting questions • End with duller, demographic data
– Do the opposite for in-person interview surveys
10
© 2018 Cengage Learning. All Rights Reserved.
Self-Administered Questionnaires
• Can be home-delivered – Researcher delivers questionnaire to home of sample
respondent, explains the study, and then comes back later
• Mailed (sent and returned) survey is most common – Researchers must reduce the trouble it takes to return a
questionnaire
11
© 2018 Cengage Learning. All Rights Reserved.
Warning Mailings & Cover Letters
• Used to increase response rates
• Warning Mailings: “Address correction requested” card sent out to determine incorrect addresses and to “warn” residents to expect questionnaire in mail
• Cover Letters: Detail why survey is being conducted, why respondent was selected, why is it important to complete questionnaire – Include institutional affiliation or sponsorship
12
© 2018 Cengage Learning. All Rights Reserved.
Self-Administered Questionnaires
• Monitoring returns: Pay close attention to the response rate; assign #’s serially
• Follow-up mailings: Nonrespondents can be sent a letter, or a letter and another questionnaire; timing
• Acceptable response rates: 50% is adequate, 60% is good, and 70% is very good – Would we rather have a lack of response bias than a high
response rate?
13
© 2018 Cengage Learning. All Rights Reserved.
Computer-Based Self-Administration
• Via Fax, Email, Web Site/Page • Issues
– Representativeness – Mixed in with, or mistaken for, spam – Requires access to Web – Sampling frame?
14
© 2018 Cengage Learning. All Rights Reserved.
Discussion Question 1
What if you administered a survey? Would you use the Internet? Why or why not?
15
© 2018 Cengage Learning. All Rights Reserved.
In-Person Interview Surveys
• Typically achieve higher response rates than mail surveys (80-85% is considered good)
• Demeanor and appearance of interviewer should be appropriate; interviewer should be familiar with questionnaire and ask questions precisely
• Can probe for additional responses • When more than one interviewer administers,
efforts must be coordinated and controlled • Practice interviewing
16
© 2018 Cengage Learning. All Rights Reserved.
Discussion Question 2
What if you were interviewed as part of a research project? How would you expect the researchers to behave?
17
© 2018 Cengage Learning. All Rights Reserved.
Computer-Assisted Interviews
• Reported success in enhancing confidentiality
• Reported higher rates of self-reporting – Computer-assisted personal interview (CAPI):
Interviewers read questions from screens and then type in answers from respondents’
– Computer-assisted self-interviewing (CASI): Respondent keys in answers, which are scrambled so that interviewer cannot access them
18
© 2018 Cengage Learning. All Rights Reserved.
Telephone Surveys
• 95.5% of all households have telephones (2005, U.S. Census Bureau)
• Random-Digit Dialing – Obviates unlisted number problem – Often results in business, pay phones, fax lines
• Saves money and time, provides safety to interviewers, more convenient
• May be interpreted as bogus sales calls; ease of hang-ups
19
© 2018 Cengage Learning. All Rights Reserved.
Computer-Assisted Telephone Interviewing
• A set of computerized tools that aid telephone interviewers and supervisors by automating various data collection tasks
• Easier, faster, more accurate, but more expensive
• Formats responses into a data file as they are keyed in
• Can automate contingency questions and skip sequences
20
© 2018 Cengage Learning. All Rights Reserved.
Discussion Question 3
What if researchers called your landline or mobile and asked you to participate in a survey over the phone? Would you agree to do it? Why or why not?
21
© 2018 Cengage Learning. All Rights Reserved.
Methods Comparison
• Self-administered questionnaires are generally cheaper, better for sensitive issues than interview surveys
• Using mail: Local and national surveys cost the same
• Interviews: More appropriate when respondent literacy may be a problem, produce fewer incompletes, achieve higher completion rates
• Validity low, reliability high in survey research • Surveys are also inflexible, superficial in coverage
22
© 2018 Cengage Learning. All Rights Reserved.
Strengths of Survey Research
• Particularly useful in describing large populations
• Standardized questionnaires can ensure uniform responses and measurement
• Protects against respondents interpreting concepts differently
23
© 2018 Cengage Learning. All Rights Reserved.
Weaknesses of Survey Research
• Standardized questionnaire items often represent the least common denominator in assessing people’s attitudes, orientations, circumstances, and experiences
• Superficial coverage of complex topics • Survey research cannot readily deal with the specific
contexts of social life • Some populations might be hard to contact through
customary sampling methods
24
© 2018 Cengage Learning. All Rights Reserved.
Should You Do It Yourself?
• Consider start-up costs • Finding, training, and paying interviewers
is time-consuming and not cheap, and requires some expertise
• Mail surveys are less expensive, and can be conducted well by 1–2 persons
• The method you use depends on your research question
25