wk 1 d

profileGEMENI80
Print2.PDF

Chapter 1 The Selection of a Research Approach

Research approaches are plans and the procedures for research that span the steps from broad assumptions to detailed methods of data collection, analysis, and interpretation. This plan involves several decisions, and they need not be taken in the order in which they make sense to us and the order of their presentation here. The overall decision involves which approach should be used to study a topic. Informing this decision should be the philosophical assumptions the researcher brings to the study; procedures of inquiry (called research designs); and specific research methods of data collection, analysis, and interpretation. The selection of a research approach is also based on the nature of the research problem or issue being addressed, the researchers’ personal experiences, and the audiences for the study. Thus, in this book, research approaches, research designs, and research methods are three key terms that represent a perspective about research that presents information in a successive way from broad constructions of research to the narrow procedures of methods.

1.1 The Three Approaches to Research

In this book, three research approaches are advanced: (a) qualitative, (b) quantitative, and (c) mixed methods. Unquestionably, the three approaches are not as discrete as they first appear. Qualitative and quantitative approaches should not be viewed as rigid, distinct categories, polar opposites, or dichotomies. Instead, they represent different ends on a continuum (Creswell, 2015; Newman & Benz, 1998). A study tends to be more qualitative than quantitative or vice versa. Mixed methods research resides in the middle of this continuum because it incorporates elements of both qualitative and quantitative approaches.

Often the distinction between qualitative research and quantitative research is framed in terms of using words (qualitative) rather than numbers (quantitative), or better yet, using closed-ended questions and responses (quantitative hypotheses) or open-ended questions and responses (qualitative interview questions). A more complete way to view the gradations of differences between them is in the basic philosophical assumptions researchers bring to the study, the types of research strategies used in the research (e.g., quantitative experiments or qualitative case studies), and the specific methods employed in conducting these strategies (e.g., collecting data quantitatively on instruments versus collecting qualitative data through observing a setting). Moreover, there is a historical evolution to both approaches—with the quantitative approaches dominating the forms of research in the social sciences from the late 19th century up until the mid-20th century. During the latter half of the 20th century, interest in qualitative research increased and along with it, the development of mixed methods research. With this background, it should prove helpful to view definitions of these three key terms as used in this book:

Qualitative research is an approach for exploring and understanding the meaning individuals or groups ascribe to a social or human problem. The process of research involves emerging questions and procedures, data typically collected in the participant’s setting, data analysis inductively building from particulars to general themes, and the researcher making interpretations of the meaning of the data. The final written report has a flexible structure. Those who engage in this form of inquiry support a way of looking at research that honors an inductive style, a focus on individual meaning, and the importance of reporting the complexity of a situation.

Quantitative research is an approach for testing objective theories by examining the relationship among variables. These variables, in turn, can be measured, typically on instruments, so that numbered data can be analyzed using statistical procedures. The final written report has a set structure consisting of introduction, literature and theory, methods, results, and discussion. Like qualitative researchers, those who engage in this form of inquiry have assumptions about testing theories deductively, building in protections against bias, controlling for alternative or counterfactual explanations, and being able to generalize and replicate the findings.

Mixed methods research is an approach to inquiry involving collecting both quantitative and qualitative data, integrating the two forms of data, and using distinct designs that may involve philosophical assumptions and theoretical frameworks. The core assumption of this form of inquiry is that the integration of qualitative and quantitative data yields additional insight beyond the information provided by either the quantitative or qualitative data alone.

These definitions have considerable information in each one of them. Throughout this book, we will discuss the parts of the definitions so that their meanings will become clear to you as you read ahead.

1.2 Three Components Involved in an Approach

Two important components in each definition are that the approach to research involves philosophical assumptions as well as distinct methods or procedures. The broad research approach is the plan or proposal to conduct research, involves the intersection of philosophy, research designs, and specific methods. A framework that we use to explain the interaction of these three components is seen in Figure 1.1 (http://content.thuzelearning.com/books/Creswell.5819.18.1/sections/navpoint-13#s9781506386720.i606) . To reiterate, in planning a study, researchers need to think through the philosophical worldview assumptions that they bring to the study, the research design that is related to this worldview, and the specific methods or procedures of research that translate the approach into practice.

Figure 1.1 A Framework for Research—The Interconnection of Worldviews, Design, and Research Methods

Philosophical Worldviews

Although philosophical ideas remain largely hidden in research (Slife & Williams, 1995), they still influence the practice of research and need to be identified. We suggest that individuals preparing a research proposal or plan make explicit the larger philosophical ideas they espouse. This information will help explain why they chose qualitative, quantitative, or mixed methods approaches for their research. In writing about worldviews, a proposal might include a section that addresses the following:

The philosophical worldview proposed in the study

A definition of basic ideas of that worldview

How the worldview shaped their approach to research

We have chosen to use the term worldview as meaning “a basic set of beliefs that guide action” (Guba, 1990, p. 17). Others have called them paradigms (Lincoln, Lynham, & Guba, 2011; Mertens, 2010); epistemologies and ontologies (Crotty, 1998), or broadly conceived research methodologies (Neuman, 2009). We see worldviews as a general philosophical orientation about the world and the nature of research that a researcher brings to a study. Individuals develop worldviews based on their discipline

orientations and research communities, advisors and mentors, and past research experiences. The types of beliefs held by individual researchers based on these factors will often lead to embracing a strong qualitative, quantitative, or mixed methods approach in their research. Although there is ongoing debate about what worldviews or beliefs researchers bring to inquiry, we will highlight four that are widely discussed in the literature: postpositivism, constructivism, transformative, and pragmatism. The major elements of each position are presented in Table 1.1 (http://content.thuzelearning.com/books/Creswell.5819.18.1/sections/navpoint-13#s9781506386720.i612) .

The Postpositivist Worldview

The postpositivist assumptions have represented the traditional form of research, and these assumptions hold true more for quantitative research than qualitative research. This worldview is sometimes called the scientific method, or doing science research. It is also called positivist/postpositivist research, empirical science, and postpositivism. This last term is called postpositivism because it represents the thinking after positivism, challenging the traditional notion of the absolute truth of knowledge (Phillips & Burbules, 2000) and recognizing that we cannot be absolutely positive about our claims of knowledge when studying the behavior and actions of humans. The postpositivist tradition comes from 19th-century writers, such as Comte, Mill, Durkheim, Newton, and Locke (Smith, 1983) and more recently from writers such as Phillips and Burbules (2000).

Postpositivists hold a deterministic philosophy in which causes (probably) determine effects or outcomes. Thus, the problems studied by postpositivists reflect the need to identify and assess the causes that influence outcomes, such as those found in experiments. It is also reductionistic in that the intent is to reduce the ideas into a small, discrete set to test, such as the variables that comprise hypotheses and research questions. The knowledge that develops through a postpositivist lens is based on careful observation and measurement of the objective reality that exists “out there” in the world. Thus, developing numeric measures of observations and studying the behavior of individuals becomes paramount for a postpositivist. Finally, there are laws or theories that govern the world, and these need to be tested or verified and refined so that we can understand the world. Thus, in the scientific method —the accepted approach to research by postpositivists—a researcher begins with a theory, collects data that either supports or refutes the theory, and then makes necessary revisions and conducts additional tests.

In reading Phillips and Burbules (2000), you can gain a sense of the key assumptions of this position, such as the following:

1. Knowledge is conjectural (and antifoundational)—absolute truth can never be found. Thus, evidence established in research is always imperfect and fallible. It is for this reason that researchers state that they do not prove a hypothesis; instead, they indicate a failure to reject the hypothesis.

2. Research is the process of making claims and then refining or abandoning some of them for other claims more strongly warranted. Most quantitative research, for example, starts with the test of a theory.

3. Data, evidence, and rational considerations shape knowledge. In practice, the researcher collects information on instruments based on measures completed by the participants or by observations recorded by the researcher.

4. Research seeks to develop relevant, true statements, ones that can serve to explain the situation of concern or that describe the causal relationships of interest. In quantitative studies, researchers advance the relationship among variables and pose this in terms of questions or hypotheses.

5. Being objective is an essential aspect of competent inquiry; researchers must examine methods and conclusions for bias. For example, standard of validity and reliability are important in quantitative research.

The Constructivist Worldview

Others hold a different worldview. Constructivism or social constructivism (often combined with interpretivism) is such a perspective, and it is typically seen as an approach to qualitative research. The ideas came from Mannheim and from works such as Berger and Luckmann’s (1967) The Social Construction of Reality and Lincoln and Guba’s (1985) Naturalistic Inquiry. More recent writers who have summarized this position are Lincoln and colleagues (2011), Mertens (2010), and Crotty (1998), among others. Social constructivists believe that individuals seek understanding of the world in which they live and work. Individuals develop subjective meanings of their experiences—meanings directed toward certain objects or things. These meanings are varied and multiple, leading the researcher to look for the complexity of views rather than narrowing meanings into a few categories or ideas. The goal of the research is to rely as much as possible on the participants’ views of the situation being studied. The questions become broad and general so that the participants can construct the meaning of a situation, typically forged in discussions or interactions with other persons. The more open-ended the questioning, the better, as the researcher listens carefully to what people say or do in their life settings. Often these subjective meanings are negotiated socially and historically. They are not simply imprinted on individuals but are formed through interaction with others (hence social constructivism) and through historical and cultural norms that operate in individuals’ lives. Thus, constructivist researchers often address the processes of interaction among individuals. They also focus on the specific contexts in which people live and work in order to understand the historical and cultural settings of the participants. Researchers recognize that their own backgrounds shape their interpretation, and they position themselves in the research to acknowledge how their interpretation flows from their personal, cultural, and historical experiences. The researcher’s intent is to make sense of (or interpret) the meanings others have about the world. Rather than starting with a theory (as in postpositivism), inquirers generate or inductively develop a theory or pattern of meaning.

For example, in discussing constructivism, Crotty (1998) identified several assumptions:

1. Human beings construct meanings as they engage with the world they are interpreting. Qualitative researchers tend to use open-ended questions so that the participants can share their views.

2. Humans engage with their world and make sense of it based on their historical and social perspectives—we are all born into a world of meaning bestowed upon us by our culture. Thus, qualitative researchers seek to understand the context or setting of the participants through visiting this context and gathering information personally. They also interpret what they find, an interpretation shaped by the researcher’s own experiences and background.

3. The basic generation of meaning is always social, arising in and out of interaction with a human community. The process of qualitative research is largely inductive; the inquirer generates meaning from the data collected in the field.

The Transformative Worldview

Another group of researchers holds to the philosophical assumptions of the transformative approach. This position arose during the 1980s and 1990s from individuals who felt that the postpositivist assumptions imposed structural laws and theories that did not fit marginalized individuals in our society or issues of power and social justice, discrimination, and oppression that needed to be addressed. There is no uniform body of literature characterizing this worldview, but it includes groups of researchers that are critical theorists; participatory action researchers; Marxists; feminists; racial and ethnic minorities; persons with disabilities; indigenous and postcolonial peoples; and members of the lesbian, gay, bisexual, transsexual, and queer communities. Historically, the transformative writers have drawn on the works of Marx, Adorno, Marcuse, Habermas, and Freire (Neuman, 2009). Fay (1987), Heron and Reason (1997), Kemmis and Wilkinson (1998), Kemmis and McTaggart (2000), and Mertens (2009, 2010) are additional writers to read for this perspective.

In the main, these inquirers felt that the constructivist stance did not go far enough in advocating for an action agenda to help marginalized peoples. A transformative worldview holds that research inquiry needs to be intertwined with politics and a political change agenda to confront social oppression at whatever levels it occurs (Mertens, 2010). Thus, the research contains an action agenda for reform that may change lives of the participants, the institutions in which individuals work or live, and the researcher’s life. Moreover, specific issues need to be addressed that speak to important social issues of the day, issues such as empowerment, inequality, oppression, domination, suppression, and alienation. The researcher often begins with one of these issues as the focal point of the study. This research also assumes that the inquirer will proceed collaboratively so as to not further marginalize the participants as a result of the inquiry. In this sense, the participants may help design questions, collect data, analyze information, or reap the rewards of the research. Transformative research provides a voice for these participants, raising their consciousness or advancing an agenda for change to improve their lives. It becomes a united voice for reform and change.

This philosophical worldview focuses on the needs of groups and individuals in our society that may be marginalized or disenfranchised. Therefore, theoretical perspectives may be integrated with the philosophical assumptions that construct a picture of the issues being examined, the people to be studied, and the changes that are needed, such as feminist perspectives, racialized discourses, critical theory, queer theory, and disability theory—theoretical lens to be discussed more in Chapter 3 (s9781506386720.i731.xhtml) .

Although these are diverse groups and our explanations here are generalizations, it is helpful to view the summary by Mertens (2010) of key features of the transformative worldview or paradigm:

It places central importance on the study of lives and experiences of diverse groups that have traditionally been marginalized. Of special interest for these diverse groups is how their lives have been constrained by oppressors and the strategies that they use to resist, challenge, and subvert these constraints.

In studying these diverse groups, the research focuses on inequities based on gender, race, ethnicity, disability, sexual orientation, and socioeconomic class that result in asymmetric power relationships.

The research in the transformative worldview links political and social action to these inequities.

Transformative research uses a program theory of beliefs about how a program works and why the problems of oppression, domination, and power relationships exist.

The Pragmatic Worldview

Another position about worldviews comes from the pragmatists. Pragmatism derives from the work of Peirce, James, Mead, and Dewey (Cherryholmes, 1992). Other writers include Murphy (1990), Patton (1990), and Rorty (1990). There are many forms of this philosophy, but for many, pragmatism as a worldview arises out of actions, situations, and consequences rather than antecedent conditions (as in postpositivism). There is a concern with applications—what works—and solutions to problems (Patton, 1990). Instead of focusing on methods, researchers emphasize the research problem and question and use all approaches available to understand the problem (see Rossman & Wilson, 1985). As a philosophical underpinning for mixed methods studies, Morgan (2007), Patton (1990), and Tashakkori and Teddlie (2010) convey its importance for focusing attention on the research problem in social science research and then using pluralistic approaches to derive knowledge about the problem. Using Cherryholmes (1992), Morgan (2007), and our own views, pragmatism provides a philosophical basis for research:

Pragmatism is not committed to any one system of philosophy and reality. This applies to mixed methods research in that inquirers draw liberally from both quantitative and qualitative assumptions when they engage in their research.

Individual researchers have a freedom of choice. In this way, researchers are free to choose the methods, techniques, and procedures of research that best meet their needs and purposes.

Pragmatists do not see the world as an absolute unity. In a similar way, mixed methods researchers look to many approaches for collecting and analyzing data rather than subscribing to only one way (e.g., quantitative or qualitative).

Truth is what works at the time. It is not based in a duality between reality independent of the mind or within the mind. Thus, in mixed methods research, investigators use both quantitative and qualitative data because they work to provide the best understanding of a research problem.

The pragmatist researchers look to the what and how to research based on the intended consequences—where they want to go with it. Mixed methods researchers need to establish a purpose for their mixing, a rationale for the reasons why quantitative and qualitative data need to be mixed in the first place.

Pragmatists agree that research always occurs in social, historical, political, and other contexts. In this way, mixed methods studies may include a postmodern turn, a theoretical lens that is

reflective of social justice and political aims.

Pragmatists have believed in an external world independent of the mind as well as that lodged in the mind. But they believe that we need to stop asking questions about reality and the laws of nature (Cherryholmes, 1992). “They would simply like to change the subject” (Rorty, 1990, p. xiv).

Thus, for the mixed methods researcher, pragmatism opens the door to multiple methods, different worldviews, and different assumptions, as well as different forms of data collection and analysis.

Research Designs

The researcher not only selects a qualitative, quantitative, or mixed methods study to conduct; the inquirer also decides on a type of study within these three choices. Research designs are types of inquiry within qualitative, quantitative, and mixed methods approaches that provide specific direction for procedures in a research study. Others have called them strategies of inquiry (Denzin & Lincoln, 2011). The designs available to the researcher have grown over the years as computer technology has advanced our data analysis and ability to analyze complex models, and as individuals have articulated new procedures for conducting social science research. Select types will be emphasized in the methods of Chapters 8 (s9781506386720.i1063.xhtml) , 9 (s9781506386720.i1172.xhtml) , and 10 (s9781506386720.i1249.xhtml) —designs that are frequently used in the social sciences. Here we introduce those that are discussed later and that are cited in examples throughout the book. An overview of these designs is shown in Table 1.2 (http://content.thuzelearning.com/books/Creswell.5819.18.1/sections/navpoint- 13#s9781506386720.i627) .

Quantitative Designs

During the late 19th and throughout the 20th century, strategies of inquiry associated with quantitative research were those that invoked the postpositivist worldview and that originated mainly in psychology. These include true experiments and the less rigorous experiments called quasi-experiments (see, an original, early treatise on this, Campbell & Stanley, 1963). An additional experimental design is applied behavioral analysis or single-subject experiments in which an experimental treatment is administered over time to a single individual or a small number of individuals (Cooper, Heron, & Heward, 2007; Neuman & McCormick, 1995). One type of nonexperimental quantitative research is causal-comparative research in which the investigator compares two or more groups in terms of a cause (or independent variable) that has already happened. Another nonexperimental form of research is the correlational design in which investigators use the correlational statistic to describe and measure the degree or association (or relationship) between two or more variables or sets of scores (Creswell, 2012). These designs have been elaborated into more complex relationships among variables found in techniques of structural equation modeling, hierarchical linear modeling, and logistic regression. More recently, quantitative strategies have involved complex experiments with many variables and treatments (e.g., factorial designs and repeated measure designs). Designs often employ longitudinal data collection over time to examine the development of ideas and trends. Designs have also included elaborate structural equation models that incorporate causal paths and the identification of the collective strength of multiple variables. Rather than discuss all of these quantitative approaches, we will focus on two designs: surveys and experiments.

Survey research provides a quantitative or numeric description of trends, attitudes, or opinions of a population by studying a sample of that population. It includes cross-sectional and longitudinal studies using questionnaires or structured interviews for data collection—with the intent of generalizing from a sample to a population (Fowler, 2008).

Experimental research seeks to determine if a specific treatment influences an outcome. The researcher assesses this by providing a specific treatment to one group and withholding it from another and then determining how both groups scored on an outcome. Experiments include true experiments, with the random assignment of subjects to treatment conditions, and quasi- experiments that use nonrandomized assignments (Keppel, 1991). Included within quasi- experiments are single-subject designs.

Qualitative Designs

In qualitative research, the numbers and types of approaches have also become more clearly visible during the 1990s and into the 21st century. The historic origin for qualitative research comes from anthropology, sociology, the humanities, and evaluation. Books have summarized the various types, and complete procedures are now available on specific qualitative inquiry approaches (Creswell & Poth, 2018). For example, Clandinin and Connelly (2000) constructed a picture of what narrative researchers do. Moustakas (1994) discussed the philosophical tenets and the procedures of the phenomenological method; Charmaz (2006), Corbin and Strauss (2007; 2015), and Strauss and Corbin (1990, 1998) identified the procedures of grounded theory. Fetterman (2010) and Wolcott (2008) summarized ethnographic procedures and the many faces and research strategies of ethnography, and Stake (1995) and Yin (2009, 2012, 2014) suggested processes involved in case study research. In this book, illustrations are drawn from the following strategies, recognizing that approaches such as participatory action research (Kemmis & McTaggart, 2000), discourse analysis (Cheek, 2004), and others not mentioned are also viable ways to conduct qualitative studies:

Narrative research is a design of inquiry from the humanities in which the researcher studies the lives of individuals and asks one or more individuals to provide stories about their lives (Riessman, 2008). This information is then often retold or restoried by the researcher into a narrative chronology. Often, in the end, the narrative combines views from the participant’s life with those of the researcher’s life in a collaborative narrative (Clandinin & Connelly, 2000).

Phenomenological research is a design of inquiry coming from philosophy and psychology in which the researcher describes the lived experiences of individuals about a phenomenon as described by participants. This description culminates in the essence of the experiences for several individuals who have all experienced the phenomenon. This design has strong philosophical underpinnings and typically involves conducting interviews (Giorgi, 2009; Moustakas, 1994).

Grounded theory is a design of inquiry from sociology in which the researcher derives a general, abstract theory of a process, action, or interaction grounded in the views of participants. This process involves using multiple stages of data collection and the refinement and interrelationship of categories of information (Charmaz, 2006; Corbin & Strauss, 2007, 2015).

Ethnography is a design of inquiry coming from anthropology and sociology in which the researcher studies the shared patterns of behaviors, language, and actions of an intact cultural group in a natural setting over a prolonged period of time. Data collection often involves observations and interviews.

Case studies are a design of inquiry found in many fields, especially evaluation, in which the researcher develops an in-depth analysis of a case, often a program, event, activity, process, or one or more individuals. Cases are bounded by time and activity, and researchers collect detailed information using a variety of data collection procedures over a sustained period of time (Stake, 1995; Yin, 2009, 2012, 2014).

Mixed Methods Designs

Mixed methods involves combining or integration of qualitative and quantitative research and data in a research study. Qualitative data tends to be open-ended without predetermined responses while quantitative data usually includes closed-ended responses such as found on questionnaires or psychological instruments. The field of mixed methods research, as we know it today, began in the middle to late 1980s. Its origins, however, go back further. In 1959, Campbell and Fisk used multiple methods to study psychological traits—although their methods were only quantitative measures. Their work prompted others to begin collecting multiple forms of data, such as observations and interviews (qualitative data) with traditional surveys (Sieber, 1973). Early thoughts about the value of multiple methods—called mixed methods—resided in the idea that all methods had bias and weaknesses, and the collection of both quantitative and qualitative data neutralized the weaknesses of each form of data. Triangulating data sources—a means for seeking convergence across qualitative and quantitative methods—was born (Jick, 1979). By the early 1990s, mixed methods turned toward the systematic integration of quantitative and qualitative data, and the idea of ways to combine the data through different types of research designs emerged. These types of designs were extensively discussed in a major handbook addressing the field in 2003 and reissued in 2010 (Tashakkori & Teddlie, 2010). Procedures for expanding mixed methods developed such as follows:

Ways to integrate the quantitative and qualitative data, such as one database, could be used to check the accuracy (validity) of the other database.

One database could help explain the other database, and one database could explore different types of questions than the other database.

One database could lead to better instruments when instruments are not well-suited for a sample or population.

One database could build on other databases, and one database could alternate with another database back and forth during a longitudinal study.

Further, the designs were developed and notation was added to help the reader understand the designs; challenges to working with the designs emerged (Creswell & Plano Clark, 2011, 2018). Practical issues are being widely discussed today in terms of examples of “good” mixed methods studies and evaluative criteria, the use of a team to conduct this model of inquiry, and the expansion of mixed

methods to other countries and disciplines. Although many designs exist in the mixed methods field, this book will focus on the three primary designs found in the social and health sciences today:

Convergent mixed methods is a form of mixed methods design in which the researcher converges or merges quantitative and qualitative data in order to provide a comprehensive analysis of the research problem. In this design, the investigator typically collects both forms of data at roughly the same time and then integrates the information in the interpretation of the overall results. Contradictions or incongruent findings are explained or further probed in this design.

Explanatory sequential mixed methods is one in which the researcher first conducts quantitative research, analyzes the results and then builds on the results to explain them in more detail with qualitative research. It is considered explanatory because the initial quantitative data results are explained further with the qualitative data. It is considered sequential because the initial quantitative phase is followed by the qualitative phase. This type of design is popular in fields with a strong quantitative orientation (hence the project begins with quantitative research), but it presents challenges of identifying the quantitative results to further explore and the unequal sample sizes for each phase of the study.

Exploratory sequential mixed methods is the reverse sequence from the explanatory sequential design. In the exploratory sequential approach the researcher first begins with a qualitative research phase and explores the views of participants. The data are then analyzed, and the information used to build into a second, quantitative phase. The qualitative phase may be used to build an instrument that best fits the sample under study, to identify appropriate instruments to use in the follow-up quantitative phase, to develop an intervention for an experiment, to design an app or website, or to specify variables that need to go into a follow-up quantitative study. Particular challenges to this design reside in focusing in on the appropriate qualitative findings to use and the sample selection for both phases of research.

These basic or core designs then can be used in more complex mixed methods strategies. The core designs can augment an experiment by, for example, collecting qualitative data after the experiment to help explain the quantitative outcome results. The core designs can be used within a case study framework to deductively document cases or to generate cases for further analysis. These basic designs can inform a theoretical study drawn from social justice or power (see Chapter 3 (s9781506386720.i731.xhtml) ) as an overarching perspective within a design that contains both quantitative and qualitative data. The core designs can also be used in the different phases of an evaluation procedure that spans from a needs assessment to a test of a program or experimental intervention.

Research Methods

The third major element in the framework is the specific research methods that involve the forms of data collection, analysis, and interpretation that researchers propose for their studies. As shown in Table 1.3 (http://content.thuzelearning.com/books/Creswell.5819.18.1/sections/navpoint-13#s9781506386720.i638) , it is useful to consider the full range of possibilities of data collection and to organize these methods, for example, by their degree of predetermined nature, their use of closed-ended versus open-ended questioning, and their focus on numeric versus nonnumeric data analysis. These methods will be developed further in Chapters 8 (s9781506386720.i1063.xhtml) through 10 (s9781506386720.i1249.xhtml) .

Researchers collect data on an instrument or test (e.g., a set of questions about attitudes toward self- esteem) or gather information on a behavioral checklist (e.g., observation of a worker engaged in a complex skill). On the other end of the continuum, collecting data might involve visiting a research site

and observing the behavior of individuals without predetermined questions or conducting an interview in which the individual is allowed to talk openly about a topic, largely without the use of specific questions. The choice of methods turns on whether the intent is to specify the type of information to be collected in advance of the study or to allow it to emerge from participants in the project. Also, the type of data analyzed may be numeric information gathered on scales of instruments or text information recording and reporting the voice of the participants. Researchers make interpretations of the statistical results, or they interpret the themes or patterns that emerge from the data. In some forms of research, both quantitative and qualitative data are collected, analyzed, and interpreted. Instrument data may be augmented with open-ended observations, or census data may be followed by in-depth exploratory interviews. In this case of mixing methods, the researcher makes inferences across both the quantitative and qualitative databases.

1.3 Research Approaches as Worldviews, Designs, and Methods

The worldviews, the designs, and the methods all contribute to a research approach that tends to be quantitative, qualitative, or mixed. Table 1.4 (http://content.thuzelearning.com/books/Creswell.5819.18.1/sections/navpoint-14#s9781506386720.i642) creates distinctions that may be useful in choosing an approach. This table also includes practices of all three approaches that are emphasized in remaining chapters of this book.

Typical scenarios of research can illustrate how these three elements combine into a research design.

Quantitative approach: Postpositivist worldview, experimental design, and pretest and posttest measures of attitudes

In this scenario, the researcher tests a theory by specifying narrow hypotheses and the collection of data to support or refute the hypotheses. An experimental design is used in which attitudes are assessed both before and after an experimental treatment. The data are collected on an instrument that measures attitudes, and the information is analyzed using statistical procedures and hypothesis testing.

Qualitative approach: Constructivist worldview, ethnographic design, and observation of behavior

In this situation, the researcher seeks to establish the meaning of a phenomenon from the views of participants. This means identifying a culture-sharing group and studying how it develops shared patterns of behavior over time (i.e., ethnography). One of the key elements of collecting data in this way is to observe participants’ behaviors during their engagement in activities.

Qualitative approach: Transformative worldview, narrative design, and open-ended interviewing

For this study, the inquirer seeks to examine an issue related to oppression of individuals. To study this, stories are collected of individual oppression using a narrative approach. Individuals are interviewed at some length to determine how they have personally experienced oppression.

Mixed methods approach: Pragmatic worldview, collection of both quantitative and qualitative data sequentially in the design

The researcher bases the inquiry on the assumption that collecting diverse types of data best provides a more complete understanding of a research problem than either quantitative or qualitative data alone. The study begins with a broad survey in order to generalize results to a population and then, in a second phase, focuses on qualitative, open-ended interviews to collect detailed views from participants to help explain the initial quantitative survey.

1.4 Criteria for Selecting a Research Approach

Given the possibility of qualitative, quantitative, or mixed methods approaches, what factors affect a choice of one approach over another for the design of a proposal? Added to worldview, design, and methods would be the research problem, the personal experiences of the researcher, and the audience(s) for whom the report will be written.

The Research Problem and Questions

A research problem, more thoroughly discussed in Chapter 5 (s9781506386720.i906.xhtml) , is an issue or concern that needs to be addressed (e.g., the issue of racial discrimination). The problem comes from a void in the literature, and conflict in research results in the literature, topics that have been neglected in the literature; a need to lift up the voice of marginalized participants; and “real-life” problems found in the workplace, the home, the community, and so forth.

Certain types of social research problems call for specific approaches. For example, if the problem calls for (a) the identification of factors that influence an outcome, (b) the utility of an intervention, or (c) understanding the best predictors of outcomes, then a quantitative approach is best. It is also the best approach to use to test a theory or explanation. On the other hand, if a concept or phenomenon needs to be explored and understood because little research has been done on it or because it involves an understudied sample, then it merits a qualitative approach. Qualitative research is especially useful when the researcher does not know the important variables to examine. This type of approach may be needed because the topic is new, the subject has never been addressed with a certain sample or group of people, and existing theories do not apply with the particular sample or group under study (Morse, 1991). A mixed methods design is useful when the quantitative or qualitative approach, each by itself, is inadequate to best understand a research problem and the strengths of both quantitative and qualitative research (and its data) can provide the best understanding. For example, a researcher may want to both generalize the findings to a population as well as develop a detailed view of the meaning of a phenomenon or concept for individuals. In this research, the inquirer first explores generally to learn what variables to study and then studies those variables with a large sample of individuals. Alternatively, researchers may first survey a large number of individuals and then follow up with a few participants to obtain their specific views and their voices about the topic. In these situations, collecting both closed-ended quantitative data and open-ended qualitative data proves advantageous.

Personal Experiences

Researchers’ own personal training and experiences also influence their choice of approach. An individual trained in technical, scientific writing, statistics, and computer statistical programs and familiar with quantitative journals in the library would most likely choose the quantitative design. On the other hand, individuals who enjoy writing in a literary way or conducting personal interviews or making up-close observations may gravitate to the qualitative approach. The mixed methods researcher is an individual familiar with both quantitative and qualitative research. This person also has the time and resources to collect and analyze both quantitative and qualitative data.

Since quantitative studies are the traditional mode of research, carefully worked out procedures and rules exist for them. Researchers may be more comfortable with the highly systematic procedures of quantitative research. Also, for some individuals, it can be uncomfortable to challenge accepted approaches among some faculty by using qualitative and transformative approaches to inquiry. On the other hand, qualitative approaches allow room to be innovative and to work more within researcher- designed frameworks. They allow more creative, literary-style writing, a form that individuals may like

to use. For those researchers undertaking social justice or community involvement, a qualitative approach is typically best, although this form of research may also incorporate mixed methods designs.

For the mixed methods researcher, the project will take extra time because of the need to collect and analyze both quantitative and qualitative data. It fits a person who enjoys and has the skills in both quantitative and qualitative research.

Audience

Finally, researchers write for audiences that will accept their research. These audiences may be journal editors and readers, faculty committees, conference attendees, or colleagues in the field. Students should consider the approaches typically supported and used by their advisers. The experiences of these audiences with quantitative, qualitative, or mixed methods studies can shape the decision made about the choice of design.

Summary

In planning a research project, researchers need to identify whether they will employ a qualitative, quantitative, or mixed methods approach. This approach is based on bringing together a worldview or assumptions about research, a specific design, and research methods. Decisions about choice of an approach are further influenced by the research problem or issue being studied, the personal experiences of the researcher, and the audience for whom the researcher writes.

Writing Exercises

1. Identify a research question in a journal article and discuss what approach would be best to study the question and why.

2. Take a topic that you would like to study, and using the four combinations of worldviews, designs, and research methods in Figure 1.1 (http://content.thuzelearning.com/books/Creswell.5819.18.1/sections/navpoint- 13#s9781506386720.i606) , discuss a project that brings together a worldview, designs, and methods. Identify whether this would be quantitative, qualitative, or mixed methods research. Use the typical scenarios that we have advanced in this chapter as a guide.

3. What distinguishes a quantitative study from a qualitative study? Mention three characteristics.

Additional Readings

Cherryholmes, C. H. (1992, August–September). Notes on pragmatism and scientific realism. Educational Researcher, 14, 13–17.

Cleo Cherryholmes discusses pragmatism as a contrasting perspective from scientific realism. The strength of this article lies in the numerous citations of writers about pragmatism and a clarification of one version of pragmatism. Cherryholmes’s version points out that pragmatism is driven by anticipated consequences, reluctance to tell a true story, and the idea that there is an external world independent of our minds. Also included in this article are numerous references to historical and recent writers about pragmatism as a philosophical position.

Crotty, M. (1998). The foundations of social research: Meaning and perspective in the research process. Thousand Oaks, CA: Sage.

Michael Crotty offers a useful framework for tying together the many epistemological issues, theoretical perspectives, methodology, and methods of social research. He interrelates the four components of the research process and shows in a table a representative sampling of topics of each component. He then goes on to discuss nine different theoretical orientations in social

research, such as postmodernism, feminism, critical inquiry, interpretivism, constructionism, and positivism.

Kemmis, S., & Wilkinson, M. (1998). Participatory action research and the study of practice. In B. Atweh, S. Kemmis, & P. Weeks (Eds.), Action research in practice: Partnerships for social justice in education (pp. 21–36). New York: Routledge.

Stephen Kemmis and Mervyn Wilkinson provide an excellent overview of participatory research. In particular, they note the six major features of this inquiry approach and then discuss how action research is practiced at the individual, the social, or at both levels.

Lincoln, Y. S., Lynham, S. A., & Guba, E. G. (2011). Paradigmatic controversies, contradictions, and emerging confluences revisited. In N. K. Denzin & Y. S. Lincoln, The SAGE handbook of qualitative research (4th ed., pp. 97–128). Thousand Oaks, CA: Sage.

Yvonna Lincoln, Susan Lynham, and Egon Guba have provided the basic beliefs of five alternative inquiry paradigms in social science research: (a) positivism, (b) postpositivism, (c) critical theory, (d) constructivism, and (e) participatory. These extend the earlier analysis provided in the first and second editions of the handbook. Each is presented in terms of ontology (i.e., nature of reality), epistemology (i.e., how we know what we know), and methodology (i.e., the process of research). The participatory paradigm adds another alternative paradigm to those originally advanced in the first edition. After briefly presenting these five approaches, they contrast them in terms of seven issues, such as the nature of knowledge, how knowledge accumulates, and goodness or quality criteria.

Mertens, D. (2009). Transformative research and evaluation. New York: Guilford.

Donna Mertens has devoted an entire text to advancing the transformative paradigm and the process of transformative research. She discusses the basic features of the transformative paradigm as an umbrella term, provides examples of groups affiliated with this paradigm, and links the paradigm to quantitative, qualitative, and mixed methods approaches. In this book she also discusses the research procedures of sampling, consent, reciprocity, data collection methods and instruments, data analysis and interpretation, and reporting.

Phillips, D. C., & Burbules, N. C. (2000). Postpositivism and educational research. Lanham, MD: Rowman & Littlefield.

D. C. Phillips and Nicholas Burbules summarize the major ideas of postpostivist thinking. Through two chapters, “What is Postpositivism?” and “Philosophical Commitments of Postpositivist Researchers,” the authors advance major ideas about postpositivism—especially those that differentiate it from positivism. These include knowing that human knowledge is conjectural rather than unchallengeable and that our warrants for knowledge can be withdrawn in light of further investigations.

https://edge.sagepub.com/creswellrd5e (https://edge.sagepub.com/creswellrd5e)

Students and instructors, please visit the companion website for videos featuring John W. Creswell, full-text SAGE journal articles, quizzes and activities, plus additional tools for research design.

Chapter 2 Review of the Literature

Besides selecting a quantitative, qualitative, or mixed methods approach, the proposal or study designer also needs to review the literature about a topic. This literature review helps to determine whether the topic is worth studying, and it provides insight into ways in which the researcher can limit the scope to a needed area of inquiry.

This chapter continues the discussion about preliminary considerations before launching into a proposal or project. It begins with a discussion about selecting a topic and writing this topic down so that the researcher can continually reflect on it. At this point, researchers also need to consider whether the topic can and should be researched. Then the discussion moves into the actual process of reviewing the literature; addressing the general purpose for using literature in a study; and then turning to principles helpful in designing literature into qualitative, quantitative, and mixed methods studies.

2.1 The Research Topic

Before considering what literature to use in a project, first identify a topic to study and reflect on whether it is practical and useful to undertake the study. The topic is the subject or subject matter of a proposed study, such as “faculty teaching,” “organizational creativity,” or “psychological stress.” Describe the topic in a few words or in a short phrase. The topic becomes the central idea to learn about or to explore.

There are several ways that researchers gain some insight into their topics when they are initially planning their research (our assumption is that the topic is chosen by the researcher and not by an adviser or committee member). One way is to draft a brief working title to the study. We are surprised at how often researchers fail to draft a title early in the development of their projects. In our opinion, the working or draft title becomes a major road sign in research—a tangible idea that the researcher can keep refocusing on and changing as the project goes on (see Glesne, 2015; Glesne & Peshkin, 1992). It becomes an orienting device. We find that, in our research, this topic grounds us and provides a sign of what we are studying, as well as a sign useful for conveying to others the central notion of the study. When students first provide their research project ideas to us, we often ask them to supply a working title if they do not already have one written down on paper.

How would this working title be written? Try completing this sentence: “My study is about . . .” A response might be, “My study is about at-risk children in the junior high,” or “My study is about helping college faculty become better researchers.” At this stage in the design, frame the answer to the question so that another scholar might easily grasp the meaning of the project. A common shortcoming of beginning researchers is that they frame their study in complex and erudite language. This perspective may result from reading published articles that have undergone numerous revisions before being set in print. Good, sound research projects begin with straightforward, uncomplicated thoughts that are easy to read and understand. Think about a journal article that you have read recently. If it was easy and quick to read, it was likely written in general language that many readers could easily identify with in a way that was straightforward and simple in overall design and conceptualization. As a project develops it will become more complicated.

Wilkinson (1991) provided useful advice for creating a title: Be brief and avoid wasting words. Eliminate unnecessary words, such as “An Approach to . . . ,” “A Study of . . . ,” and so forth. Use a single title or a double title. An example of a double title would be “An Ethnography: Understanding a Child’s Perception of War.” In addition to Wilkinson’s thoughts, consider a title no longer than 12 words, eliminate most articles and prepositions, and make sure that it includes the focus or topic of the study.

Another strategy for topic development is to pose the topic as a brief question. What question needs to be answered in the proposed study? A researcher might ask, “What treatment is best for depression?” “What does it mean to be Arabic in U.S. society today?” “What brings people to tourist sites in the Midwest?” When drafting questions such as these, focus on the key topic in the question as the major signpost for the study. Consider how this question might be expanded later to be more descriptive of your study (see Chapters 6 (s9781506386720.i950.xhtml) and 7 (s9781506386720.i1009.xhtml) on the purpose statement and research questions and hypotheses).

Actively elevating this topic to a research study calls for reflecting on whether the topic can and should be researched. A topic can be researched if a researcher has participants willing to serve in the study. It also can be researched if the investigator has resources such as collecting data over a sustained period of time and using available computer programs to help in the analysis of data.

The question of should is a more complex matter. Several factors might go into this decision. Perhaps the most important are whether the topic adds to the pool of research knowledge in the literature

available on the topic, replicates past studies, lifts up the voices of underrepresented groups or individuals, helps address social justice, or transforms the ideas and beliefs of the researcher.

A first step in any project is to spend considerable time in the library examining the research on a topic (strategies for effectively using the library and library resources appear later in this chapter). This point cannot be overemphasized. Beginning researchers may advance a great study that is complete in every way, such as in the clarity of research questions, the comprehensiveness of data collection, and the sophistication of statistical analysis. But the researcher may garner little support from faculty committees or conference planners because the study does not add anything new to the body of research. Ask, “How does this project contribute to the literature?” Consider how the study might address a topic that has yet to be examined, extend the discussion by incorporating new elements, or replicate (or repeat) a study in new situations or with new participants. Contributing to the literature may also mean how the study adds to an understanding of a theory or extends a theory (see Chapter 3 (s9781506386720.i731.xhtml) ), or how the study provides a new perspective or “angle” to the existing literature, for example, by

Studying an unusual location (e.g., rural America)

Examining an unusual group of participants (e.g., refugees)

Taking a perspective that may not be expected and reverses the expectation (e.g., why marriages do work rather than do not work)

Providing novel means of collecting data (e.g., collect sounds)

Presenting results in unusual ways (e.g., graphs that depict geographical locations)

Studying a timely topic (e.g., immigration issues) (Creswell, 2016)

The issue of should the topic be studied also relates to whether anyone outside of the researcher’s own immediate institution or area would be interested in the topic. Given a choice between a topic that might be of limited regional interest or one of national interest, we would opt for the latter because it would have wide appeal to a much broader audience. Journal editors, committee members, conference planners, and funding agencies all appreciate research that reaches a broad audience. Finally, the should issue also relates to the researcher’s personal goals. Consider the time it takes to complete a project, revise it, and disseminate the results. All researchers should consider how the study and its heavy commitment of time will pay off in enhancing career goals, whether these goals relate to doing more research, obtaining a future position, or advancing toward a degree.

Before proceeding with a proposal or a study, one needs to weigh these factors and ask others for their reaction to a topic under consideration. Seek reactions from colleagues, noted authorities in the field, academic advisers, and faculty committee members. We often have students bring to us a one-page sketch of their proposed project that includes the problem or issue leading to a need for the study, the central research question they plan on asking, the types of data they will collect, and the overall significance of their study.

2.2 The Literature Review

Once the researcher identifies a topic that can and should be studied, the search can begin for related literature on the topic. The literature review accomplishes several purposes. It shares with the reader the results of other studies that are closely related to the one being undertaken. It relates a study to the larger, ongoing dialogue in the literature, filling in gaps and extending prior studies (Cooper, 2010; Marshall & Rossman, 2016). It provides a framework for establishing the importance of the study as well as a benchmark for comparing the results with other findings. All or some of these reasons may be the foundation for writing the scholarly literature into a study (see Boote & Beile, 2005, for a more extensive discussion of purposes for compiling a literature review in research). Studies need to add to the body of literature on a topic, and literature sections in proposals are generally shaped from the larger problem to the narrower issue that leads directly into the methods of a study.

The Use of the Literature

Beyond the question of why literature is used is the additional issue of how it is used in research and proposals. It can assume various forms. Our best advice is to seek the opinion of your adviser or faculty members as to how they would like to see the literature addressed. We generally recommend to our advisees that the literature review in a proposal or project be brief and provide a summary of the major studies on the research problem; it does not need to be fully developed and comprehensive at this point, since faculty may ask for major changes in the study at the proposal meeting. In this model, the literature review is shorter—say 20 to 30 pages in length—and tells the reader that the student is aware of the literature on the topic and the latest writings. Another approach is to develop a detailed outline of the topics and potential references that will later be developed into an entire chapter, usually the second, titled “Literature Review,” which might run from 20 to 60 pages or so.

The literature review in a journal article is an abbreviated form of that found in a dissertation or master’s thesis. It typically is contained in a section called “Related Literature” and follows the introduction to a study. This is the pattern for quantitative research articles in journals. For qualitative research articles, the literature review may be found in a separate section, included in the introduction, or threaded throughout the study. Regardless of the form, another consideration is how the literature might be reviewed, depending on whether a qualitative, quantitative, or mixed methods approach has been selected.

In general, the literature review can take several forms. Cooper (2010) discussed four types: literature reviews that (a) integrate what others have done and said, (b) criticize previous scholarly works, (c) build bridges between related topics, and (d) identify the central issues in a field. With the exception of criticizing previous scholarly works, most dissertations and theses serve to integrate the literature, organize it into a series of related topics (often from general topics to narrower ones), and summarize the literature by pointing out the central issues.

In qualitative research, inquirers use the literature in a manner consistent with the assumptions of learning from the participant, not prescribing the questions that need to be answered from the researcher’s standpoint. One of the chief reasons for conducting a qualitative study is that the study is exploratory. This usually means that not much has been written about the topic or the population being studied, and the researcher seeks to listen to participants and build an understanding based on what is heard.

However, the use of the literature in qualitative research varies considerably. In theoretically oriented studies, such as ethnographies or critical ethnographies, the literature on a cultural concept or a critical theory is introduced early in the report or proposal as an orienting framework. In grounded

theory, case studies, and phenomenological studies, literature is less often used to set the stage for the study.

With an approach grounded in learning from participants and variation by type, there are several models for incorporating the literature review into a qualitative study. We offer three placement locations, and it can be used in any or all of these locations. As shown in Table 2.1 (http://content.thuzelearning.com/books/Creswell.5819.18.1/sections/navpoint-19#s9781506386720.i671) , the researcher might include the literature review in the introduction. In this placement, the literature provides a useful backdrop for the problem or issue that has led to the need for the study, such as who has been writing about it, who has studied it, and who has indicated the importance of studying the issue. This framing of the problem is, of course, contingent on available studies. One can find illustrations of this model in many qualitative studies employing different types of inquiry strategy.

A second form is to review the literature in a separate section, a model typically used in quantitative research, often found in journals with a quantitative orientation. In theory-oriented qualitative studies, such as ethnography, critical theory, or with a transformative aim, the inquirer might locate the theory discussion and literature in a separate section, typically toward the beginning of the write-up. Third, the researcher may incorporate the related literature in the final section, where it is used to compare and contrast with the results (or themes or categories) to emerge from the study. This model is especially popular in grounded theory studies, and we recommend it because it uses the literature inductively.

Quantitative research, on the other hand, includes a substantial amount of literature at the beginning of a study to provide direction for the research questions or hypotheses. It is also used to introduce a problem or to describe in detail the existing literature in a section titled “Related Literature” or “Review of Literature,” or some other similar phrase. Also, the literature review can introduce a theory —an explanation for expected relationships (see Chapter 3 (s9781506386720.i731.xhtml) )—describe the theory that will be used, and suggest why it is a useful theory to examine. At the end of a study, the researcher then revisits the literature and makes a comparison between the results with the existing findings in the literature. In this model, the quantitative researcher uses the literature deductively as a framework for the research questions or hypotheses.

In a mixed methods study, the researcher uses either a qualitative or a quantitative approach to the literature, depending on the type of strategy being used. In a sequential approach, the literature is presented in each phase in a way consistent with the method being used. For example, if the study begins with a quantitative phase, then the investigator is likely to include a substantial literature review that helps to establish a rationale for the research questions or hypotheses. If the study begins with a qualitative phase, then the literature is substantially less, and the researcher may incorporate it more into the end of the study—an inductive approach. If the research advances a convergent study with an equal weight and emphasis on both qualitative and quantitative data, then the literature may take either qualitative or quantitative forms. The decision as to which form to use is based on the audience for the study and what they would be most receptive to as well as to the students’ graduate committees and their orientation. To recap, the literature used in a mixed methods project will depend on the strategy and the relative weight given to the qualitative or quantitative research in the study.

Our suggestions for using the literature in planning a qualitative, quantitative, or mixed methods study are as follows:

In a qualitative study, use the literature sparingly in the beginning in order to convey an inductive design unless the design type requires a substantial literature orientation at the outset.

Consider the most appropriate place for the literature in a qualitative study, and base the decision on the audience for the project. Keep in mind the options: placing it at the beginning to frame the problem, placing it in a separate section, and using it at the end to compare and contrast with the findings.

Use the literature in a quantitative study deductively—as a basis for advancing research questions or hypotheses.

In a quantitative study plan, use the literature to introduce the study, advance a theory, describe related literature in a separate section, and compare findings.

In a mixed methods study, use the literature in a way that is consistent with the major type of strategy and the qualitative or quantitative approach most prevalent in the design.

Regardless of the type of study, consider the type of literature review to conduct, such as an integrative, critical, building bridges among topics or the identification of central issues.

Design Techniques

Regardless of the type of study, several steps are useful in conducting a literature review.

Steps in Conducting a Literature Review

A literature review means locating and summarizing the studies about a topic. Often these are research studies (since you are conducting a research study), but they may also include conceptual articles or opinion pieces that provide frameworks for thinking about topics. There is no single way to conduct a literature review, but many scholars proceed in a systematic fashion to capture, evaluate, and summarize the literature. Here is the way we recommend:

1. Begin by identifying key words, which is useful in locating materials in an academic library at a college or university. These key words may emerge in identifying a topic or may result from preliminary readings.

2. With these key words in mind, use your home computer to begin searching the databases for holdings (i.e., journals and books). Most major libraries have computerized databases, and we suggest you focus initially on journals and books related to the topic. General databases, including Google Scholar, Web of Science, EBSCO, ProQuest, and JSTOR, cover a broad range of disciplines. Other databases, such as ERIC, Sociofile, or PsycINFO, are based on particular disciplines.

3. Initially, try to locate about 50 reports of research in articles or books related to research on your topic. Set a priority on the search for journal articles and books because they are easy to locate and obtain. Determine whether these articles and books exist in your academic library or whether you need to send for them by interlibrary loan or purchase them through a bookstore.

4. Skim this initial group of articles or chapters, and collect those that are central to your topic. Throughout this process, simply try to obtain a sense as to whether the article or chapter will make a useful contribution to your understanding of the literature.

5. As you identify useful literature, begin designing a literature map (to be discussed more fully later). This is a visual picture (or figure) of groupings of the literature on the topic that illustrates how your particular study will add to the existing literature and position your study within the larger body of research.

6. As you put together the literature map, also begin to draft summaries of the most relevant articles. These summaries are combined into the final literature review that you write for your proposal or research study. Include precise references to the literature using an appropriate style guide, such as the Publication Manual of the American Psychological Association (American Psychological Association [APA], 2010) so that you have a complete reference to use at the end of the proposal or study.

7. After summarizing the literature, assemble the literature review, structuring it thematically or organizing it by important concepts. End the literature review with a summary of the major themes and suggest how your particular study further adds to the literature and addresses a gap in the themes. This summary should also point toward the methods (i.e., data collection and data analysis) that need to be undertaken to add to the literature. It is at this point as well that you could advance a critique of the past literature and point out deficiencies in it and issues in its methods (see Boote & Beile, 2005).

Searching Computerized Databases

To ease the process of collecting relevant material, there are some techniques useful in accessing the literature quickly through databases. Computer databases of the literature are now available through the Internet, and they provide easy access to thousands of journals, conference papers, and materials on many different topics. Academic libraries at major universities have purchased commercial databases as well as obtained databases in the public domain. Only a few of the major databases available will be reviewed here, but they are the major sources to journal articles and documents that you should consult to determine what literature is available on your topic.

ERIC is a free online digital library of education research and information sponsored by the Institute of Education Sciences (IES) of the U.S. Department of Education. This database can be found at www.eric.ed.gov (http://www.eric.ed.gov) , and ERIC provides a search of 1.2 million items indexed since 1966. The collection includes journal articles, books, research syntheses, conference papers, technical reports, policy papers, and other education-related materials. ERIC indexes more than hundreds of journals, and links are available to full-text copies of many of the materials. To best utilize ERIC, it is

important to identify appropriate descriptors for your topic, the terms used by indexers to categorize articles or documents. Researchers can search through the Thesaurus of ERIC Descriptors (ERIC, 1975) or browse the online thesaurus. A research tip in conducting an ERIC search is to locate recent journal articles and documents on your topic. This process can be enhanced by conducting a preliminary search using descriptors from the online thesaurus and locating a journal article or document which is on your topic. Then look closely at the descriptors used in this article and document and run another search using these terms. This procedure will maximize the possibility of obtaining a good list of articles for your literature review.

Another free database to search is Google Scholar. It provides a way to broadly search for literature across many disciplines and sources, such as peer-reviewed papers, theses, books, abstracts, and articles from academic publishers, professional societies, universities, and other scholarly organizations. The articles identified in a Google Scholar search provide links to abstracts, related articles, electronic versions of articles affiliated with a library you specify, web searches for information about this work, and opportunities to purchase the full text of the article.

Researchers can obtain abstracts to publications in the health sciences through the free-access PubMed. This database is a service of the U.S. National Library of Medicine, and it includes over 17 million citations from MEDLINE and life science journals for biomedical articles going back to the 1950s (www.ncbi.nlm.nih.gov (http://www.ncbi.nlm.nih.gov) ). PubMed includes links to full-text articles (located in academic libraries) and other related resources. To search PubMed, the researcher uses MeSH (Medical Subject Headings) terms, the U.S. National Library of Medicine’s controlled vocabulary thesaurus used for indexing articles for MEDLINE/PubMed. This MeSH terminology provides a consistent way to retrieve information about topics that may be described using different terms.

On the Internet you can also go to other literature search programs. One typically available is ProQuest (http://proquest.com (http://proquest.com) ), which enables a researcher to search many different databases, and it is one of the largest online content repositories in the world. Another would be EBSCO publishing, a for-fee online research service, including full-text databases, subject indexes, point-of- care medical reference, historical digital archives, and e-books. The company provides more than 350 databases and nearly 300,000 e-books. Also at academic libraries you can search ERIC, PsycINFO, Dissertation Abstracts, Periodicals Index, Health and Medical Complete, and many more specialized databases (e.g., International Index to Black Periodicals). Because EBSCO taps into many different databases, it can be one search tool to use before using more specialized databases.

Another commercially licensed database found in many academic libraries is Sociological Abstracts (Cambridge Scientific Abstracts, www.csa.com (http://www.csa.com) ). This database indexes over 2,000 journals; conference papers; relevant dissertation listings; book reviews; and selected books in sociology, social work, and related disciplines. For literature in the field of psychology and related areas, consult another commercial database: PsycINFO (www.apa.org (http://www.apa.org) ). This database indexes 2,150 journal titles, books, and dissertations from many countries. It covers the field of psychology as well as psychological aspects of physiology, linguistics, anthropology, business, and law. It has a Thesaurus of Psychological Index Terms to locate useful terms in a literature search.

Psychological Abstracts (American Psychological Association [APA], 1927–) and PsycINFO (apa.org) represent important sources for locating research articles on topics broadly related to psychology. The PsycINFO database is available through libraries and may be accessed through another service, such as EBSCO, Ovid, or ProQuest. PsycINFO indexes nearly 2,500 journals in 22 major categories and it provides bibliographic citations, abstracts for psychological journal articles, dissertations, technical reports, books, and book chapters published worldwide. Similar to an ERIC record, a summary from PsycINFO includes key phrase identifiers as well as the author, title, source, and a brief abstract of the article.

Another commercial database available in libraries is the Social Sciences Citation Index (SSCI) (Web of Knowledge, Thomson Scientific [http://isiwebofknowledge.com (http://isiwebofknowledge.com) ]). It indexes 1,700 journals spanning 50 disciplines and selectively indexes relevant items from over 3,300 scientific and technical journals. It can be used to locate articles and authors who have conducted research on a topic. It is especially useful in locating studies that have referenced an important study. The SSCI enables you to trace all studies since the publication of the key study that have cited the work. Using this system, you can develop a chronological list of references that document the historical evolution of an idea or study. This chronological list can be most helpful in tracking the development of ideas about your literature review topic.

In summary, our research tips for searching computer databases are to do the following:

Use both the free, online literature databases as well as those available through your academic library.

Search several databases, even if you feel that your topic is not strictly education, as found in ERIC, or psychology, as found in PsycInfo. Both ERIC and PsycInfo view education and psychology as broad terms for many topics.

Use guides to terms to locate your articles, such as a thesaurus, when available.

Locate an article that is close to your topic; then look at the terms used to describe it, and use these terms in your search.

Use databases that provide access to full-text copies of your articles (through academic libraries, your Internet connection to a library, or for a fee) as much as possible so that you can reduce the amount of time searching for copies of your articles.

A Priority for Selecting Literature Material

We recommend that you establish a priority in a search of the literature. What types of literature might be reviewed and in what priority? Consider the following:

1. Especially if you are examining a topic for the first time and unaware of the research on it, start with broad syntheses of the literature, such as overviews found in encyclopedias (e.g., Aikin, 1992; Keeves, 1988). You might also look for summaries of the literature on your topic presented in journal articles or abstract series (e.g., Annual Review of Psychology, 1950–).

2. Next, turn to journal articles in respected national journals—especially those that report research studies. By research, we mean that the author or authors pose a question or hypothesis, collect data, and try to answer the question or hypothesis. There are journals widely read in your field, and typically they are publications with a high-quality editorial board consisting of individuals from around the United States or abroad. By turning to the first few pages, you can determine if an editorial board is listed and whether it is made up of individuals from around the country or world. Start with the most recent issues of the journals, and look for studies about your topic and then work backward in time. Follow up on references at the end of the articles for more sources to examine.

3. Turn to books related to the topic. Begin with research monographs that summarize the scholarly literature. Then consider entire books on a single topic by a single author or group of authors or books that contain chapters written by different authors.

4. Follow this search by looking for recent conference papers. Look for major national conferences and the papers delivered at them. Often, conference papers report the latest research developments. Most major conferences either require or request that authors submit their papers for inclusion in computerized indices. Make contact with authors of pertinent studies. Seek them out at conferences. Write or phone them, asking if they know of studies related to your area of interest and inquire also if they have an instrument that might be used or modified for use in your study.

5. If time permits, scan the entries in Dissertation Abstracts (University Microfilms, 1938–). Dissertations vary immensely in quality, and one needs to be selective in choosing those to review. A search of the Abstracts might result in one or two relevant dissertations, and you can request copies of them through interlibrary loans or through the University of Michigan Microfilm Library.

6. The web also provides helpful materials for a literature review. The easy access and ability to capture entire articles makes this source of material attractive. However, screen these articles carefully for quality and be cautious about whether they represent rigorous, thoughtful, and systematic research suitable for use in a literature review. Online journals, on the other hand, often include articles that have undergone rigorous reviews by editorial boards. You might check to see if the journal has a refereed editorial board that reviews manuscripts and has published standards for accepting manuscripts in an editorial statement.

In summary, we place refereed journal articles high on the list because they are the easiest to locate and duplicate. They also report research about a topic. Dissertations are listed lower in priority because they vary considerably in quality and are the most difficult reading material to locate and reproduce. Caution should be used in choosing journal articles on the web unless they are part of refereed online journals.

A Literature Map of the Research

One of the first tasks for a researcher working with a new topic is to organize the literature. As mentioned earlier, this organization enables a person to understand how the proposed study adds to, extends, or replicates research already completed.

A useful approach for this step is to design a literature map. This is an idea that we developed several years ago, and it has been a useful tool for students to use when organizing their review of the literature for making presentations to graduate committees, summarizing the literature for a scholarly presentation, or composing an article for journal publication.

This map is a visual summary of the research that has been conducted by others, and it is typically represented in a figure. Maps are organized in different ways. One could be a hierarchical structure with a top-down presentation of the literature, ending at the bottom with the proposed study. Another might be similar to a flowchart in which the reader understands the literature as unfolding from left to right with the farthest right-hand section advancing a proposed study. A third model might be a series of circles; each circle represents a body of literature and the intersection of the circles as the place in which the future research is indicated. We have seen examples of all of these possibilities and found them all effective.

The central idea is that the researcher begins to build a visual picture of existing research about a topic. This literature map presents an overview of existing literature. Figure 2.1 (http://content.thuzelearning.com/books/Creswell.5819.18.1/sections/navpoint-19#s9781506386720.i693) is an illustration of a map that shows the literature found on procedural justice in organizational studies

(Janovec, 2001). Janovec’s map illustrates a hierarchical design, and she used several principles of good map design:

She placed her topic in the box at the top of the hierarchy.

Next, she took the studies that she found in computer searches, located copies of these studies, and organized them into three broad subtopics (i.e., Justice Perceptions Formation, Justice Effects, and Justice in Organizational Change). For another map, the researcher may have more or fewer than three major categories, depending on the extent and publications on the topic.

Within each box are labels that describe the nature of the studies in the box (i.e., outcomes).

Also within each box are references to major citations illustrating its content. It is useful to use references that are current and illustrative of the topic of the box and to briefly state the references in an appropriate style, such as APA (APA, 2010).

Consider several levels for the literature map. In other words, major topics lead to subtopics and then to sub-subtopics.

Some branches of the chart are more developed than others. This development depends on the amount of literature available and the depth of the exploration of the literature by the researcher.

After organizing the literature into a diagram, Janovec (2001) next considered the branches of the figure that provided a springboard for her proposed study. She placed a “Need to Study” (or proposed study) box at the bottom of the map, she briefly identified the nature of this proposed study (Procedural Justice and Culture), and she then drew lines to past literature that her project would extend. She proposed this study based on ideas written by other authors in the future research sections of their studies.

Include quantitative, qualitative, and mixed methods studies in your literature map.

Write a narrative description of your literature map for your committee or for presentation that begins with your topic (the heading box at the top), the databases you have reviewed, the division of the literature into broad topics in the map, the specific topic that you plan to study (at the bottom box of the map), and how your topic relates to various branches in the literature (the connecting lines—what literature your study builds on and how it builds).

Composing a literature map can be challenging. Individuals seeing this map may not be familiar with this approach to organizing the literature and making a case for your study. They need to be told the intent of such a map. It takes time to develop such a map and locate literature to put into the map. For a preliminary map, we consider collecting maybe 25 studies. For a full literature map for a dissertation or thesis, we would consider developing a map with at least 100 studies. Figuring out how your study adds to the literature takes some time. It may add to several threads in your literature map. We would refrain from tying it to all of your subdivisions; select one or two subdivisions. It is also challenging to figure out what the broad topic might be for the top of the map. This is the topic to which your literature map adds. Ask others who know about your literature, see how the research studies group according to some synthesis of the literature, and continually ask yourself what body of literature your study will contribute to. You may also have to develop several versions of your map before it comes together. Develop your map, write the discussion, and check it out with others.

Abstracting Studies

When researchers write reviews of the literature for proposed studies, they locate articles and develop brief abstracts of the articles that comprise the review. An abstract is a brief review of the literature (typically a short paragraph) that summarizes major elements to enable a reader to understand the basic features of the article (see Example 2.1 (http://content.thuzelearning.com/books/Creswell.5819.18.1/sections/navpoint-19#s9781506386720.i695) ). In developing an abstract, researchers need to consider what material to extract and summarize. This is important information when reviewing perhaps dozens, if not hundreds, of studies. A good summary of a research study reported in a journal might include the following points:

Mention the problem being addressed.

State the central purpose or focus of the study.

Briefly state information about the sample, population, or subjects.

Review key results that relate to the proposed study.

If it is a critique or methods review (Cooper, 2010), point out technical and methodological flaws in the study.

When examining a study to develop a summary, there are places to look for these parts. In well-crafted journal articles, the problem and purpose statements are clearly stated in the introduction. Information about the sample, population, or subjects is found midway through in a method (or procedure) section, and the results are often reported toward the end. In the results sections, look for passages in which the researchers report information to answer or address each research question or hypothesis. For book-length research studies, look for the same points.

Figure 2.1 An Example of a Literature Map

*Employees’ concerns about the fairness of and the making of managerial decisions

Source: Janovec (2001). Reprinted by permission.

Example 2.1 Literature Review Abstract in a Quantitative Study

The paragraph that follows summarizes the major components of a quantitative study (Creswell, Seagren, & Henry, 1979), much like the paragraph might appear in a review of the literature section of a dissertation or a journal article. In this passage, we have chosen key components to be abstracted.

Creswell and colleagues (1979) tested the Biglan model, a three-dimensional model clustering 36 academic areas into hard or soft, pure or applied, life or nonlife areas, as a predictor of chairpersons’ professional development needs. Eighty department chairpersons located in four state colleges and one university of a midwestern state participated in the study. Results showed that chairpersons in different academic areas differed in terms of their professional development needs. Based on the findings, the authors recommended that those who develop inservice programs needed to consider differences among disciplines when they plan for programs.

Creswell and colleagues began with an in-text reference in accord with the format in the APA Publication Manual (APA, 2010). Next, we reviewed the central purpose of the study, followed by information about the data collection. The abstract ended by stating the major results and presenting the practical implications of these results.

How are essays, opinions, typologies, and syntheses of past research abstracted, since these are not research studies? The material to be extracted from these non-empirical studies would be as follows:

Mention the problem being addressed by the article or book.

Identify the central theme of the study.

State the major conclusions related to this theme.

If the review type is methodological, mention flaws in reasoning, logic, force of argument, and so forth.

Example 2.2 (http://content.thuzelearning.com/books/Creswell.5819.18.1/sections/navpoint- 19#s9781506386720.i699) illustrates the inclusion of these aspects.

Example 2.2 Literature Review Abstract in a Study Advancing a Typology

Sudduth (1992) completed a quantitative dissertation in political science on the topic of the use of strategic adaptation in rural hospitals. He reviewed the literature in several chapters at the beginning of the study. In an example of summarizing a single study advancing a typology, Sudduth summarized the problem, the theme, and the typology:

Ginter, Duncan, Richardson, and Swayne (1991) recognize the impact of the external environment on a hospital’s ability to adapt to change. They advocate a process that they call environmental analysis, which allows the organization to strategically determine the

best responses to change occurring in the environment. However, after examining the multiple techniques used for environmental analysis, it appears that no comprehensive conceptual scheme or computer model has been developed to provide a complete analysis of environmental issues (Ginter et al., 1991). The result is an essential part of strategic change that relies heavily on a non-quantifiable and judgmental process of evaluation. To assist the hospital manager to carefully assess the external environment, Ginter et al. (1991) have developed the typology given in Figure 2.1 (http://content.thuzelearning.com/books/Creswell.5819.18.1/sections/navpoint- 19#s9781506386720.i693) . (p. 44)

In this example, the authors referenced the study with an in-text reference, mentioned the problem (“a hospital’s ability to adapt to change”), identified the central theme (“a process that they call environmental analysis”), and stated the conclusions related to this theme (e.g., “no comprehensive conceptual model,” “developed the typology”).

Style Manuals

In both examples, we have introduced the idea of using appropriate APA style for referencing the article at the beginning of the abstract. Style manuals provide guidelines for creating a scholarly style of a manuscript, such as a consistent format for citing references, creating headings, presenting tables and figures, and using nondiscriminatory language. A basic tenet in reviewing the literature is to use an appropriate and consistent reference style throughout. When identifying a useful document, make a complete reference to the source using an appropriate style. For dissertation proposals, graduate students should seek guidance from faculty, dissertation committee members, or department or college officials about the appropriate style manual to use for citing references.

The Publication Manual of the American Psychological Association (APA, 2010) is the most popular style manual used in the fields of education and psychology. The Chicago Manual of Style (University of Chicago Press, 2010) is also used but less widely than the APA style in the social sciences. Some journals have developed their own variations of the popular styles. We recommend identifying a style that is acceptable for your writing audiences and adopting it early in the planning process.

The most important style considerations involve in-text, end-of-text, heading, and figures and tables use. Some suggestions for using style manuals for scholarly writing are these:

When writing in-text references, keep in mind the appropriate form for types of references and pay close attention to the format for multiple citations.

When writing the end-of-text references, note whether the style manual calls for them to be alphabetized or numbered. Also, crosscheck that each in-text reference is included in the end- of-text list.

The headings are ordered in a scholarly paper in terms of levels. First, note how many levels of headings you will have in your research study. Then, refer to the style manual for the appropriate format for each. Typically, research proposals or projects contain between two and four levels of headings.

If footnotes are used, consult the style manual for their proper placement. Footnotes are used less frequently in scholarly papers today than a few years ago. If you include them, note whether they go at the bottom of the page, the end of each chapter, or at the end of the paper.

Tables and figures have a specific form in each style manual. Note such aspects as bold lines, titles, and spacing in the examples given.

In summary, the most important aspect of using a style manual is to be consistent in the approach throughout the manuscript.

The Definition of Terms

Another topic related to reviewing the literature is the identification and definition of terms that readers will need in order to understand a proposed research project. A definition of terms section may be found separate from the literature review, included as part of the literature review, or placed in different sections of a proposal.

Define terms that individuals outside the field of study may not understand and that go beyond common language (Locke, Spirduso, & Silverman, 2013). Clearly, whether a term should be defined is a matter of judgment, but define a term if there is any likelihood that readers will not know its meaning. Also, define terms when they first appear so that a reader does not read ahead in the proposal operating with one set of definitions only to find out later that the author is using a different set. As Wilkinson (1991) commented, “scientists have sharply defined terms with which to think clearly about their research and to communicate their findings and ideas accurately” (p. 22). Defining terms also adds precision to a scientific study, as Firestone (1987) stated this:

The words of everyday language are rich in multiple meanings. Like other symbols, their power comes from the combination of meaning in a specific setting. . . . Scientific language ostensibly strips this multiplicity of meaning from words in the interest of precision. This is the reason common terms are given “technical meanings” for scientific purposes. (p. 17)

With this need for precision, one finds terms stated early in the introduction to articles. In dissertations and thesis proposals, terms are typically defined in a special section of the study. The rationale is that in formal research, students must be precise in how they use language and terms. The need to ground thoughts in authoritative definitions constitutes good science.

Define terms introduced in all sections of the research plan:

The title of the study

The problem statement

The purpose statement

The research questions, hypotheses, or objectives

The literature review

The theory base of the study

The methods section

Special terms that need to be defined appear in all three types of studies: (a) qualitative, (b) quantitative, and (c) mixed methods.

In qualitative studies, because of the inductive, evolving methodological design, inquirers may define few terms at the beginning though they may advance tentative definitions. Instead, themes (or perspectives or dimensions) may emerge through the data analysis. In the procedure section, authors define these terms in the procedure section as they surface during the process of research. This approach is to delay the definition of terms until they appear in the study, and it makes such definitions difficult to specify in advance in research proposals. For this reason, qualitative proposals often do not include separate sections for a definition of terms. Instead, writers pose tentative, qualitative definitions before entry into the field.

On the other hand, quantitative studies—operating more within the deductive model of fixed and set research objectives—include extensive definitions early in the research proposal. Investigators may place them in separate sections and precisely define them. The researchers try to comprehensively define all relevant terms at the beginning of studies and to use accepted definitions found in the literature.

In mixed methods studies, the approach to definitions might include a separate section if the study begins with a first phase of quantitative data collection. If it begins with qualitative data collection, then the terms may emerge during the research, and they are defined in the findings or results section of the final report. If both quantitative and qualitative data collection occurs at the same time, then the priority given to one or the other will govern the approach for definitions. However, in all mixed methods studies, there are terms that may be unfamiliar to readers—for example, the definition of a mixed methods study itself, in a procedural discussion (see Chapter 10 (s9781506386720.i1249.xhtml) ). Also, clarify terms related to the strategy of inquiry used, such as concurrent or sequential, and the specific name for a strategy (e.g., convergent parallel design, as discussed in Chapter 10 (s9781506386720.i1249.xhtml) ).

No one approach governs how one defines the terms in a study, but several suggestions follow (see also Locke et al., 2013):

Define a term when it first appears in the proposal. In the introduction, for example, a term may require a definition to help the reader understand the research problem and questions or hypotheses in the study.

Write definitions at a specific operational or applied level. Operational definitions are written in specific language rather than abstract, conceptual definitions. Since the definition section in a dissertation provides an opportunity for the author to be specific about the terms used in the study, a preference exists for operational definitions.

Do not define the terms in everyday language; instead, use accepted language available in the research literature. In this way, the terms are grounded in the literature and not invented (Locke et al., 2013). It is possible that the precise definition of a term is not available in the literature and everyday language will need to be used. In this case, provide a definition and use the term consistently throughout the plan and the study (Wilkinson, 1991).

Researchers might define terms so that they accomplish different goals. A definition may describe a common language word (e.g., organization). It may also be paired with a limitation (e.g., the curriculum may be limited). It may establish a criterion (e.g., high grade point average), and it could also define a term operationally (e.g., reinforcement will refer to listing).

Although no one format exists for defining terms, one approach is to develop a separate section, called the “Definition of Terms,” and clearly set off the terms and their definitions by

highlighting the term. In this way, the word is assigned an invariant meaning (Locke et al., 2013). Typically, this separate section is not more than two to three pages in length.

Examples 2.3 (http://content.thuzelearning.com/books/Creswell.5819.18.1/sections/navpoint- 19#s9781506386720.i712) and 2.4 (http://content.thuzelearning.com/books/Creswell.5819.18.1/sections/navpoint- 19#s9781506386720.i715) illustrate varied structures for defining terms in a research study.

Example 2.3 Terms Defined in an Independent Variables Section

This set of two examples illustrates an abbreviated form of writing definitions for a study. The first illustrates a specific operational definition of a key term and the second the procedural definition of a key term. Vernon (1992) studied how divorce in the middle generation impacts grandparents’ relationships with their grandchildren. These definitions were included in a section on independent variables:

Kinship Relationship to the Grandchild

Kinship relationship to the grandchild refers to whether the grandparents are maternal grandparents or paternal grandparents. Previous research (e.g., Cherlin & Furstenberg, 1986) suggests that maternal grandparents tend to be closer to their grandchildren.

Sex of Grandparent

Whether a grandparent is a grandmother or grandfather has been found to be a factor in the grandparent/grandchild relationship (i.e., grandmothers tend to be more involved than grandfathers, which is thought to be related to the kinkeeping role of women within the family (e.g., Hagestad, 1988, pp. 35–36).

Example 2.4 Terms Defined in a Mixed Methods Dissertation

This example illustrates a lengthy definition of terms presented in a mixed methods study in a separate section of the first chapter (s9781506386720.i598.xhtml) that introduces the study. VanHorn- Grassmeyer (1998) studied how 119 new professionals in student affairs in colleges and universities engage in reflection—either individually or collaboratively. She both surveyed the new professionals and conducted in-depth interviews with them. Because she studied individual and collaborative reflection among student affairs professionals, she provided detailed definitions of these terms in the beginning of the study. We illustrate two of her terms next. Notice how she referenced her definitions in meanings formed by other authors in the literature:

Individual Reflection

Schon (1983) devoted an entire book to concepts he named reflective thinking, reflection-in-action, and reflective practice; this after an entire book was written a decade earlier with Argyris (Argyris & Schon, 1978) to introduce the concepts. Therefore, a concise definition of this researcher’s understanding of individual reflection that did justice to something that most aptly had been identified as an intuitive act was difficult to reach. However, the most salient characteristics of

individual reflection for the purposes of this study were these three: (a) an “artistry of practice” (Schon, 1983), (b) how one practices overtly what one knows intuitively, and (c) how a professional enhances practice through thoughtful discourse within the mind.

Student Affairs Professional

A professional has been described in many ways. One description identified an individual who exhibited “a high degree of independent judgment, based on a collective, learned body of ideas, perspectives, information, norms, and habits [and who engage(d) in professional knowing]” (Baskett & Marsick, 1992, p. 3). A student affairs professional has exhibited such traits in service to students in a higher education environment, in any one of a number of functions which support academic and co-curricular success (pp. 11–12).

A Quantitative or Mixed Methods Literature Review

When composing a review of the literature, it is difficult to determine how much literature to review. In order to address this problem, we have developed a model that provides parameters around the literature review, especially as it might be designed for a quantitative or mixed methods study that employs a standard literature review section. For a qualitative study, the literature review might explore aspects of the central phenomenon being addressed and divide it into topical areas. But the literature review for a qualitative study, as discussed earlier, can be placed in a proposal in several ways (e.g., as a rationale for the research problem, as a separate section, as something threaded throughout the study, as compared with the results of a project).

For a quantitative study or the quantitative strand of a mixed methods study, write a review of the literature that contains sections about the literature related to major independent variables, major dependent variables, and studies that relate the independent and dependent variables (more on variables in Chapter 3 (s9781506386720.i731.xhtml) ). This approach seems appropriate for dissertations and for conceptualizing the literature to be introduced in a journal article. Consider a literature review to be composed of five components: (a) an introduction, (b) Topic 1 (about the independent variable), (c) Topic 2 (about the dependent variable), (d) Topic 3, (studies that address both the independent and dependent variables), and (e) a summary. Here is more detail about each section:

1. Introduce the review by telling the reader about the sections included in it. This passage is a statement about the organization of the section.

2. Review Topic 1, which addresses the scholarly literature about the independent variable or variables. With several independent variables, consider subsections or focus on the single most important variable. Remember to address only the literature about the independent variable; keep the literature about the independent and dependent variables separate in this model.

3. Review Topic 2, which incorporates the scholarly literature about the dependent variable or variables. With multiple dependent variables, write subsections about each variable or focus on a single important one.

4. Review Topic 3, which includes the scholarly literature that relates the independent variable(s) to the dependent variable(s). Here we are at the crux of the proposed study. Thus, this section should be relatively short and contain studies that are extremely close in topic to the proposed study. Perhaps nothing has been written on the topic. Construct a section that is as close as possible to the topic or review studies that address the topic at a more general level.

5. Provide a summary that highlights the most important studies, captures major themes, suggests why more research is needed on the topic, and advances how the proposed study will fill this need.

This model focuses the literature review, relates it closely to the variables in the research questions and hypotheses, and sufficiently narrows the study. It becomes a logical point of departure for the research questions and the method section.

Summary

Before searching the literature, identify your topic, using such strategies as drafting a brief title or stating a central research question. Also consider whether this topic can and should be researched by reviewing whether there is access to participants and resources and whether the topic will add to the literature, be of interest to others, and be consistent with personal goals.

Researchers use the scholarly literature in a study to present results of similar studies, to relate the present study to an ongoing dialogue in the literature, and to provide a framework for comparing results of a study with other studies. For qualitative, quantitative, and mixed methods designs, the literature serves different purposes. In qualitative research, the literature helps substantiate the research problem, but it does not constrain the views of participants. A popular approach is to include more literature at the end of a qualitative study than at the beginning. In quantitative research, the literature not only helps to substantiate the problem but it also suggests possible questions or hypotheses that need to be addressed. A separate literature review section is typically found in quantitative studies. In mixed methods research, the use of literature will depend on the type of design and weight given to the qualitative and quantitative aspects.

When conducting a literature review, identify key words for searching the literature. Then search the online databases, such as ERIC, EBSCO, ProQuest, Google Scholar, PubMed, and more specialized databases, such as PsycINFO, Sociofile, and SSCI. Then, locate articles or books based on a priority of searching first for journal articles and then books. Identify references that will make a contribution to your literature review. Group these studies into a literature map that shows the major categories of studies and positions of your proposed study within those categories. Begin writing summaries of the studies, noting complete references according to a style manual (e.g., APA, 2010) and extracting information about the research that includes the research problem, the questions, the data collection and analysis, and the final results.

Define key terms, and possibly develop a definition of terms section for your proposal or include them within your literature review. Finally, consider the overall structure for organizing these studies. One quantitative research model is to divide the review into sections according to major variables (a quantitative approach) or major subthemes of the central phenomenon (a qualitative approach) that you are studying.

Writing Exercises

1. Develop a literature map of the studies on your topic. Include in the map the proposed study and draw lines from the proposed study to branches of studies in the map so that a reader can easily see how yours will extend existing literature.

2. Organize a review of the literature for a quantitative study, and follow the model for delimiting the literature to reflect the variables in the study. As an alternative, organize a review of literature for a qualitative study and include it in an introduction as a rationale for the research problem in the study.

3. Practice using an online computer database to search for the literature on your topic. Conduct several searches until you find an article that is as close as possible to your

research topic. Then conduct a second search using descriptors mentioned in this article. Locate 10 articles that you would select and abstract for your literature review.

4. Based on your search results from Exercise 3, write one quantitative and one qualitative abstract of two research studies found in your online search. Use the guidelines provided in this chapter for the elements to include in your literature abstracts.

Additional Readings

American Psychological Association. (2010). Publication Manual of the American Psychological Association (6th ed.). Washington, DC: Author.

The latest APA style manual is a must for every researcher’s shelf. It provides an entire chapter offering examples of how to cite works in a reference list. The examples are extensive—from journals (or periodicals) to patents. Further guidelines for presenting tables and figures are available with good examples that you can use. This manual also has chapters on scholarly writing and the mechanics of style used in this type of writing. For those planning on publishing, it provides useful information about the standard elements of a manuscript as well as ethical issues to consider.

Boote, D. N., & Beile, P. (2005). Scholars before researchers: On the centrality of the dissertation literature review in research preparation. Educational Researcher, 34(6), 3–15.

David Boote and Penny Beile discuss the importance of dissertation students to compile sophisticated literature reviews. To this end, they advance five criteria that should be in a rigorous literature review. The author should justify the inclusion and exclusion of literature (coverage), critically examine the state of the field, situate the topic in the broader literature, examine the history of the topic, note ambiguities in definitions and the literature, and offer new perspectives (synthesis). It should also critique the research methods (methodology), as well as the practical and scholarly significance of the research (significance), and be written well in a coherent fashion (rhetoric).

Locke, L. F., Spirduso, W. W., & Silverman, S. J. (2010). Proposals that work: A guide for planning dissertations and grant proposals (6th ed.) Thousand Oaks, CA: Sage.

Lawrence Locke, Waneen Spirduso, and Stephen Silverman describe several stages for reviewing the literature: develop the concepts that provide a rationale for the study, develop subtopics for each major concept, and add the most important references that support each concept. They also provide five rules for defining terms in a scholarly study: (a) never invent words, (b) provide definitions early in a proposal, (c) do not use common language forms of words, (d) define words when they are first introduced, and (e) use specific definitions for words.

Punch, K. F. (2014). Introduction to social research: Quantitative and qualitative approaches (3rd ed.). Thousand Oaks, CA: Sage.

Keith Punch provides a guide to social research that equally addresses quantitative and qualitative approaches. His conceptualizations of central issues that divide the two approaches address key differences. Punch notes that when writing a proposal or report, the point at which to concentrate on the literature varies in different styles of research. Factors that affect that decision include the

style of research, the overall research strategy, and how closely the study will follow the directions of the literature.

https://edge.sagepub.com/creswellrd5e (https://edge.sagepub.com/creswellrd5e)

Students and instructors, please visit the companion website for videos featuring John W. Creswell, full-text SAGE journal articles, quizzes and activities, plus additional tools for research design.