Provide answers and feedback on these concerns
EDU730: Research Practices and Methods
Page 1 EDU-730 Research Practices and Methods
Week 8:
Qualitative data analysis
Topic goals
To discuss some of the theoretical models within which
qualitative data can be analysed and to select the most
appropriate model for a particular piece of research.
To understand the stages involved in qualitative data
analysis, and gain some experience in coding and
developing categories.
To assess how rigour can be maximised in qualitative
data analysis.
Task – Forum
Use the excerpts from the interviews and the thematic
analysis phases as presented in this week’s materials in
order to generate ‘codes’ or ‘themes’.
EDU730: Research Practices and Methods
Page 2 EDU-730 Research Practices and Methods
QUALITATIVE DATA ANALYSIS
1.1 INTRODUCTION TO QUALITATIVE DATA ANALYSIS:
You are probably familiar with the basic differences between qualitative and
quantitative research methods based on the previous weeks and the materials
provided and the different applications those methods can have in order to deal
with the research questions posed.
Qualitative research is particularly good at answering the ‘why’, ‘what’ or ‘how’
questions, such as:
“What are the perceptions of carers living with people with learning
disability, as regards their own health needs?”
“Why do students choose to study for the MSc in Research Methods through
the online programme?
1.2 What do we mean by analysis?
As being explored in previous weeks, Quantitative research techniques generate a
mass of numbers that need to be summarised, described and analysed. The data
are explored by using graphs and charts, and by doing cross tabulations and
calculating means and standard deviations. Further analysis would build on these
initial findings, seeking patterns and relationships in the data by performing
multiple regression, or an analysis of variance perhaps (Lacey and Luff, 2007).
So it is with Qualitative data analysis. .
Qualitative Data Analysis (QDA) is the range of processes and
procedures whereby we move from the qualitative data that have
been collected into some form of explanation, understanding or
interpretation of the people and situations we are investigating.
EDU730: Research Practices and Methods
Page 3 EDU-730 Research Practices and Methods
QDA is usually based on an interpretative philosophy. The idea is to
examine the meaningful and symbolic context of qualitative data
(http://onlineqda.hud.ac.uk/Intro_QDA/what_is_qda.php)
A generous amount of words is created by interviews or observational data
and needs to be described and summarised.
The questions asked may require the researchers to seek relationships
between various themes that have been identified, or to relate behaviour
or ideas to biographical characteristics of respondents such as age or
gender.
Implications for policy or practice may be derived from the data, or
interpretation sought of puzzling findings from previous studies.
Ultimately theory could be developed and tested using advanced analytical
techniques.
1.3 Approaches in Analysis
a) Deductive approach
- Using your research questions to group the data and then look for
similarities and differences
- Used when time and resources are limited
- Used when qualitative research is a smaller component of a larger
quantitative study
b) Inductive approach
- Used when qualitative research is a major design of the inquiry
- Using emergent framework to group the data and then look for
relationships
EDU730: Research Practices and Methods
Page 4 EDU-730 Research Practices and Methods
Familiarisation with the data through review, reading, listening etc
Transcription of tape recorded material
Organisation and indexing of data for easy retrieval and
identification
Anonymising of sensitive data
Coding (may be called indexing)
Identification of themes
Re-coding
Development of provisional categories
Exploration of relationships between categories
Refinement of themes and categories
Development of theory and incorporation of pre-existing
knowledge
Testing of theory against the data
Report writing, including excerpts from original data if appropriate
(e.g. quotes from interviews)
Adapted from Pacey and Luff (2009, p. 6-7)
In summary:
There are no ‘quick fix’ techniques in qualitative analysis (Lacey and Luff, 2007).
There are probably as many different ways of analysing qualitative data as
there are qualitative researchers doing it!
It is argued that qualitative research is an interpretive and subjective
exercise is intimately involved in the process, not aloof from it (Pope and
Mays 2006).
However there are some theoretical approaches to choose from and in this
week we will explore a basic one. In addition there are some common
processes, no matter which approach you take. Analysis of qualitative data
usually goes through some or all of the following stages (though the order
may vary):
EDU730: Research Practices and Methods
Page 5 EDU-730 Research Practices and Methods
1.2 What do you want to get out of your data?
It is not always necessary to go through all the stages above, but it is suggested
that some of them are necessary in order to go in-depth in your analysis!
Let’s take an example based on the research question provided above about the
health needs of the carers:
Research question:
“What are the perceptions of carers living with people with learning disability, as
regards their own health needs?”
You may be interested in finding out the community services that needs to
be provided in order the perceived needs of the carers to be met.
You might also be interested to know what kind of services are needed or
are valued by most of the carers.
Maybe several respondents mention that they struggle with depression and
loneliness
In order to explore this, three broad levels of analysis that could be pursued are
as follows:
One approach is to simply count the number of times a particular word or
concept occurs (e.g. loneliness) in a narrative. Such approach is called
content analysis. It is not purely qualitative since the qualitative data can
then be categorised quantitatively and will be subjected to statistical
analysis
Another approach is the thematic analysis from which we would want to go
deeper than this. All units of data (eg sentences or paragraphs) referring to
loneliness could be given a particular code, extracted and examined in
more detail. Do participants talk of being lonely even when others are
present? Are there particular times of day or week when they experience
loneliness? In what terms do they express loneliness? Are those who speak
EDU730: Research Practices and Methods
Page 6 EDU-730 Research Practices and Methods
of loneliness are also those who experience depress? Such questions can
lead to themes which could eventually be developed such as ‘lonely but
never alone’.
Finally, for theoretical analysis such as ground theory we go further in
depth. For example, you may have developed theories when you have been
analysing the data with regard to depression as being associated with
perceived loss of a ‘normal’ child/spouse. The disability may be attributed
to an accident, or to some failure of medical care, without which the person
cared for would still be ‘normal’. You may be able to test this emerging
theory against existing theories of loss in the literature, or against further
analysis of the data. You may even search for ‘deviant cases’ that is data
which seems to contradict your theory, and seek to modify your theory to
take account of this new finding. This process is sometimes known as
‘analytic induction’, and is use to build and test emerging theory.
(Lacey and Luff, 2009, p.8)
In the following sections we will explore two approaches for qualitative data
analysis: a) grounded theory approach and b) thematic analysis.
1.4 Grounded Theory
Developed out of research by sociologists Glaser and Strauss (1967). Glaser
and Strauss were concerned to outline an inductive method of qualitative
research which would allow social theory to be generated systematically
from data. As such theories should be ‘grounded’ in rigorous empirical
research, rather than to be produced based in the abstract.
Grounded theory is a methodology; it is a way of thinking about and
conceptualising data. It is an approach to research as a whole and as such
can use a range of different methods.
Grounded Theory analysis is inductive, in that the resulting theory
‘emerges’ from the data through a process of rigorous and structured
analysis.
EDU730: Research Practices and Methods
Page 7 EDU-730 Research Practices and Methods
1.5 Procedure and the Rules of Grounded Theory approach
1) Data Collection and Analysis are Interrelated Processes. In grounded theory,
the analysis begins as soon as the first bit of data is collected.
2) Concepts Are the Basic Units of Analysis. A theorist works with
conceptualizations of data, not the actual data per se. Theories can't be built with
actual incidents or activities as observed or reported; that is, from "raw data." The
incidents, events, and happenings are taken as, or analyzed as, potential
indicators of phenomena, which are thereby given conceptual labels. If a
respondent says to the researcher, "Each day I spread my activities over the
morning, resting between shaving and bathing," then the researcher might label
this phenomenon as "pacing." As the researcher encounters other incidents, and
when after comparison to the first, they appear to resemble the same
phenomena, then these, too, can be labeled as "pacing." Only by comparing
incidents and naming like phenomena with the same term can a theorist
accumulate the basic units for theory. In the grounded theory approach such
concepts become more numerous and more abstract as the analysis continues
3. Categories Must Be Developed and Related. Concepts that pertain to the
same phenomenon may be grouped to form categories. Not all concepts become
categories. Categories are higher in level and more abstract than the concepts
they represent. They are generated through the same analytic process of making
comparisons to highlight similarities and differences that is used to produce lower
level concepts. Categories are the "cornerstones" of a developing theory. They
provide the means by which a theory can be integrated.
4. Sampling in Grounded Theory Proceeds on Theoretical Grounds. Sampling
proceeds not in terms of drawing samples of specific groups of individuals, units
of time, and so on, but in terms of concepts, their properties, dimensions, and
variations.
5) Analysis Makes Use of Constant Comparisons. As an incident is noted, it
should be compared against other incidents for similarities and differences. The
EDU730: Research Practices and Methods
Page 8 EDU-730 Research Practices and Methods
resulting concepts are labeled as such, and over time, they are compared and
grouped as previously described.
6) Patterns and Variations Must Be Accounted For. The data must be examined
for regularity and for an understanding of where that regularity is not apparent.
7) Process Must Be Built Into the Theory. In grounded theory, process has several
meanings. Process analysis can mean breaking a phenomenon down into stages,
phases, or steps. Process may also denote purposeful action/interaction that is
not necessarily progressive, but changes in response to prevailing conditions
8) Writing Theoretical Memos Is an Integral Part of Doing Grounded Theory.
Since the analyst cannot readily keep track of all the categories, properties,
hypotheses, and generative questions that evolve from the analytical process,
there must be a system for doing so. The use of memos constitutes such a system.
Memos are not simply about "ideas."
(adapted from Corbin and Strauss, 1990, pp.7-10)
1.6 Thematic Analysis approach (Braun and Clarke, 2006, p.79)
Thematic analysis is a method for identifying, analysing, and reporting patterns
(themes) within data. It minimally organises and describes your data set in (rich)
detail. However, it also often goes further than this, and interprets various
aspects of the research topic (Boyatzis, 1998).
Boyatzis (1998) defines the 'unit of coding' as the most basic segment or
element of the raw data of information that can be assessed in a
meaningful way regarding the phenomenon (pxi)
A good thematic code 'captures the qualitative richness of the phenomenon'
(Boyatzis 1998, p31) and has 5 elements:
1. A label
2. A definition of when the theme occurs
EDU730: Research Practices and Methods
Page 9 EDU-730 Research Practices and Methods
3. A description of how to know when the theme occurs
4. A description of any qualifications or exclusions to the theme
5. Examples to eliminate possible confusion when looking at the theme
Braun and Clarke (2006 pp 94-95) identify some "potential pitfalls" to be avoided
in qualitative analysis
1. A failure to actually analyse the data
2. Using data collection questions as themes that are reported
3. A weak or unconvincing analysis
4. A mismatch between the data and the analytic claims that are made about it. 1.
1.7 Phases of thematic analysis (inductive and deductive) (Braun and Clarke, 2006)
Phase Description of the Process
1. Development of
a priori codes
Determining important
theoretical areas that can be
used as initial codes to organize
the data (Boyatzis, 1998). Use of
theory-driven coding that links
to the theoretical framework of
the study.
2. Familiarization with the
data
Transcription of data and field
notes, reading and re-reading
the data, noting down initial
ideas (Braun and Clarke, 2006)
3. Carrying out theory-driven coding Coding data in a systematic
fashion within each interview
and the field notes and across
the entire data collating data
relevant to each a priori code
(Boyatzis 1998; Braun and
EDU730: Research Practices and Methods
Page 10 EDU-730 Research Practices and Methods
Clarke, 2006).
4. Reviewing and revising codes and
Carrying out additional data-driven coding
Reviewing and revising theory-
driven codes in the context of
the data (Boyatzis, 1998).
Additional coding is done at this
stage, which is not confined by
the a priori codes and inductive
(data-driven) codes are assigned
to the data (Fereday and Muir-
Cochrane, 2006).
5. Searching for themes Collating codes into potential
themes, gathering all data
relevant to each potential theme
(Braun and Clarke, 2006;
Fereday and Muir-Cochrane,
2006)
6. Reviewing themes Checking if the themes produced
are related to the coded extracts
(Level 1) and the entire data set
(Level 2) as well as developing
the thematic ‘map’ of the
analysis (Braun and Clarke, 2006)
so as to determine credibility of
the themes (Fereday and Muir-
Cochrane, 2006).
7. Producing the report The final opportunity for the
analysis in which vivid
compelling extract examples are
selected, final analysis of
selected extracts, relating back
the analysis to the research
questions and the relevant
literature and producing a
scholarly report of the analysis
(Braun and Clarke, 2006).
EDU730: Research Practices and Methods
Page 11 EDU-730 Research Practices and Methods
1.8 Example of qualitative data analysis using thematic analysis
Question: “how do you feel about your student accommodation?”
Participants: 10 Master’s students living in student accommodation an open
question
• You have coded three data segments using the code ‘satisfactory
accommodation’. You have defined ‘satisfactory’ as instances when
students indicate that their accommodation generally meets their needs,
but they report mixed views, balancing positive opinions with critical
comments. You have decided not to include views which are almost
exclusively positive or negative. The data segments you have coded as
‘satisfactory’ are:
‘It’s okay – it’s not my home, my house at home in my country, but I have
the things I need, desk, bed, arm chair, clean and warm, not damp or
anything.’ (Student 3)
‘It could be nicer – the decoration is a bit old, and it can be a little bit noisy
at night sometimes – but overall it’s fine just for students. When I graduate
and get a job, I want to rent a more modern apartment, fashionable with
lots of technology.’ (Student 9)
‘The only thing is it’s a bit small… I can’t invite all my friends to my room to
watch television or chat, so we have to go to the coffee shop, cinema… it’s a
bit expensive always going out. That’s the main problem, but I quite like it,
it’s quite good, I feel quite safe.’ (Student 2)
Is it okay to say ‘3 students reported that their accommodation was satisfactory’?
In qualitative studies, we are interested in individual’s feelings, thoughts, beliefs
and unique contributions. It is ok to say that 3 students reported that about their
accommodation.
EDU730: Research Practices and Methods
Page 12 EDU-730 Research Practices and Methods
1.9 Producing the report of the data
Several students suggested their
accommodation, while having some
limitations, was generally satisfactory,
being ‘okay’ (student 2) or ‘fine for
students’ (student 9). Their accommodation
appeared to meet many of their needs, for instance, student 3 commented ‘I
have the things I need, a desk, bed, arm chair, clean and warm, not damp or
anything’, while student 2 reported she ‘feels quite safe’. However, they also
noted some limitations, for example, about the limited space: ‘it’s a bit small… I
can’t invite all my friends to my room’ (student 2), and the décor: ‘it could be
nicer – the decoration is a bit old’ (student 9). Nonetheless, the students seemed
to be quite accepting of these limitations – notably, student 2 still said ‘I quite
like it, it’s quite good’ even though she found it quite expensive going out to see
friends because her room was too small to invite them over.
There was also some suggestion that the students tended to think of their
accommodation as temporary; student 3 is clear ‘it is not my home, my house’,
while student 9 is already planning to rent a more modern apartment which
suits his tastes better on graduating. This might be considered to have made
them more accepting of their accommodation’s limitations, as long as their
accommodation generally meets their main needs as students.
Summary:
The words in bold and underlined fond indicate how we suggest possible
conclusions from the data as in qualitative research we talk about
interpretations and how ‘reality’ is constructed by other people’s point of
view.
Therefore we tend not to say that e.g. ‘students are not satisfied’ we prefer
to report ‘students seem not to be satisfied’
EDU730: Research Practices and Methods
Page 13 EDU-730 Research Practices and Methods
Task – Forum
Using this week notes, please down and read the document below “Task
for qualitative data analysis_Excerpts interviews of trainee teachers”. Use
the excerpts from the interviews and the thematic analysis phases as
presented in this week’s materials in order to generate ‘codes’ or ‘themes’.
Create at least two (2) themes. Produce a brief report (phase 7) (maximum
word count: 500 words) to present 1 of the themes.
Further reading:
Aronson, J. (1995). A pragmatic view of thematic analysis. The qualitative report, 2(1), 1-
3.
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative research in
psychology, 3(2), 77-101.
Boyce, C. and Neale, P., 2006. Conducting in-depth interviews: A guide for designing and
conducting in-depth interviews for evaluation input.
Charmaz, K. (2011). Grounded theory methods in social justice research. The Sage
handbook of qualitative research, 4, 359-380.
Corbin, J. M., & Strauss, A. (1990). Grounded theory research: Procedures, canons, and
evaluative criteria. Qualitative sociology, 13(1), 3-21.
Doody, O., & Noonan, M. (2013). Preparing and conducting interviews to collect
data. Nurse researcher, 20(5), 28-32.
Fereday, J. and Muir-Cochrane, E., (2006). Demonstrating rigour using thematic analysis:
A hybrid approach of inductive and deductive coding and theme
development. International journal of qualitative methods, 5(1), pp.80-92.
Jacob, S. A., & Furgerson, S. P. (2012). Writing interview protocols and conducting
interviews: Tips for students new to the field of qualitative research. The Qualitative
Report, 17(42), 1-10.
EDU730: Research Practices and Methods
Page 14 EDU-730 Research Practices and Methods
Lacey, A., & Luff, D. (2001). Qualitative data analysis (pp. 320-357). Sheffield: Trent
Focus.
Smith, J., & Firth, J. (2011). Qualitative data analysis: the framework approach. Nurse
researcher, 18(2), 52-62.
Smithson, J. (2000). Using and analysing focus groups: limitations and
possibilities. International journal of social research methodology, 3(2), 103-119.
Strauss, A., & Corbin, J. (1994). Grounded theory methodology. Handbook of qualitative
research, 17, 273-85.
Video:
https://www.youtube.com/watch?v=DRL4PF2u9XA
References:
Boyatzis, R. E. (1998). Transforming qualitative information: Thematic analysis and code
development. sage.
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative
research in psychology, 3(2), 77-101.
Corbin, J. M., & Strauss, A. (1990). Grounded theory research: Procedures, canons, and
evaluative criteria. Qualitative sociology, 13(1), 3-21.
Fereday, J. and Muir-Cochrane, E., (2006). Demonstrating rigour using thematic analysis:
A hybrid approach of inductive and deductive coding and theme
development. International journal of qualitative methods, 5(1), pp.80-92.
Glaser, B., & Strauss, A. (1967). The discovery of grounded theory. Weidenfield &
Nicolson, London, 1-19.
Lacey A. and Luff D. (2009) Qualitative Research Analysis. The NIHR RDS for the East
Midlands / Yorkshire & the Humber.