week 9

1

Chapter Three: Research Methodology (Mixed-Methods) Part Two

Arnita Norman

Liberty University Online

CLED987: Research Methods for Christian Leadership V (A01) CLED987_A01_202430 Gary Bredfeldt

July 4, 2024

2

Research Design Synopsis

Research Problem

Teenagers today are immersed in a digital world dominated by social media. Today,

teenagers aged between 13 and 17 years are the biggest users of social media where are research

by Phew Research Center shows that 67% of U.S. use TikTok, 62% use Instagram, 59% use

Snap Chat, 32% use Facebook, 95% use YouTube while a significant number use platform like

Reddit, X, Twitch, Tumblr and WhatsApp (Vogels, Gelles-watnick & Massarat, 2022). Research

shows that teen years are very critical because that is when youngones are growing intellectually,

when identities and feelings of self-worth are formed (Katella, 2024). However, research shows

that although these platforms offer opportunities for connection and information, they highly

present challenges especially in teenagers mental well-being and social behavior (Allen et al.,

2014; Bohn, 2021; Vogels, Gelles-watnick & Massarat, 2022; Katella, 2024; Cason et al., 2024).

There is lack of study on how social media affects teenager’s religious behavior. From a

theological point of view, many religions view the world, including technology, as God's

creation. The question then becomes how teenagers in today’s digitally invested space can use

this creation responsibly and for good, avoiding its pitfalls. Spiritual growth and discipleship

require intentional practices such as prayer, reading scripture, and participating in communal

worship. Social media's pervasive presence can distract teenagers from these spiritual disciplines,

consuming time and attention that could be devoted to nurturing their faith. Theologically, this

raises concerns about how digital engagement might hinder spiritual formation and the

development of a robust and mature faith. This study will address this gap and build on the

existing research on the impact of social media on teenagers' mental well-being and social

behavior.

3

Research Purpose

This research aims to examine the digital dilemma facing teenagers, especially when it

comes to the influence of social media on their mental well-being, social behavior and religious

behavior. Understanding how social media not only affects psychological or social wellbeing but

also impacts teenager’s religious engagement will equip parents, religious leaders, and teenagers

themselves with strategies for navigating the digital world in a way that fosters both a strong

faith and healthy online habits.

Research Questions

The following research questions will be addressed in the study:

1. How does social media affect the psychological well-being, social as well as religious

behavior of teenagers?

2. How does social media affect teenagers' engagement with religious practices, beliefs, and

communities?

3. What is the role of parents, educators and religious leaders in ensuring teenagers consume

the right content from social media?

Research Design and Methodology

The study will use mixed method design where the researcher will collect and analyze

both quantitative and qualitative data. This method was selected because it will allow the

researcher to address the limitations of both quantitative and qualitative techniques. The

quantitative data will be collected through survey questionnaires and use descriptive statistics to

analyze the data. The survey design will include use of closed-ended questions to measure social

media usage patterns, mental health effect social behavior, and religious behavior. A pilot test

will be conducted to test on the survey on a small group of teenagers to ensure clarity and

4

comprehensiveness. The surveys will be administered online, where the participants will be

given a link to google forms where they can easily fill out their answer anonymously.

Descriptive statistics will be used to analyze the quantitative survey data using Excel software,

and the results will be reported using frequencies, percentages, and averages.

On the other hand, the qualitative data will be obtained through focus group surveys and

use thematic analysis technique to analyze the transcribed data. According to Stewart and

Shamdasani (2014), a focus group can be defined broadly as “a type of group discussion about a

topic under the guidance of a trained group moderator” (p. 687). The researcher will develop

semi-structured guides with open-ended questions tailored to explore teenagers' experiences,

thoughts, and feelings about social media and its impact on their lives, focusing on church youth

groups. The discussions will be recorded with permission from participants for transcription in

the later stage of analysis. The focus group sessions will take place over a period of three

months. This timeline will allow for sufficient scheduling flexibility to accommodate the

availability of the participants and to ensure thorough and thoughtful data collection. The

extended duration will also provide the opportunity for ongoing reflection and analysis, enabling

the researcher to refine questions and explore emerging themes in subsequent focus groups. The

research will rely on qualitative data analysis software (NVivo) to organize, code, and analyze

the data after it has been transcribed.

Quantitative Research Methodology

Population

The research population or the target group refers to the entire group of individuals to

which the researcher wants to generalize findings (Banerjee & Chaudhury, 2010). In this study,

population is teenagers aged 11-17 years residing in St. Louis, MO, USA. Based on the most

5

recent American census data, it is seen that there are 60,837 residents under the age of 18 in St.

Louis, which is approximately 18% of the total population in the city jurisdiction (U.S. Census

Bureau, 2022). This demographic includes a diverse group of young individuals in various stages

of adolescence, encompassing middle school, high school, and early college years. The selection

of this age range is intended to capture the full spectrum of adolescent experiences with social

media, as this period is critical for identity formation, social development, and religious

engagement.

Sampling Procedures

The aim of sampling is to have a sample size that is adequate and is a representation of

the targeted population (Crowther & Lancaster, 2012). This study will use purposive techniques

when recruiting participants for the study. In this case, the researcher only takes individuals who

meet the necessary standards constructive to the goals of the research in this case; the teenagers

involved are social media active users who are within the required age bracket. According to

Etikan et al. (2016), purposeful sampling enables the researcher to reach numbers of patients

who stand high chances of offering the needed information in the study. The data will be

collected using a sample of 200 participants. However, the above sample size will be modified to

fit specific resources available according to the study’s limitations or resources available.

Limitations of Generalization

Validity is one of the most important criteria that are used in measuring generalizability

in studies conducted using quantitative research methods (Polit & Beck, 2010). For instance,

external validity or the extent to which findings from one investigation can be translated to other

setting, has been an appreciated attribute for years (Polit & Beck, 2010). One limitation of this

study is that the findings may not be easily generalizable to all teenagers outside of the St. Louis,

6

Missouri area. The cultural, socio-economic, and regional characteristics of St. Louis might

influence the behaviors and attitudes of the participants, meaning the results might not fully

reflect the experiences of teenagers in different geographic locations or contexts. Additionally,

the use of purposive sampling limits the ability to generalize findings to the entire population of

teenagers, as the sample is not randomly selected (Etikan et al., 2016).

Ethical Considerations

While surveys might seem like a gentle touchpoint a participant is likely not to be able to

link with the researcher and may not be impacted by the research findings, meaning a set of

guidelines for ethical research using surveys is required (Hammer, 2017). In their study, Roberts

and Allen (2015) identified the following as the major ethical issues inevitable in the use of

online surveys: consent, incentives for response, individual and collective privacy and

anonymity, and data quality. In this study, the researcher will explain and obtain consent from all

the participants about the research’s purpose, procedures, and their individual rights as subjects.

In the case of the minors, consent will also be required from either the parents or the guardian of

the minor. The confidentiality principle mandates that participants will be free to withdraw from

the study at any one time without any repercussions.

As to the third point, participants will also be made aware that there is no reward for

completing the survey. Pseudonyms will be used for identifying participants and no data will be

presented in a manner that volunteers can be identified, or their individual responses can be

traced. Furthermore, the study will adhere to ethical guidelines and regulations for conducting

research with minors, ensuring their safety and well-being throughout the research process. The

researcher will take measures to ensure the data collected through online surveys is accurate and

reliable by designing clear and concise questions and storing the responses in a secure computer.

7

Proposed Instrumentation

Research instrument refers to the specific tools or methods chosen to collect data

(Zohrabi, 2013). In this case, the researchers will be using survey questionnaires to collect

quantitative data. The researcher will utilize closed ended question design, meaning that the

survey questions will have a limited set of pre-defined answer choices for participants to select

from. This design will allow for easier data analysis compared to open-ended questions where

participants provide their own answers (Zhou et al., 2017).

The provided choices will follow a 5-point Likert Scale (1: Strongly Disagree, 2:

Disagree, 3: Neutral, 4: Agree, 5: Strongly Agree). In this case, participants will have five

options to express their level of agreement or disagreement with a particular statement. As a

result, the responses will be consistent, which means the researcher will have an easy time

quantifying and analyzing the data statistically. In addition, the participants will feel encouraged

to take a clear stance on the presented statements (Joshi et al., 2015).

Research Procedures

The church is where the researcher believes she can have access to the target

demographic at ago. The participants will be invited via a link that they can fill up their answers

and submit at their own convenience. The researcher will approach the target demographics,

explain to them the purpose of the study and seek their consent to participate before sharing the

google forms link through their preferred platform such as Email, WhatsApp, and so on.

8

Data Analysis and Statistical Procedures

Descriptive statistics will be used to analyze the quantitative survey data using Excel

software. Descriptive statistics involve summarizing and describing the characteristics of the data

(George & Mallery, 2018). The results will be reported using frequencies (the number of times

each answer choice is selected for a particular question), percentages (frequencies expressed as a

proportion of the total number of respondents), and averages (measures like mean, median or

mode (most frequent answer)). Tables and different types of graphs will be used to visualize the

data.

Qualitative Research Methodology

Setting

In qualitative focus group research, the setting refers to the physical and social

environment where the focus group discussion takes place (Gibbs, 2012). Setting plays a crucial

role in influencing the quality and nature of the data collected. The setting for this research is a

church, specifically targeting the youth groups within this religious community. Churches often

serve as central social hubs for their members, particularly for young people, and provide a

context where values, behaviors, and community interactions are deeply intertwined with

religious teachings. The church setting was also chosen because of the religious aspect of the

research questions, whereby obtaining relevant data about the influence of social media on

teenagers’ religious will be easier. In addition, conducting the research in this setting allows for

the examination of how social media influences not only the general well-being and social

interactions of teenagers but also their religious behavior and engagement within a faith-based

community.

9

Participants

Participants will be recruited from the church youth, specifically targeting those aged 11

to 17 years. The researcher will select participants from church youth groups who are willing to

discuss their social media experiences openly. To ensure comprehensive data collection and to

reach data saturation, the study will conduct at least five focus groups, each consisting of 5-6

participants. According to Breen (2006), researchers using focus groups for data collection

should ensure that the groups are homogenous and comprise between four and six people in

each. This sampling strategy aims to capture a diverse range of perspectives and experiences,

providing a thorough understanding of the research topic. In addition, the researcher will seek to

have at least 5 focus group sessions. Based on the arguments of Corbin (1990) and Breen (2006),

the number of interviews to be conducted should focus on the degree of expectation of the

researcher that he or she will be reaching theoretical saturation when conducting the thematic

analysis; that is, more than expectation of the next interview would reveal new themes. By the

time the interview hits the 10-12 mark; the researcher is usually sated from experience from

theoretical saturations (Breen, 2006).

Role of the Researcher

In focus group discussion, the researcher plays the role of a moderator in which the

researcher facilitates and begins the discussion with pre-set questions and does not control the

flow of group discussion (Nyumba et al., 2018). In this study, the researcher will assume the role

of focus group leader or moderator and facilitate the arranged discussions by ensuring that each

participant has the opportunity to share their thoughts and experiences. The researcher will guide

the conversation with prepared questions but also allow the discussion to flow naturally, probing

deeper into relevant topics as they arise. This role requires the researcher to be neutral,

10

empathetic, and skilled in managing group dynamics to foster an open and respectful dialogue

(Gibbs, 2012). As a moderator, the researcher will be attuned to participants' emotional well-

being and create a space where they feel safe to express discomfort or need breaks if necessary.

Ethical Considerations

While explaining the relevance of focus groups for international business research, Sim

and Waterfield (2019) argue that focus group methodology creates different ethical issues that do

not have a one-to-one match with those arising from face-to-face interviews. The ethical

concerns that can frequently arise when conducting a focus group include consent;

confidentiality and anonymity; and risks of harm (Tolich, 2016; Sim & Waterfield, 2019). In this

study, one very important factor will be the willingness of the participants to participate. It will

be ensured that both the teenagers and their parents or guardians provide their informed consent

on their participation. As White (2013) remarks, consent is backed up by the accompanying

principle of respect for persons, signifying, one must never treat the other merely as a means to

an end. As such, the researcher will ensure participants’ wish will be respected and that they

understand the study and make an autonomous choice about involvement. The researcher will

ensure participants are fully informed and empowered to make a voluntary decision. This will be

achieved by providing adequate information about the study's purpose, procedures, risks, and

benefits.

Besides, anonymity in reporting will be strictly maintained to protect the privacy of the

participants, ensuring that no identifiable information is disclosed in the study's findings.

According to Sim and Waterfield (2019), anonymity focuses on whether an individual

participant can be identified from the collected data. In an anonymous study, there's no way to

link any information back to a specific person. This might involve removing names, addresses,

11

or any other details that could potentially reveal someone's identity. Some participants might be

worried about specific details being revealed even if they cannot be personally identified (Tolich,

2016). For example, someone might be willing to share their struggles with social media but not

be comfortable if their religious beliefs were made public without being anonymous. In this

study, the participant's identity will be kept confidential by ensuring that no one outside the

research team can identify participants from the reported findings.

Additionally, the researcher will create a safe and supportive environment for the

discussions, emphasizing that participants can withdraw from the study at any time without any

repercussions. While there are moments when focus groups almost encourage participants’

support, there are also times when one’s vulnerability with other people’s group may be

destructive and result to social or psychological harm when the confidentiality and anonymity of

the participants are compromised by the data gleaned from the discussion (Ransome, 2013).

Some of the risks that participants may face include embarrassment, shame, stigmatization,

discrimination, problem in existing relationships with friends, family and other relativity,

disadvantageous consequences at the place of work, and legal consequences for exposures

sometime that leads to legal implication (Sim & Waterfield, 2019). To avoid any form of harm to

participants, the researcher will set clear ground rules for respectful discussion and emphasize

confidentiality to help participants feel more comfortable sharing their views and experiences

with social media.

Data Collection Methods and Instruments

The qualitative data will be collected through focus groups with church youth,

particularly those between age 11- 17 years. Nyumba et al. (2018) define a focus group as a

group discussion on a particular topic organized, guided, monitored and recorded by a researcher

12

for research purposes. In those group discussions, the researcher acts as the moderator or

facilitator.

To successfully conduct the focus group discussions, the researcher will utilize various

instruments starting with a consent form that participants will be required to sign before the

focus group begins. The consent forms will outline how the data will be collected and used

thereafter. In addition, the researcher will need to have a phone ready for audio or video

recording based on how comfortable the participants will be. The recording will be used later

where the conversation will be recorded verbatim. The researcher will also take notes using

paper and pen, capturing the key points, nonverbal cues, and anything that may not be clear on

the recording (e.g., body language). This will mainly be a backup to provide additional details.

Data Analysis

To analyze the focus group data, thematic analysis technique will be followed. According

to Braun and Clarke (2019), thematic analysis is a method for analyzing qualitative data that

focuses on identifying, analyzing, and reporting patterns (themes) within the data. They outline

the six steps that must be followed when conducting thematic analysis including

1. Familiarization: Immersing yourself in the data through reading and rereading

transcripts.

2. Generating initial Codes: Identifying interesting features (codes) within the data.

3. Searching for themes: Grouping related codes into potential themes.

4. Reviewing themes: Refining and defining the identified themes.

5. Defining and naming themes: Clearly describing the essence of each theme.

6. Writing up: Presenting the findings in a clear and comprehensive way.

13

The researcher will follow these steps to analyze the focus group data and triangulate with the

quantitative data.

Chapter Summary

This research aims to examine the digital dilemma facing teenagers, especially when it

comes to the influence of social media on their mental well-being, social behavior and religious

behavior. Mixed method has been chosen in this study to enhance the validity and reliability of

the data and their interpretation. The method will provide a richer understanding of the impact of

social media on teenagers’ mental health, social behaviors as well as religious behavior. For

quantitative research, data will be collected using survey questionnaires designed with closed

ended questions and 5-point Likert scale for consistency in results. The questionnaires will be

distributed online after obtaining consent from participants, who mostly will be accessed from

the churches across St. Louis, MO. Descriptive statistics will be used to summarize and analyze

the quantitative data, where tables and graphs will be used to visualize the findings. Qualitative

data obtained through focus groups with church youth will be analyzed using thematic analysis

method.

14

References

Allen, K. A., Ryan, T., Gray, D. L., McInerney, D. M., & Waters, L. (2014). Social media use

and social connectedness in adolescents: The positives and the potential pitfalls. The

Educational and Developmental Psychologist, 31(1), 18-31.

Banerjee, A., & Chaudhury, S. (2010). Statistics without tears: Populations and

samples. Industrial psychiatry journal, 19(1), 60-65.

Bohn, K. (2021). How social media is changing the way people get to know one another. The

Pennsylvania State University, October 26.

Braun, V., & Clarke, V. (2019). Reflecting on reflexive thematic analysis. Qualitative research

in sport, exercise and health, 11(4), 589-597.

Breen, R. L. (2006). A practical guide to focus-group research. Journal of geography in higher

education, 30(3), 463-475.

Cason, G., Margolis, A., Barile, J., & Milanaik, R. L. (2024). Caring for screenagers (Part 1): a

pediatrician's primer on popular social media platforms. Current Opinion in

Pediatrics, 36(3), 315-324.

Corbin, J. (1990). Basics of qualitative research grounded theory procedures and techniques.

Crowther, D., & Lancaster, G. (2012). Research methods. Routledge.

Etikan, I., Musa, S. A., & Alkassim, R. S. (2016). Comparison of convenience sampling and

purposive sampling. American journal of theoretical and applied statistics, 5(1), 1-4.

George, D., & Mallery, P. (2018). Descriptive statistics. In IBM SPSS Statistics 25 Step by

Step (pp. 126-134). Routledge.

Gibbs, A. (2012). Focus groups and group interviews. Research methods and methodologies in

education, 186, 192.

15

Hammer, M. J. (2017). Ethical considerations for data collection using surveys. Number 2/March

2017, 44(2), 157-159.

Joshi, A., Kale, S., Chandel, S., & Pal, D. K. (2015). Likert scale: Explored and

explained. British journal of applied science & technology, 7(4), 396-403.

Katella, K. (2024). How social media affects your teen’s mental health: A parent’s guide. Yale

Medicine. Retrieved from https://www.yalemedicine.org/news/social-media-teen-mental-

health-a-parents-

guide#:~:text=The%20advisory%20points%20to%20a,a%20place%20to%20show%20thei

r

Nyumba, T.O, Wilson, K., Derrick, C. J., & Mukherjee, N. (2018). The use of focus group

discussion methodology: Insights from two decades of application in

conservation. Methods in Ecology and evolution, 9(1), 20-32.

Polit, D. F., & Beck, C. T. (2010). Generalization in quantitative and qualitative research: Myths

and strategies. International journal of nursing studies, 47(11), 1451-1458.

Ransome, P. (2013). Ethics and values in social research. Bloomsbury Publishing.

Roberts, L. D., & Allen, P. J. (2015). Exploring ethical issues associated with using online

surveys in educational research. Educational Research and Evaluation, 21(2), 95-108.

Sim, J., & Waterfield, J. (2019). Focus group methodology: some ethical challenges. Quality &

quantity, 53(6), 3003-3022.

Stewart, D. W., & Shamdasani, P. N. (2014). Focus groups: Theory and practice (Vol. 20). Sage

publications.

Tolich, M. (2016). Are Qualitative Research Ethics Unique? In Qualitative ethics in practice (pp.

33-48). Routledge.

16

U.S. Census Bureau. (2022). American Community Survey 1-year estimates. Retrieved

from Census Reporter Profile page for St. Louis,

MO http://censusreporter.org/profiles/16000US2965000-st-louis-mo/

Vogels, E. A., Gelles-watnick, R. & Massarat, M. (2022). Teens, social media and technology

2022. Phew Research Center. Retrieved from

https://www.pewresearch.org/internet/2022/08/10/teens-social-media-and-technology-

2022/

White, M. D. (2013). Pareto, consent, and respect for dignity: A Kantian perspective. In Ethics

and Economics (pp. 120-141). Routledge.

Zhou, R., Wang, X., Zhang, L., & Guo, H. (2017). Who tends to answer open-ended questions in

an e-service survey? The contribution of closed-ended answers. Behaviour & Information

Technology, 36(12), 1274-1284.

Zohrabi, M. (2013). Mixed method research: Instruments, validity, reliability and reporting

findings. Theory and practice in language studies, 3(2), 254.