R3S1

CLASSMATE 1

Reliability:

Test-retest reliability: With this type of reliability in a research study, researchers select a group of individuals and administer the same test twice at different periods of time. The test is provided to a group of individuals over a given period of time. Once the tests are given over the required time frame, researchers will then correlate the results from tests 1 and 2 and evaluate the stability of the test.Test-retest reliability can be implemented in order to test the knowledge of students on a certain subject and even IQ testing. For example, if students are tested on a subject such as geography, they will be tested at the end of the school year and then once the school year starts. The correlation coefficient between both scores provides the researchers with a measure of the stability of this exam over a period of time.

In terms of my current job, where we provide tobacco cessation opportunities the community, we could implement test-retest reliability by giving our clients that attend our tobacco cessation courses a small exam on the information that has been covered in the courses. There are a few days between each course, so we can administer the  2nd test when they come back to the course.

Interrater reliability: This reliability method helps measure the level or agreement and consistency of how different observers or researchers’ rate, assign, or categorize data. This is considered to be an observation reliability method and can be used to observe behavior where a group of researchers will gather data. The data collected by the researchers should be similar in how they have categorized the information observed.

At the current department I work for, there are courses that we provide specifically for behavioral health. A team of researchers can observe the courses and rate the different types of behaviors. Once the data is collected and examined, the team of researchers should have a certain level in consistency on the collected and hoe it was rated or categorized.

Validity:

Construct validity is a test that helps measure theoretical entities, concepts, or traits. Depending on the study, construct validity will help measure something in specific as opposed to things that may be similar to that trait. For example, a questionnaire that is set up to assess the participants' aggression levels, construct validity will measure aggression and not other similar traits such as being dominant, assertive, or anything possibly related to that trait. Construct validity measures what it states it is measuring.

At the current department I work in, where we provide tobacco cessation opportunities, construct validity can be used to measure specific behaviors from our clients. 

References:

-American Psychological Association. (n.d.-a).  Apa Dictionary of Psychology. American Psychological Association. https://dictionary.apa.org/construct-validity https://forrt.org/glossary/construct-validity/

-American Psychological Association. (n.d.).  Using the global assessment of functioning scale to demonstrate the importance of inter-rater reliability. American Psychological Association. https://www.apa.org/ed/precollege/undergrad/ptacc/inter-rater-reliability#:~:text=Inter%2Drater%20reliability%20is%20a,it%20can%20have%20detrimental%20effects.

-Reliability and Validity. (n.d.). https://chfasoa.uni.edu/reliabilityandvalidity.htm

-Salkind, N. J. (2012).  Exploring research. Prentice Hall.

CLASSMATE 2

Test-retest reliability is one of the most commonly practiced types of reliability methods and can be done fairly easily. Test-retest reliability is a statistical measure commonly used to assess the consistency and reproducibility of results obtained from healthy controls in research studies. While time between the first test and the second test differs, the same group of people receive the same test both time

Example of test-retest: Respondent to an IQ test: Each respondent is tested twice - the two tests are taken a month apart, then the   correlation coefficientLinks to an external site.  between two sets of IQ-scores is a reasonable measure of the test-retest reliability of this test ( https://www.statistics.com).Links to an external site.

Parallel forms reliability

Parallel forms reliability measures the correlation between two equivalent versions of a test. You use it when you have two different assessment tools or sets of questions designed to measure the same thing.

Parallel forms reliability example

A set of questions is formulated to measure financial risk aversion in a group of respondents. The questions are randomly divided into two sets, and the respondents are randomly divided into two groups. Both groups take both tests: group A takes test A first, and group B takes test B first. The results of the two tests are compared, and the results are almost identical, indicating high parallel forms reliability (Middleton, 2022).

Concurrent validity.  Concurrent validity indicates the amount of agreement between two different assessments. Generally, one assessment is new while the other is well established and has already been proven to be valid. An author of a new assessment would want her assessment to have high concurrent validity with well-respected, well-established assessments (sciencedirect.com. 2020)

Predictive  validity: is when a test can predict future performance, the test must correlate with a variable that can only be assessed at some point in the future, after the test has been administered.

 A student’s GPA is a widely accepted marker of academic performance and can be used as a criterion variable. To assess the predictive validity of the math test, you can compare how students scored in that test to their GPA after the first semester in the engineering program. If high test scores were associated with individuals who later performed well in their studies and achieved a high GPA, then the math test would have strong predictive validity (Nikolopoulou, 2022).

 

 

Voyager Sopris Learning (2023). Understanding test-re-test reliability: What It Is and why It matters.

Middleton, F. (2022). The 4 types of validity in research definitions & examples.

https://www.sciencedirect.com/topics/psychology/concurrent-validityLinks to an external site.

Nikolopoulou, K (2022). What is criterion validity? definition & examples.