Psychology
abc7746
6.docxPART 1
Read the attached powerpoint slides and Answer the following questions. Minimum 300 words, must have in-text citation and references in APA format
Test Reliability
Identify three tests that are of interest to you. These could be tests that we have already discussed this semester, tests that you will be taking and writing your summaries on, or tests that just interest you! I would recommend choosing some of the assessments that have been in existence and used for quite some time because you will find more information readily available.
1. Search the Internet to find information about the reliability of each test. Please be sure to reference any supporting journal articles that have tested the reliability of the instruments you have chosen.
2. Report the type of reliability testing conducted on the test and the characteristics of the test takers in each reliability study.
3. Write one paragraph explaining the similarity or difference between the methods used to estimate reliability for each test.
4. Be sure to support your discussion with scholarly sources.
PART 2
Need responses for following discussion posts – minimum 150 words for each response and must have in-text citation and reference in APA format
Response 1
We learned about reliability/validity and how test scores should be consistent for this week's discussion. We rely heavily on tests results to have precision and to trust the measurement of each test user's approximate scores the same way every time it is used (Lovler & Miller, 2020). Looking at different reliability tests, I am intrigued to learn more about using the Spearman-Brown formula, Cohen's Kappa, and standard error of measurement. Different types of tests require strategic calculations of the results and the ability to measure behaviors. These are the three tests I found that I want to investigate further.
Projective Tests- We all know about MBTI and its testing ability when it comes to personality. Still, there is another test I want to check, such as the Thematic Appreciation Test (TAT), a projective measurement and technique intended to evaluate a person's patterns of thought, attitudes, observational capacity, and emotional responses to ambiguous test materials (Encylopedia of Mental Disorders, n.d.). I looked this up and found that it is widely used by practicing clinicians; however, clinicians use different cards or a different number of cards. This process makes it incredibly difficult to obtain reliability and validity estimates and almost impossible to compare results. (Cherry, 2020.)
Achievement Tests – Achievement/Motivation tests, such as the Wechlar Individual Assessment test or the Ray Achievement Motivation Scale, can provide insights on individuals' achievement-orientated behaviors. Test users scores differently depending on how motivated and the way they answer the questions (Britt, 2012). What I like about these tests is that the questions are opinion based and depending on the sequence of the answers, the tests rate you on how far individuals are achievers in life.
Neuropsychological Tests – These tests are specifically designed tasks used to measure a psychological function known to be linked to a particular brain structure or pathway. The Beck Depression Inventory is a nominal scale measurement that rates depression scores ranging from mood, self-dislikes, indecisiveness, to loss of libido (Beck & Steer, 1984). Reliability is likely due to how individuals are compared due to their socioeconomic background and cultural differences. There had been some consistencies among the users that found high levels of depression (Beck & Steer, 1984). Validity is questioned because of how the tests were distributed, the design of the test, and the reconstruction of the questions.
Methods used to estimate reliability depends on how the administrators design the test and when tests are administered to the users. Results can also have many factors to form precision outcomes of the tests depending on the errors of tests and the reliability coefficients that can measure behaviors properly.
Reference
Beck, A.T., & Steer, R.A. (1984). Internal consistencies of the original and revised beck depression inventory. Journal of Clinical Psychology 40(6), 1365-1367. https://web.a.ebscohost.com/ehost/pdfviewer/pdfviewer?vid=10&sid=e28a4843-21f1-4b12-9608-acff691a2786%40sdc-v-sessmgr03
Britt, M. (2012). Test reliability explained [Video]. YouTube.
Play Video
Cherry, K. (2020). Why Is the thematic apperception test used in therapy? VeryWell Mind. https://www.verywellmind.com/what-is-the-thematic-apperception-test-tat-2795588
Encyclopedia of Mental Disorders (n.d.) Thematic apperception test. http://www.minddisorders.com/Py-Z/Thematic-Apperception-Test.html
Miller, L. A., & Lovler, R. L. (2020). In Foundations of psychological testing: A practical approach (6th ed., pp. 54–84). SAGE.
Response 2
I have chosen to discuss and compare the reliability of the following personality tests: DiSC, Big Five Personality Test (B5T), and Meyers-Brigg Type Indicator (MBTI). In a study conducted by Roodt (1997) on DiSC reliability and validity, the test-retest method was used on 90 randomly-selected employees from several companies in Kwa-Zulu-Natal and Gauteng, South Africa. No further information is given on the characteristics of the test participants in regards to the actual study. The questionnaire given to the participants consisted of 24 questions each with four options to select: the respondents were instructed to select a response that most closely resembled themselves and a response that was least like themselves for each question (Roodt, 1997).
The reliability test conducted for B5T involved interscale correlations (Satow, 2021), which measures internal consistency. The test itself measures attributes by asking similar questions in different ways about the same attributes. Since the test is well-known, it has been taken many times by many different people worldwide. For this study, test results were taken and used from the online website Psychomeda from the period of June 2019 to July 2020 (Satow, 2021). The test is free and anonymous, and the sample size consisted of 21,048 records, with 13,123 female respondents between 20 and 30 years of age with high school diplomas and jobs (Satow, 2021). Then, of course, this meant that the sample size of men numbered 7,925.
Parallel forms were used to test the reliability of the MBTI. The study consisted of mailing 2733 questionnaires to business school alumni who were managers with postgraduate management qualifications (Lamond, 2001). Of the 2733 questionnaires mailed, 523 questionnaires were received (Lamond, 2001). Most of the respondents were born in Australia, while three quarters of the respondents were male with the modal age group being 40-49 years old (Lamond, 2001). Fifteen percent of the respondents were born in a non-English speaking country, and 40% of the non-Australian born respondents were Asian (Lamond, 2001).
In the DiSC study, Roodt (1997) applied the same instrument to the same respondents at a later stage and then the correlation scores were calculated. In regards to the reliability test conducted in the B5T study, Cronbach’s scale was used for interscale correlations with the reliability scores on each of the personality attributes. Inter-correlation calculations were conducted prior to the gathering of data from tests on the Psychomeda website (Satow, 2021). Additionally, all statistical calculations were conducted with the statistics program R, R Core Team, 2020, version 4.0.3 (Satow, 2021). The reliability of the MBTI was tested using two forms of the research instrument: Form A for MBTI and Form B for the Managerial Style Measure (Lamond, 2001). “To test whether the ordering of the questions had affected the respondents’ answers to the MBTI, the reliability of the MBTI was determined separately for the two forms” (Lamond, 2001, p.19). Different reliability tests were needed for each study due to the methods used and the characteristics of the psychological assessments themselves. The DiSC study involved the same companies which then allowed the same respondents to participate, so it was feasible to use the test-retest method. In the case of the B5T study, the sample size was extremely large, and it was not possible to perform the other reliability tests with random respondents’ data from the testing website. While both the test-retest method and parallel forms could have been used to test the reliability of the MBTI, the parallel forms method was more suitable given the mode of administration- mail surveys- of the questionnaires to a large pool of recipients. Resources Lamond, D. (2001). The Myers-Brigg Type Indicator: Evidence of its validity, reliability and normative characteristics for managers in an Australian context. Macquarie University. Roodt, K. (1997). Reliability and validity study on the Discus personality profiling system. University of South Africa. Satow, L. (2021, January 31). Reliability and validity of the enhanced Big Five Personality Test (B5T). https://doi.org/10.31234/osf.io/wsugv
