Test Evaluation

USING THE MENTAL MEASUREMENTS YEARBOOK (MMY) DATABASE

In order to complete your Test Evaluation Paper in Module: Week 5, you will need to learn to utilize an online database known as the Mental Measurements Yearbook (MMY) database.

The Buros Center for Testing publishes a book series called the Mental Measurements Yearbook . The MMY provides review articles for over 2,000 instruments, batteries, assessments, and tests used in psychological/education evaluations. Testing professionals can read these reviews to make informed decisions about tests that they may want to use. Online access to these reviews can be obtained through Liberty University’s Jerry Falwell Library website.

1. Go to the Jerry Falwell Library mainpage ( http://www.liberty.edu/library/)

2. From the tool menu on the right-hand side of the screen, click the arrow to open the dropdown menu for COLLECTIONS and click the link for DATABASES. (See below)

PSYC 545

Page 1 of 6

3. When the DATABASES page open, on the left-hand side of the screen, choose to BROWSE BY LETTER, and click the link for letter “M” (for Mental Measurements Yearbook).

4. Scroll down the list of databases that begin with the letter “M” until you see the Mental Measurements Yearbook. Click the title to enter the database.

5. Before you can enter the database, you will be prompted to log in to the EZProxy portal for off- campus access to library resources. Enter your Liberty.edu user name and password here.

6. Once you are logged in, you will be able to search the Mental Measurements Yearbook (MMY)

database for tests that are of interest to you. See the sample MMY search page below.

7. Once you click the search button, a page with tests that address your topic of choice will open.

8. When you have found a test that looks interesting to you, click on its title, and you will be taken to a page that provides information about the test as well as at least one review of the test.

9. For your Test Evaluation Paper, you will want to find at least 2 reviews for the test that you choose to evaluate. As you read the reviews of the test, be sure to take note of the key psychometric information required for the paper:

a. Purpose of the Test

b. Type of Test/Scoring

c. Normative Sample

d. Reliability Data

e. Validity Data

10. Remember, if any of the required psychometric data are NOT provided in the reviews, then be sure to explain what additional information you would need to fully evaluate the test.

PSYC 545

Test Evaluation Paper Assignment Instructions

Overview

The purpose of the current assignment is to evaluate the psychometric properties of a psychological assessment of your choice. For this paper, each student will select ONE psychological test that is NOT covered in the textbook or in any class presentations. Students will use the Mental Measurements Yearbook (MMY) database available through Liberty University’s Jerry Falwell Library website to find resources to aid in evaluating the test. In grading your paper, your instructor will look at the following:

Instructions

Evaluation of the Psychometric Properties of the Test

Your evaluation of the test should include the following areas of consideration:

1. Purpose of Test: What is the purpose of the test (personality, screening, diagnosis, marriage counseling, placement for children, etc.)? Who developed it and why? How is it used?

2. Type of Test/Scoring: What kind of items does the test utilize (T/F, Likert, etc.)? How is the test scored? What kind of score(s) do respondents receive (percentile rank, z score, T score, total and /or subscale scores?)

3. Normative Sample: Describe the normative sample (including the number of participants and their known demographic characteristics). Indicate whether or not the normative sample is adequately representative of the intended test-takers.

4. Administration: How is the test administered? Paper and pencil? Computer based? Who can purchase/administer the test (i.e., minimum qualifications)?

5. Reliability: Correctly use terms from the textbook/course materials to define the types of evidence for reliability reported in the review articles, and provide the specific numerical values of the reliability statistics. If no reliability data are provided, then explain what type of evidence for reliability you would need in order to fully evaluate the test.

6. Validity: Correctly use terms from the textbook/course materials to define the types of evidence for validity reported in the review articles, and provide the specific numerical values of the validity coefficients. If no validity data are provided, then explain what type of evidence for validity you would need in order to fully evaluate the test.

Justification for Selecting the Test

Your justification for selecting the test should include the following areas of consideration:

1. Explain why you selected this test for review. Specifically, explain how the test is relevant to what you are doing now and/or your future career plans.

2. Explain how the test that you chose fits in with the goals and responsibilities of Christian professionals who might utilize the test. Choose at least one scriptural citation to support your argument.

Assignment Parameters

1. Use of current APA formatting guidelines is expected throughout your paper.

2. Your assignment should include an APA-formatted Title Page.

3. You will choose one (1) psychological test to evaluate, and you will find two (2) articles from the Mental Measurements Yearbook (MMY) database that assess the psychometric properties of the test that you chose.

4. In your evaluation of the test, you will use information gathered from both review articles to write a comprehensive evaluation of the test.

· The written evaluation of the test itself (the body of your paper) should be 2-3 pages in length.

· Your paper should be written in a scholarly writing style with a formal, college-level tone that utilizes appropriate grammar, diction, spelling, and punctuation.

· Your paper should appropriately utilize in-text citations of all sources (2 review articles and 1 scriptural citation), and citations should be presented in accurate APA format.

5. Your paper will include an APA-formatted References Page.

· Your references page should include the reference information for the 2 review articles that you obtained from the MMY.

· You also may include the class textbook as a reference if you cite information from the textbook when writing your paper.

· Make sure that you reference every source that you cite and that you cite every source that you reference. (Follow the current APA guidelines about including the Bible in your References page. Citing the Bible is required.)

· Your references for articles obtained from the MMY should include the following information: 1) Last name, first initial of author(s) of the review, 2) year of publication of MMY edition, 3) name of test being reviewed, 4) name(s) of MMY editors, 5) title of MMY edition, and 6) electronic retrieval statement

Note: Your assignment will be checked for originality via the Turnitin plagiarism tool.

Page 2 of 2

TEST EVALUATION 1

TEST EVALUATION 4

Evaluation of the Personality Assessment Inventory—Adolescent Comment by Matthew Swain: Please Note: This is an example paper meant to illustrate the general expectations and parameters of the assignment. However, it is not meant to be an example of a perfect Test Evaluation paper, as there are spelling and grammatical issues, as well as a lack of complete information on all psychometric properties for the test described. Use this document as a guide, but continue to follow the specific guidelines for content and expectatons outlined in the Test Evaluation Paper Instructions document.

Liberty U. Student

Department of Psychology, Liberty University

Author Note

Correspondance concerning this assignment should be addressed to Liberty U. Student, 1971 Univeristy Blvd., Lynchburg, VA 24515. Email: [email protected]

Abstract

An abstract that provides an overview of the paper’s content is required. Please format the abstract according to current APA Manual standards. Write your abstract (and paper) as if you are preparing this manuscript for submission in a peer-reviewed journal.

Keywords: test name, test content keyword, assessment, psychometric properties

Evaluation of the Personality Assessment Inventory—Adolescent

The Personality Assessment Inventory- Adolescent (PAI-A) is a self report personality questionnaire for clinical assessment of adolescents ranging in age from 12 to 18 years old. Kade (2010) identifies this assessment as an objective test for personality, designed to give insight on vital client variables in professional settings. The manual for the test indicates that there are 264 items that take participants 30-45 minutes to complete, and examiners 10-15 minutes to score. Each item is answered on a 4-point likert-like scale ranging from false/not at all true, to true/very true (Sandoval, 2010). The option of having computer-based administration, scoring, and interpretive report software is available. Analysis of the test instructions and items shows reading comprehension at a fifth grade level is required for test completion.

Norms for scores on the PAI-A were based in 707 participants. The sample was not random, because data were collected on 1,032 participants in matching demographics. Norms are not broken down by age, ethnicity, or gender because observed group differences were typically within the range of measurement error and account for less than 5% of the variance in scores (Kade, 2010).

There was an average test-retest reliability coefficient of .78 for the scales after a mean of 18 days. Sandoval (2010) explains that six validity studies were completed with samples ranging from 77 to 1,160 and support the assessments criterion related validity. Sandoval (2010) also asserts that the PAI-A gives a much better alternative to the growing number of other self report measures available for this age group in clinical decision making.

Justification for Choosing the Personality Assessment Inventory—Adolescent

I selected the current test because I thought it would be very helpful for my brother who was diagnosed with both Oppositional Defiant Disorder and Attention Deficit/Hyperactivity Disorder at age 9. It will be helpful to him when he is older and starts venturing into more professional settings. Specifically, it would be very beneficial to be knowledgeable about the different aspects of his personality when sending him to college or into the work place so that he may be as effective and productive as possible. Knowing what affect his behavioral disorders have on his personality will enable our family to equip him with the tools necessary to succeed and achieve to his fullest potential.

From the perspective of a Christian professional who utilizes psychological tests, this test is a reliable and validy way to gain information and to make clinical decisions to help people who may be struggling with emotional and/or behavioral disorders. In Matthew 25:35-40 (New International Version) Jesus says: 35 For I was hungry and you gave me something to eat, I was thirsty and you gave me something to drink, I was a stranger and you invited me in, 36 I needed clothes and you clothed me, I was sick and you looked after me, I was in prison and you came to visit me.’ 37 “Then the righteous will answer him, ‘Lord, when did we see you hungry and feed you, or thirsty and give you something to drink? 38 When did we see you a stranger and invite you in, or needing clothes and clothe you? 39 When did we see you sick or in prison and go to visit you?’ 40 “The King will reply, ‘Truly I tell you, whatever you did for one of the least of these brothers and sisters of mine, you did for me.’

The PAI-A is a test that allows Christian professionals to accurately and consistently identify hurting people in order to offer them assistance. In this way we will fulfill Jesus’ expectations for His followers to take care others just as if we were taking care of Him.

References Comment by Matthew Swain: For your Test Evaluation Paper, you will have AT LEAST two (2) references on your References Page. Specifically, you will provide the reference information for the 2 review articles that you obtained from the MMY in order to evaluate the test that you chose. If you used and cited information from the class textbook when writing your paper, please be sure to incude its reference information on the References page Be sure that you cite all of the sources that you reference and that you reference all of the sources that you cite!

Kade, H. D. (2010). Test review of the Personality Assessment Inventory-Adolescent. In R. A. Spies, J. F. Carlson, & K. F. Geisinger (Eds.), The eighteenth mental measurement yearbook. Retrieved from the Buros University Mental Measurement Yearbook online database.

Sandoval, J. (2010). Test review of the Personality Assessment Inventory-Adolescent. In R. A. Spies, J. F. Carlson, & K. F. Geisinger (Eds.), The eighteenth mental measurement yearbook. Retrieved from the Buros University Mental Measurement Yearbook online database.