Assignment: Pre-Employment Test Suitability

PSYC 8576: Advanced Personnel Psychology

Test Evaluation Template

Directions: For the test/instrument you have identified for this assignment, evaluate it using the below criteria taken from the Officer of Personnel Management Assessment Decision Guide provided as a resource. Use the template provided on the second page to record you assessment.

Validity: This refers to extent to which the assessment method has been shown to accurately measure a job-related competency and/or predict successful performance on the job. Typically, it is discussed in terms of content, criterion-related, or construct validity. 

Reliability: Assessment reliability is demonstrated by the consistency of scores obtained when the same applicants are reexamined with the same or equivalent form of an assessment. It also refers to internal consistency of the test items.

Face Validity/Applicant Reactions: Face validity refers to applicants’ judgments regarding the degree to which the content of an assessment tool is relevant and representative of the content of the job. Applicant reactions include perceptions of the face validity of the test as well as overall reactions to the assessment process. 

Administration Method: This measure considers information regarding how an assessment method can be used. Typically, this includes the size of the applicant group that can be assessed at one time and whether the assessment can be administered using paper-and-pencil or electronic formats. 

Subgroup Differences: This concerns the extent to which the assessment method has been shown to result in different pass (or selection) rates, average scores, or prediction errors across groups. Differences are typically based on race, ethnicity, or gender. 

Development Costs: These costs include the amount and type of resources required to develop an assessment, in terms of time, money, and technical expertise. 

Administration Costs: These costs include the amount and type of resources required to administer an assessment, in terms of time, money, staff, equipment, facilities, and information technology support. 

Utility/Return on Investment (ROI): This refers to the extent to which the benefits gained from using the assessment method outweigh the costs of development and administration. 

Common Uses: This is a description of the occupations and/or situations for which the assessment method is typically used. 

Test Name__________________________________________________

Description___________________________________________________________________________________________________________________________________________________________________________________________________________________________________

Evaluation Criteria
Validity
Reliability
Face Validity/ Applicant
Administration Method
Subgroup Differences
Development Costs
Administration Costs
Utility/Return on Investment
Common Uses