Test Analysis
TEST EVALUATION OUTLINE EDC 670/660
The test evaluation is intended to develop your skill in critically evaluating standardized assessments.
Section 1: General Features
Provide the basic identifying information regarding the assessment including:
(a) title of the assessment, (b) author(s), (c) publisher, (d) publication date, (e) age/grade range, and (f) test user qualifications.
Section 2: Description of Instrument
(a) purpose of instrument: What does the instrument measure?
(b) population: Who is the instrument intended to be used with?
(c) how is the instrument administered (self-scored, individual-, group-, computer-, etc.) and scored (hand-scored, computer-, self-)?
(d) what type of scores does the instrument yield (raw score, percentiles, standard scores, age/grade equivalents, qualitative descriptions, etc.)?
Section 3: Psychometric Properties
(a) Describe the norm group. Explain if it is representative, current, large enough? Explain if the instrument is appropriate for multicultural populations?
(b) Describe the reliability evidence of test results (test-rest, alternate forms, internal consistency, interrater reliability). Is there enough reliability evidence to make a decision whether to use or not to use the instrument?
(c) Describe the validity evidence of test results (content, criterion-related, construct). Is there enough validity evidence to make a decision whether to use or not to use the instrument?
(d) Describe and summarize at least two different professional reviews of the test i.e. Mental Measurement Yearbook, Tests in Print or other sources.
Section 4: Practical Aspects
(a) How much time is required for administer the instrument.
(b) How easy or difficult is it to administer, score, and interpret the instrument?
(c) What is the cost of the instrument (including manuals, test booklets, answer sheets, computer administration and scoring, etc.)?
(d) How useful is the instrument manual?
Section 5: Strengths, weaknesses, and overall test evaluation
Based on the psychometric properties, practical aspects and other external sources, summarize the instrument’s strengths and weaknesses and give your final evaluation of the instrument.