writing assignment #1

Homework 1 – Validity & Reliability

Name:

Directions: Homework 1 is divided into two parts. Part 1 focuses on assessing validity and

reliability of large-scale assessments while Part 2 focuses on assessing validity and reliability in

local classroom assessments.

Part 1- Large-scale Assessments

1. Read pages 32-42 in the SOL Technical Report for 2014-2015 which is (Attached). Then categorize each piece of provided validity and reliability evidence into one of the Sources

of Validity Evidence or Sources of Reliability Evidence discussed in the McMillan

textbook (Required is Chapter attached). For example, if the report talks about how

the SOL is positively related to performance on the SAT, this piece of evidence would

best fit into the Evidence Based on Relationships to Other Variables category. Be sure to

also include an explanation as to why you think the piece of evidence fits into the

evidence category you have chosen.

2. Are any of the Sources of Validity Evidence and/or Sources of Reliability Evidence discussed in the McMillan textbook not represented in the technical report? If yes, list

them and describe how the SOL test constructors could go about assessing these sources

of validity and reliability evidence.

Part 2 – Local Classroom Assessments

3. Think of written tests that you have taken in previous courses, and reflect on these questions:

1. Have you ever taken a test that you believe had a poor sample of content? 2. Have you ever taken a test that was not aligned well with the objectives,

instructional materials (e.g., textbooks), and/or actual instruction. Briefly describe

such experiences. (worth 2.75 points)

4. Using a test you described in # 3 above, discuss how your instructor could have collected evidence of validity and reliability for the test. Specifically, in your response address

what Sources of Validity Evidence and Reliability Evidence would have been appropriate

and how he or she could have gone about collecting these pieces of validity and

reliability evidence. Be sure to clearly articulate your reasoning using support from the

course readings. (worth 2.75 points)

NOTE: Please follow every point in the instructions above. DO NOT MISS

ANY POINT.

Due in 24 hours.