Education Assignment 1
may2025
a year ago
30
files (2)Assignment1.1.docx
Assignment1.2.docx
Assignment1.1.docx
Due 7/19/2025
10 Pages and 10 references from open sources.
Assignment 1 - Evaluation Plan
The first assignment is to conduct an evaluation of an academic program of your choice. This report may be on a program identified by the CIMA student (Study Island- https://www.edmentum.com/products/study-island/)
The plan should include:
1. Program description
2. Program documentation and review
3. Review of literature related to the program
4. Methods used to evaluate the program, including the development of an evaluation rubric document
Assignment 1 should be approximately ten pages in length.
This assignment requires 10 citations at a minimum for the grade of A.
Assignment1.2.docx
Rewrite this so that it is 10 pages
1. Program Description
Study Island is a K–12 online formative assessment and practice platform aligned to state standards (e.g., CCSS, NGSS). It offers customizable quizzes, benchmark assessments (3–12), real-time feedback, remediation tools, and gamified elements like “blue ribbons” and interactive group sessions.
Core features: question bank (10K+ items, tech-enhanced), adaptive remediation, dashboards, teacher toolkit (lesson plans, multimedia resources), support for special needs (text-to-speech, adjustable formats).
Originally launched in 2000, Study Island evolved from Ohio proficiency prep to a national solution used in ~24,000 schools and 11M users.
2. Program Documentation & Review
Key documentation includes:
· Product Overview and Technical Manual detailing platform features and usage.
· Efficacy Reports (Allentown, Reading School Districts) documenting statistically significant gains, especially in 6th-grade math and PA PSSA improvements.
· ESSA Tier 3 Study (2016–17) showing moderate evidence of effectiveness, peer-reviewed by Marzano Researc.
Documentation is rigorous, user-oriented, and grounded in controlled studies, though heavy vendor influence suggests a need for independent validation.
3. Literature Review
A. Formative Assessment & Retrieval Practice
Study Island's model aligns with formative assessment best practices—immediate feedback, mastery-based progression—shown effective in meta-analyses (Bangert-Drowns et al., Black & Wiliam).
B. Technology-Enhanced Learning
Ed-tech platforms with regular usage (30 min/week) yield meaningful gains (Cheung & Slavin).
C. Platform-Specific Evidence
· 6th-grade math gains (Allentown).
· Reading & math growth across elementary schools (McLeod 2017).
· High school literacy proficiency improvement (Kiriakidis & Gernert 2014).
D. Limitations
Studies often quasi-experimental, with vendor-led bias. Independent replication is limited. Some literature on tech in education notes potential selection bias in non-RCTs .
4. Evaluation Methods
4.1 Framework & Design
· Mixed-methods: Combines quantitative (achievement data) and qualitative (teacher/student interviews, usability surveys).
· Quasi-experimental using Propensity Score Matching, mirroring McLeod et al. (2017).
· Logic model: Inputs (tech, PD), activities (practice, remediation), outputs (usage logs, mastery rates), outcomes (state test scores, engagement).
4.2 Data Sources
· Usage logs: frequency, topics, time spent
· Assessment scores: pre/post platform use (Exact Path, state tests)
· Surveys/interviews: perceptions of usability, differentiation
· Classroom observation: integration into instruction
4.3 Evaluation Rubric
Rubric domains (1–5 scale):
1. Standards alignment – content matches state standards
2. Feedback quality – accuracy and remediation logic
3. User engagement – motivational elements, accessibility
4. Data usability – clarity/actionability of reports
5. Integration – teacher ease, curriculum fit
6. Equity/access – device compatibility, special needs support
Rubric developed from documentation, literature, and stakeholder input. Piloted by digital-native teachers, revised for clarity.
4.4 Analysis Plan
· Quantitative: ANCOVA comparing treatment/control on post-scores, controlling pre-scores and demographics
· Correlation between usage intensity and score gain
· Qualitative: Thematic coding of interviews/surveys to assess barriers, usability themes
4.5 Ethical Considerations
· Obtain parental consent & IRB approval
· Anonymize all student data
· Ensure equitable access and participation
References
1. Bracht, N. T. (2011). Relationship Between Study Island and Student Outcomes.
2. Edmentum. (2017). ESSA Evidence-Based Intervention: Study Island in Elementary Schools.
3. Edmentum Research. (2018). Study Island Research Report.
4. Cheung, A., & Slavin, R. E. (2012). Effectiveness of Educational Technology.
5. Kiriakidis, P. P., & Gernert, R. (2014). Effect on High School Literacy.
6. McLeod, J. (2017). QuasiExperimental Study of Study Island.
7. Meador, D. (2019). In-Depth Review of Study Island.
8. Black, P., & Wiliam, D. (1998). Assessment and classroom learning.
9. Bangert-Drowns, R. L., Kulik, C.-L. C., Kulik, J. A., & Morgan, M. T. (1991). The instructional effect of feedback in test-like events.
10. Means, B., Toyama, Y., Murphy, R., Bakia, M., & Jones, K. (2010). Evaluation of evidence-based practices in online learning.
11. Slavin, R. E., Lake, C., Chambers, B., Cheung, A., & Davis, S. (2009). Effective reading programs for the elementary grades.
