MOD5 ASSGN
Program and Evaluation Tool Planning
Lua Shanks
Dr. Johnson
EDSD7900
10-23-2022
Program and Evaluation Tool Planning
Part 1
Identified Program in Early Childhood Education
Becoming part of Mayor Keller’s taskforce places one in a pivotal role of influencing the change process in matters that affect Grand City area. Early childhood education as a specialization area has programs that need to be evaluated in readiness for the change process. One such program that needs evaluation is the English language literacy program. The goal of English language literacy program is to improve basic writing, reading, and speaking skills from kindergarten level all the way to grades 3 to 5. The stakeholders involved in the program are early childhood educators, school administrators, district education officers, and parents. The current goals of the program include improving English language proficiency among the learners and advancing writing and reading skills of the learners from kindergarten to fifth grade.
Current Program Data
Strategies, Activities, or Initiatives to make the Program Effective
While the program has not been effective in the achievement of its goals, there are classroom strategies that are in place to improve its effectiveness. Provision of explicit and systematic kind of instruction in vocabulary ensures that children are exposed to words so as to acquire a proper understanding of their meanings. According to McGee and Richgels (2003), children can make connection between words if vocabulary is presented to them thematically (McGee & Richgels, 2003). Word learning in early childhood learners can also be improved through reading aloud that entails explanation of particular vocabularies targeted for a specific learning session. The other strategy that is in place to improve the effectiveness of the program is improving the alphabet knowledge of early childhood learners. The strategy includes working with learners to identify and name sounds and letters of the alphabet. This strategy goes together with creating phenological awareness in early childhood learners. It includes activities such as recognizing and saying rhyming words with a teacher, matching sounds to letters, and listening to identify the syllabus within words. Other than learning sounds, interactive reading of storybooks is another strategy that will improve the effectiveness of the program. Story telling becomes more effective as a learning strategy when it is done through reading. Improving learners interactive experience of language through songs, rhymes, poems, and letter prints are practical ways that will enable early learners improve their language literacy.
Part 2
Indicators to Measure the Effectiveness of Program
According to Giancola (2014), indicators are statements that can be applied to determine the progress of a program. The progress is measured in relation to target objectives and target goals of a program (Giancola, 2014). The indicators that will be used to measure the effectiveness of the English language literacy program in early childhood learners are evidence of increased knowledge of the alphabet. The children’s ability to name the letters of the alphabet and categorize them into the lower and upper cases will be an indicator of progress in language literacy. The rationale for this indicator is to determine whether leaners get the basics of English language learning. Ability to name letters automatically will be another indicator to consider for the progress. This indicator also relates to learning the basics of the language that are essential for early childhood learning. The third indicator that will show the effectiveness of the program is ability of a learner to identify and name objects automatically. The rationale for this indicator is to determine progress and cognitive development of learners. It is also necessary in determining learner’s awareness of things in their surroundings. Phonics and its awareness as an indicator will be used to assess the ability of the students to pronounce words correctly and make sounds that come from the combination of letters. Phonics forms the basis of speaking (Brown, 2014). The last indicator to determine the progress of the program will be mastery of words, letters, memory of sounds, and writing capabilities. Writing and pronunciation are essential elements of language literacy that enable learners to know the spellings and develop the confidence to speak.
Criteria and Evaluation Tool Design
While language learning is a continuous process that is not only done at the kindergarten level, but also continues throughout the learning process, it is essential to accommodate the fact that language learning in early childhood education setting affects language learning achievements and developments in all the advanced stages of the learning process. The criteria for evaluating the indicators will include determining their impact both in the short-term and in the long-term. Determining the effectiveness of the indicators to influence immediate achievement and influence in long-life learning. Based on these considerations the evaluation tool that will be used is that which will identify or highlight progresses or achievements made throughout the learning process. An evaluation design applicable for this case is that which will track progress on a timely basis, but continually throughout the learning process. The design will be quantitative in nature to inculcate the use of data during evaluation. Data is a critical component of tracking progress. The evaluation tool appropriate for the program will be assessments and tests. Tests and assessments are mostly quantitative in nature; however, they can include some qualitative aspects if a program designer find them appropriate. The rationale for this choice is based on fact student performance in language and literacy program should be quantified for easy tracking of progress. Giancola, (2014) indicates that if a program is aligned properly to assessment, then data becomes a meaningful indicator of progress and success. The position of the author shows the connection between objective assessment and data (Giancola, 2014).
Strategies for Buy-in and Collaboration
Buy-in and collaboration among the stakeholders of the program is necessary in ensuring support and success both at the school and community levels. Developing a shared vision for the program will ensure buy-in from other stakeholders (Giancola, 2014). The language literacy must have a vision that matches that of the state and district education department. This shared vision can be done by ensuring that assessments and teaching activities meet the guidelines from the state and district. For instance, assessment should align to English proficiency standards for the state. The rationale for establishing a shared vision is hinged on the need of avoiding or eliminating lack of cooperation among the stakeholders. The shared vision must align to the policies at the school level, community, district and state levels. Another strategy for buy-in and collaboration is solicitation for feedback from the stakeholders. There is a need to meet with the stakeholders, especially parents to solicit their feedback on the performance of their children based on the evaluation methods used. Parents can also highlight possible areas of challenges that they believe should be solved to improve performance. Parents can also highlight the areas of strength that should be capitalized for better results.
Part 3
The program will utilize tests and assessments as the appropriate tools of evaluation. The evaluation will be backed by quality indicators selected for the program. Giancola (2014) identify indicators as statements that are applicable when determining the progress of a program. The author states that the progress of a program is measured based on its goals and objectives (Giancola, 2014). One indicator that will justify the need for tests and assessment is improvement in knowledge of the alphabet. Test will be done and assessed to ascertain whether learners have increased their capability to identify letters of the alphabet. For instance, students will take letter identification tests, which will be assessed on the basis of how fast a student can identify a letter. The second indicator that will be evaluated using the tool is increased ability to name letters. Students will also be tested on their ability to spot letters and name them in a mixture of letters. Tests will be done so that students can identify and group letters in both lower and upper cases. During the assessment, a score guide will be established to gauge the increased capability. The goal of the program is to improve the performance of the students in English language and literacy. The performance of students in grades 3-5 in Grand City has not been impressive. The number of students in these grades who did not meet expectation increased increased in the last 5 years from 40.3% to 50.7% (Walden University, 2016). Letter naming forms the foundation of language literacy. The third indicator that will be assessed is increased capability to automatically name objects. Test will be done that will entail identification and naming of objects. A typical test paper for this assessment will entail the objects that students interact with in their environments such class desks, chairs, kitchen utensils, and other household items. The fourth indicator for the assessment will determine increased performance in phonics. An oral test will be done where students will make sounds of letters, phrases, and words. The fifth indicator that will be assessed is to determine increase mastery of words. This will be done by asking by testing student’s pronunciation, spelling tests, and dictation.
Validity and reliability of the measurable criteria will be based on data and alignment to the program goals within a given time frame. According to Henson (2016), validity of data is a critical component in determining the delivery of a program. The data in a program must be consistent with the conditions of the program (Henson,2016). Assessments and tests will only be done after learners have gone through a certain objective within a specified period of time. The teachers will outline the time frames for the achievement of each of the listed indicators and objectives. For instance, letter identification will be assessed after the learners have gone through a learning process that entails identification of letters and tested after a period of 3 or 4 months.
Assessment and tests as program evaluation tools were created on guideline of determining increased improvement. Progress was a key component that was used as guide to determine the ability of the program to realize its goal. Jayaratne (2016) states that improvement as component of evaluation is to transform a program so that it can show better performance. Giancola, (2014) adds the element of data and states if that if a program is aligned properly to assessment, then data becomes a meaningful indicator of progress and success (Giancola, 2014). The program was designed on the basis of improvement.
Part 4 Action Plan
The action plan will support the program evaluation by ensuring that program activities are performed within a defined time frame. The action plan will provide the guideline in terms of timing and time allocation for the activities. For instance, the action plan will provide a time reference of what students are supposed to achieve in various grades of learning. A grade one teacher teaching English language and literacy will know that by end of the grade, the students are proficient in letter naming. This particular activity should be performed within a period of 6 months maximum. Action plan helps with planning, monitoring, and organization of program activities around the targeted goals.
For purposes of continuity with ongoing program evaluation, data on student performance will be tracked for each of the listed activities. Student assessment and test scores will be recorded after every test. The data will be analyzed using graphs and charts. Performance in each indicator will be analyzed with reference to time factor and grade promotion. Any deviations or changes in performance will be noted and used for improvement. The data will be presented to parents in forms of student performance reports. The data will be disseminated to the school administrators in the form of class or grade performance reports. The data will be disseminated to the school district and administrators in the form of grades reports compared to state standards.
Tracking of data plays a crucial role in monitoring program performance. It has the advantage of identifying program aspects that do not align with the program goal. Monitoring of data helps project participants to ascertain which particular areas need which type or amount of resources so as to enhance improvement. While monitoring of progress has the advantage of keeping tracking on the improvement component, dissemination of results to the stakeholders enhances stakeholder support and involvement. Dissemination of the results to the stakeholders help in building stakeholder collaboration and reduce resistance (Giancola, 2014).
References
Brown, C. S. (2014). Language and literacy development in the early years: Foundational skills that support emergent readers. Language and Literacy Spectrum, 24, 35-49.
McGee, L. M., & Richgels, D. J. (2003). Designing early literacy programs: Strategies for at- risk preschool and kindergarten children. New York: The Guilford Press.
Giancola, S. P. (2014). Evaluation matters: Getting the information you need from your evaluation. Giancola Research Associates, Inc.
Henson, H. (2016). Data quality evaluation for program Evaluators. Canadian Journal of Program Evaluation, 31(1).
Jayaratne, K. S. U. (2016). Tools for formative evaluation: Gathering the information necessary for program improvement. The Journal of Extension, 54(1), 7.
Walden University. (2016). Grand City education and demographic data files. Retrieved from https://cdn- media.waldenu.edu/2dett4d/Walden/EDDD/2015/CH/mm/grand_city/index.html
Appendices
|
Action Plan Title: Language and Literacy Program in Grand City
|
||||
|
Program Goal: Improve language and literacy performance in early childhood education in Grand City for grades 1-5
|
||||
|
Implementation |
Evaluation-Updates |
|||
|
Action Steps to Complete |
By When
|
By When By WhoM |
Resources: What Is Needed for This to Happen? |
Progress Notes |
|
Test and assessments for letter identification |
Within a period of 6 months |
End of grade 1 by English teacher |
Letter charts, letter drawings, letter cuttings, books |
Student able to identify letters by end of grade 1 |
|
Tests and assessments for sounds and pronunciation |
Within a period of 6 months |
End of grade 2 by English and language teacher |
Sound books, recorded audios, spelling tests |
Student scores satisfactory marks in tests for sounds and pronunciation |
|
Oral test for sounds |
3 months’ time |
By end of grade 2 head of literacy department |
Sound and letter audio recordings, books |
Student able to say letter sounds, word sounds, syllables, and phrases |
|
Tests and assessments for object identification |
Within a period of 2 months |
By end of grade 3 Head of English and literacy |
Object drawings, object paintings, coloring of objects, books |
Student able to able to identify and name objects within their sounding |
Action Plan Template
PART ONE: Develop the SMART Goal.
Use this template to develop specific, measurable, attainable, relevant and time-bound (SMART) goals for your action plan.
Goal Statement: Improve language and literacy performance in early child education in Grand City for grades 1-3.
Specific : yes.
Measurable : Indicators of improvement will be evaluated in alignment of the goal
Attainable : Yes, it is achievable. The resources are available for the achievement of the goal within the specified grades.
Relevant : It is relevant. Language and literacy in childhood education is necessary in early learners for developing their writing and speaking skills
Time-Bound : The program targets learners in grade 1 all the way to grade 5
PART TWO: Determine Evidence of Success.
Direct Evidence: Improved test scores in the indicators
Indirect Evidence: Proficiency of learners when speaking the language, when writing, and when interacting with the teachers.
PART THREE: Develop an Action Plan.
|
Key Action (for whom, what grade levels) |
Resources, skills, training, support, and funding needed |
Person or group responsible |
Start/end dates of activities |
|
Language teacher, school administrator, district administrator of education |
Beginning of grade 1 to beginning of grade 2 |
||
|
Sound materials, letter charts, books. Funds to purchase books provided by the school administration |
Language teacher, school administrators |
The first 6 months of grade 2 learning |
|
|
Sound recorders and books. Funds provided by the school administration |
Language teacher and school administrator |
3 months towards the end of grade 2 |
|
|
Letter spellings, letter drawings, sound recordings |
|||
|
Object drawings, object paintings, books, and charts |
3 months towards end of third grade |