Course Revisions and Evaluation Report
Quality Online Learning and Teaching, Faculty/Peer Assessment, Condensed Version
This version of the QOLT instrument is best used when not necessarily wanting to enter scores in the online version of the instrument. For example, an instructor may be doing an initial or cursory review of their course before deciding where best to focus their attention in redesign efforts. In addition, the following version of the QOLT self/peer-assessment instrument is ideal for consultation purposes, such as between an Instructional Designer and Instructor.
To find further information regarding the QOLT Awards Program and a demonstration of many effective examples related to QOLT, see the 1-hour QOLT Informational Webinar, go to http://tinyurl.com/qolt-webinar-2013
To access the online version of the QOLT instruments, go to http://tinyurl.com/qolt-instruments
The Course Objectives part is comprised of 54 objectives organized into nine sections as follows:
1. Course Overview and Introduction (8 objectives)
2. Assessment and Evaluation of Student Learning (6 objectives)
3. Instructional Materials and Resources Utilized (6 objectives)
4. Students Interaction and Community (7 objectives)
5. Facilitation and Instruction (8 objectives)
6. Technology for Teaching and Learning (5 objectives)
7. Learner Support and Resources (4 objectives)
8. Accessibility and Universal Design (7 objectives)
9. Course Summary and Wrap-up (3 objectives)
Please read each section title and objective carefully. Examples are provided to promote clarity. Use the ratings scale below to effectively assess how well you met each objective. It is helpful to make comments on each objective as to where/how the objective is being met and/or addressed in your course. See example below.
|
3 |
Exceeds/Always |
Criterion evidence is clear, appropriate for the course, and demonstrates "best practices." |
|
2 |
Meets/Often |
Criterion evidence is clear and appropriate for the course, but there is some room for enhancement |
|
1 |
Partially meets/Sometimes |
Criterion evidence exists but needs to be presented more clearly and/or further developed. |
|
0 |
Does not meet/Rarely or Never |
No criterion evidence exists, or is present but not appropriate for the course. |
|
NA |
Objective does not apply to the course |
It may be something only a fully online course would need and you are teaching a blended course for example. |
Example
|
Section 1. Course Overview and Introduction (8 objectives) Instructor gives a thorough description of the course, as well as introducing students to the course. |
||
|
Objectives |
Example |
Completed |
|
1.1 Instructor uses course environment to provide clear and detailed instructions for students to begin accessing all course components, such as syllabus, course calendar, assignments, and support files. |
Welcome message or materials introducing course structure/ components is highly recommended. |
|
|
1.2 Detailed instructor information is available to students and includes multiple formats for being contacted by students, availability information, brief biographical information, and a picture of the instructor. |
Instructor introduces him/herself to the class and provides more than one way to be contacted such as email, phone, and/or office hours (in-person and/or online). |
|
|
1.3 Course description includes the purpose and format of the course, as well as prerequisite knowledge and competencies, if applicable. |
Instructor introduces the purpose of the course as well as explain the course format as either completely online or in person |
|
|
1.4 Online etiquette expectations for various forms of course communication and dialog (e.g., chat, "hangout," email, online discussion) are presented and clear to the student. |
Rules of conduct may include use of the language and formatting. See further at Netiquette: Make it Part of Your Syllabus |
|
|
1.5 Academic integrity or "code of ethics" is defined. Related institutional policies for students to adhere are clearly stated and/or links to those policies (e.g., online catalog; institution web page) is provided. |
Policies typically include cheating, plagiarism, and copyright. Instructor may also provide sample work that demonstrates plagiarism. |
|
|
1.6 A list of technical competencies necessary for course completion is provided, identifying and delineating the role/extent the online environment plays in the total course. |
Technical competencies may include the use of Learning Management System, downloading and uploading, file management/sharing, , communications tools, collaboration tools, discipline-specific software or hardware. In addition, instructors may want to point students to the CSU Stanislaus Online Readiness Self-Assessment. |
|
|
1.7 Instructor provides samples of student work and provides opportunity to students to ask questions. |
Instructor can do a mock exercise, show an assignment, discuss readings, and review projects. |
|
|
1.8 Instructor asks students to share their own learning goals. |
Instructor encourages students to share why they take the course, and asks about the relevancy of the course to their academic degree, daily life, and potential careers. |
|
|
Section 2. Assessment of Student Learning (6 objectives) Student Evaluation and Assessment refers to the process used to gather evidence of the achievement of the Student Learning Objectives/Outcomes (SLOs). We strongly recommend that instructors contact the Office of Academic Assessment for assistance and information about this section. |
||
|
Objectives |
Example |
Completed |
|
2.1 All Student Learning Objectives/Outcomes (SLOs) are specific, well-defined, and measureable. |
Learning Objectives are measurable and observable, e.g. define, apply, synthesize in Bloom’s Taxonomy. Note: If your course level objectives are mandated and not measurable, then module or weekly level objectives should be measurable and support course level objectives. |
|
|
2.2 Grading policy is provided in a manner that clearly defines expectations for the course and respective assignments. |
Instructor provides late submission policy and scale, weights of respective assignments, and the corresponding letter grade if scores are accumulated at the end. |
|
|
2.3 The learning activities (including the assignments and ungraded activities) promote the achievement of the SLOs. |
Instructors explain how learning activities such as assignments or discussions contribute to the achievement of the stated SLOs. |
|
|
2.4 The assessment instruments (e.g., rubrics) are detailed and appropriate to the student work and respective outcomes being assessed. This includes assessing modes of online participation and contributions. |
There are multiple ways for students to demonstrate competence or mastery. E.g., research project, paper, tests, presentations, or multimedia projects. Students are not just grades for online participation but the quality of their participation and contributions. |
|
|
2.5 Throughout the semester, instructor provides multiple opportunities to give feedback on students learning and to help students “self-check” their learning. |
Activities may include but not limited to blogs for reflection, peer review, practice test and draft of term paper, module summary. Instructor effectively uses Learning Management System gradebook (or similar) for timely quantitative and qualitative feedback |
|
|
2.6 Throughout the semester, instructor provides multiple opportunities to solicit feedback from their students about their learning and on the course for the improvement of the course. |
Instructor may consider the use of surveys, discussion forums, or item analyses to collect feedback or attitudinal data (that goes beyond student learning outcomes) on the effectiveness or difficulty of the resources and activities (e.g., “Muddiest Point”), or item analysis of test questions in order to improve the course in the future. |
|
|
Section 3. Instructional Materials and Resources (6 objectives) Addresses the variety of materials and material formats the instructor has chosen to present course content and enable students to meet relevant learning outcomes and, when possible, the affordability of chosen course materials. |
||
|
Objectives |
Example |
Completed |
|
3.1 Instructor provides students with adequate time and notice to acquire course materials. |
Instructor includes instruction in the syllabus or elsewhere in the course as to acquire course materials including textbooks, and other types of external resources. |
|
|
3.2 Syllabus lists whether textbooks and materials are required or recommended. |
Instructor separates the materials and labels them as either required or recommended. |
|
|
3.3 Instructor articulates the purpose of all materials as to how they are related to the course and module learning objectives. |
For required and recommended materials, there are brief statements as to the value/purpose in meeting student learning objectives/outcome(s). If external links/websites are used, the links should be self-evident or a short description of the specific link needs to be provided instead of posting a general link for students to explore. |
|
|
3.4 When possible, instructor provides s options in terms of how students acquire course materials, including Open Educational Resources. |
Course materials include both the Open Educational Resources (e.g. MERLOT) and external materials |
|
|
3.5 There is a variety of instructional material types and perspectives, while not overly relying on one content type such as text. |
Materials types include PowerPoint, videos, text. Multiple perspectives refer to different opinions from scholars in the field. |
|
|
3.6 Modeling academic integrity, instructor appropriately cites all resources and materials used throughout the course. |
These resources and materials include text, images, tables, videos, audio, and website. In addition to citation, when possible, direct link to the source may be provided. |
|
|
Section 4. Students Interaction and Community (Course Design) (7 objectives) Addresses (1) the opportunities students have to interact with the content, their peers, and their instructor, and (2) how well the course design encourages students to become active learners and contribute to the online course community. |
||
|
Objectives |
Example |
Completed |
|
4.1 At the beginning of the course, instructor provides an opportunity to have students self-introduce to develop the sense of community. |
Instructor may encourage students to post their pictures and share some personal information such as hobbies to build the community at the beginning. |
|
|
4.2 Instructor provides the information about being a successful online learner/student. |
Instructor provides a self-assessment for students to identify their readiness for learning online and learning strategies or provides a link to an online readiness survey such as the Online Readiness Self-Assessment from CSU Stanislaus. |
|
|
4.3 Navigation throughout the online components of the course is logical, consistent, and efficient. |
Discussions are organized in clearly defined forums, threads, or communities. The course carries consistent structure for across modules. |
|
|
4.4 Learning activities facilitate and support active learning that encourages frequent and ongoing peer-to-peer engagement.
|
If group work required, a statement of the task is provided, with clear and concise outcomes that are appropriate and reasonable. Rules for forming groups, assigning roles, benchmarks and expectations of group participants clearly stated. |
|
|
4.5 The modes and requirements for student interaction are clearly communicated. |
Requirements for participation (e.g., frequency, length, timeliness) are included in the syllabus and/or in the description of the assignment in within the module. |
|
|
4.6 Instructor clearly explains his or her role regarding participation in the online environment. Instructor participates and manages, yet lets students take reasonable ownership. |
Instructor works to keep students on task/topic with their online discussions. Instructor may offer prompts to refocus students to the task at hand or there may be the desired effect simply by them engaging with the discussion group. |
|
|
4.7 The course learning activities help students understand fundamental concepts, and build skills useful outside of the course. |
Learning activities engage students in learning some basic concepts, but also give students opportunities to use higher level learning skills such as apply, analyze, etc, to make connections with real-world problem solving. |
|
|
Section 5. Facilitation and Instruction (Course Delivery) (8 objectives) Addresses how well the instructor facilitates the course, communicates with students, engages students to be active learners, and reinforces the development of a sense of community among course participants. |
||
|
Objectives |
Example |
Completed |
|
5.1 The instructor was helpful in identifying areas of agreement and disagreement on course topics. |
Through moderation of course discussions, instructor presents areas where ideas or viewpoints differ. S/he uses differences as teachable moments, either resolving them based on hard data or acknowledging the respective viewpoints as valid. |
|
|
5.2 Instructor helps students understand importance of course topics and related outcomes |
Instructor sequences and moderates content delivery and related activities while maintaining overall focus on meeting the stated learning objectives and outcomes. |
|
|
5.3 The instructor helps keep course participants engaged and participating in productive dialogues. |
Instructor, as moderator, guides students who have gotten "off track" back to the tasks and related outcomes. |
|
|
5.4 Instructor encourages students to explore new concepts through the course experience. |
Rather than limiting all students to the same traditional or narrow focus, instructor allows students latitude/choice around course topics. Note: The ability to do this varies by discipline and topic. |
|
|
5.5 The instructor helped to focus discussion on relevant issues. |
None |
|
|
5.6 The instructor provides feedback in a timely fashion. |
Instructor uses the Learning Management System efficiently to respond to student work submissions with scores and feedback related to strengths and/or weaknesses. |
|
|
5.7 Instructor sends communications about important goals and course topics as opportunities arise. |
None |
|
|
5.8 Instructor sends reminders of due dates and duration of respective modules, as well as other instructions to keep students on task. |
Instructor enters all date ranges and due dates into the Learning Management System, and reminders are sent to students. |
|
|
Section 6. Technology for Teaching and Learning (5 objectives)
Addresses how well the instructor utilizes technology to effectively deliver course content, engage students in learning activities (individual, student-to-student, and instructor-to-student), and allow students to express themselves or demonstrate learning. |
||
|
Objectives |
Example |
Completed |
|
6.1 The tools and media support the course learning objectives/outcomes. |
Examples include use videos or animation to demonstrate the process of photosynthesis. |
|
|
6.2 Instructor takes advantage of the current tools provided by the Learning Management System (or similar) to enhance learning. |
The course uses a virtual classroom for synchronous web conferencing. |
|
|
6.3 Technological tools and resources used in the course enable student engagement and active learning. |
Instructor uses collaborative software such as Google docs to work on group projects and/or SoftChalk to engage students in mediated learning. |
|
|
6.4 Instructor provides clear information regarding access to the technology and related resources required in the course. |
Instructor provides information about where and how to acquire the technologies. For downloads, instructor provides direct links. Any costs are specified up-front. |
|
|
6.5 Acceptable technological formats for assignment completion and submissions have been articulated. |
Rather than limiting the acceptable format to one content or technology type, instructor is open to allowing students to meet objectives using multiple formats for assignment completion such as word processing, electronic poster creation, multimedia artifact, or combination of these (mash-up). |
|
|
Section 7. Learner Support and Resources (4 objectives) Addresses the program, academic, and/or technical resources available to learners. Though instructors may not play the direct support role, they should be aware of potential issues and promote what is available to support students. |
||
|
Objectives |
Example |
Completed |
|
7.1 Instructor states her or his role in the support process. |
Though some of the support necessary may fall outsides of the instructor role or expertise, instructors can advocate for students to avail themselves of related support services. |
|
|
7.2 The course syllabus (or related) lists and/or links to a clear explanation of the technical support provided by the campus and suggestions as to when and how students should access it. |
Technical support may mean the Information Technology (IT) help desk where students would seek assistance when they have technical problems with the Learning Management System. |
|
|
7.3 Course syllabus (or related) provides an introduction to campus academic (non-technical) support services and resources available to support students in achieving their educational goals. E.g., Disability Support Services, Writing Center, Tutoring Center). |
Academic support services may include but not limited to the Library, writing center, online tutoring service. Resources may include online orientation for new students, successful learning strategies for online learners, Lynda.com training videos. |
|
|
7.4 Course syllabus (or related) provides information regarding how the institution's student support (non-academic, non-technical) services and resources (E.g., advising, mentoring) can help students succeed and how they can these services. |
Such services usually include but not limited to online registration, advising and counseling. |
|
|
Section 8. Accessibility and Universal Design (7 objectives) Addresses the course’s adherence to accessibility and universal design principles that are critical to some learners but that benefit all learners. NOTE: We strongly recommend that instructors contact their campus disability service center for assistance and information related to this section. |
||
|
Objectives |
Example |
Completed |
|
8.1 Syllabus (or similar) links to the campus accessible policy, whether it is required or recommended that instructors do so. |
See Iowa State University's Sample Syllabus Statements Regarding Disabilities for a list of sample syllabus statements regarding accommodations or support for students with disabilities. |
|
|
8.2 Instructor articulated how s/he proactively supports a wide range of learning styles and abilities of all students, as opposed to just making reactive accommodations for those with registered disabilities. Note: This support does not entail sacrificing academic rigor or student learning outcomes. The goal is supporting the needs of all learners as opposed to having an inflexible teaching and learning process. |
See EnACT's UDL-Universe: A Comprehensive Faculty Development Guide for how to state proactive support for all students in a syllabus. |
|
|
8.3 Students are given accessibility information and policies related to the online course environment. |
Instructor provides the campus ADA compliance statement and the Learning Management System accessibility statement and/or provides a link to the institution's disability services and Learning Management System accessibility information. |
|
|
8.4 Students can clearly ascertain the role of the instructor in providing support for those officially registered with the campus disability services office. |
Instructor includes information from Services for Students with Disabilities to address working with students with disabilities. |
|
|
8.5 Course materials created by the instructor or from external sources are in formats that are accessible to students with disabilities. |
Text formatting and document organization, navigation and links, images and graphics, tables, and background and colors accommodate assistive technology. (e.g., the link to take a quiz says, "Take Quiz 1," NOT "Click Here". Images and graphics have Alternate Text Tags. File formats including audio and video, Word, PowerPoint, and PDF are all accessible. (e.g., videos are captioned or a text script is provided.) |
|
|
8.6 All tools used within learning management system or that are third-party are accessible and assistive technology ready. |
Tools may include but not limited to virtual classroom and plug-ins such as Studymate Class, Web 2.0 social networking technologies (wiki, twitter, and more). Some of these tools may not be completely accessible. Versions, such as, EasyChirp (Twitter) and EasySlideshare (Slideshare) have significant accessibility enhancements. |
|
|
8.7 If accessibility of a particular course resource or activity is not practicable, instructor provides an equally effective accessible alternative for students. |
None |
|
|
Section 9. Course Summary and Wrap-up (3 objectives) Addresses the opportunities students are given to summarize the semester, establish the connection between this course and other courses, and prepare to start the next phase of their program/progress. |
||
|
Objectives |
Example |
Completed |
|
9.1 Instructor provides students opportunities to ask questions as a form of closure and to foster insight into accomplishments. |
Instructor uses discussion threads to ask students (1) if they have any questions and (2) to reflect on their progress toward their learning objectives and outcomes. |
|
|
9.2 Instructor provides students with feedback about their overall learning and progress and their experiences of the term. |
Instructor includes specific, summative feedback on student learning across the term (semester or quarter). |
|
|
9.3 Instructor provides opportunities for students to reflect on their learning and connect their individual learning goals with the expectations (stated learning objectives and outcomes) of the instructor. |
Instructor asks students questions to compare what they can do now, having met the student learning objectives, with what they could do prior to taking the course. |
|
10