Reporting the Results of a Website Evaluation
Website Motivational Analysis Checklist (WebMAC) Professional( (v. 2.0)
DIRECTIONS:
WebMAC Professional was designed for professional educators to assess Web sites for use in classroom instruction or for student use in homework assignments or projects. Before using WebMAC Professional, it's a good idea to spend some time exploring the Web site to be evaluated in order to have some familiarity with its content and structure. You may need to go through the Web site at least once more to complete this checklist.
Rate your level of agreement with each of the 32 items on the next two pages by placing the appropriate number value on the line in front of each item. If you are not sure about any item, select the best response you can give.
3 = strongly agree
2 = somewhat agree
1 = somewhat disagree
0 = strongly disagree
NA = Not Applicable
Example of completed item:
3 0. This Web site makes me happy.
After you have rated all 32 items, go back and look at each NA item. You should place one of the following scores next to the NA for that item.
0 = the Web site would have benefited if it had included the item (e.g. audio).
1 = the Web site didn't require that item.
2 = the Web site was better off for not including that item.
Copyright ( 1999 (revised 2004) by Ruth V. Small & Marilyn P. Arnone, Syracuse, New York. All rights reserved. No part of the material protected by this copyright notice may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording , or by any information storage and retrieval system (except for non-profit educational use), without the written permission of the copyright owner.
WebMAC Professional (v. 2.0)
Your Name _____________________________________________________________________________
Grade level/subject ______________________________________________________________________
Web Site URL __________________________________________________________________________
Directions: Place the appropriate number about this Web site on the line preceding each item.
3 = strongly agree
2 = somewhat agree
1 = somewhat disagree
0 = strongly disagree
NA = Not Applicable
___ 1. The screen layout of this Web site is attractive.
___ 2. There is a menu or site map at the beginning that describes what content is contained within the Web site.
___ 3. Visual (e.g. videos, photographs) or audio information included in this Web site helps to clarify or describe the topic.
___ 4. Navigating this Web site does not require any special skills or experience by me or my students.
___ 5. There is an eye-catching title and/or visual on the home page of this Web site that will attract students' attention.
___ 6. This Web site provides valuable links to other useful Web sites.
___ 7. The purpose of this Web site is always clear to me.
___ 8. The Web site has a help function that I or my students can use at any time.
___ 9. This Web site provides opportunities for interactivity.
___ 10. The Web site's information is provided by credible sources.
___ 11. The directions for using this Web site are simple and clear.
___ 12. This Web site makes it easy to search or query for information.
___ 13. The information on my topic included in this Web site is interesting.
___ 14. The information contained in this Web site is current and up-to-date.
___ 15. There is useful information on my topic at this Web site.
___ 16. This Web site's graphics are crisp and clearly visible.
___ 17. The variety of formats (e.g. text, images, sound) helps to maintain attention.
___ 18. The information at this Web site is accurate and unbiased.
___ 19. All of the information at this Web site is presented using clear and consistent language and style.
___ 20. All of this Web site's hyperlinks are active and fully functioning.
WebMAC Professional (v. 2.0) page 2
Name_______________________________ URL _____________________________
3 = strongly agree
2 = somewhat agree
1 = somewhat disagree
0 = strongly disagree
NA = Not Applicable
___ 21. This Web site has novel or unique features that make it more interesting for students.
___ 22. There is little or no unimportant or redundant information at this Web site.
___ 23. The text at this Web site is well-written without grammatical, spelling, or other errors.
___ 24. At all times, I can control what information at this Web site I wish to see or show my students.
___ 25. This Web site stimulates curiosity and exploration.
___ 26. This Web site provides opportunities for users to actively participate or contribute ideas.
___ 27. This Web site provides the appropriate amount of information on the topic for a lesson or assignment.
___ 28. All buttons and other navigation mechanisms for moving around at this Web site work the way they should.
___ 29. The colors and/or background patterns used in this Web site are pleasing.
___ 30. This Web site provides opportunities to communicate with its authors.
___ 31. No matter where I am in this Web site, I can return to the home page.
___ 32. The amount of time it takes for pictures, games, videos, etc. to appear on the screen at this Web site is reasonable for teaching/learning situations.
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __ _ _ _ _ _ _ _ _ _ _ _ _
| | | | | | | | | | | | | | | | | | | | | | |
0
48
0
48
32
16
16
32
24
40
40
8
8
Average to high for value/Below average to
low for expectation for success
Below average to low for value/Below
average to low for expectation for success
High Expectation for Success
Low Expectation for Success
Low ValueHigh Value
There is enough at this Web site to warrant a return visit.
YES
NO
I would recommend this Web site to my colleagues. YES NO
What is the greatest strength of this Web site?_______________________________
____________________________________________________________________
____________________________________________________________________
What needs improvement at this Web site? ___________________________________
____________________________________________________________________
____________________________________________________________________
____________________________________________________________________
Scoring WebMAC Professional (v. 2.0)
Before transferring scores, go back to each item designated as "NA" and choose a score for that item based on the following criteria:
· 0 points if you feel that the site would have benefited if it had included the item (e.g. audio).
· 1 point if you feel that the Web site didn't require that item.
· 2 points if you believe the site was better off for not including that item.
When all 32 items have a number score, transfer each score into the appropriately numbered space in one of the four columns below. Then add the scores for each column and write the total on the appropriate line.
S M O E
1. ___ 2. ___ 3. ___ 4. ___
5. ___ 6. ___ 7. ___ 8. ___
9. ___ 10. ___ 11. ___ 12. ___
13. ___ 14. ___ 15. ___ 16. ___
17. ___ 18. ___ 19. ___ 20. ___
21. ___ 22. ___ 23. ___ 24. ___
25. ___ 26. ___ 27. ___ 28. ___
29. ___ 30. ___ 31. ___ 32. ___
TOTAL S ___ TOTAL M ___ TOTAL O ___ TOTAL E ___
The S column reflects how STIMULATING this Web site is for you.
The M column reflects how MEANINGFUL this Web site is to you.
The O column reflects how ORGANIZED you think this Web site is.
The E column reflects how EASY-TO-USE this Web site is for you.
Transforming Scores
Now you may transform your scores into visual representations so that you can
clearly see the results of your evaluation.
1. Take each of the four total scores above and plot them (either with a dot or a bar) on the graph below.
2. If you use dots, connect the dots to make a line.
Now take the total scores from the four categories (S, M, O, E) and add them together in the following way to get your two overall motivational quality scores.
S + M = ______ (V) O + E = ______ (XS)
The V score reflects a summary motivation score on the Value dimension; i.e. how stimulating and meaningful the Web site is. The XS score reflects a summary motivation score on the Expectation for Success dimension; i.e. how organized and easy-to-use the Web site is.
Plotting the Scores
To plot scores on the scoring grid,
1. Place a dot for the V score along the Value continuum and a dot for the XS score along the Expectation for Success continuum on the grid.
2. Draw straight lines to their intersection point, representing the overall motivational quality score of the Web site
In the example below the evaluated Web site received a Value score of 40 and an Expectation for Success score of 18. Their intersection point falls within the lower right quadrant of the grid. Now go to the next page to record your scores.
Example Completed Scoring Grid
To record your actual scores onto the scoring grid.
1. Plot the score for V along the Value continuum and the score for XS along the Expectation for Success continuum.
2. Draw straight lines to the intersection point.
NEEDS SOME IMPROVEMENT
NEEDS MUCH IMPROVEMENT
0
8
16
2
24
30
E
O
40V;18XS
X
High Value
Low Value
Low Expectation for Success
High Expectation for Success
| | | | | | | | | | | | | | | | | | | | | | |
0
48
0
48
32
16
16
32
Average to high for value/Average to high for expectation for success
24
40
40
8
8
Average to high for value/Below average to low for expectation for success
Below average to low for value/Below average to low for expectation for success
Awesome
Website!
High Expectation for Success
Low Expectation for Success
Low Value
High Value
Average to high for expectation for success/Below average to low for value
M
S
HIGHLY MOTIVATING
1