Reporting the Results of a Website Evaluation

profilejlel
WebMACProfessional011.doc

Website Motivational Analysis Checklist (WebMAC) Professional( (v. 2.0)

DIRECTIONS:

WebMAC Professional was designed for professional educators to assess Web sites for use in classroom instruction or for student use in homework assignments or projects. Before using WebMAC Professional, it's a good idea to spend some time exploring the Web site to be evaluated in order to have some familiarity with its content and structure. You may need to go through the Web site at least once more to complete this checklist.

Rate your level of agreement with each of the 32 items on the next two pages by placing the appropriate number value on the line in front of each item. If you are not sure about any item, select the best response you can give.

3 = strongly agree

2 = somewhat agree

1 = somewhat disagree

0 = strongly disagree

NA = Not Applicable

Example of completed item:

3 0. This Web site makes me happy.

After you have rated all 32 items, go back and look at each NA item. You should place one of the following scores next to the NA for that item.

0 = the Web site would have benefited if it had included the item (e.g. audio).

1 = the Web site didn't require that item.

2 = the Web site was better off for not including that item.

Copyright ( 1999 (revised 2004) by Ruth V. Small & Marilyn P. Arnone, Syracuse, New York. All rights reserved. No part of the material protected by this copyright notice may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording , or by any information storage and retrieval system (except for non-profit educational use), without the written permission of the copyright owner.

WebMAC Professional (v. 2.0)

Your Name _____________________________________________________________________________

Grade level/subject ______________________________________________________________________

Web Site URL __________________________________________________________________________

Directions: Place the appropriate number about this Web site on the line preceding each item.

3 = strongly agree

2 = somewhat agree

1 = somewhat disagree

0 = strongly disagree

NA = Not Applicable

___ 1. The screen layout of this Web site is attractive.

___ 2. There is a menu or site map at the beginning that describes what content is contained within the Web site.

___ 3. Visual (e.g. videos, photographs) or audio information included in this Web site helps to clarify or describe the topic.

___ 4. Navigating this Web site does not require any special skills or experience by me or my students.

___ 5. There is an eye-catching title and/or visual on the home page of this Web site that will attract students' attention.

___ 6. This Web site provides valuable links to other useful Web sites.

___ 7. The purpose of this Web site is always clear to me.

___ 8. The Web site has a help function that I or my students can use at any time.

___ 9. This Web site provides opportunities for interactivity.

___ 10. The Web site's information is provided by credible sources.

___ 11. The directions for using this Web site are simple and clear.

___ 12. This Web site makes it easy to search or query for information.

___ 13. The information on my topic included in this Web site is interesting.

___ 14. The information contained in this Web site is current and up-to-date.

___ 15. There is useful information on my topic at this Web site.

___ 16. This Web site's graphics are crisp and clearly visible.

___ 17. The variety of formats (e.g. text, images, sound) helps to maintain attention.

___ 18. The information at this Web site is accurate and unbiased.

___ 19. All of the information at this Web site is presented using clear and consistent language and style.

___ 20. All of this Web site's hyperlinks are active and fully functioning.

WebMAC Professional (v. 2.0) page 2

Name_______________________________ URL _____________________________

3 = strongly agree

2 = somewhat agree

1 = somewhat disagree

0 = strongly disagree

NA = Not Applicable

___ 21. This Web site has novel or unique features that make it more interesting for students.

___ 22. There is little or no unimportant or redundant information at this Web site.

___ 23. The text at this Web site is well-written without grammatical, spelling, or other errors.

___ 24. At all times, I can control what information at this Web site I wish to see or show my students.

___ 25. This Web site stimulates curiosity and exploration.

___ 26. This Web site provides opportunities for users to actively participate or contribute ideas.

___ 27. This Web site provides the appropriate amount of information on the topic for a lesson or assignment.

___ 28. All buttons and other navigation mechanisms for moving around at this Web site work the way they should.

___ 29. The colors and/or background patterns used in this Web site are pleasing.

___ 30. This Web site provides opportunities to communicate with its authors.

___ 31. No matter where I am in this Web site, I can return to the home page.

___ 32. The amount of time it takes for pictures, games, videos, etc. to appear on the screen at this Web site is reasonable for teaching/learning situations.

_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __ _ _ _ _ _ _ _ _ _ _ _ _

image1.emf image2.emf

| | | | | | | | | | | | | | | | | | | | | | |

0

48

0

48

32

16

16

32

24

40

40

8

8

Average to high for value/Below average to

low for expectation for success

Below average to low for value/Below

average to low for expectation for success

High Expectation for Success

Low Expectation for Success

Low ValueHigh Value

image3.emfThere is enough at this Web site to warrant a return visit. YES NO

I would recommend this Web site to my colleagues. YES NO

What is the greatest strength of this Web site?_______________________________

____________________________________________________________________

____________________________________________________________________

What needs improvement at this Web site? ___________________________________

____________________________________________________________________

____________________________________________________________________

____________________________________________________________________

Scoring WebMAC Professional (v. 2.0)

Before transferring scores, go back to each item designated as "NA" and choose a score for that item based on the following criteria:

· 0 points if you feel that the site would have benefited if it had included the item (e.g. audio).

· 1 point if you feel that the Web site didn't require that item.

· 2 points if you believe the site was better off for not including that item.

When all 32 items have a number score, transfer each score into the appropriately numbered space in one of the four columns below. Then add the scores for each column and write the total on the appropriate line.

S M O E

1. ___ 2. ___ 3. ___ 4. ___

5. ___ 6. ___ 7. ___ 8. ___

9. ___ 10. ___ 11. ___ 12. ___

13. ___ 14. ___ 15. ___ 16. ___

17. ___ 18. ___ 19. ___ 20. ___

21. ___ 22. ___ 23. ___ 24. ___

25. ___ 26. ___ 27. ___ 28. ___

29. ___ 30. ___ 31. ___ 32. ___

TOTAL S ___ TOTAL M ___ TOTAL O ___ TOTAL E ___

The S column reflects how STIMULATING this Web site is for you.

The M column reflects how MEANINGFUL this Web site is to you.

The O column reflects how ORGANIZED you think this Web site is.

The E column reflects how EASY-TO-USE this Web site is for you.

Transforming Scores

Now you may transform your scores into visual representations so that you can

clearly see the results of your evaluation.

1. Take each of the four total scores above and plot them (either with a dot or a bar) on the graph below.

2. If you use dots, connect the dots to make a line.

Now take the total scores from the four categories (S, M, O, E) and add them together in the following way to get your two overall motivational quality scores.

S + M = ______ (V) O + E = ______ (XS)

The V score reflects a summary motivation score on the Value dimension; i.e. how stimulating and meaningful the Web site is. The XS score reflects a summary motivation score on the Expectation for Success dimension; i.e. how organized and easy-to-use the Web site is.

Plotting the Scores

To plot scores on the scoring grid,

1. Place a dot for the V score along the Value continuum and a dot for the XS score along the Expectation for Success continuum on the grid.

2. Draw straight lines to their intersection point, representing the overall motivational quality score of the Web site

In the example below the evaluated Web site received a Value score of 40 and an Expectation for Success score of 18. Their intersection point falls within the lower right quadrant of the grid. Now go to the next page to record your scores.

Example Completed Scoring Grid

To record your actual scores onto the scoring grid.

1. Plot the score for V along the Value continuum and the score for XS along the Expectation for Success continuum.

2. Draw straight lines to the intersection point.

NEEDS SOME IMPROVEMENT

NEEDS MUCH IMPROVEMENT

0

8

16

2

24

30

E

O

40V;18XS

X

High Value

Low Value

Low Expectation for Success

High Expectation for Success

| | | | | | | | | | | | | | | | | | | | | | |

0

48

0

48

32

16

16

32

Average to high for value/Average to high for expectation for success

24

40

40

8

8

Average to high for value/Below average to low for expectation for success

Below average to low for value/Below average to low for expectation for success

Awesome

Website!

High Expectation for Success

Low Expectation for Success

Low Value

High Value

Average to high for expectation for success/Below average to low for value

M

S

HIGHLY MOTIVATING

1