Final Project

Final project

I wanted everyone to grapple a little with the usability test plan and the dimensions of your own studies in order to encourage you to think through the process and not rely too heavily on the usability.gov report template. A template tells you what to put where. A template does not do the thought work for you. 

On this page you will find a template used by the US government for usability reports. The title page specifies that the report is used for testing webpages, but in fact, the report format is standard: title page, table of contents, introduction, executive summary, methodology, results, recommendations, conclusions, and appended materials. Words in red font tell you what to do, and words in blue font provide examples. The black font is the report. The differences between the blue and black font can at times be confusing, but that does not diminish from the functionality of the template.

 

Note: Your report will likely include a Works Cited page. Appendix A will be your evaluation test plan and Appendix B will be your testing materials. You may have additional appendices. Materials that you revised will likely be placed in Appendix C.

 

Parts of a formal report

Title page

Table of contents

Introduction Executive summary Methodology Results Recommendations Conclusions

Works cited

Appendix A

Appendix B

Additional appendices 

You will need to read through the template a few times to get a feel for it. The different sections of the template have subsections that may or may not be relevant to your individual study. Follow your usability test plan, and use the template accordingly. Also, the example provided in the template is much more robust than your own individual studies, so do not let the size intimidate you. (And I do not think I need to mention this, but please do not write your report in red or blue ink.)

 

Task

Select a web or print document that you will test for usability. A good size is around 2400-3000 words, but this can vary depending on your plan. You can select a website, a procedural document, an annual report, or 2-3 internal documents as long as they collectively have some substance. Identify your target users and select an appropriate type of testing for the assignment (one text-based and one user-based method).

 

Usability Test: Research Procedures

Fill out your usability test plan and create testing materials (checklists, surveys for participants, and/or other research materials). See the attached form below. Select one text-based method (for example, a readability test) and one user-based method (for example, a survey or protocol analysis). Recruit 3-5 people for a user-based test. Please use Blackboard Messages to seek assistance from your classmates if finding participants poses a problem. Collect your data.

 

Additional Information for Text-based Testing

· Readability tests:

http://office.microsoft.com/en-us/word-help/test-your-document-s-readability-HP010148506.aspx

· Free Readability Testing Programs:

http://www.readabilityformulas.com/free-readability-formula-tests.php

http://www.online-utility.org/english/readability_test_and_improve.jsp

 

Additional Information for User-based Testing

Make sure that you read all assigned readings that discuss usability testing. Visit  http://www.w3.org/WAI/EO/Drafts/UCD/questions.html   that offers sample questions for user-based testing.

NOTE: If you need to quote any outside sources, please provide a formal list of works cited in MLA or APA. Visit  http://owl.english.purdue.edu/  if you do not know how to create citations. Citing your sources is important to avoid plagiarism.

Usability Report

Write a usability report discussing the following:

a. the document that you have selected

b. the purpose of the test and your target audiences

c. your research methods (goals, key questions/testing scenarios, constraints, and types of usability testing and their appropriateness)

d. your main findings

e. conclusions and recommendations for improvement

 

The US government usability report template came from here:  https://www.usability.gov/how-to-and-tools/resources/templates/report-template-usability-test.html . There are other resources here as well. In fact, this is quite the usability study resource rabbit hole. There are as well numerous examples of reports in the technical communication textbook linked under Course Learning Resources.

You will need to read through the template a few times to get a feel for it. The different sections of the template have subsections that may or may not be relevant to your individual study. Follow your usability test plan, and use the template accordingly. Also, the example provided in the template is much more robust than your own individual studies, so do not let the size intimidate you. (And I do not think I need to mention this, but please do not write your report in red or blue ink.)

Appendix A: Usability Test Plan

Fill out this table and finalize the procedures for your usability test. Ch. 9 in Burnett can help you fill out various parts of the plan. .

See attached

Testing Goals

Test Type	Sub-types of Tests: (See pp. 314, 315, 316, 318.)	Goals (What do you want to find out?)
Text-based	(Readability tests, design review, or editorial review?)
User-based	(Retrospective or concurrent? Beta test or user feedback?)

 

Participants

Test Type	Researchers/Participants and Their Characteristics (Who will perform or participate in each type of testing? How many participants?)
Text-based	(Describe your own characteristics as a researcher: level of education, experience, age, gender, and any other relevant characteristics.)
User-based	(Describe your participants’ level of education, experience, age, gender, and any other relevant characteristics.)

 

Methods

Key Features and Elements for Testing

Test Type	Specific Features and Elements for Testing (What will you focus on?)
Text-based	(Diction, sentence length, paragraph length, design features, etc.?)
User-based	(Organization, navigation, completeness, etc.?)

 

Key Questions and Testing Scenarios

Test Type	Questions/Scenarios
Text-based	(Which tool (a checklist or a formula) will you use and what will it do?)
User-based	(What will you ask your participants to do?)

 

Testing Materials Needed

Test Type	Specific Testing Methods (Highlight one per test type.)	Testing Materials (Highlight one per test type.)
Text-based	□   Using a checklist □   Using readability tests; explain which one: □   Using a computer program to assess structural and stylistic features; explain which one:	□   Guidelines or checklists for verbal information □   Guidelines or checklists for visual information □   Readability formulas and calculators
User-based	□   Using the focus group method □   Using the protocol analysis method □   Using a survey of users	□   A handout with a list of questions for discussion (purpose of testing, overall procedures, time needed, consent, numbered tasks/questions) □   A handout with the description of a specific task for a user (purpose of testing, overall procedures, time needed, consent, numbered tasks/questions) □   A survey of users (purpose of testing, overall procedures, time needed, consent, numbered tasks/questions): · Multiple choice · Likert scale · Ranking · Semantic differentials · Other:_______________