Evaluating Websites.

LOCATING & EVALUATING DATA

The following are examples of secondary sources:

· Scholarly journal articles

· Trade journal articles

· Popular Magazine articles

· Literary and scientific reviews

· Television documentaries

When you search for periodicals, be sure to distinguish among different types. Mass-market publications, such as newspapers and popular magazines, differ from scholarly publications in their accessibility, audience, and purpose.

Newspapers and magazines are written for a broader audience than scholarly journals. Their content is usually quite accessible and easy to read. Trade magazines that target readers within a particular industry may presume the reader has background knowledge, but these publications are still reader-friendly for a broader audience. Their purpose is to inform and, often, to entertain or persuade readers as well.

Scholarly or academic journals are written for a much smaller and more expert audience. The creators of these publications assume that most of their readers are already familiar with the main topic of the journal. The target audience is also highly educated. Informing is the primary purpose of a scholarly journal. While a journal article may advance an agenda or advocate a position, the content will still be presented in an objective style and formal tone. Entertaining readers with breezy comments and splashy graphics is not a priority.

Because of these differences, scholarly journals are more challenging to read. That doesn’t mean you should avoid them. On the contrary, they can provide in-depth information unavailable elsewhere. Because knowledgeable professionals carefully review the content before publication, scholarly journals are far more reliable than much of the information available in popular media. Seek out academic journals along with other resources. Just be prepared to spend a little more time processing the information.

You will use your research question or thesis statement to develop keywords to find sources efficiently. One way to refine your keyword search is to use Boolean operators. These operators allow you to combine keywords, find variations on a word, and otherwise expand or limit your results. Here are some of the ways you can use Boolean operators:

· For database searches for example, Proquest or Ebscohost, combine keywords with the word “and” or + (plus sign) to limit results to citations that include both keywords—for example, diet + nutrition.

· For database searches or Internet search engines (Google) combine keywords with the word “not” or – (minus sign) to search for the first word without the second. This keyword method can help you eliminate irrelevant results based on words that are similar to your search term. For example, searching for obesity not childhood locates materials on obesity but excludes materials on childhood obesity.

· For Internet search engines (Google) enclose a phrase in quotation marks to search for an exact phrase, such as “morbid obesity.”

· Use parentheses to direct the order of operations in a search string. For example, since Type II diabetes is also known as adult-onset diabetes, you could search (Type II or adult-onset) and diabetes to limit your search results to articles on this form of the disease.

· For databases use a wildcard symbol such as #, ?, or $ after a word to search for variations on a term. For instance, you might type diabet# to search for information on diabetes and diabetics. The specific symbol used varies with different databases.

When faced with the challenge of writing a research paper, some students rely on popular search engines as their first source of information. Typing a keyword or phrase into a search engine instantly pulls up links to dozens, hundreds, or even thousands of related websites—what could be easier? Unfortunately, despite its apparent convenience, this research strategy has the following drawbacks to consider:

· Results do not always appear in order of reliability. The first few hits that appear in search results may include sites whose content is not always reliable, such as online encyclopedias that can be edited by any user. Because websites are created by third parties, the search engine cannot tell you which sites have accurate information.

· Results may be too numerous for you to use. The amount of information available on the web is far greater than the amount of information housed within a particular library or database. Realistically, if your web search pulls up thousands of hits, you will not be able to visit every site—and the most useful sites may be buried deep within your search results.

· Search engines are not connected to the results of the search. Search engines find websites that people visit often and list the results in order of popularity. The search engine, then, is not connected to any of the results. When you cite a source found through a search engine, you do not need to cite the search engine. Only cite the source.

A general web search can provide a helpful overview of a topic and may pull up genuinely useful resources. To get the most out of a search engine, however, use strategies to make your search more efficient. Use multiple keywords and Boolean operators to limit your results. Click on the Advanced Search link on the homepage to find additional options for streamlining your search. Depending on the specific search engine you use, the following options may be available:

· Limit results to websites that have been updated within a particular time frame.

· Limit results by language or country.

· Limit results to scholarly works available online.

· Limit results by file type.

· Limit results to a particular domain type, such as .edu (school and university sites) or .gov (government sites). This is a quick way to filter out commercial sites, which can often lead to more objective results.

Use the Bookmarks or Favorites feature of your web browser to save and organize sites that look promising.

Evaluating Sources

To evaluate your research sources, you will use critical thinking skills consciously and deliberately. You will consider criteria such as the type of source, its intended purpose and audience, the author’s (or authors’) qualifications, the publication’s reputation, any indications of bias or hidden agendas, how current the source is, and the overall quality of the writing, thinking, and design.

The different types of sources you will consult are written for distinct purposes and with different audiences in mind. This accounts for other differences, such as the following:

· How thoroughly the writers cover a given topic

· How carefully the writers research and document facts

· How editors review the work

· What biases or agendas affect the content

A journal article written for an academic audience for the purpose of expanding scholarship in a given field will take an approach quite different from a magazine feature written to inform a general audience. Textbooks, hard news articles, and websites approach a subject from different angles as well. To some extent, the type of source provides clues about its overall depth and reliability.

High-Quality Sources
These sources provide the most in-depth information. They are researched and written by subject matter experts and are carefully reviewed.	· Scholarly books and articles in scholarly journals · Trade books and magazines geared toward an educated general audience, such as Smithsonian Magazine or Nature · Government documents, such as books, reports, and web pages · Documents posted online by reputable organizations, such as universities and research institutes · Textbooks and reference books, which are usually reliable but may not cover a topic in great depth
Varied-Quality Sources
These sources are often useful. However, they do not cover subjects in as much depth as high-quality sources, and they are not always rigorously researched and reviewed. Some, such as popular magazine articles or company brochures, may be written to market a product or a cause. Use them with caution.	· News stories and feature articles (print or online) from reputable newspapers, magazines, or organizations, such as Newsweek or the Public Broadcasting Service · Popular magazine articles, which may or may not be carefully researched and fact checked · Documents published by businesses and nonprofit organizations
Questionable Sources
These sources should be avoided. They are often written primarily to attract a large readership or present the author’s opinions and are not subject to careful review.	· Loosely regulated or unregulated media content, such as Internet discussion boards, blogs, free online encyclopedias, talk radio shows, television news shows with obvious political biases, personal websites, and chat rooms

Wikipedia may seem like a great source of information. It usually appears among the first few results of an Internet search. Wikipedia covers thousands of topics, and many articles use an informal, straightforward writing style. Unfortunately, these sites have no control system for researching, writing, and reviewing articles. Instead, they rely on a community of users to police themselves. At best, these sites can be a starting point for finding other, more trustworthy sources. Never use them as final sources.

Credibility & Reputability

Even when you are using a type of source that is generally reliable, you will still need to evaluate the author’s credibility and the publication itself on an individual basis. To examine the author’s credibility—that is, how much you can believe of what the author has to say—examine his or her credentials. What career experience or academic study shows that the author has the expertise to write about this topic? You can also conduct a Google search for the author to see what other material he/she has written and where it has been published.

Just as important as the author’s credibility is the publication’s overall reputability. Reputability refers to a source’s standing and reputation as a respectable, reliable source of information. An established and well-known newspaper, such as the New York Times or the Wall Street Journal, is more reputable than a college newspaper put out by comparatively inexperienced students. A website that is maintained by a well-known, respected organization and regularly updated is more reputable than one created by an unknown author or group.

If you are using articles from scholarly journals, you can check databases that keep count of how many times each article has been cited in other articles. This can be a rough indication of the article’s quality or, at the very least, of its influence and reputation among other scholars.

Bias & Agendas

Whenever you consult a source, always think carefully about the author’s or authors’ purpose in presenting the information. Few sources present facts completely objectively. In some cases, the source’s content and tone are significantly influenced by biases or hidden agendas.

Bias refers to favoritism or prejudice toward a particular person, group, or idea. For instance, an author may be biased against a certain political party and present information in a way that subtly—or not so subtly—makes that organization look bad. Bias can lead an author to present facts selectively, edit quotations to misrepresent someone’s words, and distort information.

Hidden agendas are goals that are not immediately obvious but influence how an author presents the facts. For instance, an article about the role of beef in a healthy diet would be questionable if it were written by a representative of the beef industry—or by the president of an animal-rights organization. In both cases, the author would likely have a hidden agenda.

Currency

Be sure to seek out sources that are current, or up to date. Depending on the topic, sources may become outdated relatively soon after publication, or they may remain useful for years. For instance, online social networking sites have evolved rapidly over the past few years. An article published in 2002 about this topic will not provide current information. On the other hand, a research paper on elementary education practices might refer to studies published decades ago by influential child psychologists.

When using websites for research, check to see when the site was last updated. Many sites publish this information on the homepage, and some, such as news sites, are updated daily or weekly. Many nonfunctioning links are a sign that a website is not regularly updated. Do not be afraid to ask your professor for suggestions if you find that many of your most relevant sources are not especially reliable—or that the most reliable sources are not relevant.