homework history16

profileyasmine
Segment1-HistoryMethodology1.ppt

Social Science Methodology
(History, Political Science, Sociology, Economics and other Social Sciences)

US History 16

Segment 1

Social Science Methodology
Some Important Definitions

Methodology-

The science of method. How you will approach and design your research. Set of techniques, concepts, and approaches whose objective is to increase the clarity and accuracy of understanding phenomenon. One example is the “scientific method”. Another is the “historical method”

Facts -

Assumptions -

Theory -

Proof or Prove -

Hypothesis -

Area of Study -

Scope of Study -

• History • Micropolitics • Macropolitics • Political Economics • International Relations • Economics

• Politics and Gov’t • Culture • Influence of Religion • Economic Factors

An indisputable, or generally accepted truth . FACTS ARE “ ______ ________”

Accept as being true, without proof

A supposition made as a starting point. A proposition made as a basis for reasoning. EXAMPLE?

A developed system of ideas, explaining something

To establish the validity of a hypothesis, through some testing process

History-

The study of past events, usually through written records/accounts (and more recently by electronic means)

3

Conjecture -

Formation of an opinion based on incomplete information, but argued as if a fact. Also known as “argument by assertion”.

History Methodology
Facts, Assumptions, and Designing Testing Methods

Facts -

Assumptions -

An indisputable, or generally accepted truth

Accept as being true, without proof

Scientific (Social Science) Method:

1) Make Observations

2) Form Hypothesis

4) Refine Hypothesis (if needed)

3) Test Hypothesis against known facts

5) Develop Theory

6) Continually Test Theory Against Facts, Refine as Needed

1) Facts about Object?

2) Assumptions about Object?

3) Designing a method

Assertion -

Statement made as fact/truth with no supporting evidence

4

History Methodology

Which of these tend to be “Facts”

Types of Questions which Interest Social Scientists (Including Historians?

Who, What, Where, When, Why, How, So What?

Who, What, Where, When, How

1) Where did the murders take place?

What: Murder of 500,000 Rwandans (Mostly Tutsi’s at the hands of Hutu’s)

Why?

Now this is harder. It’s more than facts, but the interpretation of facts, and on that not everyone agrees (economics, levels of poverty, education levels, tribalism, power struggle, evil leadership, cultural factors, type of government, role of military)

Examples of Questions (The Easy)

2) Who committed the murders?

3) How did the murders take place?

How: Mostly with machetes

Who: Government/Military Leaders, henchmen

Where: Rwanda and Burundi – East Central Africa

When: 1994

5

4) Who was arrested? Who was tried? Were they charged with murder or with crimes against humanity? Who was convicted? What were the sentences given?

History Methodology
Why are some Questions hard to answer?

The Hard

1) Franklin Roosevelt passes Social Security in the 1930s

2) Why did the Japanese bomb Pearl Harbor?

3) What caused the U.S. Civil War?

1) Sources don’t reveal (or lie about) the real reasons for actions

2) Sources sometimes speak in couched, nuanced, and diplomatic language

a) National Security Concerns

b) Could prove politically embarrassing or costly

3) History is a complex mix of culture, economics, influence, personality,

political systems, morality, beliefs, interest groups, etc.

4) People don’t always agree on definitions: Democracy, Socialism, Republic,

Capitalism, Freedom, Morality, Decency, Pornography, Imperialism, Safety,

Dangerous, Risky

5) Subjects are a moving target: change with culture, times, society, trends

c) Would rather have political cover, if possible

6

Social Science Research – Limitations and Problems (Overview of Criticisms)

SUMMARY: Many have branded social science as a “phony science” or a “soft science”. They point out what I think are some legitimate criticisms of the trade. We will review these criticisms one-by-one in the following slides. You will find that the limitations typically come down to human factors and poor procedures. When these issues are remediated, we’re still short of a “hard science”, but what we have is something useful and valuable.

7

Problem #1 – Researcher Bias

IT ORIGINATES WHEN THE RESEARCHER:

  • Has a political agenda, a world view, pre-conceived notions, certain normative values, or narrow experiences
  • Has a personal, professional, or monetary stake in a particular outcome….(i.e. a conflict of interest)
  • Has an ego, or desperately wants results to fit hypothesis
  • Is simply not willing to accept certain results

RESULTS AFFECTED WHEN THE RESEARCHER:

  • “Cherry Picks” data (either consciously or otherwise)
  • Filters data through their own “view” of the world
  • Designs an experiment (like a poll) to get desired results
  • Uses hyperbole or shows over the top results to make point

JUST SOME EXAMPLES OF HOW THIS CAN OCCUR:

  • A Marxist and a Libertarian both look at the same economic data
  • A Global Warming advocate researches C02 and Ice Sheet Data
  • A Labor Union studies the impact of stimulus spending on GDP
  • Business wants to show shareholders the value of a proposed merger
  • Victim’s Rights group and a Police Dept. researches crime statistics

8

Problem #2 – Diverse Or Bad Data Set

SUMMARY: When the researcher uses too small or too narrow a set of data for the results. This can happen either:

  • Innocuously because of sloppy procedures or a poorly designed experiment.
  • Maliciously by means of researcher bias through cherry picking data.

EITHER WAY, THE RESULTS ARE SKEWED

AND THE STUDY FLAWED

JUST SOME EXAMPLES OF HOW THIS CAN OCCUR:

  • A public opinion poll on taxes but 85% of the respondents are Republicans
  • A global warming study claiming decades of data, but only using 1968, 76, 89, and 91
  • A study on education that only looks at inner-city school results, or private school results
  • A poll on Social Security that only asks responders over 65 years of age
  • Economics study that focuses on manufacturing, but only in 2003

Don’t Cherry Pick Your Data.

At Best It’s Sloppy. At worst, it’s Intellectually Dishonest.

9

Problem #3 – Logical Fallacies

SUMMARY: A fallacy is incorrect reasoning leading to a misconception. It can happen by accident, or by deliberate design. There are many types of logical fallacies. These are traps into which even good researchers sometimes fall. They are also the tools of the intellectually dishonest and manipulative

SOME OF THE MORE COMMON LOGICAL FALLACIES

10

FALLACY ARGUMENT PROBLEM
Sweeping Generalization Cutting people is a crime. Surgeons cut people Surgeons are criminals The exception does not break nor define the rule. a dicto simpliciter ad dictum secundum quid (where an accountable exception is ignored).
Appeal to Authority Climatologist ‘Bob’ says global warming is real, so it is Authority alone is not a fallacy, but claiming they are “all knowing” or are immune to criticism or other interpretation is.
Affirming the Consequent or Denying the antecedent If it rains, the ground gets wet. The ground is wet, so it rained There are other ways the ground could have gotten wet. Sprinklers anyone? Perhaps a garden hose?
Begging the Question Cindy always tells me the truth. I know since she told me. Cindy may be lying. The statement in and of itself isn’t proof
Fallacy of the loaded question Have you stopped beating your wife? Either a yes or no answer is an admission to doing this at some point
Argument by Innuendo Larry was never actually caught stealing the money The statement implies that Larry is guilty without offering proof
Fallacy of Composition All the players on the team are the best in the league, therefore, the team must be in first place While all team members may be the best at their position, they do not play well together as a team, so they are in last place
Proof by Verbosity Overwhelm the listener with a volume of material that sounds plausible and scientific Superficially appears well researched, and is laborious to untangle, so it is left unchallenged.
Argument by Assertion War is not the answer Uh….What is the question? War is NEVER the answer? Ever?
Figure of speech The cowboy was at home on the range “At Home” does not mean he lived there, only that he felt comfortable
Ad Hominem Tu Quoque I can’t defeat the argument, so personally attack the source. Politicians are called “dumb”, “extreme”, “racist”, and other names….but the core of their arguments are not addressed
Strawman PERSON A – Sunny Days are Great PERSON B – If all days were sunny, there would be no rain, and without rain, we’d have famine and death. Therefore, you’re wrong Misrepresent an opponent’s argument to defeat it easier. Person B has falsely framed A’s argument, and has attacked the misrepresented assertion rather than what Person A actually said
Cause ≠ Correlation -After 2 year old John was vaccinated, he developed autism -Rooster crowing before dawn caused the sun to come up No evidence here that vaccine was the cause. Autism may be noticeable at the age children receive vaccines, and there is no causality.

Problem #4 – Relativism and Normative Definitions

The Moral Continuum

In Your Opinion, Which woman is “properly” dressed?

ULTRA CONSERVATIVE

ULTRA LIBERAL

Burqa

The Problem is the relativism of some normative questions

WHAT IS YOUR DEFINITION OF THESE TERMS? Well, It’s Relative.

- Decency - Morality - (Im)Proper

- Freedom - Pornography - Oppression

- Democracy - Right/Wrong - Capitalism

- Social Good - Offensive

Niqab

Hijab

Covered Arms

Covered Legs

Short Skirt

Bikini

One piece

?

This is a 1920s era cartoon

What would the Victorian era woman think now?

  • Answers will span time. An 1820 vs 1920 vs. a 2020 answer
  • Answers span cultures: China vs South Africa vs Spain?
  • Answers depend on personal preferences and outlooks, world views
  • Questions often lack a degree of precision around definitions
  • Problems of scope and degree: Where do you draw the line?
  • Freedom “to” vs. Freedom “from”….the irreconcilable difference

11

THESE ARE QUESTIONS/ANSWERS IN WHICH WE HAVE CONFIDENCE:

- The Japanese attacked the United States on December 7th, 1941 because ________

1) Speed of Light in a Vacuum – 186,282 miles per second

2) Atomic Composition of Water – 2 Hydrogen Atoms + 1 Oxygen Atom

3) Photosynthesis

4) Energy = Mass x the Speed of Light squared (E=MC2)

• Economic Factors

• Domestic Politics (elections, interest groups, pork)

• International Politics

Problem #5 – Level of Certainty and Granularity

5) 1 +1 = 2

- Congress passed a piece of legislation because ________

- The President negotiated a free trade agreement with South Korea because _________

BUT ANSWERS TO THESE QUESTIONS ARE NOT “SCIENTIFCALLY PRECISE”:

• Social Factors – Religion, Culture, Philosophy, World Outlook

• Role of Power

• Role of Ego and Ambition

The Granularity Problem: What is the “right” level of detail to answer questions and do research?

Mountain

Hill

Boulder

Rock

Stone

Pebble

Sand

-Too Much Detail

-Too complex to be grasped

-Argument drowns in data

-Too High Level

-Oversimplified

-Lacks crucial evidence

NO MATTER WHERE YOUR ARGUMENT IS ON THIS CONTINUUM, SOME QUALITY/EFFECTIVENESS WILL BE SACRIFICED

12

Problem #6 – Can you trust your sources?

• Public or Private

• Opinion or Fact

• Do they have a bias, an agenda, or something to gain?

• What is their personality?

• Are they being descriptive or persuasive?

When was it written:

At time of event, or going from memory

Why was it written:

• Running for office or otherwise will benefit?

What is more credible: The words of a politician who knows this will be published and is crafting an image vs the private thoughts and musings of a diary

The Charleston (South Carolina) Mercury announcing Secession. A fair account? Doubtful.

The Federalist Papers arguing for ratification of the Constitution. Important, but the authors have a Point of View

List of Cotton Prices – 1822. Simple, unfiltered records are arguably a more trustworthy source of data

13

Document Type:

Diary, political speech, letter, public record, interview

Who is Author:

Politician, General, Sergeant, Bureaucrat, Average Person

What was the Author’s motivation?

• Was the author paid? Did they know it would be published?

• Correcting a tarnished reputation? Managing an image?

• Was Author simply doing job? – Government Record Keeper

Problem #7 – Statistics are misleading and can be deviously used

Mark Twain

There are Lies, Damn Lies, and Statistics

42.7% of people agree with Mark Twain on this statement

14

Technically True Statistic Why Misleading or not so simple What’s the agenda?
Between 2005 and 2007, Cancer death rates next to the nuclear power plant rose 300% The results sound dramatic, but are statistically insignificant. The rate went from 1/100K to 3/100K Anti-nuclear activists using data in an intellectually dishonest way to scare
Company earnings rose 2000% from last year Sounds like the company had a great year. But last year profits were $1. Now they’re $20. Nothing. Company owner trying to dress up or spin bad earnings
Oil Company profits were $35B in 2011 Oil company margin % is lower than many industries, including tech, banking, commodities, manufacturing “Evil” Oil + Insurance Co’s frequent targets for demagogue politicians
2008 was the hottest year on record Other recent years cooler. Global Warming backers cherry pick data
Patients who used our drug had a 60% reduction in the incidence of heart attack The drug also destroys the liver. Over 10 years, 80% of patients suffer liver failure Trying to get FDA approval of drug
America has the highest cost of health insurance in the world, and not any better results There are complicated reasons for that. Just 3: 1) America has a high obesity, sugar consumption, and diabetes rate. Low exercise 2) We are a litigious society, and doctors perform defensive medicine (running costly tests) 3) Medical breakthroughs /innovation happen here Oversimplifying the health care debate by making it sound like the insurance companies are just out for profits


Misapplying Facts:

Conclusions don’t necessarily

follow facts

FACT: Cotton is the largest U.S. agricultural export

FACT: Cotton is most profitable crop

FACT: Cotton is the single largest crop

CONCLUSION: Greater than 50% of available crop acreage in 1860 was planted with Cotton

FACT: Cotton had more acreage than any other crop

Problem #8 – Misapplying Facts

Problem #9 – How you ask the question

15

Issue Question Sample 1 Sample 2 – Which will yield different results
Smoking Do people have the right to smoke? Given cancer/death rates, should people have the right to smoke?
Global Warming Is Global Warming a priority? With economic issues and world famine, is global warming a priority?
Gun Control Should people own guns? The 2nd amendment guarantees the right to own arms. Repeal it?
Health Care Should the government provide health care? Government = You. Prepared to pay higher taxes to provide healthcare?
Social Security Do you support cuts to Social Security? To keep Social Security solvent, will you pay 20% more each check?


Problem #10 – My Pet Peeve – Conspiracy Theories

Why Conspiracy Theories Don’t Stand Up

  • Think Critically – Use your common sense, and you’ll know they are filled with fallacies and don’t hold up to scrutiny
  • Somebody would have talked– For conspiracies to work, they require absolute silence and obedience from participants. People talk, so this isn’t credible. It would eventually come out.
  • Government Incompetence – Governments can’t run a post office or a DMV….but they can execute and maintain an elaborate conspiracy? No.
  • Cherry Picked Facts – Conspiracy theorists do three things with facts:
  • Use some facts and ignore others
  • Use facts out of their proper context
  • Weave the few facts they have loosely into a fairy tale that sounds credible and plausible but doesn’t hold up to scrutiny

Why Conspiracy Theories Thrive?

  • Nobody Checks the Facts – The conspiracy theorist sounds so plausible…it must be true….right? Wrong. Think critically.
  • Belief in the “Oz behind the Curtain”– People have a belief that things can’t just happen, someone must be pulling levers.
  • Agendas – Like the creator of the conspiracy theory, the believers often share a dark political agenda involving that theory

16

The Top Conspiracy Theories
Kennedy Assassination: The CIA killed John F. Kennedy. They put a 2nd gunman on the grassy knoll
9/11 “Truthers”: 9/11 was an inside job (again by the CIA). They planted explosives in the buildings to ensure they fell down
Obama “Birthers”: Barack Obama was not born in the United States, it’s a giant cover up
Moon Landings – The moon landings were frauds done in a Hollywood movie studio
Pearl Harbor – Roosevelt let the attack happen so he could take America to war against Nazi Germany
Jewish domination of financial markets – The Jews own all of the money, banks, and control the Global Economy
Lady Diana – Murdered by the British Royal Family because she had become too much of an embarrassment
Any Number of Bogus “Stories” floating around the Internet – Checking snopes.com, and they’re almost always false


Other Problems with Research

Ockham’s Razor teaches us to begin with the simplest explanation, and only build from there when we have “proof”

Some arguments have “slippery slopes”. Start arguing for one thing, then other things must also be allowed…things you may not have intended

BEWARE THE LAW OF UNINTENDED CONSEQUENCES

17

Other Research Problems How does it materialize?
Use of hyperbole Dramatic, exaggerated phrases. Use of words like “very”, “extreme”, “unprecedented” to try and convince
Speaking for facts instead of letting facts speak for themselves If the case is strong, facts shouldn’t need to be interpreted. If someone is interpreting facts, it may reflect on the weakness of the case
False dilemma You can either have A or you can have B. (C, D, and E are never mentioned). It’s a false choice (aka False Dichotomy)

Conclusion – Employing these problems to your Advantage

1) Design a study that measures how democratic a nation is

3) Measure and quantify “wealth” in a society

2) Create a “freedom” index that quantitatively shows the relative freedom a country enjoys

4) Measure the level of contentment that citizens feel with their government/political system

KNOWING ABOUT THESE PROBLEMS WILL HELP YOU BE A BETTER RESEARCHER

You want the Truth – We’re all after the right answer. Put ideology away. Don’t speak for facts…Let facts speak for themselves.

Critical Thinking - Use a healthy dose of skepticism every time you hear a statistic, read a report or the news, or listen to a politician

Devil’s Advocate- Think of alternative explanations or cures. Don’t accept at face value the conclusions you’re given…ever

Spot A Weak Case – Is speaker calling opponent dumb, using hyperbole, or misrepresenting an idea? Argument by assertion or facts?

Ferret out Agendas – Agendas stink, make you look bad, and get in the way of honest research. Throw out the bias, and follow the facts

Find Right Balance – Don’t get too high-level, but don’t get too detailed. Strike the right balance in your research

Law of Unintended Consequences – Think through all the implications of your recommendation. Actions have consequences

Correlation ≠ Causality – Two things that occur at the same time may be completely unrelated. Get your causal links correct

Remember Ockham’s Razor– It’s rarely simple…but start with simple as a foundation, then build from there with facts

FROM THEORETICAL TO PRACTICAL

IF YOUR POLITICAL SCIENCE, ECONOMICS, OR HISTORY PROFESSOR ASKED YOU TO CONDUCT ONE OF THE FOLLOWING STUDIES…HOW CAN YOU AVOID THE TRAPS WE JUST DISCUSSED?

18