extra

1/15/2022

1

Chapter 4 EAB 3002

Reinforcement and Extinction of Operant Behavior

DR. TARA LOUGHREY, BCBA-D

Topics Covered in Chapter 4 1. Define operant behavior and operant conditioning

2. Operant extinction, spontaneous recovery, resistance to extinction

3. Continuous vs intermittent reinforcement

4. Shaping

5. Variables affecting resistance to extinction

6. Differential reinforcement (discrimination vs differentiation)

7. Role of discriminative stimuli and motivation in operant behavior

8. Role of consequences in operant behavior

ASR When this type of behavior is selected by reinforcing consequences, its frequency increases.

1. Operant

2. Respondent

3. Involuntary behavior

4. Conditioned responding

1

2

3

1/15/2022

2

Examples of Operant Behavior oA lever press

oOpening a door

oButtoning a shirt

oStopping at a red traffic light

oAsking for a glass of milk

oTaking a sip of water

oThinking about examples of operants

ASR Is this likely to be an example of operant behavior? Washing one’s hands.

1. Yes

2. No

ASR Is this likely to be an example of operant behavior? Leg muscles twitching when feels electric shock.

1. Yes

2. No

4

5

6

1/15/2022

3

ASR Is this an example of operant or respondent behavior? Sneezing when pepper gets inside your nose.

1. Operant

2. Respondent

ASR Is this an example of operant or respondent behavior? Slowing down at the sight of a police patrol car behind you.

1. Operant

2. Respondent

Operant Conditioning •Ability to learn through consequence events which evolved through natural selection

•Also known as operant selection

•Behavior operates on environment to produce an environment effect

•These effects usually result from movements of the skeletal frame.

•Operant responses usually involve contractions of the skeletal muscles.

•Unlike natural selection, environment continues select certain topographies of behavior to be reproduced

•These responses contact reinforcement

Process that continues throughout entire lifetime ◦ Even individuals with Alzheimer's disease are sensitive to operant selection

https://www.youtube.com/watch?v=yhvaSEJtOV8

7

8

9

1/15/2022

4

Operant Conditioning

Process in which repeated cycles occur of: 1. Behavioral variability

2. Specific responses are selected by immediate contingent consequences.

3. Selected responses or response dimensions are repeated (reproduced) across time

◦ Strengthening of behavior or a dimension in of behavior

10

ASR Operant behavior most commonly involves the:

1. Cardiac muscles

2. Glands

3. Skeletal muscles

4. Smooth muscles

ASR Which statement describes the Law of Effect?

A. Behavior is anything an organism does.

B. Learning is a permanent change in behavior.

C. Organisms can learn through consequences

D. Stimuli can be conditioned to elicit reflex responses

12

10

11

12

1/15/2022

5

ASR Operant selection research started with this person’s instrumental experiment

A) Watson

B) Pavlov

C) Thorndike

D) Skinner

13

Thorndike Puzzle Box

Studied learning in cats

Designed a puzzle box

Measured latency to escape box once put in

Pressing a lever resulted in escape and access to food (scrap of fish)

http://www.youtube.com/watch?v=BDujDOLre- 8&feature=player_embedded

14

Operant Chamber

•Skinner used these chambers with rats and pigeons to study schedules of reinforcement

15

13

14

15

1/15/2022

6

The Cumulative recorder and graph

•Automated recording

•Captures moment to moment changes in responding

•Ideal for studying schedules of reinforcement

•Rate indicated by slope • Flat line=no

responding/extinction effects

16

ASR An operant class represents two or more responses that share the same or

1. Topography or magnitude

2. Cause or effect

3. Function or topography

4. Extent or duration

ASR •This term describes the appearance and form of the response.

1. Function

2. Determinant

3. Topography

4. Magnitude

16

17

18

1/15/2022

7

Consequences

•Effects future probability of the behavior under similar conditions.

•Effects of consequences on behavior are only be seen by taking repeated measures of behavior across time and graphing the data

19

Consequences either accelerate (strengthen) OR decelerate (weaken) behavior)

20

ASR

21

Which of the following is NOT operant behavior?

A) Yelling at the teacher

B) Closing your eyes to avoid seeing light

C) Blinking in response to bright sunlight

D) Chewing food

19

20

21

1/15/2022

8

ASR The simplest operant contingency is the;

A) S-S contingency

B) R-R contingency

C) R-S contingency

D) S-R-S contingency

22

Types of Consequences Consequences involve two general types of environmental changes:

1. Stimuli are added to the environment (something is presented, turned on, increased, etc.) Positive (+)

2. Stimuli are withdrawn or removed from the environment (something is removed, turned off, decreased, etc.) Negative (-)

23

Types of Consequences

Consequences can have two effects on behavior:

◦ They can make behavior MORE likely to occur in the future: Reinforcement

OR

◦ They can make behavior LESS likely to occur: Punishment

24

22

23

24

1/15/2022

9

25

•4 types of consequences result from the combination of these variables:

Positive (+) Negative (-)

Positive Reinforcement Negative Reinforcement

SR/r+ SR/r-

Reinforcement Present something that results (Relief)

in future increase in behavior (get something you like!)

Remove something that results in future increase in behavior

+ Appetitive Stimulus (avoid/escape something you don’t like!)

- Aversive Stimulus

Positive Punishment Negative Punishment

SP/p+ SP/p- Punishment present something that results Remove something that results

in future decrease in behavior in future decrease in behavior

(get something you don’t like!) (lose something you like!)

+ Aversive Stimulus - Appetitive Stimulus

26

Consequences can have their effects with and without conditioning/learning

Reinforcement 4 Reinforcement Types:

1. Unconditioned Positive Reinforcement (SR+)

2. Conditioned Positive Reinforcement (Sr+)

3. Unconditioned Negative Reinforcement (SR-)

4. Conditioned Negative Reinforcement (Sr-)

27

25

26

27

1/15/2022

10

Punishment 4 Punishment Types:

1. Unconditioned Positive Punishment (SP+)

2. Conditioned Positive Punishment (Sp+)

3. Unconditioned Negative Punishment (SP-)

4. Conditioned Negative Punishment (Sp-)

28

Use of terms

Note:

•We reinforce and punish behavior, NOT people!

✓ Correct: Jane’s screaming was reinforced by attention provided by her Mom

X Incorrect: Jane was reinforced by attention provided by her Mom

29

Use of Terms •We don’t say the increase or decrease is due to reinforcement or punishment.

–We must specify the contingencies (environmental changes) that might result in reinforcement or punishment taking place.

✓ Correct: Jane’s screaming is punished from time-out from Mom’s attention.

X Incorrect: Jane’s screaming is punished.

30

28

29

30

1/15/2022

11

ASR Correct use of reinforcement?

He cries at the grocery store because it has been reinforced.

A. Yes

B. No

31

32

In addition, consequences can be

ASR I stick a knife in my toaster to get the toast out and get shocked. In the future, I never put utensils in the toaster.

1. Positive Reinforcement

2. Negative Reinforcement

3. Positive Punishment

4. Negative Punishment

5. NOT reinforcement/punishment

33

31

32

33

1/15/2022

12

ASR I stick a knife in my toaster to get the toast out and get shocked. In the future, I never

put utensils in the toaster.

1. Socially Mediated

2. Automatic

34

ASR I stick a knife in my toaster to get the toast out and get shocked. In the future, I never

put utensils in the toaster.

1. Socially Mediated

2. Automatic

35

ASR I stick a knife in my toaster to get the toast out and get shocked. In the future, I never

put utensils in the toaster.

1. Unconditioned

2. Conditioned

36

34

35

36

1/15/2022

13

At a house party, I politely ask, “where is the bathroom?” My friend tells me, “door to the

left.” I rush to the door to left.

1) Positive Reinforcement

2) Negative Reinforcement

3) Positive Punishment

4) Negative Punishment

5) NOT reinforcement/punishment

ASR

37

I hold out my arms and baby gives me a hug. Holding out my arms in front of baby

has increased over the past week.

1. Positive Reinforcement

2. Negative Reinforcement

3. Positive Punishment

4. Negative Punishment

5. NOT reinforcement/punishment

ASR

38

I hold out my arms and baby gives me a hug. Holding out my arms in front of baby has increased over the past week.

1. Socially mediated

2. Automatic

ASR

39

37

38

39

1/15/2022

14

I hold out my arms and baby gives me a hug. Holding out my arms in front of baby has increased over the past week.

1. Unconditioned

2. Conditioned

ASR

40

Jane pinches her older sister whenever her older sister tries to play with her dolls. Whenever Jane is caught pinching her older sister, her mom takes away her dolls for one week. This decreases the frequency of Jane pinching her older sister.

1. Positive Reinforcement

2. Negative Reinforcement

3. Positive Punishment

4. Negative Punishment

5. NOT reinforcement/punishment

ASR

41

ASR It begins to hail and hail falls on my head. I open my umbrella and place it over my head. Hail no longer hits my head. My opening-the-umbrella behavior is maintained by its consequence.

1. Positive Reinforcement

2. Negative Reinforcement

3. Positive Punishment

4. Negative Punishment

5. NOT reinforcement/punishment

40

41

42

1/15/2022

15

Critical Attributes

Reinforcement:

1. An environmental change must occur after the response, immediately after.

2. The environmental change must be contingent upon the response.

3. Must be an increase in future responding, or maintenance of responding across time.

4. Automaticity of reinforcement (learning can occur without words)

Note: same critical attributes apply to punishment except #3 would refer to a decrease in responding)

43

In other words….

◦ Contingency and Contiguity are key in reinforcement (and punishment) ◦ Dependency and timing are critical!

◦ Automaticity of reinforcement: ◦ You don’t have to understand it for it to work!

◦ Remember learning can occur with and without words!

◦ Contingencies can affect behavior even when we cannot verbally state them!

44

Variable Attributes of Reinforcement

1. Unconditioned or conditioned.

2. Positive or negative.

3. Automatic (non-social or direct) or socially mediated

4. Variety of schedules

5. Occurs in nature and in everyday life but may also be programmed (planned).

6. May be reinforcing under some conditions may NOT be reinforcing under different conditions depending on state of deprivation and satiation = motivation

45

43

44

45

1/15/2022

16

What is intrinsic motivation?

https://www.youtube.com/watch?v=hbkJ5MKEVEE

How to Identify Reinforcers? •Measure target response and identify whether it increases following delivery of reinforcement over time

•Can’t assume that a reinforcer is ubiquitous and functions as reinforcers for all behavior across all individuals

•Common examples of misused stimuli as reinforcers • Verbal praise

• Public acknowledgement

• Tokens

• Stickers

•https://www.youtube.com/watch?v=8CIZx3oPbDs

Free Operant Method •This method allows individual to allocate responding according to preference and reinforcing value

•Responses are “free” to vary

•Serves as an assessment model to develop a hierarchy of preference of stimuli which may act as reinforcers for other behavior

•https://www.youtube.com/watch?v=GA_6-zmAQbA

46

47

48

1/15/2022

17

49

Consequences that affect behavior

Reinforcement Punishment

Withhold reinforcement = Extinction

Withhold punishment = Recovery from punishment

Other Consequences

•Extinction is contrary to reinforcement

•Recovery from punishment is contrary to punishment

•Effects on future behavior are opposite

•Extinction = decrease in rate

•Recovery from punishment = increase in rate

50

51

Consequences that affect behavior

Reinforcement Punishment

Withhold reinforcement = Extinction

Withhold punishment = Recovery from punishment

Behavior decreases Behavior increases Behavior decreases

Behavior increases

49

50

51

1/15/2022

18

Critical Attributes Extinction

1. The behavior has to have been previously reinforced.

2. Reinforcement has to be withheld each and every time the behavior occurs.

3. The behavior has to be weakened.

52

Variable Attributes Extinction Side Effects

1. Behavior may immediately and temporarily increase in frequency, duration, and intensity, before it decreases.

◦ Short-term effect is known as an extinction burst.

2. The behavior may also change in topography, and emotional responses may occur.

53

Extinction

Extinction example: ◦ Soda Machine, Broken elevator

◦ Extinction Burst

◦ Increase rate, novel/variability in behavior, emotional outbursts, aggression

◦ Can the burst be tolerated? If not, extinction is not appropriate ◦ Long term effect = decrease in rate

◦ Spontaneous recovery

◦ Clinicians, parents, teachers etc. must be ready to implement extinction at all times

54

52

53

54

1/15/2022

19

ASR If behavior is maintained through positive reinforcement, extinction consists of withholding the . If behavior is maintained through negative reinforcement, extinction consists of NOT withdrawing the .

1. Aversive stimulus, reinforcing stimulus

2. Reinforcing stimulus, punishing stimulus

3. Preferred stimulus, aversive stimulus

4. Reinforcing stimulus, aversive stimulus

55

Spontaneous Recovery

56

Of the Response

R-S

R alone R

R alone

New stimulus conditions

57

Summary Table

55

56

57

1/15/2022

20

ASR is the reappearance of a previously extinguished behavior during the

extinction of a more recently reinforced behavior.

A) Reinforcement

B) Resurgence

C) Spontaneous recovery

58

ASR A closed sign on a store decreases the chances that you will try to go in given that in the past you have been unsuccessful. Your pattern of behavior in the presence of the closed sign is evidence of this;

1. Respondent extinction

2. Resistance to extinction

3. Partial Reinforcement effect

4. Discriminated extinction

ASR When some responses are reinforced and others are not, we call this schedule of reinforcement this;

1. Extinction

2. Intermittent

3. Continuous

58

59

60

1/15/2022

21

ASR Resistance to extinction is greater when responses are reinforced on intermittently.

1. True

2. False

ASR A gambler looses all his money at the casino and decided he will never return. After years of going every day, he stops going to the casino. One month later, he receives a letter in the mail with free credits towards gambling and goes back to the casino. This effect is known as;

1. Recovery

2. Reinstatement

3. Resurgence

4. Renewal

ASR When a drug user returns home from rehabilitation and begins using the drug again at home given its availability, this is known as;

1. Renewal

2. Resurgence

3. Reinstatement

4. Spontaneous recovery

61

62

63

1/15/2022

22

Terms The terms reinforcement, extinction, and recovery are named after their effects.

To reinforce means to strengthen.

To extinguish means to stamp out.

To recover means to come back strong.

In behavior analysis, punishment means to weaken through a contingent relationship between a behavior and a consequence.

64

ASR • Dad used to yell “no” at Claire when she would try to grab a cookie

from the cookie jar. Her cookie grabbing behavior decreased significantly since he has been yelling “no.” Dad gets a terrible sore throat and stops yelling “no” when she tries to grab the cookie. Claire starts grabbing cookies again. Claire grabbing cookies again from the cookie jar is most likely due to:

1. Positive punishment

2. Negative punishment

3. Extinction

4. Recovery from punishment

5. Positive reinforcement

65

ASR Mom used to tell Joey “be nice to your sister” every time he would call her “fatso” but Joey keeps calling her “fatso”. Her friend, a behavior analyst, tells her that she may be reinforcing this behavior and to instead withhold attention when Joey calls his sister “fatso.” She now says nothing to Joey when he calls his sister “fatso.” Joey eventually stops calling her “fatso.” This is an example of:

1. Positive punishment

2. Negative punishment

3. Extinction

4. Recovery from punishment

5. Positive reinforcement

66

64

65

66

1/15/2022

23

Reinforcer Effectiveness

Variables that contribute to the effectiveness of a reinforcer:

1. Deprivation & satiation (and similar operations)

2. Species-specific biological preparedness

3. Response effort (response energy)

4. Competing reinforcers

5. Environmental context

6. And many more!

Ex: substitutability of reinforcers /cost

67

ASR Water is more reinforcing the longer one goes without drinking water (and similar liquids). This exemplifies which variable of reinforcer effectiveness:

1. Deprivation

2. Satiation

3. Response effort

4. Competing reinforcers

68

ASR

“A consequence that may be punishing under some conditions may NOT be punishing under different conditions”

1. True

2. False

69

67

68

69

1/15/2022

24

Role of Antecedents Operant behavior is behavior that has an effect on the environment and is primarily under the control of its consequences.

However, it is typically controlled by a combination of antecedents and consequences.

Operant behavior is never controlled by antecedents alone.

4-term contingency

•More complex analysis of antecedents from 3-term contingency

•Recognizes that MOs and discriminative stimuli have different effects on behavior and consequences

71

Antecedents have last names

Consequences are their better half ☺

Operant antecedents never function independently of consequences

Antecedent effects on behavior depend on their relation with consequences ◦ Are they tied to reinforcement?

◦ Are they tied to punishment?

◦ Are they tied to extinction?

72

70

71

72

1/15/2022

25

Discriminative Stimuli

“Last names” of each type of discriminative stimulus refers to the type of consequence which led to the development of that discriminative stimulus

4 Types:

1.SD: paired with reinforcement

2.SΔ (S-delta):paired with extinction

3.SDP: paired with punishment

4.SΔP: paired with unavailability of punishment

73

Discriminative Stimuli

Discriminative stimuli: evoke or abate behavior due to a past history of reinforcement, extinction, or punishment

Discriminative stimuli are ALWAYS learned (ontogenic provenance)

ASR Consequences have effects on discriminative stimuli.

A) Evocative

B) Abative

C) Function-altering

D) Value-altering

E) Behavior-altering

75

73

74

75

1/15/2022

26

Role of Motivation https://www.youtube.com/watch?v=L6MamDfrH-I

Once referred to as drive

Depriving an organism of food results in increasing reinforcing value of food

ASR “Irrelevant responses” are not likely to be produced by the rat because they contact this consequence…

1. Reinforcement

2. Extinction

3. Punishment

4. Spontaneous Recovery

ASR Pressing the bar resulted in food pellet delivery each and every time. This schedule of reinforcement is known as ;

1. All or none

2. Intermittent

3. Continuous

4. Shaping

76

77

78

1/15/2022

27

ASR The rats different topographies of behavior in the magazine training can also be called this;

1. Behavior variability

2. Behavior plasticity

3. Behavior diversity

4. Behavior change

ASR The opposite of deprivation is known as;

1. intrinsic motivation

2. extrinsic motivation

3. abolishing operation

4. satiation

ASR This term is used to match or tie an earlier pattern of reinforcement to a subsequent phase in research;

1. Matching

2. Yoking

79

80

81

1/15/2022

28

ASR Behavior variability can be treated as an operant and reinforced accordingly to increase variability

1. True

2. False

ASR In the example where the bar press results in the removal of electric shock, the bar pressing increases due to which consequence?

1. Positive reinforcement

2. Negative reinforcement

3. Positive punishment

4. Negative punishment

ASR Reinforcing successive approximations to the target response is known as;

1. Conditioning

2. Magazine Training

3. Shaping

4. Continuous reinforcement

82

83

84

1/15/2022

29

Differential Reinforcement

•2-step process: extinction for undesired behavior + reinforcement for replacement behavior

•2 ways of doing it:

1. Reinforce behavior in presence of a stimulus. Do not reinforce same behavior in absence of the stimulus.

✓Leads to discrimination

2. Reinforce closer approximations to a target response; put previous approximations on extinction

✓Leads to differentiation

85

Differential Reinforcement

– If reinforcement is based on topography of response, it leads to differentiation

• Undesirable behavior on extinction • Replacement behavior reinforced

– If reinforcement is based on stimulus conditions, it leads to discrimination

• Reinforcement in presence of stimulus • Extinction in absence of stimulus

86

Differentiation •Differentiation: refers to Responses

✓One stimulus, multiple response topographies ▪ One topography is selected through process of differential reinforcement

Example: At home, Mary ignores Bob if he talks to her using his fake British accent, but she will respond to him if talks with his normal American accent. Bob stops using a fake British accent at home, and starts speaking with his normal American accent = differentiation of verbal behavior (accent).

87

85

86

87

1/15/2022

30

Discrimination •Discrimination: refers to Stimuli

✓Multiple stimuli, one response

Ex: Teaching Bobby to enter the correct restroom, no easy feat!

88

When airplane bathroom says vacant, I can use it. When the airplane bathroom says

occupied, I cannot use it. This is an example of:

1. Discrimination

2. Differentiation

ASR

89

When airplane bathroom says vacant, I can use it. When the airplane bathroom says occupied, I cannot use it. This is an

example of:

Think: is reinforcement based on the topography of the

response, or the conditions under which it occurs?

1. Discrimination

2. Differentiation

ASR

90

88

89

90

1/15/2022

31

If I open a Heineken with a bottle opener, I can get the top off. If I try to twist the cap, I

cannot get the top off. This is an example of:

1. Discrimination

2. Differentiation

ASR

91

ASR There is an immediate and momentary increase in the frequency of the response which only lasts while the is present.

1. SD

2. SΔ

3. SDP

92

ASR contingencies select behavior. contingencies deselect

behavior.

1. Reinforcement, punishment

2. Conditioned, unconditioned

3. Operant, natural

4. Operant, respondent

93

91

92

93

1/15/2022

32

Premack Principle •“Grandma's law”

•If you do your homework, then you can watch tv.

•If access to a high probability behavior is made contingent upon a low probability behavior, then the likelihood of the low probability will increase.

•Basically, you can use a preferred activity to reinforce a non-preferred activity.

•Premack principle as it applied to adults: • How do you arrange a to do list? Using Premack?

• https://www.youtube.com/watch?v=tDUOvof_V5U

94

ASR leads to reordering the and determines which behaviors

function as reinforcement at any given moment.

1. Discriminative stimuli, environment

2. Deprivation, response hierarchy

3. Punishment, stimulus function

4. Reinforcement, response hierachy

ASR

You set up a contingency with yourself that if you completed your reading assignment on Sunday morning, you can go to your friend’s Superbowl party on Sunday night. Completing your reading assignment would be considered the;

1. SD

2. Contingent response

3. Antecedent

4. Instrumental response

94

95

96

1/15/2022

33

ASR

You set up a contingency with yourself that if you completed your reading assignment on Sunday morning, you can go to your friend’s Superbowl party on Sunday night. Going to your friend’s Superbowl party would be considered the;

1. SD

2. Contingent response

3. Antecedent

4. Instrumental response

Response Deprivation Hypothesis •Depriving an organism of an activity (response) makes the response more valuable

https://www.youtube.com/watch?v=OuVc8U9LZA0

Behavioral Neuroscience https://www.youtube.com/watch?v=YIEt6TrjJXw

•With advancements in behavioral neuroscience, we understand role of dopamine neurotransmitter in activation of neurons in brain during reinforcing activities/reward

•In other words, at the neuron level, dopamine release serves as the reinforcing event when it binds to neural receptors

https://www.youtube.com/watch?v=DMcmrP-BWGk

97

98

99

1/15/2022

34

Operant Conditioning and Neuroplasticity

•Operant conditioning and changes in operant behavior also leads to changes in brain wiring known as neuroplasticity

•Important implications for those with traumatic brain injuries and stroke victims

https://www.youtube.com/watch?v=0joWRRKkGAE

What’s Next •Chapter 4 Quiz and ASR check opens on Wednesday at 12:00 AM and closes on Sunday at 11:59 PM in CANVAS

•Read Chapter 5 and create system of SAFMEDS

•Complete Chapter 5 reading assignment by Wednesday at 11:59 PM in CANVAS

•Complete the Honorlock Practice Quiz in CANVAS, under modules in preparation for Midterm exam

100

101