extra

2/7/2022

1

Chapter 5 EAB 3002

Schedules of Reinforcement DR. TARA LOUGHREY, BCBA-D

Topics Covered in Chapter 5 1.Basic schedules of reinforcement 2.Boundary conditions of schedules

(continuous, intermittent and extinction) 3.Behavior patterns under various schedules 4.Resistance to change 5.Molecular and molar accounts of

performance on schedules

Skinner’s Contributions to Operant Behavior

https://www.youtube.com/watch?v=YIEt6TrjJXw

1

2

3

2/7/2022

2

Parameters of Reinforcement

When a preferred stimulus is delivered contingent upon a response and the response is not increasing or maintaining, parameters of reinforcement may need to change

◦ Parameters of reinforcement: 1. Magnitude (associated with quality of the reinforcer)

2. Quantity (#)

3. Duration (amount of time)

4

ASR The parameters of reinforcement are:

1. Magnitude, effort and quality

2. Quality, quantity and magnitude

3. Quality, magnitude and duration

4. Duration, magnitude and quantity

5

ASR Which parameter of reinforcement?

Johnny can have 3 skittles if he eats 1 ¼ by ¼ inch piece of broccoli.

1. Magnitude

2. Quantity

3. Duration

6

4

5

6

2/7/2022

3

ASR Which parameter of reinforcement?

George gets to watch Tom and Jerry for 30 minutes once he finishes his homework.

1. Magnitude

2. Quantity

3. Duration

7

ASR Which parameter of reinforcement?

Sally used to give her date a hug after he took her out but saw no change in her date’s telephone behavior until she started giving him hugs and kisses after their dates.

1. Magnitude

2. Quantity

3. Duration

8

ASR Which parameter of reinforcement?

If I want to use free-play as a reinforcer for completing table-work, which parameter am I interested in?

1. Magnitude

2. Quantity

3. Duration

9

7

8

9

2/7/2022

4

ASR Which parameter of reinforcement?

Josh, a high-school student, loves to surf. I am working with his parents who want to establish a behavioral contract with Josh to improve his grades. Money is not an issue for this family. They suggest taking him to Hawaii for earning a 3.5 GPA as his midterm grade. I suggest they take him to a surf shop for a new board contingent upon earning a 3.5 during midterm and taking him to Hawaii for earning a final GPA of 3.5. This involves manipulation of which parameter of reinforcement?

1. Magnitude 2. Quantity 3. Duration

10

ASR A schedule of reinforcement is:

1. a rule that describes which responses will be followed by a reinforcer and which will not

2. a rule that describes how many responses have to be made in order to get a reinforcer

3. a rule that describes how much time has to pass before a reinforcer is delivered

4. a rule that dictates when to give a reinforcer

11

Why NOT the others? X. a rule that describes how many responses have to be made in order to get a reinforcer: this specifically refers to a type of schedule (ratio schedules)

X. a rule that describes how much time has to pass before a reinforcer is delivered: this specifically refers to a type of schedule (interval schedules)

X. a rule that dictates when to give a reinforcer: this specifically refers to a type of schedule (time-based schedules)

12

10

11

12

2/7/2022

5

Schedules of reinforcement

Extinction: • NO response is reinforced • Probability of reinforcement

per response = 0% • EX: try to open airplane

bathroom door when it says “occupied”

CRF: • EVERY response is

reinforced • Probability of

reinforcement per response = 100%

EX: try to open airplane door when it says “vacant”

Intermittent: • SOME responses are reinforced

• Probability of reinforcement per response = 0.1% to 99.9% • EX: Holding a door for someone and the probability of them

saying “thank you” (reinforcer)

13

ASR The two schedules of reinforcement that serve as boundaries for all other schedules are:

1. Fixed and Variable

2. Ratio and Interval

3. CRF and Extinction

14

Schedules of reinforcement Which schedule is used to establish/strengthen behavior?

1. Continuous

2. Intermittent

3. Extinction

15

13

14

15

2/7/2022

6

Schedules of reinforcement Which schedule is used to maintain behavior?

1. Continuous

2. Intermittent

3. Extinction

16

Schedules of reinforcement Which schedule is used to weaken behavior?

1. Continuous

2. Intermittent

3. Extinction

17

ASR This schedule produces stereotyped responses and weak resistance to extinction.

1. Continuous

2. Intermittent

3. Extinction

16

17

18

2/7/2022

7

Schedules of reinforcement

Reinforcement can be delivered based on two variables:

based on # of responses

RATIO

delivered after 1st response after some interval

INTERVAL

Criteria does not change

FIXED Fixed Ratio Fixed Interval

Criteria varies around some average

VARIABLE Variable Ratio Variable Interval

19

HINTS

You want look for: ◦ “every” = Fixed

◦ “about every” or “on average” = Variable

◦ Based on number of responses = Ratio

◦ Based on FIRST response after some period of time = Intervals

20

ASR Which of the following is NOT an intermittent schedule?

1. Fixed ratio

2. Variable interval

3. Continuous

4. Fixed interval

21

19

20

21

2/7/2022

8

ASR Liz is very excited for the tooth fairy to put money under her pillow. She checks under her pillow at 6:00 pm, 7:00 pm, 8:00 pm, and then 9:00 pm before she falls asleep, but there is no money under the pillow until 6 AM. Which schedule of reinforcement is checking for money on?

1. A. Interval

2. B. Ratio

22

ASR Now Liz puts something under her pillow every night and checks in the morning for money. The “tooth fairy” only puts money under her pillow when she looses a tooth and puts it under there. Thus putting other things that are not teeth under her pillow is likely going to contact which type of schedule?

1. Continuous

2. Intermittent

3. Extinction

23

ASR Each time I turn on my computer, my desktop background picture appears. This is an example of:

1. Fixed-ratio reinforcement

2. Variable-ratio reinforcement

3. Continuous reinforcement

4. Fixed-interval reinforcement

24

22

23

24

2/7/2022

9

ASR

If you answered “fixed ratio”, that would also be correct. But CRF (Continuous ReinForcement) is a better answer because the question specified that I see the picture each time I turn on my computer.

25

ASR I cheer “go Claire” every time she makes a basket.

1. Fixed Ratio (FR)

2. Variable Ratio (VR)

3. Fixed Interval (FI)

4. Variable Interval (VI)

26

ASR Claire’s coach cheers “go Claire” about every third time she makes a basket.

1. Fixed Ratio (FR)

2. Variable Ratio (VR)

3. Fixed Interval (FI)

4. Variable Interval (VI)

27

25

26

27

2/7/2022

10

ASR Peter works at a vocational setting where he answers the phone and takes messages. I collect baseline and then tell his boss every five minutes, to deliver praise if you see him take a message correctly. Which type of schedule did I suggest for Peter’s behavior?

1. Fixed Ratio (FR)

2. Variable Ratio (VR)

3. Fixed Interval (FI)

4. Variable Interval (VI)

28

ASR Hitchhiking (raising one’s thumb on the side of the road) is likely maintained by which schedule of reinforcement?

1. Fixed Ratio (FR)

2. Variable Ratio (VR)

3. Fixed Interval (FI)

4. Variable Interval (VI)

29

ASR On a construction site about every half an hour or so, I walk by the builder and deliver praise the first time I see him on-task.

1. Fixed Ratio (FR)

2. Variable Ratio (VR)

3. Fixed Interval (FI)

4. Variable Interval (VI)

30

28

29

30

2/7/2022

11

ASR Mary works at a job where she is paid by the hour. Mary’s work related behavior is reinforced on a _____________ schedule.

1. Fixed Ratio (FR)

2. Variable Ratio (VR)

3. Fixed Interval (FI)

4. Variable Interval (VI)

31

ASR I get a paycheck in my mailbox for consulting work sometime after I send an invoice to the parent and she receives it.

1. Fixed Ratio (FR)

2. Variable Ratio (VR)

3. Fixed Interval (FI)

4. Variable Interval (VI)

32

ASR Each week you log into ANGEL at a certain time to take the Unit test. (hint: think about what happens if you try to take the test too early)

1. Fixed Ratio (FR)

2. Variable Ratio (VR)

3. Fixed Interval (FI)

4. Variable Interval (VI)

33

31

32

33

2/7/2022

12

When you go shopping at your favorite store, you get a coupon for 20% off your next purchase. But you can’t use it until April 1st, and it expires two weeks later. Which schedule?

A.Fixed Interval

B.Fixed Interval w/limited hold

C.Variable Interval

D.Variable Interval w/limited hold

ASR

Time-based schedules ◦ TIME based schedules (FT, VT) are not related to behavior at all,

and will usually say something like, “regardless of what they are doing”.

◦ Also called non-contingent reinforcement (NCR)

35

Patterns of Responding

36

34

35

36

2/7/2022

13

ASR Produces a “scalloped” pattern of responding:

1. FR

2. VR

3. FI

4. VI

37

ASR Produces “all or none” pattern of responding; post-reinforcement pause followed by burst of responding

1. FR

2. VR

3. FI

4. VI

38

ASR The post-reinforcement pause is also sometimes referred to as the;

1. laziness effect

2. preratio pause

3. interruption pause

37

38

39

2/7/2022

14

Risks of the Post-Reinforcement Pause (PRP) and How to Mitigate it https://www.youtube.com/watch?v=XGd128PQoks

ASR Produces steady, high rate of responding

1. FR

2. VR

3. FI

4. VI

41

ASR Produces steady, low to moderate rate of responding

1. FR

2. VR

3. FI

4. VI

42

40

41

42

2/7/2022

15

ASR Which schedule of reinforcement will produce steady, high-rate behavior?

1. Fixed ratio

2. Variable ratio

3. Fixed interval

4. Variable interval

5. Fixed time

6. Variable time

Let’s say you want to teach a child how to ask for attention appropriately. Which schedule of reinforcement should you use while you’re first teaching the skill?

1. Fixed ratio

2. Variable ratio

3. Fixed interval

4. Variable interval

5. Continuous

44

ASR

ASR In a DRH, the criteria for reinforcement is initially set _______________

1. Just below the lowest baseline rate

2. At the average baseline rate

3. Just above the average baseline rate

4. Just above the highest baseline rate

45

43

44

45

2/7/2022

16

ASR Increasing your ratio too abruptly can result in …

Type your answer

Ratio Strain, responding starts to extinguish because the response effort is too high to contact reinforcement.

https://www.youtube.com/watch?v=UBYqf95uCgo

46

Discriminating complex schedules of reinforcement

1. Concurrent- are available at the same time, as opposed to multiple, mixed, and chained = involves choice between two schedules

2. Multiple - one schedule on, then off, then next schedule on; signaled!

3. Mixed- same as multiple, only no signal (without the signal, you’re all mixed up!)

4. Chained- response requirements of two or more schedules must be met in a specific order before reinforcement occurs, each schedule component is correlated with a signal

5. Tandem- response requirements of two or more schedules must be met in a specific order before reinforcement occurs, each schedule component is NOT correlated with a signal

47

ASR During centers, preschool students can play with blocks, color, read a book, or use the computer. Which type of schedule?

1. Concurrent

2. Multiple

3. Mixed

4. Chained

48

46

47

48

2/7/2022

17

ASR During ‘centers’, students are broken up into groups and travel from table to table. At one table, Maria, the teacher, reads students a story and expects students to attend and answer questions. At the other table, Jane, the teacher’s aid, puts out worksheets but does not expect students to complete the work. Which type of schedule is likely in place during centers?

1. Concurrent

2. Multiple

3. Mixed

4. Chained

49

ASR Students, when given the choice, go to Jane’s center and spend more time here than Maria’s center. Which principle describes the students’ response allocation?

1. Law of effect

2. Matching law

3. Behavioral contrast

50

ASR Maria thinks the students are ready for a more challenging reading center. Now students must read two pages, complete a worksheet and then put away their book before moving to the next center. Which type of schedule is Maria using?

1. Concurrent 2. Multiple 3. Mixed 4. Chained

51

49

50

51

2/7/2022

18

When a student needs to go to the bathroom during centers, Maria teaches students that they must first raise their hand and then ask politely once called upon. Which schedule is in place for going to the bathroom during centers?

1. Concurrent

2. Multiple

3. Mixed

4. Chained

ASR

ASR Sometimes the PC laptop will connect to the internet immediately when you turn it on. Other times you have to get up and reset the internet router before the laptop will connect to the internet.

1. Concurrent

2. Multiple

3. Mixed

4. Chained

53

Behavioral Contrast If rate of behavior decreases in one setting due to changes in schedule

requirements (i.e., extinction) in one setting, it may increase in another setting where NO change has been made (e.g., intermittent reinforcement) and vice versa

In other words, behavior will increase in the setting where reinforcement is more available and decrease in the setting where reinforcement is less available

Important to consider when implementing an intervention in only one of the target settings where the response is likely to occur (e.g., home vs. school)

54

52

53

54

2/7/2022

19

ASR At school, a well trained teacher does not respond to Jeff’s inappropriate swearing as a behavior analyst determines that this behavior is attention-maintained. At home, parents reprimand Jeffrey repeatedly when he swears. Swearing is likely to at school and at home due to .

1. Increase, decrease, behavioral contrast

2. Decrease, increase, behavioral contrast

3. Decrease, increase, extinction

55

ASR The effects of schedules of reinforcement extend over species, reinforcers, and behavior. This refers to the assumption of;

1. variability

2. consistency

3. generality

Rule Governed Behavior •Also called verbally-mediated

•Controlled by verbal antecedent stimuli (rules)

•Opposite of contingency-shaped behavior which is maintained by consequences

57

55

56

57

2/7/2022

20

Rule-Governed Bx •Rule-governed learning can be more efficient than contingency-shaping

•Rule-governed behavior can interfere with learning • Can be more resistant to modification by environmental contingencies

https://www.youtube.com/watch?v=2yno_W7RVVA

58

ASR Your friend tells you there is a sale at Banana Republic this weekend so you go there on Saturday to purchase a new outfit. You have never been to a sale before.

Your behavior is

A. Rule-governed

B. Contingency-shaped

C. Respondent

D. Event-governed

59

ASR When the ratio requirements for reinforcement are increased systematically typically after each reinforcer, we call this a schedule

1. Fixed

2. Progressive ratio (PR)

3. Mixed

4. Chained

https://www.youtube.com/watch?v=6jkfwIdxy48

58

59

60

2/7/2022

21

ASR In a progressive ratio schedule, the schedule with the highest ratio is known as the;

1. Endpoint

2. Breakpoint

3. Finish line

ASR When an individual is initially exposed to a new schedule of reinforcement, traditional behavior patterns do not emerge immediately. This early performance is known as the;

1. introduction effect

2. steady-state performance

3. preratio effect

4. transition state

ASR The study of behavior allocation through time involving feedback processes that move the system from an unstable transitional state to a steady-state equilibrium is known as;

1. Behavioral economics

2. Behavioral dynamics

3. Molecular research

4. Molar research

61

62

63

2/7/2022

22

ASR This measure of behavior represents the time between responses. For example, the time between a child screaming and the next instance of screaming is known as;

1. latency

2. rate

3. count

4. inter-response time (IRT)

ASR In this account, effects of schedules of reinforcement are analyzed within session by measuring changes in the IRT.

1. Molecular

2. Molar

ASR In this account, effects of schedules of reinforcement are analyzed across sessions by measuring overall rate of responding;

1. Molecular

2. Molar

64

65

66

2/7/2022

23

More examples of Schedules of Reinforcement

https://www.youtube.com/watch?v=JoP-2wn-2rY

What industries have mastered the art of schedules of reinforcement for profit/engagement with platforms?

•Social Media (Facebook, LinkedIn, Twitter, Instagram)

•Video gaming

•https://www.youtube.com/watch?v=tWtvrPTbQ_c

https://www.youtube.com/watch?v=EHmC2D0_Hdg

•Casinos/Gambling

•What do these industries all have in common (e.g., what schedule of reinforcement is most commonly used?) • Variable ratios and variable interval schedules

What behavior do you engage in at high rates maintained on a VR schedule? •Netflix and channel surfing

•Fishing

•Bargain shopping

•Social media

•Gambling

•Video gaming

•Shopping for bargains

•Using dating apps

67

68

69

2/7/2022

24

What’s Next •Chapter 5 Quiz

•Study Chapters 1-5 in preparation for Midterm Exam

•Review Orientation and Becoming Certified Slides (5 bonus questions from this week)

•Complete Honorlock Practice Quiz in CANVAS, Modules

70