Urgent 2

profilestudystudent
lambert_chapter_12PPT.pptx

Chapter 12

Learning, Memory, and Decision Making

2

Outline

Neurobiological foundations of learning and memory

Modifying memories

Attention as a gateway to learning and memory

Decision making

Neurobiological foundations of learning and memory

Behavioral Approaches

Cellular Mechanisms

Structural Neuroplasticity

Integrating Clinical and Laboratory Research

(a) Pavlov used dogs to assess saliva production in response to varying stimuli; (b) his classic work pairing conditioned and unconditioned stimuli laid the groundwork for empirical investigations for learning.

4

Neurobiological foundations of learning and memory

Behavioral Approaches

Pavlov: Classical conditioning

Watson: Trial and error learning

Skinner: Operant conditioning

(a) Pavlov used dogs to assess saliva production in response to varying stimuli; (b) his classic work pairing conditioned and unconditioned stimuli laid the groundwork for empirical investigations for learning.

5

Neurobiological foundations of learning and memory

Classical conditioning

US:UR

NS+US:UR

CS:CR

(a) Pavlov used dogs to assess saliva production in response to varying stimuli; (b) his classic work pairing conditioned and unconditioned stimuli laid the groundwork for empirical investigations for learning.

6

Neurobiological foundations of learning and memory

Law of Effect

How did Thorndike measure learning?

Problem solving and puzzle boxes. Thorndike observed cats’ responses in puzzle boxes as they searched for ways to escape and approach the food. Once a response was observed to lead to the positive consequence of obtaining the desired food, that same response was repeated in future exposures to the puzzle box.

7

Neurobiological foundations of learning and memory

Operant Conditioning vs. Classical conditioning

8

Neurobiological foundations of learning and memory

Skinner box

Skinner developed operant chambers in which rats pressed levers to receive food pellets. The rats adjusted their responses to changing reinforcement schedules signaled with cues such as lights or sounds.

9

Role of contingency in behavior

Is there a danger in only measuring lever presses?

Neurobiological foundations of learning and memory

10

Cellular mechanisms

Hebbian learning: neurons the fire together, wire together

What happens chemically to allow a neuron to change its response to a stimulus?

Neurobiological foundations of learning and memory

Sensitization and Habituation

Neurobiological foundations of learning and memory

Eric Kandel used the aplysia as a model animal to investigate cellular responses in forms of associative learning such as sensitization and habituation.

12

Some cells help us learn specific kinds of information

Place cells

Grid cells

Direction cells

Rats need to navigate from early on in development

Neurobiological foundations of learning and memory

13

Neurobiological foundations of learning and memory

Place cells and grid cells in the hippocampus and surrounding areas are important for the rat’s movement of body and head around its environment.

14

Long-term potentiation as a candidate for memory

Neurobiological foundations of learning and memory

Microelectrodes are used to record postsynaptic potentials of the hippocampal neurons.

Postsynaptic glutamate receptors have been identified as key components of the LTP process.

15

What happens structurally during learning?

Restructuring of dendrites

Growing new neurons

Problems with always growing new neurons?

Slow

Space limitations

Energy cost

Neurobiological foundations of learning and memory

16

Neurobiological foundations of learning and memory

Learning-induced spine restructuring. During behavioral learning, the structures of the dendritic spines are modified in ways that are thought to facilitate neural networks supporting the newly acquired learned behavioral responses.

17

Neurobiological foundations of learning and memory

New cells have increased rates of survival early in the learning process; however, once the task is mastered, the death rate of newborn neurons increases.

18

We can learn about brain function by studying patients with brain damage

Neurobiological foundations of learning and memory

HM

Bilateral MTL lesions

Anterograde amnesia

Procedural vs. declarative memory

Neurobiological foundations of learning and memory

20

Neurobiological foundations of learning and memory

(a) Brain imaging has confirmed bilateral hippocampal damage in H.M., which impaired his declarative memory while leaving his procedural memory less impaired. (b) The ventral surface of H.M.’s brain. (c) Following H.M.’s death, the neuroanatomist Jacopo Annese conducted the necessary histological analysis of the brain tissue; equipment was created to freeze and slice the whole brain into pieces that could then be studied under a microscope.

21

Neurobiological foundations of learning and memory

Memory engram

Theory of equipotentiality

22

Neurobiological foundations of learning and memory

Neural networks and memories. Although research suggests that memories are not represented or coded in a single cell, it is unclear whether memories are stored in networks characterized as sparse or more distributed across the brain.

23

To study memory in animals, we need procedures with well defined parameters

Different tasks allow study of different kinds of memory

Neurobiological foundations of learning and memory

Delayed nonmatching-to-sample task. (a) When monkeys are assessed in this task that requires them to hold the information in memory before making the correct response, (b) those with lesions of the hippocampus and amygdala exhibit learning deficits.

24

Delayed (non)match to sample

Morris water maze

Radial arm maze

Eye-blink condition

Rodent obstacle courses

Neurobiological foundations of learning and memory

Delayed nonmatching-to-sample task. (a) When monkeys are assessed in this task that requires them to hold the information in memory before making the correct response, (b) those with lesions of the hippocampus and amygdala exhibit learning deficits.

25

Neurobiological foundations of learning and memory

Delayed nonmatching-to-sample task. (a) When monkeys are assessed in this task that requires them to hold the information in memory before making the correct response, (b) those with lesions of the hippocampus and amygdala exhibit learning deficits.

26

Neurobiological foundations of learning and memory

When spatial ability is assessed in the Morris water maze, (b) animals with hippocampal damage perform poorly during training and testing.

27

Neurobiological foundations of learning and memory

Spatial memory is assessed in the radial arm maze in which animals are required to remember arms or alleys of the maze to avoid revisiting previously visited arms—a response recorded as an error.

28

Neurobiological foundations of learning and memory

The interpositus nucleus of the cerebellum is integrally involved in the rabbit conditioned eye-blink response. Following conditioning, both the conditioned stimulus (CS, tone) and the unconditioned stimulus (US, air puff) trigger the eye-blink response (either as an unconditioned response (UR) or as a conditioned response [CR]).

29

Neurobiological foundations of learning and memory

Obstacle course training and neuroplasticity. (a) When rats were exposed to physical training (AC) in challenging obstacle courses, (b) increased synapses were observed in the Purkinje cells when compared with those of nontrained animals.

30

In humans, fMRI and PET can be used to find regions active while subjects perform different memory tasks

Drawbacks to fMRI vs. single cell recording?

Neurobiological foundations of learning and memory

When participants were asked to (a) retrieve and organize pictures representing scenes from a movie in the order presented in the movie as opposed to inferring how the order of the pictures should appear, (b) more hippocampal activation was observed.

31

Systematizing memory

Structural organization

Functional organization

Process-based organization

Neurobiological foundations of learning and memory

32

Cortical–hippocampal memory system

Neurobiological foundations of learning and memory

Cortical–hippocampal memory system. In both rodents and primates, the hippocampus receives and sends information to the parahippocampal and neocortical association areas. The parahippocampal region can be considered a hub or convergence area for this memory input—distributing it to the appropriate hippocampal and neocortical areas.

33

Processing-based memory system

Fast vs. slow encoding

Single-item vs. associative encoding

Flexible vs. rigid representation

Neurobiological foundations of learning and memory

34

Neurobiological foundations of learning and memory

This model distinguishes among three different types of memory systems: fast and flexible associations, slow and rigid associations, and fast processing of single-input units. Each proposed system is associated with specific brain areas.

35

Neurobiological foundations of learning and memory

Hippocampus implicated in complex memory across species

Similar to mammals, avian memory processing likely involves the avian version of the hippocampus

36

Modifying Memories

How reliable is memory under normal conditions?

What about stressful situations?

Key ideas

Reconsolidation

Post-retrieval lability

Confabulation

Modifying Memories

(a) In this paradigm, rats are exposed to cats prior to being tested in a memory task. (b) Rats previously exposed to cats made more errors in the radial-arm maze than nonexposed rats.

38

Modifying Memories

Knowing that stress impairs memory, how can we help people who experience stress (all of us, at one point or another)?

What about severe acute stress, or chronic stress?

Modifying Memories

PTSD

Imaging data reveal that PTSD is characterized by hyperactivation of the amygdala, insula, and cingulate cortex and diminished activity in the ventromedial prefrontal cortex. Both hyper- and hypoactivation have been observed in the hippocampus

40

Modifying Memories

Effect of stress can be cumulative

When rats were exposed to two hours of immobilization stress, (a) they exhibited more densely populated spines on neurons in the amygdala after 10 days as well as (b) persistent avoidance of the open arm in an elevated plus maze. these data reflect strong memories of the immobilization stress, with the effects building over time.

41

Modifying Memories

Are some people more susceptible to stress-impaired memory?

How would you test this idea?

42

Modifying Memories

Posttraumatic stress disorder (PTSD) effects on conditional discrimination. (a) After establishing light signals that predict or do not predict a threatening stimulus (air blast), (b) participants were exposed to a novel aversive noise stimulus alone and in the presence of the light cues that were associated with the air blast. (c) Participants in the high-symptom PTSD category were less likely to inhibit threat expectation in the presence of the safety signals than the control and low PTSD participants.

43

Attention as the gatekeeper

In order to remember, we must first attend

Inattentional blindness

44

Attention as the gatekeeper

Inattentional blindness. When study participants were asked to observe a video and focus on the number of times the ball was passed among the players, they failed to see the gorilla that walked across the room.

45

Attention as the gatekeeper

Parts of attending

Alerting

Orienting

Executive attention

46

Attention as the gatekeeper

Attentional modes in the brain. During the three aspects of attentional modes including alerting, orienting, and executive function, specific brain areas are engaged to facilitate these responses.

47

Attention as the gatekeeper

Attentional modes in the brain. During the three aspects of attentional modes including alerting, orienting, and executive function, specific brain areas are engaged to facilitate these responses.

48

Attention as the gatekeeper

Attentional modes in the brain. During the three aspects of attentional modes including alerting, orienting, and executive function, specific brain areas are engaged to facilitate these responses.

49

Attention as the gatekeeper

Because attention necessarily affects memory, what can we do about attention disorders

How do we decide when to give brain-altering drugs to children?

50

Decision making

Decisions require integrating current sensory information and memory

How many kinds of memory are required to verbally understand and correctly answer a simple arithmetic question?

To study decision making, we start with simple tasks

Decision making

(a) When monkeys are exposed to a random dot decision-making task, as they make the decision to respond in a certain way, the (b) lateral intraparietal (LIP) area and (c) the dorsolateral prefrontal cortex (DLPFC) are activated.

52

Decision making

Appreciating uncertainty is a necessary part of (rational) decision making

Even a decision at a traffic light could be fraught with uncertainty

Decision making

In everyday tasks such as driving, various categories of uncertainty are encountered including sensory, state, rule, and prediction uncertainty.

54

Decision making

We can not always learn a single stimulus-response rule

In everyday environments, the rules change from time to time

Decision making

Orbitofrontal cortex and flexible behavior

When rats were trained in an odor discrimination task in which one odor predicted a desired sweet fluid and another odor predicted an aversive bitter fluid, animals with lesions were slow to inhibit the previous response– outcome association and adapt by changing their responses to avoid the bitter fluid.

56

|