psychology essay

Minfu Liang
02_VisualPerception.pdf

10/2/2019

1

Vision

What is vision?

The Human Condition René Magritte

What is vision?

• Construction of the world based on incoming information provided by light interacting with photoreceptors on the retina.

• Most important/informative sense for humans • Greatest amount of sensory cortex is devoted to vision

• Conscious experience dominated by visual information

• Evolutionary adaptations • Early notification over rich detail (speed/accuracy trade)

• Collection of earlier adaptations

10/2/2019

2

Why must vision be constructed?

• Problem of inverse optics • Our eyes receive a 2D view of

the world • We live in a 3D world • Infinite amount of potential 3D

scenes that result in same 2D image

• Viewpoint invariance • Objects should be recognized

regardless of view • “Accidental” views

• Perception = sensation + experience

Basic roadmap of visual system

• Points of light ->

• Larger “circles” of light ->

• Lines and edges ->

• Shapes / Color / Motion ->

• Objects ->

• Complete visual image

• Feedforward AND feedback

Light • Comprised of photons – particle and wave

• Color (and visibility) of light determined by its wavelength

• Intensity of light determined by its amplitude

10/2/2019

3

The Eye

Focusing Light

• Light entering the eye must be focused on the retina

• Lens (and also cornea) responsible for focusing image properly • Lens adjusts focal point by becoming more or less

spherical (accommodation)

• Cornea helps to direct light into the lens

• Nearsightedness (myopia)

• Farsightedness (hyperopia)

Accommodation and Convergence

10/2/2019

4

Retina

• Light stimulates photoreceptors at far end of retina

• Neural signals travel to bipolar cells, where they are converged and sent to ganglion cells

• Ganglion cells further converge information and connect to brain

Horizontal cells Amacrine cells

Rods and Cones

Bipolar Cells

Ganglion Cells

Rods and Cones • Rods

• Low light vision (scotopic)

• Sensitive to fast motion

• High convergence (low spatial resolution)

• Concentrated at peripheries of eye

• ~120 million

• Stargazing

• Cones • Requires bright light (photopic)

• Three types – short, medium, and long – correspond to wavelength most sensitive to

• Low convergence (high spatial resolution)

• Concentrated in the fovea

• ~6 million

10/2/2019

5

Ganglion cells • Parvo cells

• Connections mostly from cones

• Color sensitive

• Good at edge detection

• Good spatial resolution

• Magno cells • Connections mostly from rods

• Sensitive to motion over wide areas

• Bad spatial resolution

• “Fast track”

From Eye to Brain

10/2/2019

6

Visual Fields

Visual Fields

Left Visual Field Right Visual Field

Primary Visual Cortex

• Information from the optic nerve splits to both hemispheres in the optic chiasm

• Routed through the lateral geniculate nucleus (LGN) in the thalamus

• Projected to primary visual cortex, area V1 in the Occipital lobe

10/2/2019

7

Visual Cortex

• Area V1 (primary visual area)

• Back of occipital lobe

• Individual neurons responsive to edges of specific orientations

• Retinotopic organization

• Cortical magnification

Mapping Visual Cortex

10/2/2019

8

Visual Cortex and Edges

• What is the shape of receptive fields in V1?

• Hubel and Wiesel’s cat study

• Cells in V1 respond best to edges of particular orientations

Optimal Contrast Sensitivity

• Visual acuity • Smallest contrast able to be

seen reliably

• Snellen chart

• Visual system is most sensitive to contrast at certain frequencies

• About 4-6 cycles per visual angle

Subjective Edges

• Subjective edge – edge that exists for an observer, but not actually an edge

• Continuation – straight edges continue while occluded

• Closure – Edges are assumed to be “closed” and solid

10/2/2019

9

Onward from V1

http://www.intechopen.com/source/html/39288/media/image1.png

“What”

“Where”

10/2/2019

10

Information from LGN is routed to multiple pathways through the brain simultaneously! Dorsal stream becomes active earlier than ventral…why?

Color

• Physics definition • Wavelength of light

• Can be emitted from a light source or reflected off a surface

• Perceptual definition • Experience of “color”

• Based on wavelength – but only partially

• Color constancy effects, brightness/lightness interplay

10/2/2019

11

Cones and Color

• Three types of cones, corresponds to size of wavelength most sensitive to • Short (Blue)

• Medium (Green)

• Long (Red)

• Combination of information from three cones is unique for all visible wavelengths

• S-cones are less common, and absent in fovea

• M-cones are a more recent development (cf. dog vision)

10/2/2019

12

Red sensitive ganglion cell

Green sensitive ganglion cell

Yellow sensitive ganglion cell

Blue sensitive ganglion cell

Red

Green

Blue

Opponent-Process Theory

• Color “opposites”

• Red-Green, Blue-Yellow, Black-White

• Color afterimage – refractory period

10/2/2019

13

Color Constancy

• Compensation for lighting when determining color

• Different lightings can cause vastly different color sensations

• But perception accounts for this, stabilizing the world

http://xkcd.com/1492/

10/2/2019

14

Color Contrast / Averaging

10/2/2019

15

How far away are things?

Measuring Size

• The size of an object on the retina is determined by both the size of the object and the distance it is from the observer.

• To account for this, objects can be measured in terms of visual angle.

Size and Distance

• Why do we use visual angle to measure things? • Retinal size is determined by object size and distance

• Visual angle is known • If size of object is known, distance can be calculated • If distance is known, size can be calculated • Of course, there is ambiguity…

• What if neither are known? • Heuristics based on visual cues • Physiological cues

• Accommodation and convergence • Binocular disparity – eyes don’t capture exact same image

10/2/2019

16

Constructing 3D

• Scene from image

• Monocular depth cues • Requires one eye only

• Can be represented in 2D art/pictures

• Binocular depth cues • Requires both eyes

• Different images in each eye (why?)

• Distance information is provided from both

Monocular Cues

• Close one eye – can you still see depth?

10/2/2019

17

Occlusion

• Closer objects occlude objects further away

Proximity to Horizon (Relative Height) • Distance from object origin to horizon

• Closer proximity = further away

Relative Size / Height

10/2/2019

18

Vanishing Point

Ponzo Illusion

10/2/2019

19

Relative size

• Similar objects appear smaller as they are further away

Texture Gradient

• Similar to relative size

• Pattern gets smaller as it recedes - compression

10/2/2019

20

Aerial Perspective

• Objects far away are blurred and hazy

• Light scattering over long distances (and moisture)

10/2/2019

21

Ames Room

Ebbinghaus Illusion

• Size constancy

• Size is partially determined by context!

10/2/2019

22

Binocular Depth Cues

• Each eye gets a slightly different view of the visual field (check it yourself)

• Binocular disparity

• For a given object, the degree of offset is determined by how far away it is

Binocular Depth Cues

Left Eye Right Eye

10/2/2019

23

Inducing binocular 3D

• Anaglyph 3d (red-cyan glasses)

• Polarized 3d • This is the kind at 3d movies

• Polarized beam split by glasses – 2 images in one

• HMDs (head mounted displays) • One screen per eye

10/2/2019

24

But our cues only go so far…

Inverse Optics Problem

• Theoretically infinite amount of 3d visual scenes giving rise to 2d retinal image

10/2/2019

25

Correspondence Problem

Motion Effects

• Apparent Motion • Movies and animation

• Santa Cruz Fishhook

10/2/2019

26

Santa Cruz Fishhook Sign

Santa Cruz Fishhook Sign

Motion Effects

• Apparent Motion • Movies and animation

• Santa Cruz Fishhook

• Structure from motion • Rotating objects provide information about 3d shape

• Ballerina illusion

10/2/2019

27

10/2/2019

28

Motion and Depth

• Motion parallax • Movement of scene when

you are moving

• Closer things move by faster