paper essay, It is due in 16 hours from now.

profileavvhatgihasad
levitin_chapter_1.pdf

1. What Is Music?

From Pitch to Timbre

1

2

3

4

5

6

7

8

9

10

11

12

13

14

co 15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

What is music? To many, “music” can only mean the great masters—Beethoven, Debussy, and Mozart. To others, “music” is Busta Rhymes, Dr. Dre, and Moby. To one of my saxophone teachers at Berklee

College of Music—and to legions of “traditional jazz” aficionados—

anything made before 1940 or after 1960 isn’t really music at all. I had

friends when I was a kid in the sixties who used to come over to my

house to listen to the Monkees because their parents forbade them to lis-

ten to anything but classical music, and others whose parents would

only let them listen to and sing religious hymns. When Bob Dylan dared

to play an electric guitar at the Newport Folk Festival in 1965, people

walked out and many of those who stayed, booed. The Catholic Church

banned music that contained polyphony (more than one musical part

playing at a time), fearing that it would cause people to doubt the unity

of God. The church also banned the musical interval of an augmented

fourth, the distance between C and F-sharp and also known as a tritone

(the interval in Leonard Bernstein’s West Side Story when Tony sings the

name “Maria”). This interval was considered so dissonant that it must

have been the work of Lucifer, and so the church named it Diabolus in

musica. It was pitch that had the medieval church in an uproar. And it

was timbre that got Dylan booed.

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 13

The music of avant-garde composers such as Francis Dhomont,

Robert Normandeau, or Pierre Schaeffer stretches the bounds of what

most of us think music is. Going beyond the use of melody and harmony,

and even beyond the use of instruments, these composers use record-

ings of found objects in the world such as jackhammers, trains, and wa-

terfalls. They edit the recordings, play with their pitch, and ultimately

combine them into an organized collage of sound with the same type of

emotional trajectory—the same tension and release—as traditional mu-

sic. Composers in this tradition are like the painters who stepped out-

side of the boundaries of representational and realistic art—the cubists,

the Dadaists, many of the modern painters from Picasso to Kandinsky to

Mondrian.

What do the music of Bach, Depeche Mode, and John Cage funda-

mentally have in common? On the most basic level, what distinguishes

Busta Rhymes’s “What’s It Gonna Be?!” or Beethoven’s “Pathétique”

Sonata from, say, the collection of sounds you’d hear standing in the

middle of Times Square, or those you’d hear deep in a rainforest? As

the composer Edgard Varèse famously defined it, “Music is organized

sound.”

This book drives at a neuropsychological perspective on how music

affects our brains, our minds, our thoughts, and our spirit. But first, it is

helpful to examine what music is made of. What are the fundamental

building blocks of music? And how, when organized, do they give rise to

music? The basic elements of any sound are loudness, pitch, contour, du-

ration (or rhythm), tempo, timbre, spatial location, and reverberation.

Our brains organize these fundamental perceptual attributes into higher-

level concepts—just as a painter arranges lines into forms—and these

include meter, harmony, and melody. When we listen to music, we are ac-

tually perceiving multiple attributes or “dimensions.” Here is a brief sum-

mary of them.

~ A discrete musical sound is usually called a tone. The word note is also used, but scientists reserve that word to refer to something

that is notated on a page or score of music. The two terms, tone

14 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 14

and note, refer to the same entity in the abstract, where the word

tone refers to what you hear, and the word note refers to what you

see written on a musical score.

~ Pitch is a purely psychological construct, related both to the actual frequency of a particular tone and to its relative position in the musi-

cal scale. It provides the answer to the question “What note is that?”

(“It’s a C-sharp.”) I’ll define frequency and musical scale below.

~ Rhythm refers to the durations of a series of notes, and to the way that they group together into units. For example, in the “Alphabet

Song” (the same as “Twinkle, Twinkle Little Star”) the notes of the

song are all equal in duration for the letters A B C D E F G H I J K

(with an equal duration pause, or rest, between G and H), and then

the following four letters are sung with half the duration, or twice

as fast per letter: L M N O (leading generations of schoolchildren

to spend several early months believing that there was a letter in

the English alphabet called ellemmenno).

~ Tempo refers to the overall speed or pace of the piece. ~ Contour describes the overall shape of a melody, taking into ac-

count only the pattern of “up” and “down” (whether a note goes up

or down, not the amount by which it goes up or down).

~ Timbre is that which distinguishes one instrument from another— say, trumpet from piano—when both are playing the same written

note. It is a kind of tonal color that is produced in part by over-

tones from the instrument’s vibrations.

~ Loudness is a purely psychological construct that relates (nonlin- early and in poorly understood ways) to the physical amplitude of

a tone.

~ Spatial location is where the sound is coming from. ~ Reverberation refers to the perception of how distant the source is

from us in combination with how large a room or hall the music is

What Is Music? 15

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 15

in; often referred to as “echo” by laypeople, it is the quality that

distinguishes the spaciousness of singing in a large concert hall

from the sound of singing in your shower. It has an underappreci-

ated role in communicating emotion and creating an overall pleas-

ing sound.

These attributes are separable. Each can be varied without altering

the others, allowing the scientific study of one at a time, which is why we

can think of them as dimensions. The difference between music and a

random or disordered set of sounds has to do with the way these funda-

mental attributes combine, and the relations that form between them.

When these basic elements combine and form relationships with one an-

other in a meaningful way, they give rise to higher-order concepts such

as meter, key, melody, and harmony.

~ Meter is created by our brains by extracting information from rhythm and loudness cues, and refers to the way in which tones

are grouped with one another across time. A waltz meter orga-

nizes tones into groups of three, a march into groups of two or four.

~ Key has to do with a hierarchy of importance that exists between tones in a musical piece; this hierarchy does not exist in-the-world,

it exists only in our minds, as a function of our experiences with a

musical style and musical idioms, and mental schemas that all of

us develop for understanding music.

~ Melody is the main theme of a musical piece, the part you sing along with, the succession of tones that are most salient in your

mind. The notion of melody is different across genres. In rock mu-

sic, there is typically a melody for the verses and a melody for the

chorus, and verses are distinguished by a change in lyrics and

sometimes by a change in instrumentation. In classical music, the

melody is a starting point for the composer to create variations on

that theme, which may be used throughout the entire piece in dif-

ferent forms.

16 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 16

~ Harmony has to do with relationships between the pitches of dif- ferent tones, and with tonal contexts that these pitches set up that

ultimately lead to expectations for what will come next in a musi-

cal piece—expectations that a skillful composer can either meet

or violate for artistic and expressive purposes. Harmony can mean

simply a parallel melody to the primary one (as when two singers

harmonize) or it can refer to a chord progression—the clusters of

notes that form a context and background on which the melody

rests.

The idea of primitive elements combining to create art, and of the im-

portance of relationships between elements, also exists in visual art and

dance. The fundamental elements of visual perception include color

(which can be decomposed into the three dimensions of hue, saturation,

and lightness), brightness, location, texture, and shape. But a painting is

more than these—it is not just a line here and another there, or a spot of

red in one part of the picture and a patch of blue in another. What makes

a set of lines and colors into art is the relationship between this line and

that one; the way one color or form echoes another in a different part of

the canvas. Those dabs of paint and lines become art when form and

flow (the way in which your eye is drawn across the canvas) are created

out of lower-level perceptual elements. When they combine harmoni-

ously they ultimately give rise to perspective, foreground and back-

ground, emotion, and other aesthetic attributes. Similarly, dance is not

just a raging sea of unrelated bodily movements; the relationship of

those movements to one another is what creates integrity and integrality,

a coherence and cohesion that the higher levels of our brain process.

And as in visual art, music plays on not just what notes are sounded, but

which ones are not. Miles Davis famously described his improvisational

technique as parallel to the way that Picasso described his use of a can-

vas: The most critical aspect of the work, both artists said, was not the

objects themselves, but the space between objects. In Miles’s case, he

described the most important part of his solos as the empty space be-

What Is Music? 17

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 17

tween notes, the “air” that he placed between one note and the next.

Knowing precisely when to hit the next note, and allowing the listener

time to anticipate it, is a hallmark of Davis’s genius. This is particularly

apparent in his album Kind of Blue.

To nonmusicians, terms such as diatonic, cadence, or even key and

pitch can throw up an unnecessary barrier. Musicians and critics some-

times appear to live behind a veil of technical terms that can sound pre-

tentious. How many times have you read a concert review in the

newspaper and found you have no idea what the reviewer is saying? “Her

sustained appoggiatura was flawed by an inability to complete the

roulade.” Or, “I can’t believe they modulated to C-sharp minor! How

ridiculous!” What we really want to know is whether the music was per-

formed in a way that moved the audience. Whether the singer seemed to

inhabit the character she was singing about. You might want the re-

viewer to compare tonight’s performance to that of a previous night or a

different ensemble. We’re usually interested in the music, not the techni-

cal devices that were used. We wouldn’t stand for it if a restaurant re-

viewer started to speculate about the precise temperature at which the

chef introduced the lemon juice in a hollandaise sauce, or if a film critic

talked about the aperture of the lens that the cinematographer used; we

shouldn’t stand for it in music either.

Moreover, many of those who study music—even musicologists and

scientists—disagree about what is meant by some of these terms. We

employ the term timbre, for example, to refer to the overall sound or

tonal color of an instrument—that indescribable character that distin-

guishes a trumpet from a clarinet when they’re playing the same written

note, or what distinguishes your voice from Brad Pitt’s if you’re saying

the same words. But an inability to agree on a definition has caused the

scientific community to take the unusual step of throwing up its hands

and defining timbre by what it is not. (The official definition of the

Acoustical Society of America is that timbre is everything about a sound

that is not loudness or pitch. So much for scientific precision!)

What is pitch? This simple question has generated hundreds of scien-

18 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 18

tific articles and thousands of experiments. Pitch is related to the fre-

quency or rate of vibration of a string, column of air, or other physical

source. If a string is vibrating so that it moves back and forth sixty times

in one second, we say that it has a frequency of sixty cycles per second.

The unit of measurement, cycles per second, is often called Hertz (ab-

breviated Hz) after Heinrich Hertz, the German theoretical physicist

who was the first to transmit radio waves (a dyed-in-the-wool theoreti-

cian, when asked what practical use radio waves might have, he report-

edly shrugged, “None”). If you were to try to mimic the sound of a fire

engine siren, your voice would sweep through different pitches, or fre-

quencies (as the tension in your vocal folds changes), some “low” and

some “high.”

Keys on the left of the piano keyboard strike longer, thicker strings

that vibrate at a relatively slow rate. Keys to the right strike shorter, thin-

ner strings that vibrate at a higher rate. The vibration of these strings dis-

places air molecules, and causes them to vibrate at the same rate—with

the same frequency as the string. These vibrating air molecules are what

reach our eardrum, and they cause our eardrum to wiggle in and out at

the same frequency. The only information that our brains get about the

pitch of sound comes from that wiggling in and out of our eardrum; our

inner ear and our brain have to analyze the motion of the eardrum in or-

der to figure out what vibrations out-there-in-the-world caused the

eardrum to move that way.

By convention, when we press keys nearer to the left of the keyboard,

we say that they are “low” pitch sounds, and ones near the right side of

the keyboard are “high” pitch. That is, what we call “low” are those

sounds that vibrate slowly, and are closer (in vibration frequency) to the

sound of a large dog barking. What we call “high” are those sounds that

vibrate rapidly, and are closer to what a small yip-yip dog might make.

But even these terms high and low are culturally relative—the Greeks

talked about sounds in the opposite way because the stringed instru-

ments they built tended to be oriented vertically. Shorter strings or pipe

organ tubes had their tops closer to the ground, so these were called

the “low” notes (as in “low to the ground,”) and the longer strings and

What Is Music? 19

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 19

tubes—reaching up toward Zeus and Apollo—were called the “high”

notes. Low and high—just like left and right—are effectively arbitrary

terms that ultimately have to be memorized. Some writers have argued

that “high” and “low” are intuitive labels, noting that what we call high-

pitched sounds come from birds (who are high up in trees or in the sky)

and what we call low-pitched sounds often come from large, close-to-

the-ground mammals such as bears or the low sounds of an earthquake.

But this is not convincing, since low sounds also come from up high

(think of thunder) and high sounds can come from down low (crickets

and squirrels, leaves being crushed underfoot).

As a first definition of pitch, let’s say it is that quality that primarily

distinguishes the sound that is associated with pressing one piano key

versus another.

Pressing a piano key causes a hammer to strike one or more strings

inside the piano. Striking a string displaces it, stretching it a bit, and its

inherent resiliency causes it to return toward its original position. But it

overshoots that original position, going too far in the opposite direction,

and then attempts to return to its original position again, overshooting it

again, and in this way it oscillates back and forth. Each oscillation cov-

ers less distance, and, in time, the string stops moving altogether. This is

why the sound you hear when you press a piano key gets softer until it

trails off into nothing. The distance that the string covers with each os-

cillation back and forth is translated by our brains into loudness; the rate

at which it oscillates is translated into pitch. The farther the string trav-

els, the louder the sound seems to us; when it is barely traveling at all,

the sound seems soft. Although it might seem counterintuitive, the dis-

tance traveled and the rate of oscillation are independent. A string can

vibrate very quickly and traverse either a great distance or a small one.

The distance it traverses is related to how hard we hit it—this corre-

sponds to our intuition that hitting something harder makes a louder

sound. The rate at which the string vibrates is principally affected by its

size and how tightly strung it is, not by how hard it was struck.

It might seem as though we should simply say that pitch is the same

as frequency; that is, the frequency of vibration of air molecules. This is

20 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 20

almost true. Mapping the physical world onto the mental world is sel-

dom so straightforward. However, for most musical sounds, pitch and

frequency are closely related.

The word pitch refers to the mental representation an organism has

of the fundamental frequency of a sound. That is, pitch is a purely psy-

chological phenomenon related to the frequency of vibrating air mole-

cules. By “psychological,” I mean that it is entirely in our heads, not in

the world-out-there; it is the end product of a chain of mental events that

gives rise to an entirely subjective, internal mental representation or

quality. Sound waves—molecules of air vibrating at various frequen-

cies—do not themselves have pitch. Their motion and oscillations can

be measured, but it takes a human (or animal) brain to map them to that

internal quality we call pitch.

We perceive color in a similar way, and it was Isaac Newton who first

realized this. (Newton, of course, is known as the discoverer of the the-

ory of gravity, and the inventor, along with Leibniz, of calculus. Like

Einstein, Newton was a very poor student, and his teachers often com-

plained of his inattentiveness. Ultimately, Newton was kicked out of

school.)

Newton was the first to point out that light is colorless, and that con-

sequently color has to occur inside our brains. He wrote, “The waves

themselves are not colored.” Since his time, we have learned that light

waves are characterized by different frequencies of oscillation, and

when they impinge on the retina of an observer, they set off a chain of

neurochemical events, the end product of which is an internal mental

image that we call color. The essential point here is: What we perceive as

color is not made up of color. Although an apple may appear red, its

atoms are not themselves red. And similarly, as the philosopher Daniel

Dennett points out, heat is not made up of tiny hot things.

A bowl of pudding only has taste when I put it in my mouth—when it

is in contact with my tongue. It doesn’t have taste or flavor sitting in my

fridge, only the potential. Similarly, the walls in my kitchen are not

“white” when I leave the room. They still have paint on them, of course,

but color only occurs when they interact with my eyes.

What Is Music? 21

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 21

Sound waves impinge on the eardrums and pinnae (the fleshy parts of

your ear), setting off a chain of mechanical and neurochemical events,

the end product of which is an internal mental image we call pitch. If a

tree falls in a forest and no one is there to hear it, does it make a sound?

(The question was first posed by the Irish philosopher George Berkeley.)

Simply, no—sound is a mental image created by the brain in response to

vibrating molecules. Similarly, there can be no pitch without a human or

animal present. A suitable measuring device can register the frequency

made by the tree falling, but truly it is not pitch unless and until it is

heard.

No animal can hear a pitch for every frequency that exists, just as the

colors that we actually see are a small portion of the entire electromag-

netic spectrum. Sound can theoretically be heard for vibrations from just

over 0 cycles per second up to 100,000 cycles per second or more, but

each animal hears only a subset of the possible sounds. Humans who are

not suffering from any kind of hearing loss can usually hear sounds from

20 Hz to 20,000 Hz. The pitches at the low end sound like an indistinct

rumble or shaking—this is the sound we hear when a truck goes by out-

side the window (its engine is creating sound around 20 Hz) or when a

tricked-out car with a fancy sound system has the subwoofers cranked

up really loud. Some frequencies—those below 20 Hz—are inaudible to

humans because the physiological properties of our ears aren’t sensitive

to them.

The range of human hearing is generally 20 Hz to 20,000 Hz, but this

doesn’t mean that the range of human pitch perception is the same; al-

though we can hear sounds in this entire range, they don’t all sound mu-

sical; that is, we can’t unambiguously assign a pitch to the entire range.

By analogy, colors at the infrared and ultraviolet ends of the spectrum

lack definition compared to the colors closer to the middle. The figure on

page 23 shows the range of musical instruments, and the frequency as-

sociated with them. The sound of the average male speaking voice is

around 110 Hz, and the average female speaking voice is around 220 Hz.

The hum of fluorescent lights or from faulty wiring is 60 Hz (in North

America; in Europe and countries with a different voltage/current stan-

22 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 22

What Is Music? 23

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

A27.500 30.863 32.703 36.708 41.203 43.654 48.999 55.000 61.735 65.406 73.416 82.407 87.307 97.999 110.00 123.47 130.81 146.83 164.81 174.61 196.00 220.00 246.94 261.63 293.66 329.63 349.23 392.00 440.00 493.88 523.55 587.33 659.26 698.46 783.99 880.00 987.77 1046.5 1174.7 1318.5 1396.9 1568.0 1760.0 1975.5 2093.0 2349.3 2637.0 2793.0 3136.0 3520.0 3951.1 4186.0

A A

A A

A A

A B

B B

B B

B B

B C

C C

C C

C C

C D

D D

D D

D D

E E

E E

E E

E F

F F

F F

F F

G G

G G

G G

G

29.135

34.648 38.891

46.249 51.913 58.270

69.269 77.782

92.499 103.83 116.54

138.59 155.56

185.00 207.65 233.08

277.18Middle C

A-440

311.13

369.99 415.30 466.16

554.37 622.25

739.99 830.61 932.33

1108.7 1244.5

1480.0 1661.2 1864.7

2217.5 2489.0

2960.0 3322.4 3729.3

Tu ba

M an ʼs

v oi

ce

Tr um

pe t

W om

an ʼs

v oi

ce

Vi ol

in

Pi cc

ol o

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 23

24 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

dard, it can be 50 Hz). The sound that a singer hits when she causes a

glass to break might be 1000 Hz. The glass breaks because it, like all

physical objects, has a natural and inherent vibration frequency. You can

hear this by flicking your finger against its sides or, if it’s crystal, by run-

ning your wet finger around the rim of the glass in a circular motion.

When the singer hits just the right frequency—the resonant frequency of

the glass—it causes the molecules of the glass to vibrate at their natural

rate, and they vibrate themselves apart.

A standard piano has eighty-eight keys. Very rarely, pianos can have a

few extra ones at the bottom and electronic pianos, organs, and synthe-

sizers can have as few as twelve or twenty-four keys, but these are spe-

cial cases. The lowest note on a standard piano vibrates with a frequency

of 27.5 Hz. Interestingly, this is about the same rate of motion that con-

stitutes an important threshold in visual perception. A sequence of still

photographs—slides—displayed at or about this rate of presentation

will give the illusion of motion. “Motion pictures” are a sequence of still

images alternating with pieces of black film presented at a rate (one

forty-eighth of a second) that exceeds the temporal resolving properties

of the human visual system. We perceive smooth, continuous motion

when in fact there is no such thing actually being shown to us. When

molecules vibrate at around this speed we hear something that sounds

like a continuous tone. If you put playing cards in the spokes of your bi-

cycle wheel when you were a kid, you demonstrated to yourself a related

principle: At slow speeds, you simply hear the click-click-click of the

card hitting the spokes. But above a certain speed, the clicks run to-

gether and create a buzz, a tone you can actually hum along with; a pitch.

When this lowest note on the piano plays, and vibrates at 27.5 Hz, to

most people it lacks the distinct pitch of sounds toward the middle of the

keyboard. At the lowest and the highest ends of the piano keyboard, the

notes sound fuzzy to many people with respect to their pitch. Composers

know this, and they either use these notes or avoid them depending on

what they are trying to accomplish compositionally and emotionally.

Sounds with frequencies above the highest note on the piano keyboard,

around 6000 Hz and more, sound like a high-pitched whistling to most

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 24

people. Above 20,000 Hz most humans don’t hear a thing, and by the age

of sixty, most adults can’t hear much above 15,000 Hz or so due to a stiff-

ening of the hair cells in the inner ear. So when we talk about the range

of musical notes, or that restricted part of the piano keyboard that con-

veys the strongest sense of pitch, we are talking about roughly three

quarters of the notes on the piano keyboard, between about 55 Hz and

2000 Hz.

Pitch is one of the primary means by which musical emotion is con-

veyed. Mood, excitement, calm, romance, and danger are signaled by a

number of factors, but pitch is among the most decisive. A single high

note can convey excitement, a single low note sadness. When notes are

strung together, we get more powerful and more nuanced musical state-

ments. Melodies are defined by the pattern or relation of successive

pitches across time; most people have no trouble recognizing a melody

that is played in a higher or lower key than they’ve heard it in before. In

fact, many melodies do not have a “correct” starting pitch, they just float

freely in space, starting anywhere. “Happy Birthday” is an example of

this. One way to think about a melody, then, is as an abstract prototype

that is derived from specific combinations of key, tempo, instrumenta-

tion, and so on. A melody is an auditory object that maintains its identity

in spite of transformations, just as a chair maintains its identity when

you move it to the other side of the room, turn it upside down, or paint it

red. So, for example, if you hear a song played louder than you are ac-

customed to, you still identify it as the same song. The same holds for

changes in the absolute pitch values of the song, which can be changed

so long as the relative distances between them remain the same.

The notion of relative pitch values is seen readily in the way that we

speak. When you ask someone a question, your voice naturally rises in

intonation at the end of the sentence, signaling that you are asking. But

you don’t try to make the rise in your voice match a specific pitch. It is

enough that you end the sentence somewhat higher in pitch than you be-

gan it. This is a convention in English (though not in all languages—we

have to learn it), and is known in linguistics as a prosodic cue. There are

similar conventions for music written in the Western tradition. Certain

What Is Music? 25

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 25

sequences of pitches evoke calm, others, excitement. The brain basis for

this is primarily based on learning, just as we learn that a rising intona-

tion indicates a question. All of us have the innate capacity to learn the

linguistic and musical distinctions of whatever culture we are born into,

and experience with the music of that culture shapes our neural path-

ways so that we ultimately internalize a set of rules common to that mu-

sical tradition.

Different instruments use different parts of the range of available

pitches. The piano has the largest range of any instrument, as you can

see from the previous illustration. The other instruments each use a sub-

set of the available pitches, and this influences the ways that instruments

are used to communicate emotion. The piccolo, with its high-pitched,

shrill, and birdlike sound, tends to evoke flighty, happy moods regardless

of the notes it’s playing. Because of this, composers tend to use the pic-

colo for happy music, or rousing music, as in a Sousa march. Similarly, in

Peter and the Wolf, Prokofiev uses the flute to represent the bird, and

the French horn to indicate the wolf. The characters’ individuality in

Peter and the Wolf is expressed in the timbres of different instruments

and each has a leitmotiv—an associated melodic phrase or figure that

accompanies the reappearance of an idea, person, or situation. (This is

especially true of Wagnerian music drama.) A composer who picks so-

called sad pitch sequences would only give these to the piccolo if he

were trying to be ironic. The lumbering, deep sounds of the tuba or

double bass are often used to evoke solemnity, gravity, or weight.

How many unique pitches are there? Because pitch comes from a

continuum—the vibration frequencies of molecules—there are techni-

cally an infinite number of pitches: For every pair of frequencies you

mention, I could always come up with one between them, and a theoret-

ically different pitch would exist. But not every change in frequency

gives rise to a noticeable difference in pitch, just as adding a grain of

sand to your backpack will not change the weight perceptibly. So not all

frequency changes are musically useful. People differ in their ability to

detect small changes in frequency; training can help, but generally

speaking, most cultures don’t use distances much smaller than a semi-

26 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 26

tone as the basis for their music, and most people can’t reliably detect

changes smaller than about one tenth of a semitone.

The ability to detect differences in pitch is based on physiology, and

varies from one animal to another. The basilar membrane of the human

inner ear contains hair cells that are frequency selective, firing only in

response to a certain band of frequencies. These are stretched out

across the membrane from low frequencies to high; low-frequency

sounds excite hair cells on one end of the basilar membrane, medium

frequency sounds excite the hair cells in the middle, and high-frequency

sounds excite them at the other end. We can think of the membrane as

containing a map of different pitches very much like a piano keyboard

superimposed on it. Because the different tones are spread out across

the surface topography of the membrane, this is called a tonotopic map.

After sounds enter the ear, they pass by the basilar membrane, where

certain hair cells fire, depending on the frequency of the sounds. The

membrane acts like a motion-detector lamp you might have in your gar-

den; activity in a certain part of the membrane causes it to send an elec-

trical signal on up to the auditory cortex. The auditory cortex also has a

tonotopic map, with low to high tones stretched out across the cortical

surface. In this sense, the brain contains a “map” of different pitches, and

different areas of the brain respond to different pitches. Pitch is so im-

portant that the brain represents it directly; unlike almost any other mu-

sical attribute, we could place electrodes in the brain and be able to

determine what pitches were being played to a person just by looking at

the brain activity. And although music is based on pitch relations rather

than absolute pitch values, it is, paradoxically, these absolute pitch val-

ues that the brain is paying attention to throughout its different stages of

processing.

A scale is just a subset of the theoretically infinite number of pitches, and

every culture selects these based on historical tradition or somewhat ar-

bitrarily. The specific pitches chosen are then anointed as being part of

that musical system. These are the letters that you see in the figure

above. The names “A,” “B,” “C,” and so on are arbitrary labels that we as-

What Is Music? 27

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 27

sociate with particular frequencies. In Western music—music of the Eu-

ropean tradition—these pitches are the only “legal” pitches; most instru-

ments are designed to play these pitches and not others. (Instruments

like the trombone and cello are an exception, because they can slide be-

tween notes; trombonists, cellists, violinists, etc., spend a lot of time

learning how to hear and produce the precise frequencies required to

play each of the legal notes.) Sounds in between are considered mis-

takes (“out of tune”) unless they’re used for expressive intonation (in-

tentionally playing something out of tune, briefly, to add emotional

tension) or in passing from one legal tone to another.

Tuning refers to the precise relationship between the frequency of a

tone being played and a standard, or between two or more tones being

played together. Orchestral musicians “tuning up” before a performance

are synchronizing their instruments (which naturally drift in their tuning

as the wood, metal, strings, and other materials expand and contract

with changes in temperature and humidity) to a standard frequency, or

occasionally not to a standard but to each other. Expert musicians often

alter the frequency of tones while they’re playing for expressive pur-

poses (except, of course, on fixed-pitch instruments such as keyboards

and xylophones); sounding a note slightly lower or higher than its nomi-

nal value can impart emotion when done skillfully. Expert musicians

playing together in ensembles will also alter the pitch of tones they play

to bring them more in tune with the tones being played by the other mu-

sicians, should one or more musicians drift away from standard tuning

during the performance.

The note names in Western music run from A to G, or, in an alterna-

tive system, as Do - re - mi - fa - sol - la - ti - do (the alternate system is

used as lyrics to the Rodgers and Hammerstein song “Do-Re-Mi” from

The Sound of Music: “Do, a deer, a female deer, Re, a drop of golden

sun . . .”). As frequencies get higher, so do the letter names; B has a

higher frequency than A (and hence a higher pitch) and C has a higher

frequency than either A or B. After G, the note names start all over again

at A. Notes with the same name have frequencies that are multiples of

each other. One of the several notes we call A has a frequency of 55 Hz

28 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 28

and all other notes called A have frequencies that are two, three, four,

five (or a half) times this frequency.

Here is a fundamental quality of music. Note names repeat because of

a perceptual phenomenon that corresponds to the doubling and halving

of frequencies. When we double or halve a frequency, we end up with a

note that sounds remarkably similar to the one we started out with. This

relationship, a frequency ratio of 2:1 or 1:2, is called the octave. It is so

important that, in spite of the large differences that exist between musi-

cal cultures—between Indian, Balinese, European, Middle Eastern, Chi-

nese, and so on—every culture we know of has the octave as the basis

for its music, even if it has little else in common with other musical tra-

ditions. This phenomenon leads to the notion of circularity in pitch per-

ception, and is similar to circularity in colors. Although red and violet

fall at opposite ends of the continuum of visible frequencies of electro-

magnetic energy, we see them as perceptually similar. The same is true

in music, and music is often described as having two dimensions, one

that accounts for tones going up in frequency (and sounding higher and

higher) and another that accounts for the perceptual sense that we’ve

come back home again each time we double a tone’s frequency.

When men and women speak in unison, their voices are normally an

octave apart, even if they try to speak the exact same pitches. Children

generally speak an octave or two higher than adults. The first two notes

of the Harold Arlen melody “Somewhere Over the Rainbow” (from the

movie The Wizard of Oz) make an octave. In “Hot Fun in the Summer-

time” by Sly and the Family Stone, Sly and his backup singers are singing

in octaves during the first line of the verse “End of the spring and here

she comes back.” As we increase frequencies by playing the successive

notes on an instrument, there is a very strong perceptual sense that

when we reach a doubling of frequency, we have come “home” again. The

octave is so basic that even some animal species—monkeys and cats, for

example—show octave equivalence, the ability to treat as similar, the

way that humans do, tones separated by this amount.

An interval is the distance between two tones. The octave in Western

music is subdivided into twelve (logarithmically) equally spaced tones.

What Is Music? 29

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 29

30 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

The intervallic distance between A and B (or between “do” and “re”) is

called a whole step or a tone. (This latter term is confusing, since we call

any musical sound a tone; I’ll use the term whole step to avoid ambiguity).

The smallest division in our Western scale system cuts a whole step per-

ceptually in half: This is the semitone, which is one twelfth of an octave.

Intervals are the basis of melody, much more so than the actual

pitches of notes; melody processing is relational, not absolute, meaning

that we define a melody by its intervals, not the actual notes used to cre-

ate them. Four semitones always create the interval known as a major

third regardless of whether the first note is an A or a G# or any other

note. Here is a table of the intervals as they’re known in our (Western)

musical system:

The table could continue on: Thirteen semitones is a minor ninth,

Distance in semitones Interval name

0 unison

1 minor second

2 major second

3 minor third

4 major third

5 perfect fourth

6 augmented fourth, diminished fifth, or tritone

7 perfect fifth

8 minor sixth

9 major sixth

10 minor seventh

11 major seventh

12 octave

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 30

fourteen semitones is a major ninth, etc., but these names are typically

used only in more advanced discussions. The intervals of the perfect

fourth and perfect fifth are so called because they sound particularly

pleasing to many people, and since the ancient Greeks, this particular

feature of the scale is at the heart of all music. (There is no “imperfect

fifth,” this is just the name we give the interval.) Ignore the perfect fourth

and fifth or use them in every phrase, they have been the backbone of

music for at least five thousand years.

Although the areas of the brain that respond to individual pitches

have been mapped, we have not yet been able to find the neurological ba-

sis for the encoding of pitch relations; we know which part of the cortex

is involved in listening to the notes C and E, for example, and for F and

A, but we do not know how or why both intervals are perceived as a ma-

jor third, or the neural circuits that create this perceptual equivalency.

These relations must be extracted by computational processes in the

brain that remain poorly understood.

If there are twelve named notes within an octave, why are there only

seven letters (or do-re-mi syllables)? After centuries of being forced to

eat in the servants’ quarters and to use the back entrance of the castle,

this may just be an invention by musicians to make nonmusicians feel in-

adequate. The additional five notes have compound names, such as E♭ pronounced “E-flat”) and F# (pronounced “F-sharp”). There is no reason

for the system to be so complicated, but it is what we’re stuck with.

The system is a bit clearer looking at the piano keyboard. A piano has

white keys and black keys spaced out in an uneven arrangement—some-

times two white keys are adjacent, sometimes they have a black key

between them. Whether the keys are white or black, the perceptual dis-

tance from one adjacent key to the next always makes a semitone, and a

distance of two keys is always a whole step. This applies to many West-

ern instruments; the distance between one fret on a guitar and the next

is also a semitone, and pressing or lifting adjacent keys on woodwind in-

struments (such as the clarinet or oboe) typically changes the pitch by a

semitone.

What Is Music? 31

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 31

The white keys are named A, B, C, D, E, F, and G. The notes be-

tween—the black keys—are the ones with compound names. The note

between A and B is called either A-sharp or B-flat, and in all but formal

music theoretic discussions, the two terms are interchangeable. (In fact,

this note could also be referred to as C double-flat, and similarly, A could

be called G double-sharp, but this is an even more theoretical usage.)

Sharp means high, and flat means low. B-flat is the note one semitone

lower than B; A-sharp is the note one semitone higher than A. In the par-

allel do-re-mi system, unique syllables mark these other tones: di and ra

indicate the tone between do and re, for example.

The notes with compound names are not in any way second-class mu-

sical citizens. They are just as important, and in some songs and some

scales they are used exclusively. For example, the main accompaniment

to “Superstition” by Stevie Wonder is played on only the black keys of

the keyboard. The twelve tones taken together, plus their repeating

cousins one or more octaves apart, are the basic building blocks for

melody, for all the songs in our culture. Every song you know, from

“Deck the Halls” to “Hotel California,” from “Ba Ba Black Sheep” to the

theme from Sex and the City, is made up from a combination of these

twelve tones and their octaves.

To add to the confusion, musicians also use the terms sharp and flat

to indicate if someone is playing out of tune; if the musician plays the

tone a bit too high (but not so high as to make the next note in the scale)

we say that the tone being played is sharp, and if the musician plays the

tone too low we say that the tone is flat. Of course, a musician can be

only slightly off and nobody would notice. But when the musician is off

by a relatively large amount—say one quarter to one half the distance be-

tween the note she was trying to play and the next one—most of us can

usually detect this and it sounds off. This is especially apparent when

there is more than one instrument playing, and the out-of-tune tone we

are hearing clashes with in-tune tones being played simultaneously by

other musicians.

The names of pitches are associated with particular frequency values.

Our current system is called A440 because the note we call A that is in

32 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 32

the middle of the piano keyboard has been fixed to have a frequency of

440 Hz. This is entirely arbitrary. We could fix A at any frequency, such as

439, 444, 424, or 314.159; different standards were used in the time of

Mozart than today. Some people claim that the precise frequencies affect

the overall sound of a musical piece and the sound of instruments. Led

Zeppelin often tuned their instruments away from the modern A440 stan-

dard to give their music an uncommon sound, and perhaps to link it with

the European children’s folk songs that inspired many of their composi-

tions. Many purists insist on hearing baroque music on period instru-

ments, both because the instruments have a different sound and because

they are designed to play the music in its original tuning standard, some-

thing that purists deem important.

We can fix pitches anywhere we want because what defines music is

a set of pitch relations. The specific frequencies for notes may be arbi-

trary, but the distance from one frequency to the next—and hence from

one note to the next in our musical system—isn’t at all arbitrary. Each

note in our musical system is equally spaced to our ears (but not neces-

sarily to the ears of other species). Although there is not an equal change

in cycles per second (Hz) as we climb from one note to the next, the dis-

tance between each note and the next sounds equal. How can this be?

The frequency of each note in our system is approximately 6 percent

more than the one before it. Our auditory system is sensitive both to rel-

ative changes and to proportional changes in sound. Thus, each increase

in frequency of 6 percent gives us the impression that we have increased

pitch by the same amount as we did last time.

The idea of proportional change is intuitive if you think about

weights. If you’re at a gym and you want to increase your weight lifting

of the barbells from 5 pounds to 50 pounds, adding 5 pounds each week

is not going to change the amount of weight you’re lifting in an equal

way. After a week of lifting 5 pounds, when you move to 10 you are dou-

bling the weight; the next week when you move to 15 you are adding 1.5

times as much weight as you had before. An equal spacing—to give your

muscles a similar increase of weight each week—would be to add a con-

stant percentage of the previous week’s weight each time you increase.

What Is Music? 33

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 33

For example, you might decide to add 50 percent each week, and so you

would then go from 5 pounds to 7.5, then to 11.25, then to 16.83, and so

on. The auditory system works the same way, and that is why our scale

is based on a proportion: Every tone is 6 percent higher than the previ-

ous one, and when we increase each step by 6 percent twelve times, we

end up having doubled our original frequency (the actual proportion is

the twelfth root of two = 1.059463 . . . ).

The twelve notes in our musical system are called the chromatic

scale. Any scale is simply a set of musical pitches that have been chosen

to be distinguishable from each other and to be used as the basis for con-

structing melodies.

In Western music we rarely use all the notes of chromatic scale in

composition; instead, we use a subset of seven (or less often, five) of

those twelve tones. Each of these subsets is itself a scale, and the type of

scale we use has a large impact on the overall sound of a melody, and its

emotional qualities. The most common subset of seven tones used in

Western music is called the major scale, or Ionian mode (reflecting its

ancient Greek origins). Like all scales, it can start on any of the twelve

notes, and what defines the major scale is the specific pattern or distance

relationship between each note and its successive note. In any major

scale, the pattern of intervals—pitch distances between successive keys—

is: whole step, whole step, half step, whole step, whole step, whole step,

half step.

Starting on C, the major scale notes are C - D - E - F - G - A - B - C, all

white notes on the piano keyboard. All other major scales require one or

more black notes to maintain the required whole step/half step pattern.

The starting pitch is also called the root of the scale.

The particular placement of the two half steps in the sequence of the

major is crucial; it is not only what defines the major scale and distin-

guishes it from other scales, but it is an important ingredient in musical

expectations. Experiments have shown that young children, as well as

adults, are better able to learn and memorize melodies that are drawn

from scales that contain unequal distances such as this. The presence of

the two half steps, and their particular positions, orient the experienced,

34 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 34

acculturated listener to where we are in the scale. We are all experts in

knowing, when we hear a B in the key of C—that is, when the tones are

being drawn primary from the C major scale—that it is the seventh note

(or “degree”) of that scale, and that it is only a half step below the root,

even though most of us can’t name the notes, and may not even know

what a root or a scale degree is. We have assimilated the structure of this

and other scales through a lifetime of listening and passive (rather than

theoretically driven) exposure to the music. This knowledge is not in-

nate, but is gained through experience. By a similar token, we don’t need

to know anything about cosmology to have learned that the sun comes

up every morning and goes down at night—we have learned this se-

quence of events through largely passive exposure.

Different patterns of whole steps and half steps give rise to alterna-

tive scales, the most common of which (in our culture) is the minor

scale. There is one minor scale that, like the C major scale, uses only the

white notes of the piano keyboard: the A minor scale. The pitches for

that scale are A - B - C - D - E - F - G - A. (Because it uses the same set of

pitches, but in a different order, A minor is said to be the “relative minor

of the C major scale.”) The pattern of whole steps and half steps is

different from that of the major scale: whole–half–whole–whole–half–

whole–whole. Notice that the placement of the half steps is very differ-

ent than in the major scale; in the major scale, there is a half step just

before the root that “leads” to the root, and another half step just before

the fourth scale degree. In the minor scale, the half steps are before the

third scale degree and before the sixth. There is still a momentum when

we’re in this scale to return to the root, but the chords that create this

momentum have a clearly different sound and emotional trajectory.

Now you might well ask: If these two scales use exactly the same set

of pitches, how do I know which one I’m in? If a musician is playing the

white keys, how do I know if he is playing the A minor scale or the C ma-

jor scale? The answer is that—entirely without our conscious aware-

ness—our brains are keeping track of how many times particular notes

are sounded, where they appear in terms of strong versus weak beats,

and how long they last. A computational process in the brain makes an

What Is Music? 35

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 35

inference about the key we’re in based on these properties. This is an-

other example of something that most of us can do even without musical

training, and without what psychologists call declarative knowledge—

the ability to talk about it; but in spite of our lack of formal musical edu-

cation, we know what the composer intended to establish as the tonal

center, or key, of the piece, and we recognize when he brings us back

home to the tonic, or when he fails to do so. The simplest way to estab-

lish a key, then, is to play the root of the key many times, play it loud, and

play it long. And even if a composer thinks he is writing in C major, if he

has the musicians play the note A over and over again, play it loud and

play it long; if the composer starts the piece on an A and ends the piece

on an A, and moreover, if he avoids the use of C, the audience, musi-

cians, and music theorists are most probably going to decide that the

piece is in A minor, even if this was not his intent. In musical keys as in

speeding tickets, it is the observed action, not the intention, that counts.

For reasons that are largely cultural, we tend to associate major

scales with happy or triumphant emotions, and minor scales with sad or

defeated emotions. Some studies have suggested that the associations

might be innate, but the fact that these are not culturally universal indi-

cates that, at the very least, any innate tendency can be overcome by

exposure to specific cultural associations. Western music theory recog-

nizes three minor scales and each has a slightly different flavor. Blues

music generally uses a five note (pentatonic) scale that is a subset of the

minor scale, and Chinese music uses a different pentatonic scale. When

Tchaikovsky wants us to think of Arab or Chinese culture in the Nut-

cracker ballet, he chooses scales that are typical to their music, and

within just a few notes we are transported to the Orient. When Billie Hol-

iday wants to make a standard tune bluesy, she invokes the blues scale

and sings notes from a scale that we are not accustomed to hearing in

standard classical music.

Composers know these associations and use them intentionally. Our

brains know them, too, through a lifetime of exposure to musical idioms,

patterns, scales, lyrics, and the associations between them. Each time

we hear a musical pattern that is new to our ears, our brains try to make

36 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 36

an association through whatever visual, auditory and other sensory cues

accompany it; we try to contextualize the new sounds, and eventually,

we create these memory links between a particular set of notes and a

particular place, time, or set of events. No one who has seen Hitchcock’s

Psycho can hear Bernard Hermann’s screeching violins without thinking

of the shower scene; anyone who has ever seen a Warner Bros. “Merrie

Melody” cartoon will think of a character sneakily climbing stairs when-

ever they hear plucked violins playing an ascending major scale. The

associations are so powerful—and the scales distinguishable enough—

that only a few notes are needed: The first three notes of David Bowie’s

“China Girl” or Mussorgsky’s “Great Gate of Kiev” (from Pictures at an

Exhibition) instantly convey a rich and foreign (to us) musical context.

Nearly all this variation in context and sound comes from different

ways of dividing up the octave and, in virtually every case we know of,

dividing it up into no more than twelve tones. Although it has been

claimed that Indian and Arab-Persian music use “microtuning”—scales

with intervals much smaller than a semitone—close analysis reveals that

their scales also rely on twelve or fewer tones and the others are simply

expressive variations, glissandos (continuous glides from one tone to

another), and momentary passing tones, similar to the American blues

tradition of sliding into a note for emotional purposes.

In any scale, a hierarchy of importance exists among scale tones;

some are more stable, structurally significant, or final sounding than oth-

ers, causing us to feel varying amounts of tension and resolution. In the

major scale, the most stable tone is the first degree, also called the tonic.

In other words, all other tones in the scale seem to point toward the

tonic, but they point with varying momentum. The tone that points most

strongly to the tonic is the seventh scale degree, B in a C major scale.

The tone that points least strongly to the tonic is the fifth scale degree, G

in the C major scale, and it points least strongly because it is perceived

as relatively stable; this is just another way of saying that we don’t feel

uneasy—unresolved—if a song ends on the fifth scale degree. Music the-

ory specifies this tonal hierarchy. Carol Krumhansl and her colleagues

performed a series of studies establishing that ordinary listeners have

What Is Music? 37

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 37

incorporated the principles of this hierarchy in their brains, through pas-

sive exposure to music and cultural norms. By asking people to rate how

well different tones seemed to fit with a scale she would play them, she

recovered from their subjective judgments the theoretical hierarchy.

A chord is simply a group of three or more notes played at the same

time. They are generally drawn from one of the commonly used scales,

and the three notes are chosen so that they convey information about

the scale they were taken from. A typical chord is built by playing the

first, third, and fifth notes of a scale together. Because the sequence of

whole steps and half steps is different for minor and major scales, the in-

terval sizes are different for chords taken in this way from the two dif-

ferent scales. If we build a chord starting on C and use the tones from the

C major scale, we use C, E, and G. If instead we use the C minor scale,

the first, third, and fifth notes are C, E-flat, and G. This difference in the

third degree, between E and E-flat, turns the chord itself from a major

chord into a minor chord. All of us, even without musical training, can

tell the difference between these two even if we don’t have the terminol-

ogy to name them; we hear the major chord as sounding happy and the

minor chord as sounding sad, or reflective, or even exotic. The most ba-

sic rock and country music songs use only major chords: “Johnny B.

Goode,” “Blowin’ in the Wind,” “Honky Tonk Women,” and “Mammas

Don’t Let Your Babies Grow Up to Be Cowboys,” for example.

Minor chords add complexity; in “Light My Fire” by the Doors, the

verses are played in minor chords (“You know that it would be un-

true . . .”) and then the chorus is played in major chords (“Come on baby,

light my fire”). In “Jolene,” Dolly Parton mixes minor and major chords

to give a melancholy sound. Pink Floyd’s “Sheep” (from the album Ani-

mals) uses only minor chords.

Like single notes in the scale, chords also fall along a hierarchy of sta-

bility, depending on context. Certain chord progressions are part of

every musical tradition, and even by the age of five, most children have

internalized rules about what chord progressions are legal, or typical of

their culture’s music; they can readily detect deviations from the stan-

dard sequences just as easily as we can detect when an English sentence

38 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 38

is malformed, such as this one: “The pizza was too hot to sleep.” For

brains to accomplish this, networks of neurons must form abstract rep-

resentations of musical structure, and musical rules, something that they

do automatically and without our conscious awareness. Our brains are

maximally receptive—almost spongelike—when we’re young, hungrily

soaking up any and all sounds they can and incorporating them into the

very structure of our neural wiring. As we age, these neural circuits are

somewhat less pliable, and so it becomes more difficult to incorporate,

at a deep neural level, new musical systems, or even new linguistic

systems.

Now the story about pitch becomes a bit more complicated, and it’s all

the fault of physics. But this complication gives rise to the rich spectrum

of sounds we hear in different instruments. All natural objects in the

world have several modes of vibration. A piano string actually vibrates at

several different rates at once. The same thing is true of bells that we hit

with a hammer, drums that we hit with our hands, or flutes that we blow

air into: The air molecules vibrate at several rates simultaneously, not

just a single rate.

An analogy is the several types of motion of the earth that are simul-

taneously occurring. We know that the earth spins on its axis once every

twenty-four hours, that it travels around the sun once every 365.25 days,

and that the entire solar system is spinning along with the Milky Way

galaxy. Several types of motion, all occurring at once. Another analogy is

the many kinds of vibration that we often feel when riding a train. Imag-

ine that you’re sitting on a train in an outdoor station, with the engine off.

It’s windy, and you feel the car rock back and forth just a little bit. It does

so with a regularity that you can time with your handy stopwatch, and

you feel the train moving back and forth about twice a second. Next, the

engineer starts the engine, and you feel a different kind of vibration

through your seat (due to the oscillations of the motor—pistons and

crankshafts turning around at a certain speed). When the train starts

moving, you experience a third sensation, the bump the wheels make

every time they go over a track joint. Altogether, you will feel several dif-

What Is Music? 39

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 39

ferent kinds of vibrations, all of them likely to be at different rates, or fre-

quencies. When the train is moving, you are no doubt aware that there is

vibration. But it is very difficult, if not impossible, for you to determine

how many vibrations there are and what their rates are. Using specialized

measuring instruments, however, one might be able to figure this out.

When a sound is generated on a piano, flute, or any other instru-

ment—including percussion instruments like drums and cowbells—it

produces many modes of vibration occurring simultaneously. When you

listen to a single note played on an instrument, you’re actually hearing

many, many pitches at once, not a single pitch. Most of us are not aware

of this consciously, although some people can train themselves to hear

this. The one with the slowest vibration rate—the one lowest in pitch—

is referred to as the fundamental frequency, and the others are collec-

tively called overtones.

To recap, it is a property of objects in the world that they generally vi-

brate at several different frequencies at once. Surprisingly, these other

frequencies are often mathematically related to each other in a very sim-

ple way: as integer multiples of one another. So if you pluck a string and

its slowest vibration frequency is one hundred times per second, the

other vibration frequencies will be 2 x 100 (200 Hz), 3 x 100 Hz (300 Hz),

etc. If you blow into a flute or recorder and cause vibrations at 310 Hz,

additional vibrations will be occurring at twice, three times, four times,

etc., this rate: 620 Hz, 930 Hz, 1240 Hz, etc. When an instrument creates

energy at frequencies that are integer multiples such as this, we say that

the sound is harmonic, and we refer to the pattern of energy at different

frequencies as the overtone series. There is evidence that the brain re-

sponds to such harmonic sounds with synchronous neural firings—the

neurons in auditory cortex responding to each of the components of the

sound synchronize their firing rates with one another, creating a neural

basis for the coherence of these sounds.

The brain is so attuned to the overtone series that if we encounter a

sound that has all of the components except the fundamental, the brain

fills it in for us in a phenomenon called restoration of the missing fun-

damental. A sound composed of energy at 100 Hz, 200 Hz, 300 Hz, 400

40 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 40

Hz, and 500 Hz is perceived as having a pitch of 100 Hz, its fundamental

frequency. But if we artificially create a sound with energy at 200 Hz, 300

Hz, 400 Hz, and 500 Hz (leaving off the fundamental), we still perceive it

as having a pitch of 100 Hz. We don’t perceive it as having a pitch of 200

Hz, because our brain “knows” that a normal, harmonic sound with a

pitch of 200 Hz would have an overtone series of 200 Hz, 400 Hz, 600 Hz,

800 Hz, etc. We can also fool the brain by playing sequences that deviate

from the overtone series such as this: 100 Hz, 210 Hz, 302 Hz, 405 Hz, etc.

In cases like these, the perceived pitch shifts away from 100 Hz in a com-

promise between what is presented and what a normal harmonic series

would imply.

When I was in graduate school, my advisor, Mike Posner, told me

about the work of a graduate student in biology, Petr Janata. Although he

hadn’t been raised in San Francisco like me, Petr had long bushy hair

that he wore in a ponytail, played jazz and rock piano, and dressed in tie-

dye: a true kindred spirit. Peter placed electrodes in the inferior collicu-

lus of the barn owl, part of its auditory system. Then, he played the owls

a version of Strauss’s “The Blue Danube Waltz” made up of tones from

which the fundamental frequency had been removed. Petr hypothesized

that if the missing fundamental is restored at early levels of auditory pro-

cessing, neurons in the owl’s inferior colliculus should fire at the rate of

the missing fundamental. This was exactly what he found. And because

the electrodes put out a small electrical signal with each firing—and be-

cause the firing rate is the same as a frequency of firing—Petr sent the

output of these electrodes to a small amplifier, and played back the

sound of the owl’s neurons through a loudspeaker. What he heard was

astonishing; the melody of “The Blue Danube Waltz” sang clearly from

the loudspeakers: ba da da da da, deet deet, deet deet. We were hearing

the firing rates of the neurons and they were identical to the frequency

of the missing fundamental. The overtone series had an instantiation not

just in the early levels of auditory processing, but in a completely differ-

ent species.

One could imagine an alien species that does not have ears, or that

doesn’t have the same internal experience of hearing that we do. But it

What Is Music? 41

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 41

would be difficult to imagine an advanced species that had no ability

whatsoever to sense vibrating objects. Where there is atmosphere there

are molecules that vibrate in response to movement. And knowing

whether something is generating noise or moving toward us or away

from us, even when we can’t see it (because it is dark, our eyes aren’t at-

tending to it, or we’re asleep) has a great survival value.

Because most physical objects cause molecules to vibrate in several

modes at once, and because for many, many objects the modes bear sim-

ple integer relations to one another, the overtone series is a fact-of-the-

world that we expect to find everywhere we look: in North America, in

Fiji, on Mars, and on the planets orbiting Antares. Any organism that

evolved in a world with vibrating objects is likely—given enough evolu-

tionary time—to have evolved a processing unit in the brain that incor-

porated these regularities of its world. Because pitch is a fundamental

cue to an object’s identity, we would expect to find tonotopic mappings

as we do in human auditory cortex, and synchronous neural firings for

tones that bear octave and other harmonic relations to one another; this

would help the brain (alien or terrestrial) to figure out that all these

tones probably originated from the same object.

The overtones are often referred to by numbers: The first overtone is

the first vibration frequency above the fundamental, the second over-

tone is the second vibration frequency above the fundamental, etc. Be-

cause physicists like to make the world confusing for the rest of us, there

is a parallel system of terminology called harmonics, and I think it was

designed to make undergraduates go crazy. In the lingo of harmonics,

the first harmonic is the fundamental frequency, the second harmonic is

equal to the first overtone, and so on. Not all instruments vibrate in

modes that are so neatly defined. Sometimes, as with the piano (because

it is a percussive instrument), the overtones can be close, but not exact,

multiples of the fundamental frequency, and this contributes to their

characteristic sound. Percussion instruments, chimes, and other objects—

depending on composition and shape—often have overtones that are

clearly not integer multiples of the fundamental, and these are called

partials or inharmonic overtones. Generally, instruments with inhar-

42 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 42

monic overtones lack the clear sense of pitch that we associate with har-

monic instruments, and the cortical basis for this may relate to a lack of

synchronous neural firing. But they still do have a sense of pitch, and we

hear this most clearly when we can play inharmonic notes in succession.

Although you may not be able to hum along with the sound of a single

note played on a woodblock or a chime, we can play a recognizable

melody on a set of woodblocks or chimes because our brain focuses on

the changes in the overtones from one to another. This is essentially

what is happening when we hear people playing a song on their cheeks.

A flute, a violin, a trumpet, and a piano can all play the same tone—

that is, you can write a note on a musical score and each instrument will

play a tone with an identical fundamental frequency, and we will (tend

to) hear an identical pitch. But these instruments all sound very different

from one another.

This difference is timbre (pronounced TAM-ber), and it is the most

important and ecologically relevant feature of auditory events. The tim-

bre of a sound is the principal feature that distinguishes the growl of a

lion from the purr of a cat, the crack of thunder from the crash of ocean

waves, the voice of a friend from that of a bill collector one is trying to

dodge. Timbral discrimination is so acute in humans that most of us can

recognize hundreds of different voices. We can even tell whether some-

one close to us—our mother, our spouse—is happy or sad, healthy or

coming down with a cold, based on the timbre of that voice.

Timbre is a consequence of the overtones. Different materials have

different densities. A piece of metal will tend to sink to the bottom of a

pond; an identically sized and shaped piece of wood will float. Partly due

to density, and partly due to size and shape, different objects also make

different noises when you strike them with your hand, or gently tap them

with a hammer. Imagine the sound that you’d hear if you tap a hammer

(gently, please!) against a guitar—a hollow, wooden plunk sound. Or if

you tap a piece of metal, like a saxophone—a tinny plink. When you tap

these objects, the energy from the hammer causes the molecules within

them to vibrate, to dance at several different frequencies, frequencies

determined by the material the object is made out of, its size, and its

What Is Music? 43

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 43

shape. If the object is vibrating at, say, 100 Hz, 200 Hz, 300 Hz, 400 Hz,

etc., the intensity of vibration doesn’t have to be the same for each of

these harmonics, and in fact, typically, it is not.

When you hear a saxophone playing a tone with a fundamental fre-

quency of 220 Hz, you are actually hearing many tones, not just one. The

other tones you hear are integer multiples of the fundamental: 440, 660,

880, 1200, 1420, 1640, etc. These different tones—the overtones—have

different intensities, and so we hear them as having different loudnesses.

The particular pattern of loudnesses for these tones is distinctive of the

saxophone, and they are what give rise to its unique tonal color, its

unique sound—its timbre. A violin playing the same written note (220

Hz) will have overtones at the same frequencies, but the pattern of how

loud each one is with respect to the others will be different. Indeed, for

each instrument, there exists a unique pattern of overtones. For one in-

strument, the second overtone might be louder than in another, while the

fifth overtone might be softer. Virtually all of the tonal variation we

hear—the quality that gives a trumpet its trumpetiness and that gives a

piano its pianoness—comes from the unique way in which the loud-

nesses of the overtones are distributed.

Each instrument has its own overtone profile, which is like a finger-

print. It is a complicated pattern that we can use to identify the instru-

ment. Clarinets, for example, are characterized by having relatively high

amounts of energy in the odd harmonics—three times, five times, and

seven times the multiples of the fundamental frequency, etc. (This is a

consequence of their being a tube that is closed at one end and open at

the other.) Trumpets are characterized by having relatively even

amounts of energy in both the odd and the even harmonics (like the clar-

inet, the trumpet is also closed at one end and open at the other, but the

mouthpiece and bell are designed to smooth out the harmonic series). A

violin that is bowed in the center will yield mostly odd harmonics and ac-

cordingly can sound similar to a clarinet. But bowing one third of the

way down the instrument emphasizes the third harmonic and its multi-

ples: the sixth, the ninth, the twelfth, etc.

All trumpets have a timbral fingerprint, and it is readily distinguish-

44 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 44

able from the timbral fingerprint for a violin, piano, or even the human

voice. To the trained ear, and to most musicians, there even exist differ-

ences among trumpets—all trumpets don’t sound alike, nor do all pianos

or all accordions. (Well, to me all accordions sound alike, and the sweet-

est, most enjoyable sound I can imagine is the sound they would make

burning in a giant bonfire.) What distinguishes one particular piano from

another is that their overtone profiles will differ slightly from each other,

but not, of course, as much as they will differ from the profile for a harp-

sichord, organ, or tuba. Master musicians can hear the difference be-

tween a Stradivarius violin and a Guarneri within one or two notes. I can

hear the difference between my 1956 Martin 000-18 acoustic guitar, my

1973 Martin D-18, and my 1996 Collings D2H very clearly; they sound like

different instruments, even though they are all acoustic guitars; I would

never confuse one with another. That is timbre.

Natural instruments—that is, acoustic instruments made out of real-

world materials such as metal and wood—tend to produce energy at sev-

eral frequencies at once because of the way the internal structure of

their molecules vibrates. Suppose that I invent an instrument that, unlike

any natural instruments we know of, produces energy at one, and only

one, frequency. Let’s call this hypothetical instrument a generator (be-

cause it can generate tones of specific frequencies). If I line up a bunch

of generators, I could set each one of them to play a specific frequency

corresponding to the overtone series for a particular instrument playing

a particular tone. I could have a bank of these generators making sounds

at 110, 220, 330, 440, 550, and 660 Hz, which would give the listener the

impression of a 110 Hz tone played by a musical instrument. Further-

more, I could control the amplitude of each of my generators and make

each of the tones play at a particular loudness, corresponding to the

overtone profile of a natural musical instrument. If I did that, the result-

ing bank of generators would approximate the sound of a clarinet, or

flute, or any other instrument I was trying to emulate.

Additive synthesis such as the above approach achieves a synthetic

version of a musical-instrument timbre by adding together elemental

sonic components of the sound. Many pipe organs, such as those found

What Is Music? 45

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 45

in churches, have a feature that will let you play around with this. On

most pipe organs you press a key (or a pedal), which sends a blast of air

through a metal pipe. The organ is constructed of hundreds of pipes of

different sizes, and each one produces a different pitch, corresponding

to its size, when air is shot through it; you can think of them as mechan-

ical flutes, in which the air is supplied by an electric motor rather than by

a person blowing. The sound that we associate with a church organ—its

particular timbre—is a function of there being energy at several different

frequencies at once, just as with other instruments. Each pipe of the or-

gan produces an overtone series, and when you press a key on the organ

keyboard, a column of air is blasted through more than one pipe at a

time, giving a very rich spectrum of sounds. These supplementary pipes,

in addition to the one that vibrates at the fundamental frequency of the

tone you’re trying to play, either produce tones that are integer multiples

of the fundamental frequency, or are closely related to it mathematically

and harmonically.

The organ player typically has control over which of these supple-

mentary pipes he wants to blow air through by pulling and pushing

levers, or drawbars, that direct the flow of air. Knowing that clarinets

have a lot of energy in the odd harmonics of the overtone series, a clever

organ player could simulate the sound of a clarinet by manipulating

drawbars in such a way as to re-create the overtone series of that instru-

ment. A little bit of 220 Hz here, a dash of 330 Hz, a dollop of 440 Hz, a

heaping helping of 550 Hz, and voilà!—you’ve cooked yourself up a rea-

sonable facsimile of an instrument.

Starting in the late 1950s, scientists began experimenting with build-

ing such synthesis capabilities into smaller, more compact electronic de-

vices, creating a family of new musical instruments known collectively

as synthesizers. By the 1960s, synthesizers could be heard on records by

the Beatles (on “Here Comes the Sun” and “Maxwell’s Silver Hammer”)

and Walter/Wendy Carlos (Switched-On Bach), followed by groups who

sculpted their sound around the synthesizer, such as Pink Floyd and

Emerson, Lake and Palmer.

46 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 46

Many of these synthesizers used additive synthesis as I’ve described

it here, and later ones used more complex algorithms such as wave guide

synthesis (invented by Julius Smith at Stanford) and FM synthesis (in-

vented by John Chowning at Stanford). But merely copying the overtone

profile, while it can create a sound reminiscent of the actual instrument,

yields a rather pale copy. There is more to timbre than just the overtone

series. Researchers still argue about what this “more” is, but it is gener-

ally accepted that, in addition to the overtone profile, timbre is defined

by two other attributes that give rise to a perceptual difference from one

instrument to another: attack and flux.

Stanford University sits on a bucolic stretch of land just south of San

Francisco and east of the Pacific Ocean. Rolling hills covered with pas-

tureland lie to the west, and the fertile Central Valley of California is just

an hour or so to the east, home of a large proportion of the world’s

raisins, cotton, oranges, and almonds. To the south, near the town of

Gilroy, are vast fields of garlic. Also to the south is Castroville, known as

the “artichoke capitol of the world.” (I once suggested to the Castroville

Chamber of Commerce that they change capitol to heart. The response

was not enthusiastic.)

Stanford has become something of a second home for computer sci-

entists and engineers who love music. John Chowning, who was well

known as an avant-garde composer, has had a professorship in the mu-

sic department there since the 1970s, and was among a group of pio-

neering composers at the time who were using the computer to create,

store, and reproduce sounds in their compositions. Chowning later be-

came the founding director of the Center for Computer Research in Mu-

sic and Acoustics at Stanford, known as CCRMA (pronounced CAR-ma;

insiders joke that the first c is silent). Chowning is warm and friendly.

When I was an undergraduate at Stanford, he would put his hand on my

shoulder and ask what I was working on. You got the feeling talking to a

student was for him an opportunity to learn something. In the early

1970s, while fiddling with the computer and with sine waves—the sorts

of artificial sounds that are made by computers and used as the building

What Is Music? 47

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 47

blocks of additive synthesis—Chowning noticed that changing the fre-

quency of these waves as they were playing created sounds that were

musical. By controlling these parameters just so, he was able to simulate

the sounds of a number of musical instruments. This new technique be-

came known as frequency modulation synthesis, or FM synthesis, and

became embedded first in the Yamaha DX9 and DX7 line of synthesizers,

which revolutionized the music industry from the moment of their intro-

duction in 1983. FM synthesis democratized music synthesis. Before FM,

synthesizers were expensive, clunky, and hard to control. Creating new

sounds took a great deal of time, experimentation, and know-how. But

with FM, any musician could obtain a convincing instrumental sound

at the touch of a button. Songwriters and composers who could not af-

ford to hire a horn section or an orchestra could now play around with

these textures and sounds. Composers and orchestrators could test out

arrangements before taking the time of an entire orchestra to see what

worked and what didn’t. New Wave bands like the Cars and the Pre-

tenders, as well as mainstream artists like Stevie Wonder, Hall and

Oates, and Phil Collins, started to use FM synthesis widely in their

recordings. A lot of what we think of as “the eighties sound” in popular

music owes its distinctiveness to the particular sound of FM synthesis.

With the popularization of FM came a steady stream of royalty income

that allowed Chowning to build up CCRMA, attracting graduate students

and top-flight faculty members. Among the first of many famous elec-

tronic music/music-psychology celebrities to come to CCRMA were

John R. Pierce and Max Mathews. Pierce had been the vice president of

research at the Bell Telephone Laboratories in New Jersey, and super-

vised the team of engineers who built and patented the transistor—and it

was Pierce who named the new device (TRANSfer resISTOR). In his dis-

tinguished career, he also is credited with inventing the traveling wave

vacuum tube, and launching the first telecommunications satellite, Tel-

star. He was also a respected science fiction writer under the pseudonym

J. J. Coupling. Pierce created a rare environment in any industry or re-

search lab, one in which the scientists felt empowered to do their best

48 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 48

and in which creativity was highly valued. At the time, the Bell Telephone

Company/AT&T had a complete monopoly on telephone service in the

U.S. and a large cash reserve. Their laboratory was something of a play-

ground for the very best and brightest inventors, engineers, and scientists

in America. In the Bell Labs “sandbox,” Pierce allowed his people to be

creative without worrying about the bottom line or the applicability of

their ideas to commerce. Pierce understood that the only way true inno-

vation can occur is when people don’t have to censor themselves and can

let their ideas run free. Although only a small proportion of those ideas

may be practical, and a smaller proportion still would become products,

those that did would be innovative, unique, and potentially very prof-

itable. Out of this environment came a number of innovations including

lasers, digital computers, and the Unix operating system.

I first met Pierce in 1990 when he was already eighty and was giving

lectures on psychoacoustics at CCRMA. Several years later, after I had

earned my Ph.D. and moved back to Stanford, we became friends and

would go out to dinner every Wednesday night and discuss research. He

once asked me to explain rock and roll music to him, something he had

never paid any attention to and didn’t understand. He knew about my

previous career in the music business, and he asked if I could come over

for dinner one night and play six songs that captured all that was impor-

tant to know about rock and roll. Six songs to capture all of rock and

roll? I wasn’t sure I could come up with six songs to capture the Beatles,

let alone all of rock and roll. The night before he called to tell me that he

had heard Elvis Presley, so I didn’t need to cover that.

Here’s what I brought to dinner:

1) “Long Tall Sally,” Little Richard

2) “Roll Over Beethoven,” the Beatles

3) “All Along the Watchtower,” Jimi Hendrix

4) “Wonderful Tonight,” Eric Clapton

5) “Little Red Corvette,” Prince

6) “Anarchy in the U.K.,” the Sex Pistols

What Is Music? 49

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 49

A couple of the choices combined great songwriters with different

performers. All are great songs, but even now I’d like to make some ad-

justments. Pierce listened and kept asking who these people were, what

instruments he was hearing, and how they came to sound the way they

did. Mostly, he said that he liked the timbres of the music. The songs

themselves and the rhythms didn’t interest him that much, but he found

the timbres to be remarkable—new, unfamiliar, and exciting. The fluid

romanticism of Clapton’s guitar solo in “Wonderful Tonight,” combined

with the soft, pillowy drums. The sheer power and density of the Sex Pis-

tols’ brick-wall-of-guitars-and-bass-and-drums. The sound of a distorted

electric guitar wasn’t all that was new to Pierce. The ways in which in-

struments were combined to create a unified whole—bass, drums, elec-

tric and acoustic guitars, and voice—that was something he had never

heard before. Timbre was what defined rock for Pierce. And it was a rev-

elation to both of us.

The pitches that we use in music—the scales—have remained essen-

tially unchanged since the time of the Greeks, with the exception of the

development—really a refinement—of the equal tempered scale during

the time of Bach. Rock and roll may be the final step in a millennium-long

musical revolution that gave perfect fourths and fifths a prominence in

music that had historically been been given only to the octave. During

this time, Western music was largely dominated by pitch. For the past

two hundred years or so, timbre has become increasingly important. A

standard component of music across all genres is to restate a melody us-

ing different instruments—from Beethoven’s Fifth and Ravel’s “Bolero”

to the Beatles’ “Michelle” and George Strait’s “All My Ex’s Live in Texas.”

New musical instruments have been invented so that composers might

have a larger palette of timbral colors from which to draw. When a coun-

try or popular singer stops singing and another instrument takes up the

melody—even without changing it in any way—we find pleasurable the

repetition of the same melody with a different timbre.

The avant-garde composer Pierre Schaeffer (pronounced Sheh-FEHR,

using your best imitation of a French accent) performed some crucial

50 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 50

experiments in the 1950s that demonstrated an important attribute of

timbre in his famous “cut bell” experiments. Schaeffer recorded a num-

ber of orchestral instruments on tape. Then, using a razor blade, he cut

the beginnings off of these sounds. This very first part of a musical in-

strument sound is called the attack; this is the sound of the initial hit,

strum, bowing, or blowing that causes the instrument to make sound.

The gesture our body makes in order to create sound from an instru-

ment has an important influence on the sound the instrument makes. But

most of that dies away after the first few seconds. Nearly all of the ges-

tures we make to produce a sound are impulsive—they involve short,

punctuated bursts of activity. In percussion instruments, the musician

typically does not remain in contact with the instrument after this initial

burst. In wind instruments and bowed instruments, on the other hand,

the musician continues to be in contact with the instrument after the ini-

tial impulsive contact—the moment when the air burst first leaves her

mouth or the bow first contacts the string; the continued blowing and

bowing has a smooth, continuous, and less impulsive quality.

The introduction of energy to an instrument—the attack phase—

usually creates energy at many different frequencies that are not related

to one another by simple integer multiples. In other words, for the brief

period after we strike, blow into, pluck, or otherwise cause an instru-

ment to start making sound, the impact itself has a rather noisy quality

that is not especially musical—more like the sound of a hammer hitting

a piece of wood, say, than like a hammer hitting a bell or a piano string,

or like the sound of wind rushing through a tube. Following the attack is

a more stable phase in which the musical tone takes on the orderly pat-

tern of overtone frequencies as the metal or wood (or other material)

that the instrument is made out of starts to resonate. This middle part of

a musical tone is referred to as the steady state—in most instances the

overtone profile is relatively stable while the sound emanates from the

instrument during this time.

After Schaeffer edited out the attack of orchestral instrument record-

ings, he played back the tape and found that it was nearly impossible for

most people to identify the instrument that was playing. Without the at-

What Is Music? 51

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 51

tack, pianos and bells sounded remarkably unlike pianos and bells, and

remarkably similar to one another. If you splice the attack of one instru-

ment onto the steady state, or body, from another, you get varied results:

In some cases, you hear an ambiguous hybrid instrument that sounds

more like the instrument that the attack came from than the one the

steady state came from. Michelle Castellengo and others have discovered

that you can create entirely new instruments this way; for example, splic-

ing a violin bow sound onto a flute tone creates a sound that strongly re-

sembles a hurdy-gurdy street organ. These experiments showed the

importance of the attack.

The third dimension of timbre—flux—refers to how the sound

changes after it has started playing. A cymbal or gong has a lot of flux—

its sound changes dramatically over the time course of its sound—while

a trumpet has less flux—its tone is more stable as it evolves. Also, in-

struments don’t sound the same across their range. That is, the timbre of

an instrument sounds different when playing high and low notes. When

Sting reaches up toward the top of his vocal range in “Roxanne” (by The

Police), his straining, reedy voice conveys a type of emotion that he can’t

achieve in the lower parts of his register, such as we hear on the opening

verse of “Every Breath You Take,” a more deliberate, longing sound. The

high part of Sting’s register pleads with us urgently as his vocal cords

strain, the low part suggests a dull aching that we feel has been going on

for a long time, but has not yet reached the breaking point.

Timbre is more than the different sounds that instruments make.

Composers use timbre as a compositional tool; they choose musical in-

struments—and combinations of musical instruments—to express par-

ticular emotions, and to convey a sense of atmosphere or mood. There is

the almost comical timbre of the bassoon in Tchaikovsky’s Nutcracker

Suite as it opens the “Chinese Dance,” and the sensuousness of Stan

Getz’s saxophone on “Here’s That Rainy Day.” Substitute a piano for the

electric guitars in the Rolling Stones’ “Satisfaction” and you’d have an

entirely different animal. Ravel used timbre as a compositional device in

Bolero, repeating the main theme over and over again with different tim-

bres; he did this after he suffered brain damage that impaired his ability

52 This Is Your Brain on Music

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33 S

34 R

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 52

to hear pitch. When we think of Jimi Hendrix, it is the timbre of his elec-

tric guitars and his voice that we are likely to recall the most vividly.

Composers such as Scriabin and Ravel talk about their works as

sound paintings, in which the notes and melodies are the equivalent of

shape and form, and the timbre is equivalent to the use of color and

shading. Several popular songwriters—Stevie Wonder, Paul Simon, and

Lindsey Buckingham—have described their compositions as sound

paintings, with timbre playing a role equivalent to the one that color does

in visual art, separating melodic shapes from one another. But one of the

things that makes music different from painting is that it is dynamic,

changing across time, and what moves the music forward are rhythm

and meter. Rhythm and meter are the engine driving virtually all music,

and it is likely that they were the very first elements used by our ances-

tors to make protomusics, a tradition we still hear today in tribal drum-

ming, and in the rituals of various preindustrial cultures. While I believe

timbre is now at the center of our appreciation of music, rhythm has held

supreme power over listeners for much longer.

What Is Music? 53

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

S 33

R 34

4th Pass Pages

18828_01_1-270_r9kp.qxd 5/23/06 3:17 PM Page 53