Society. “A few of the monkeys we watched loved apple juice, and the other monkeys loved grape juice, and so I began to wonder, what is going on inside those little monkey heads? Why do different rewards affect the brain in different ways?”
Schultz began a series of experiments to decipher how rewards work on a neurochemical level. As technology progressed, he gained access, in the 1990s, to devices similar to those used by the researchers at MIT. Rather than rats, however, Schultz was interested in monkeys like Julio, an eight-pound macaque with hazel eyes who had a very thin electrode inserted into his brain that allowed Schultz to observe neuronal activity as it occurred. [50]
One day, Schultz positioned Julio on a chair in a dimly lit room and turned on a computer monitor. Julio’s job was to touch a lever whenever colored shapes-small yellow spirals, red squiggles, blue lines-appeared on the screen. If Julio touched the lever when a shape appeared, a drop of blackberry juice would run down a tube hanging from the ceiling and onto the monkey’s lips.
Julio liked blackberry juice.
At first, Julio was only mildly interested in what was happening on the screen. He spent most of his time trying to squirm out of the chair. But once the first dose of juice arrived, Julio became very focused on the monitor. As the monkey came to understand, through dozens of repetitions, that the shapes on the screen were a cue for a routine (touch the lever) that resulted in a reward (blackberry juice), he started staring at the screen with a laserlike intensity. He didn’t squirm. When a yellow squiggle appeared, he went for the lever. When a blue line flashed, he pounced. And when the juice arrived, Julio would lick his lips contentedly.
JULIO’S REWARD RESPONSE WHEN HE RECEIVES THE JUICE
As Schultz monitored the activity within Julio’s brain, he saw a pattern emerge. Whenever Julio received his reward, his brain activity would spike in a manner that suggested he was experiencing happiness. [51] A transcript of that neurological activity shows what it looks like when a monkey’s brain says, in essence, “I got a reward!”
Schultz took Julio through the same experiment again and again, recording the neurological response each time. Whenever Julio received his juice, the “I got a reward!” pattern appeared on the computer attached to the probe in the monkey’s head. Gradually, from a neurological perspective, Julio’s behavior became a habit.
JULIO’S HABIT LOOP
What was most interesting to Schultz, however, was how things changed as the experiment proceeded. As the monkey became more and more practiced at the behavior-as the habit became stronger and stronger-Julio’s brain began
NOW, JULIO’S REWARD RESPONSE OCCURS BEFORE THE JUICE ARRIVES
In other words, the shapes on the monitor had become a cue not just for pulling a lever, but also for a pleasure response inside the monkey’s brain. Julio started expecting his reward as soon as he saw the yellow spirals and red squiggles.
Then Schultz adjusted the experiment. Previously, Julio had received juice as soon as he touched the lever. Now, sometimes, the juice didn’t arrive at all, even if Julio performed correctly. Or it would arrive after a slight delay. Or it would be watered down until it was only half as sweet.
When the juice didn’t arrive or was late or diluted, Julio would get angry and make unhappy noises, or become mopey. And within Julio’s brain, Schultz watched a new pattern emerge: craving. When Julio anticipated juice but didn’t receive it, a neurological pattern associated with desire and frustration erupted inside his skull. When Julio saw the cue, he started anticipating a juice-fueled joy. But if the juice didn’t arrive, that joy became a craving that, if unsatisfied, drove Julio to anger or depression.
Researchers in other labs have found similar patterns. Other monkeys were trained to anticipate juice whenever they saw a shape on a screen. Then, researchers tried to distract them. They opened the lab’s door, so the monkeys could go outside and play with their friends. They put food in a corner, so the monkeys could eat if they abandoned the experiment.
For those monkeys who hadn’t developed a strong habit, the distractions worked. They slid out of their chairs, left the room, and never looked back. They hadn’t learned to crave the juice. However, once a monkey had developed a habit-once its brain
This explains why habits are so powerful: They create neurological cravings. Most of the time, these cravings emerge so gradually that we’re not really aware they exist, so we’re often blind to their influence. But as we associate cues with certain rewards, a subconscious craving emerges in our brains that starts the habit loop spinning. One researcher at Cornell, for instance, found how powerfully food and scent cravings can affect behavior when he noticed how Cinnabon stores were positioned inside shopping malls. Most food sellers locate their kiosks in food courts, but Cinnabon tries to locate their stores
“There is nothing programmed into our brains that makes us see a box of doughnuts and automatically want a sugary treat,” Schultz told me. “But once our brain learns that a doughnut box contains yummy sugar and other carbohydrates, it will start
To understand this process, consider how Julio’s habit emerged. First, he saw a shape on the screen:
Over time, Julio learned that the appearance of the shape meant it was time to execute a routine. So he touched the lever:
As a result, Julio received a drop of blackberry juice.
That’s basic learning. The habit only emerges once Julio begins
JULIO’S HABIT LOOP
This is how new habits are created: by putting together a cue, a routine, and a reward, and then cultivating a craving that drives the loop. [55] Take, for instance, smoking. When a smoker sees a cue-say, a pack of Marlboros-her brain starts anticipating a hit of nicotine. Just the sight of cigarettes is enough for the brain to crave a nicotine rush. If it doesn’t arrive, the craving grows until the smoker reaches, unthinkingly, for a Marlboro.
Or take email. When a computer chimes or a smartphone vibrates with a new message, the brain starts anticipating the momentary distraction that opening an email provides. That expectation, if unsatisfied, can build until a meeting is filled with antsy executives checking their buzzing BlackBerrys under the table, even if they know it’s probably only their latest fantasy football results. (On the other hand, if someone disables the buzzing-and,