squarely. “See how he popped up?” Shonka said. “He stood right there and threw the ball in the face of that rush. This kid has got a lot of courage.” Daniel was six feet tall and weighed 225 pounds: thick through the chest and trunk. He carried himself with a self-assurance that bordered on cockiness. He threw quickly and in rhythm. He nimbly evaded defenders. He made short throws with touch and longer throws with accuracy. By the game’s end, he had completed an astonishing 78 percent of his passes, and handed Nebraska its worst home defeat in fifty- three years. “He can zip it,” Shonka said. “He can really gun when he has to.” Shonka had seen all the promising college quarterbacks, charted and graded their throws, and to his mind Daniel was special: “He might be one of the best college quarterbacks in the country.”
But then Shonka began to talk about when he was on the staff of the Philadelphia Eagles, in 1999. Five quarterbacks were taken in the first round of the college draft that year, and each looked as promising as Chase Daniel did now. But only one of them, Donovan McNabb, ended up fulfilling that promise. Of the rest, one descended into mediocrity after a decent start. Two were complete busts, and the last was so awful that after failing out of the
The year before, the same thing happened with Ryan Leaf, who was the Chase Daniel of 1998. The San Diego Chargers made him the second player taken over all in the draft, and gave him an $11 million signing bonus. Leaf turned out to be terrible. In 2002, it was Joey Harrington’s turn. Harrington was a golden boy out of the University of Oregon, and the third player taken in the draft. Shonka still can’t get over what happened to him.
“I tell you, I saw Joey live,” he said. “This guy threw lasers, he could throw under tight spots, he had the arm strength, he had the size, he had the intelligence.” Shonka got as misty as a 280-pound ex-linebacker in a black tracksuit can get. “He’s a concert pianist, you know? I really—I mean, I really—liked Joey.” And yet Harrington’s career consisted of a failed stint with the Detroit Lions and a slide into obscurity. Shonka looked back at the screen, where the young man he felt might be the best quarterback in the country was marching his team up and down the field. “How will that ability translate to the National Football League?” He shook his head slowly. “Shoot.”
This is the quarterback problem. There are certain jobs where almost nothing you can learn about candidates before they start predicts how they’ll do once they’re hired. So how do we know whom to choose in cases like that? In recent years, a number of fields have begun to wrestle with this problem, but none with such profound social consequences as the profession of teaching.
2.
One of the most important tools in contemporary educational research is value added analysis. It uses standardized test scores to look at how much the academic performance of students in a given teacher’s classroom changes between the beginning and the end of the school year. Suppose that Mrs. Brown and Mr. Smith both teach a classroom of third graders who score at the fiftieth percentile on math and reading tests on the first day of school in September. When the students are retested in June, Mrs. Brown’s class scores at the seventieth percentile, while Mr. Smith’s students have fallen to the fortieth percentile. That change in the students’ rankings, value-added theory says, is a meaningful indicator of how much more effective Mrs. Brown is as a teacher than Mr. Smith.
It’s only a crude measure, of course. A teacher is not solely responsible for how much is learned in a classroom, and not everything of value that a teacher imparts to his or her students can be captured on a standardized test. Nonetheless, if you follow Brown and Smith for three or four years, their effect on their students’ test scores starts to become predictable: with enough data, it is possible to identify who the very good teachers are and who the very poor teachers are. What’s more—and this is the finding that has galvanized the educational world—the difference between good teachers and poor teachers turns out to be vast.
Eric Hanushek, an economist at Stanford, estimates that the students of a very bad teacher will learn, on average, half a year’s worth of material in one school year. The students in the class of a very good teacher will learn a year and a half’s worth of material. That difference amounts to a year’s worth of learning in a single year. Teacher effects dwarf school effects: your child is actually better off in a bad school with an excellent teacher than in an excellent school with a bad teacher. Teacher effects are also much stronger than class-size effects. You’d have to cut the average class almost in half to get the same boost that you’d get if you switched from an average teacher to a teacher in the eighty-fifth percentile. And remember that a good teacher costs as much as an average one, whereas halving class size would require that you build twice as many classrooms and hire twice as many teachers.
Hanushek recently did a back-of-the-envelope calculation about what even a rudimentary focus on teacher quality could mean for the United States. If you rank the countries of the world in terms of the academic performance of their schoolchildren, the United States is just below average, half a standard deviation below a clump of relatively high-performing countries like Canada and Belgium. According to Hanushek, the United States could close that gap simply by replacing the bottom 6 percent to 10 percent of public-school teachers with teachers of average quality. After years of worrying about issues like school funding levels, class size, and curriculum design, many reformers have come to the conclusion that nothing matters more than finding people with the potential to be great teachers. But there’s a hitch: no one knows what a person with the potential to be a great teacher looks like. The school system has a quarterback problem.
3.
Kickoff time for Missouri’s game against Oklahoma State was seven o’clock. It was a perfect evening for football: cloudless skies and a light fall breeze. For hours, fans had been tailgating in the parking lots around the stadium. Cars lined the roads leading to the university, many with fuzzy yellow-and-black Tiger tails hanging from their trunks. It was one of Mizzou’s biggest games in years. The Tigers were undefeated and had a chance to become the No. 1 college football team in the country. Shonka made his way through the milling crowds and took a seat in the press box. Below him, the players on the field looked like pieces on a chessboard.
The Tigers held the ball first. Chase Daniel stood a good seven yards behind his offensive line. He had five receivers, two to his left and three to his right, spaced from one side of the field to the other. His linemen were widely spaced as well. In play after play, Daniel caught the snap from his center, planted his feet, and threw the ball in quick seven- and eight-yard diagonal passes to one of his five receivers.
The style of offense that the Tigers run is called the
But for Shonka this didn’t help matters. It had always been hard to predict how a college quarterback would fare in the pros. The professional game was, simply, faster and more complicated. With the advent of the spread, though, the correspondence between the two levels of play had broken down almost entirely. NFL teams don’t run the spread. They can’t. The defenders in the pros are so much faster than their college counterparts that they would shoot through those big gaps in the offensive line and flatten the quarterback. In the
