Next, as we touch the statistical bases, the RWA scale had an “alpha” coefficient of .90 in McWilliams and Keil’s sample. Does that mean it was the boss coefficient, the way an “alpha animal” is the leader of the pack? No. When you’re talking about a personality test, you care a lot about how well the items all measure the same underlying trait, even though on the surface they seem to be talking about lots of different things. That cohesiveness is called the
Finally you should know, if you are a social scientist on the prowl for scales to throw into the pot for your next project, that I have made a pact with the devil. Hell will be the final destination of any researcher who decides to use
Physicists, astronomers, chemists, and so on learned long ago that it is essential to the scientific quest to standardize measurements, but many social scientists can’t seem to understand that.
Beelzebub has even agreed to my request that these people be forced to listen to badly played banjo music 24/7/365/Eternity while in hell. There will be another room nearby featuring novice bagpipe players, for editors who accept articles that used a mangled version of one of my scales.
4 The Libertarian Party poll also solicited opinions on a variety of social issues and economic attitudes. RWA scale scores correlated highest with attitudes
5 If I were you, I’d be wondering how well my results, which are based mainly on my local Canadian samples, apply to the United States. I wondered that too, so I made a determined effort when I started out to repeat my studies with American samples. I almost always found the same things in Alabama and Pennsylvania and Texas and Indiana and New York and Wyoming and California that I had found in Manitoba. Once American researchers began using my measures, I could simply loll by my hearth and read what others turned up in Massachusetts and Kentucky and Michigan and Nebraska and Washington and so on. The bottom line: A strong record of replication has accumulated over time.
Still, sometimes weird things happen. For example, a Colorado Ph.D. student recently told me she found no correlation between college students’ RWA scale scores, and those of their parents—whereas correlations in the .40s to .50s have appeared quite routinely in the past. And naturally other researchers do not get
6 The Weschler Adult Intelligence Survey, probably the most widely used IQ test, has a
P.S. We’re going to have a lot of technical notes at the beginning of this chapter as I try to anticipate the questions that you might bring up—if you are the careful, critical reader everyone says you are. Eventually the sailing will get smoother. But you don’t have to read these notes, which you see can be rather tedious. They won’t be on the exam.
7 This isn’t as big a problem with the RWA scale as it might be. Believe it or not, most people don’t writhe over the meaning of its statements. The items had to show they basically meant the same thing to most people to get on the test in the first place. If a statement is terrifically ambiguous, the answers it draws will be all over the lot, connect to nothing else reliably, and explain zilcho. I know because I’ve written lots of crummy items over the years.
But I stubbornly plodded along until I got enough good ones. It took eight studies, run over three years, involving over 3000 subjects and 300 items to get the first version of the RWA scale in 1973. Then the scale was continually revised as better (less ambiguous, more pertinent) statements replaced weaker ones. Only two of the items you answered (Nos. 6 and 18) survive from the first version. The internal consistency of responses to the test is so high, producing its high alpha and reliability, because items that were too ambiguous fouled out of the game during all this testing. So the years spent developing the test paid off. Let’s hear it for fixation. (And can you see why I get so p.o.’d when some researchers chop up my scales?).
But still, to any individual person, any item can mean something quite different from what I intend. And some people will consistently have “unusual” interpretations of the items. And the test, which was designed to measure right-wing authoritarianism in North America, will probably fall apart in markedly different cultures.
While we’re on the subject of what the items on the RWA scale measure, people sometimes say “Of course conservatives (or religious conservatives) score highly on it; it’s full of conservative ideas.” I think this does a disservice to “conservative ideas” and to being “religious.” Take Item 16: “God’s laws about abortion, pornography, and marriage must be strictly followed before it is too late, and those who break them must be strongly punished.” Knowing what you do about the
On the other hand the item, “Abortion, pornography and divorce are sins”-which you may agree reflects a
(My God! You’re still reading this!) To put it another way, an empirical way: if you look at how responses to Item 16 correlate with the other items on the RWA scale, and then also look at how it correlates with some measure of traditional religious belief, such as the Christian Orthodoxy scale that measures acceptance of the