May 2008
Sun Mon Tue Wed Thu Fri Sat
        1 2 3
4 5 6 7 8 9 10
11 12 13 14 15 16 17
18 19 20 21 22 23 24
25 26 27 28 29 30 31

Authors' Committee

Chair:

Andy Eggers (Gov)

Members:

Weihua An (Soc)
Kevin Bartz (Stats)
Sebastian Bauhoff (HealthPol)
John Graves (HealthPol)
Justin Grimmer (Gov)
Jens Hainmueller (Gov)
Mike Kellermann (Gov)
Ellie Powell (Gov)
Gary King (Gov)

Weekly Research Workshop Sponsors

Alberto Abadie, Lee Fleming, Adam Glynn, Guido Imbens, Gary King, Kevin Quinn, Jamie Robins, Don Rubin, Chris Winship

Recent Comments

Recent Entries

Categories

Blogroll

Brad DeLong
Cognitive Daily
Complexity & Social Networks
Developing Intelligence
EconLog
The Education Wonks
Empirical Legal Studies
Free Exchange
Freakonomics
Health Care Economist
Junk Charts
Language Log
Law & Econ Prof Blog
Machine Learning (Theory)
Marginal Revolution
Mixing Memory
Mystery Pollster
New Economist
Political Arithmetik
Political Science Methods
Pure Pedantry
Science & Law Blog
Simon Jackman
Social Science++
Statistical modeling, causal inference, and social science

Archives

Notification

Powered by
Movable Type 3.34


« Applied Statistics - No Meeting | Main | Experts and Trials III: More Noise »

21 November 2005

Occam's Razor And Thinking about Evolution

Amy Perfors

I'm fascinated by the ongoing evolution controversy in America. Part of this is because as a scientist I realize how important it is to defend rational, scientific thinking -- meaning reliance on evidence, reasoning based on logic rather than emotion, and creating falsifiable hypotheses. I also recognize how deeply important it is that our students are not crippled educationally by not being taught how to think this way.

But from the cognitive science perspective, it's also interesting to try to understand why evolution is so unbelievable and creationism so logical and reasonable to many fairly intelligent laypeople. (I doubt it's just ignorance or mendacity!) What cognitive heuristics and ways of thinking cause this widespread misunderstanding?

There are probably a number of things. Two I'm not going to talk about include emotional reasons for wanting not to believe in evolution as well as the tendency for people who don't know much about either sides of an issue to think the fair thing to do is "split the middle" and "teach both sides." The thing I do want to talk about today-- the one that's relevant to a statistical social science blog -- concerns people's notions of simplicity and complexity. My hypothesis is that laypeople and scientists probably apply Occam's Razor to the question of evolution in very different ways, which is part of what leads to such divergent views.

[Caveat: this is speculation; I don't study this myself. Second caveat: I am neither saying that it's scientifically okay to believe in creationism, nor that people who do are stupid; this post is about explaining, not justifying, the cognitive heuristics we use that make evolution so difficult to intuitively grasp].

Anyway...

Occam's Razor is a reasoning heuristic that says, roughly, that if two hypotheses both explain the data fairly well, the simpler is likely to be better. Simpler hypotheses, generally formalized as those with fewer free parameters, don't "overfit" the data too much and thus generalize to new data better. Simpler models are also better because they make a strong predictions. Such models are therefore falsifiable (one can easily find something they don't predict, and see if it is true) and, in probabilistic terms, put a lot of the "probability mass" or "likelihood" on a few specific phenomena. Thus, when such a specific phenomenon does occur, simpler models explain it better than a more complex theory, which spread the probability mass over more possibilities. In other words, a model with many free parameters -- a complicated one -- will be compatible with many different types of data if you just tweak the parameters. This is bad because it then doesn't "explain" much of anything, since anything is consistent with it.

When it comes to evolution and creationism, I think that scientists and laypeople often make exactly the opposite judgments about which hypothesis is simple and which is complex; therefore their invokation of Occam's Razor results in opposite conclusions. For the scientist, the "God" hypothesis (um, I mean, "Intelligent Designer") is almost the prototypical example of a hypothesis that is so complex it's worthless scientifically. You can literally explain anything by invoking God (and if you can't, you just say "God works in mysterious ways" and feel like you've explained it), and thus God scientifically explains nothing. [I feel constrained to point out that God is perfectly fine in a religious or spiritual context where you're not seeking to explain the world scientifically!] This is why ID is not approved by scientists; not because it's wrong, but because it's not falsifiable -- the hypothesis of an Intelligent Designer is consistent with any data whatsoever, and thus as theories go ... well, it isn't one, really.

But if you look at "simplicity" in terms of something like number of free parameters, you can see why a naive view would favor ID over evolution. On a superficial inspection, the ID hypothesis seems like it really has only one free parameter (God/ID exists, or not); this is the essence of a simple hypothesis. By contrast, evolution is complicated - though the basic idea of natural selection is fairly straightforward, even that is more complicated than a binary choice, and there are many interesting and complicated phenomena arising in the application of basic evolutionary theory (simpatric vs. allopatric speciation, the role of migration and bottlenecks, asexual vs sexual reproduction, different mating styles, recessive genes, junk DNA, environmental and hormonal affects on genes, accumulated effects over time, group selection, canalization, etc). The layperson either vaguely knows about all of this or else tries to imagine how you could get something as complicated as a human out of "random accidents" and concludes that you could only do so if the world was just one specific way (i.e. if you set many free parameters just exactly one way). Thus they conclude that it's therefore an exceedingly complex hypothesis, and by Occam's Razor one should favor the "simpler" ID hypothesis. And then when they hear scientists not only believe this apparently unbelievable thing, but refuse to consider ID as a scientific alternative, they logically conclude that it's all just competing dogma and you might as well teach both.

This is a logical train of reasoning on the layperson's part. (Doesn't mean it's true, but it's logical given what they know). The reason it doesn't work is twofold: (a) a misunderstanding of evolution as "randomness"; seeing it as a search over the space of possible organisms is both more accurate and more illuminating, I think; and (b) misunderstanding the "God" hypothesis as the simple one.

If I'm right that these are among the fundamental errors the layperson makes in reasoning about evolution, the the best way to reach the non-mendacious, intelligent creationist is by pointing out these flaws. I don't know if anybody has studied whether this hunch is correct, but it sure would be fascinating to find out what sorts of arguments work best, not just because it would help us argue effectively on a national level, but also because it would reveal interesting things about how people tend to use Occam's Razor in real-life problems.

Posted by Amy Perfors at November 21, 2005 4:04 AM

Comments

Amy,

I think "Occam's razor" and parsimony are overrated. For biology I can't say, but in social science, "complicated" is more believable than "simple," to me. If you can approximate reality with just a few parameters, fine. If you can use more parameters to fold in more information, that's even better.

See here and here for more.

On a separate point, as a political scientist I think it makes sense to understand the appeal of various beliefs such as creationism by considering the political and social forces supporting them. In this case you have a lot of churches and political figures too. It's not so much that someone's using Occam's razor or whatever to decide on a belief, as they're using these rules to justify a belief that it can be convenient to have.

Posted by: Andrew [TypeKey Profile Page] at November 21, 2005 11:52 AM

Thanks for commenting!

Re the latter point, I definitely agree that there are many factors besides Occam's Razor that the layperson uses in this particular case, and I wouldn't even argue that factors like authority and emotional beliefs were less important than notions about the simplicity of an explanation. The question is rather about the subset of laypeople who have neither a pressing emotional reason to disbelieve in evolution (because they aren't religious, or at least not dogmatically so) nor a pressing political or social authority telling them they should (for the same reason). For those people, do their notions about simplicity of explanation play a role in their distrust of evolution as a viable explanation?

Your first point (and the links you gave) is quite interesting, and I definitely think that the question of to what extent "simple" explanations should be favored either by statisticians or social scientists is nontrivial. (As well as the debate about to what extent priors and hierarchical models impact "simplicity", but that's a debate for another day).

That said, the question of what social scientists and statisticians should do when making models is rather different than the question of what laypeople do do when creating models of the world, which is what I was more focused on. Whether it is "correct" in some objective sense or not, do people have and use Occam's-Razor like notions of simplicity? And if so, how and where? There is some research suggesting they do, but I'm not aware of any applied to their reasoning about complex scientific problems that they don't really understand, like evolution.

But I may have misunderstood your point. Another way to read it (sorry if I'm not getting it quite right) is that you might be pointing out that it is your personal experience to favor more complex explanations in social science, and therefore you doubt that people in general favor simple explanations. As they say, the plural of anecdote is not data, but introspection is a great place for a cognitive scientist to form hypotheses to test, so this point is quite interesting to me. :) To what extent do you think this intuition of yours resulted from your years of experience at working with statistical models in the social sciences? In other words, is it a byproduct of expert knowledge and training, or not?

Posted by: Amy at November 21, 2005 2:08 PM

Forgive me if this is too far off your post. There is, I think, another quite different way of approaching this question, which applies to many (but not all) who do not accept evolution. Nothing to do with Occam's Razor. Many Christians reject evolution in large part because many evolutionary scientists say that evolution proves there is no God. Such eminent scientists as Richard Dawkins and Edward O. Wilson come to mind. Christians, who admittedly are not experts in biochemistry, never mind quantum physics, say, "If that what these scientists say about evolution--and they're the experts, so they should know--then evolution must be false."


When leading evolutionary scientists say that evolution disproves God, what are faithful Christians supposed to think? If what I suggest is correct, then Profs Wilson, Dawkins, etc., are partly responsible for the widespread rejection of evolution. It seems to me that scientists who know the difference between science and metaphysics should publicly say something about this. Or maybe they have and the media haven't reported it--I don't know.

FWIW, I'm a Christian and a working statistician, and I accept evolutionary theory. The view I subscribe can be usefully summarised as evolutionary creationism. I was persuaded of this after reading Howard Van Till and Kenneth Miller, among others.


Scott

Posted by: StatGuy at November 24, 2005 12:54 PM

I was unaware that there are scientists that have publicly stated that evolutionary theory proves that there is no God - I'd like to see their statements before I feel up to commenting on that. Such a claim is, as I understand it, itself unscientific - there is no way that evolutionary theory could "prove" such a thing at all - hence my surprise.

But, that aside, I certainly do agree that many folks probably disbelieve in evolution for reasons completely unrelated to Occam's Razor. The question to my mind was whether that might play a role in addition to these other reasons.

In any case, thanks for commenting!

Posted by: Amy at November 26, 2005 5:35 PM

I wouldn't say Octam's razor is over-rated. I find advances in biology a lot more useful than Technological Determinism or Uncertainty Reduction Theory. Most Social Scientific theories could use some serious shaving.

I've been thinking about your blog for a while, Amy. Do you think it's fair to say that Octam's Razor would favor creationism if one takes the existence of God for granted? It seems a lot more reasonable to imagine an all-powerful being would simply fathom the world into being, rather than using evolutions intricate, round-about method. One would then have to explain why God didn't create the world he was after right off.

Posted by: demo at July 22, 2006 7:48 PM

Notification

Enter e-mail address to receive notification of new comments to this entry

Post a comment




Remember Me?

(you may use HTML tags for style)