May 2008
Sun Mon Tue Wed Thu Fri Sat
        1 2 3
4 5 6 7 8 9 10
11 12 13 14 15 16 17
18 19 20 21 22 23 24
25 26 27 28 29 30 31

Authors' Committee

Chair:

Andy Eggers (Gov)

Members:

Weihua An (Soc)
Kevin Bartz (Stats)
Sebastian Bauhoff (HealthPol)
John Graves (HealthPol)
Justin Grimmer (Gov)
Jens Hainmueller (Gov)
Mike Kellermann (Gov)
Ellie Powell (Gov)
Gary King (Gov)

Weekly Research Workshop Sponsors

Alberto Abadie, Lee Fleming, Adam Glynn, Guido Imbens, Gary King, Kevin Quinn, Jamie Robins, Don Rubin, Chris Winship

Recent Comments

Recent Entries

Categories

Blogroll

Brad DeLong
Cognitive Daily
Complexity & Social Networks
Developing Intelligence
EconLog
The Education Wonks
Empirical Legal Studies
Free Exchange
Freakonomics
Health Care Economist
Junk Charts
Language Log
Law & Econ Prof Blog
Machine Learning (Theory)
Marginal Revolution
Mixing Memory
Mystery Pollster
New Economist
Political Arithmetik
Political Science Methods
Pure Pedantry
Science & Law Blog
Simon Jackman
Social Science++
Statistical modeling, causal inference, and social science

Archives

Notification

Powered by
Movable Type 3.34


« Valid Standard Errors for Propensity Score Matching, Anyone? | Main | Another classroom demo: the scientific method »

23 March 2006

Control Groups for Breakfast, Revisited

A few months ago, I wrote an entry entitled The Value of Control Groups in Causal Inference (and Breakfast Cereal). It was a report on a fun experiment I did that worked well both in my daughter's kindergarten class and my graduate methods class at Harvard. There were a fair number of comments posted in the blog, and I also received dozens of other notes from parents and school teachers all over the country with many interesting questions and suggestions.

That correspondence covered four main points:

  1. Some people suggested a variety of interesting alternative experiments, which is great, but in designing these many forgot that you must always have a control group. That's the main lesson of the experiment: you often learn nothing without some kind of control group, and teaching this to kids (and graduate students!) is quite important.
  2. Some people didn't squish the cereal enough and the magnet didn't pick up the pieces. It will attract only when squished very well since the bits of iron are very small.
  3. People then asked why the cereal doesn't stick to the magnet without squishing it up. The reason is the same reason a magnet won't pick up a nail driven into a log, but it will pick up the nail if not in the log.
  4. Finally, most people asked for other experiments they could run with their kids. For that, which I'm writing up now, please tune in next time!

Posted by Gary King at March 23, 2006 6:00 AM

Comments

I think a better control "group" for your cereal demo isn't a different cereal, but a non-magnet that doesn't pick up the possibly "sticky" Total.

You could even show an interaction effect by comparing Total to a sticky cereal with no iron (something corn-syrupy, I bet, like Golden Grahams?) which would stick to both a magnet and a non-magnet.

Posted by: brent at March 23, 2006 8:19 AM

To reiterate a point made by Gary to me before I attempted this in my daughter's class: You must squish the cereal before the you do the demo. That is, you can squish some as an example for the class, but then you need to pull out a pre-squished bag for the magnet. The reason for this is that it takes a very long time with a moderate amount of cereal to get the pieces small enough that they will be picked up by the magnet.

But, even with this problem, the kids had a fine time. I look forward to Gary's future examples. Surely he has at least one for each year of elementary school . . . ;-)

Posted by: David Kane at March 26, 2006 7:21 PM

well, you don't have to squish it, but with kindergarteners, its always helpful to be as prepared as conceivably possible. squishing on the fly is more convincing of course, so its preferable if you have the equipment, such as a really good rolling pin.

using a metal non-magnet would make a good control group too, tho you have to figure out if its as impressive to 5-year-olds.

(a 4th grade experiment will appear here in a few days.)

Posted by: Gary King [TypeKey Profile Page] at March 26, 2006 8:13 PM

Notification

Enter e-mail address to receive notification of new comments to this entry

Post a comment




Remember Me?

(you may use HTML tags for style)