| Sun | Mon | Tue | Wed | Thu | Fri | Sat |
|---|---|---|---|---|---|---|
| 1 | 2 | 3 | ||||
| 4 | 5 | 6 | 7 | 8 | 9 | 10 |
| 11 | 12 | 13 | 14 | 15 | 16 | 17 |
| 18 | 19 | 20 | 21 | 22 | 23 | 24 |
| 25 | 26 | 27 | 28 | 29 | 30 | 31 |
« Applied Statistics - Ken Kleinman | Main | Applied Stats slides »
20 March 2007
Empirical, particularly quantitative empirical, scholarship is all the rage these days in law schools. (By the way, as a quantitative legal empiricist,that makes me really nervous. If there's one constant in legal academia, it's that things go in and out of style as fast in law schools as they do in Milan fashion shows.)
One thing that has been bothering me lately about this next phase, new wave, dance craze aspect of legal scholarship is the use of appellate cases as datapoints. It's tempting to think that one can code appellate decisions or judicial opinions pursuant to some neutral criteria, then look for trends, tease out inferences of causation, etc. Here's a note of caution: they're not i.i.d. They're probably not i.i.d. given X (whatever X is). Precedent matters. In our legal system, the fact that a previous appellate case (with a published opinion) was decided a certain way is a reason to decide a subsequent, facially similar appellate case the same way, even if the first decision might have been (arguably) wrong. Folks will argue over how much precedent matters; all I can tell say is that as a law clerk to an appellate judge, I participated in numerous conversations that resulted in the sentiment, "I might/would have decided the present case differently had Smith v. Jones not been on the books, but I see no grounds for departing from the reasoning of Smith v. Jones here." I.i.d. models, or analyses that assume non-interference among units, should be viewed with great caution in this setting.
Posted by James Greiner at March 20, 2007 4:40 PM
Two small points. First, as another, in Jim's apt words, "quantitative legal empiricist," I instinctively share his sense of unease with the legal academy's recent (and growing) embrace of all things empirical. That said (and self-interest aside), I have a hunch the current empirical "fad" will likely endure (unlike many other fads that periodically traipse through legal academia). Second, Jim's main substantive point is dead on--precedent matters. Empirical legal scholarship that neglects this point does so at considerable analytic peril.
Posted by: Michael Heise at March 20, 2007 6:09 PM
Just so I understand your concern, Jim, are you talking specifically about modeling decisions as response variables, or is broader than that? And would you be less concerned about Supreme Court decisions, where precedents are kind of like constitutional conventions in the United Kingdom - things to be observed until they aren't?
Posted by: Mike Kellermann at March 21, 2007 4:39 PM
Michael, Mike, first, apologies. I was testing the blog notification software, and as a result, did not get notified of either comment.
Michael, I hope you're right that you and I are not participating in a fad.
Mike, to answer your questions briefly, I think my worries depend on the modeling that's being done. "Often" (whatever that means), quantitative analysts worry less about the distributions of covariates (or background variables or whatever you call them). If appellate decisions are covariates, and the analyst understands that his/her inferences are limited to the portion of the covariate space covered by the data, then there is less concern. But when appellate decisions are modeled, either as outcomes or as covariates, then my stomach churns.
To answer your second question, in a word, "No." Precendent may matter less to the Supreme Court, particularly on constitutional cases, but my sense is that it still matters. Much of the first year of law school is about beating precedent into law students, and most folks on the high court got through the first year.
Posted by: Jim at April 3, 2007 12:20 PM