Statisticians take themselves too seriously

by John on January 28, 2010

I suppose most people take themselves too seriously, but I’ve been thinking specifically about how statisticians take themselves too seriously.

The fundamental task of statistics is making decisions in the presence of uncertainty, and that’s hard. You have to make all kinds of simplifying assumptions and arbitrary choices to get anywhere. But after a while you lose sight of these decisions. Or you justify your decisions after the fact, making a virtue out of a necessity. After you’ve worked on a problem long enough, it’s nearly impossible to say “Of course, our whole way of thinking about this might have been wrong from the beginning.”

My concern is not so much “creative” statistics but rather uncreative statistics, rote application of established methods. Statistics is extremely conventional. But a procedure is not objective just because it is conventional.  An arbitrary choice made 80 years ago is still an arbitrary choice.

I’ve taken myself too seriously at times in regard to statistical matters; it’s easy to get caught up in your model. But I’m reminded of a talk I heard one time in which the speaker listed a number of embarrassing things that people used to believe. He was not making a smug comparison of how sophisticated we are now compared to our ignorant ancestors. Instead, his point was that we too may be mistaken. He exhorted everyone to look in a mirror and say “I may be wrong. I may be very, very wrong.”

Related posts:

The IOT test
Bike shed arguments
The data may not contain the answer
Problems versus dilemmas
Approximate problems and approximate solutions

{ 4 comments… read them below or add one }

1

Mike K Smith 01.28.10 at 08:46

Sounds a bit like the archetypical ISTJ Myers-Briggs type for statisticians: Think deeply, apply logic, trust evidence, use the methods that worked last time…

2

Ito 01.29.10 at 04:26

Nice idea, but in my opinion too short for a blog post.
You could either compress this idea to fit in a tweet, or (better) developp it, giving some examples of concrete cases. where statisticians take themselves too seriously.

3

John MacIntyre 01.29.10 at 09:46

“I’m reminded of a talk I heard one time in which the speaker listed a number of embarrassing things that people used to believe”

Sounds interesting. I don’t suppose you saw it online & have a url? (wishful thinking on my part)

4

John 01.29.10 at 09:48

John, it was in a psychology course from The Teaching Company. I’m not certain, but I think it was this one.

Leave a Comment

You can use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>