{"id":86,"date":"2009-01-22T13:53:17","date_gmt":"2009-01-22T18:53:17","guid":{"rendered":"http:\/\/blog.richmond.edu\/physicsbunn\/2009\/01\/22\/why-i-am-not-a-popperian\/"},"modified":"2009-01-22T13:53:17","modified_gmt":"2009-01-22T18:53:17","slug":"why-i-am-not-a-popperian","status":"publish","type":"post","link":"https:\/\/blog.richmond.edu\/physicsbunn\/2009\/01\/22\/why-i-am-not-a-popperian\/","title":{"rendered":"Why I am not a Popperian"},"content":{"rendered":"

In my experience, most scientists don’t know or care much about the philosophy of science, but if they do know one thing, it’s Karl Popper’s idea that the hallmark of a scientific hypothesis is falsifiability<\/em>.\u00a0 In general, scientists seem to have taken this idea to heart.\u00a0 For instance, when a scientist wants to explain why astrology, or Creationism, or any number of other things aren’t<\/em> science, the accusation of unfalsifiability invariably comes up.\u00a0 Although I’ll admit to using this rhetorical trick myself from time to time, to me the idea of falsifiability fails in a big way to capture the scientific way of thinking.\u00a0 I hinted about this in an earlier post<\/a>, but now I’d like to go into it in a bit more detail.<\/p>\n

Let me begin with a confession: I have never read Popper.\u00a0 For all I know, the position I’m about to argue against is not what he really thought at all.\u00a0 It is of course a cardinal academic sin to argue against someone’s position without\u00a0 actually knowing what that person wrote.\u00a0 My excuse is that I’m going to argue against Popper as he is generally understood by scientists<\/em>, which may be different from the real Popper.\u00a0 As a constant reminder that I may be arguing against a cartoon version of Popper, I’ll refer to cartoon-Popper as “Popper<\/font><\/em>” from now on.\u00a0 (If that’s not showing up in a different font on your browser, you’ll just have to imagine it.\u00a0 Maybe you’re better off<\/a>.)<\/p>\n

I bet that the vast majority of scientists, like me, know only Popper<\/font><\/em>‘s views, not Popper’s views, so I don’t feel too bad about addressing the former, not the latter.<\/p>\n

Popper<\/font><\/em>‘s main idea is that a scientific hypothesis must be falsifiable<\/em>, meaning that it must be possible for some sort of experimental evidence to prove the hypothesis wrong.\u00a0 For instance, consider the “Matrix-like” hypothesis that you’re just a brain in a vat, with inputs artificially pumped in to make it seem like you’re sensing and experiencing all of the things you think you are.\u00a0 Every experiment you can imagine doing could be explained under this hypothesis, so it’s not falsifiable, and hence not scientific.<\/p>\n

When Popper <\/font><\/em>says that a scientific hypothesis must be falsifiable, it’s not clear whether this is supposed to be a descriptive statement (“this is how scientists actually think”) or a normative one (“this is how scientists should <\/em>think”).\u00a0 Either way, though, I think it misses the boat, in two different but related ways.<\/p>\n

1. Negativity<\/em>.<\/strong>\u00a0 The most obvious thing about Popper<\/font><\/em>‘s falsifiability criterion is that it privileges falsifying over verifying. When scientists talk about Popper<\/font><\/em>, they often regard this as a feature, not a bug.\u00a0 They say that scientific theories can never be proved right, but they can be proved wrong.<\/p>\n

At the level of individual hypotheses, this is self-evidently silly.\u00a0 Does anyone really believe that “there is life on other planets” is an unscientific hypothesis, but “there is no life on other planets” is scientific? \u00a0 When I write a grant proposal to NSF, should I carefully insert “not”s in appropriate places to make sure that the questions I’m proposing to address are phrased in a suitably falsifiable way?\u00a0 It’d be like submitting a proposal to Alex Trebek<\/a>.<\/p>\n

From what little I’ve read on the subject, I think that this objection is about Popper<\/font><\/em>, not Popper, in at least one way.\u00a0 The real Popper apparently applied the falsifiability criterion to entire scientific theories, not to individual hypotheses.\u00a0 But it’s not obvious to me that that helps, and anyway Popper <\/font><\/em>as understood by most scientists is definitely about falsifiability of individual hypotheses. For example, I was recently on a committee to establish learning outcomes for our general-education science courses as part of our accreditation process.\u00a0 One of the outcomes had to do with formulating scientific hypotheses, and we discussed whether to include Popper<\/font><\/em>ian falsifiability as a criterion for these hypotheses.\u00a0 (Fortunately, we decided not to.)<\/p>\n

2. “All-or-nothing-ness.”<\/em><\/strong> The other thing I don’t like about Popper<\/font><\/em>ian falsifiability is the way it thinks of hypotheses as either definitely true or definitely false. (Once again, the real Popper’s view is apparently more sophisticated than Popper<\/font><\/em>‘s on this point.) This problem is actually much more important to me than the first one.\u00a0 The way I reason as a scientist places much more emphasis on the uncertain, tentative nature of scientific knowledge: it’s crucial to remember that beliefs about scientific hypotheses are always probabilistic.<\/p>\n

Bayesian inference<\/a> provides a much better model for understanding both how scientists do think and how they should think.\u00a0 At any given time, you have a set of beliefs about the probabilities of various statements about the world being true.\u00a0 When you acquire some new information (say by doing an experiment), the additional information causes you to update those sets of probabilities.\u00a0 Over time, that accumulation of evidence drives some of those probabilities very close to one and others very close to zero.\u00a0 As I noted in my earlier post,Bayes’s theorem provides a precise description of this process.<\/p>\n

(By the way, scientists sometimes divide themselves into “frequentist” and “Bayesian” camps, with different interpretations of what probabilities are all about.\u00a0 Some frequentists will reject what I’m saying here, but I claim that they’re just in denial: Bayesian inference still describes how they reason, even if they won’t admit it.)<\/p>\n

For rhetorical purposes if nothing else, it’s nice to have a clean way of describing what makes a hypothesis scientific, so that we can state succinctly why, say, astrology doesn’t count.\u00a0 Popper<\/font><\/em>ian falsifiability nicely meets that need, which is probably part of the reason scientists like it.\u00a0 Since I’m asking you to reject it, I should offer up a replacement.\u00a0 The Bayesian way of looking at things does supply a natural replacement for falsifiability, although I don’t know of a catchy one-word name for it.\u00a0 To me, what makes a hypothesis scientific is that it is amenable to evidence<\/em>.<\/strong>\u00a0 That just means that we can imagine experiments whose results would drive the probability of the hypothesis arbitrarily close to one, and (possibly different) experiments that would drive the probability arbitrarily close to zero.<\/p>\n

If you write down Bayes’s theorem, you can convince yourself that this is equivalent to the following:\u00a0 a hypothesis H is amenable to evidence as long as there are some possible experimental results E with the property that P(E | H) is significantly different from P(E | not-H).\u00a0 That is, there have to be experimental outcomes that are much more (or less) likely if the hypothesis is true than if it’s not true.<\/p>\n

Most examples of unscientific hypotheses (e.g., astrology) fail this test on the ground that they’re too vague to allow decent estimates of these probabilities.<\/p>\n

The idea of evidence, and the amenability-to-evidence criterion, are pretty intuitive and not too hard to explain:\u00a0 “Evidence” for a hypothesis just means an observation that is more consistent with the hypothesis being true than with its being false.\u00a0 A hypothesis is scientific if you can imagine ways of gathering evidence.\u00a0 Isn’t that nicer than Popper<\/font><\/em>ian falsifiability?<\/p>\n","protected":false},"excerpt":{"rendered":"

In my experience, most scientists don’t know or care much about the philosophy of science, but if they do know one thing, it’s Karl Popper’s idea that the hallmark of a scientific hypothesis is falsifiability.\u00a0 In general, scientists seem to have taken this idea to heart.\u00a0 For instance, when a scientist wants to explain why … Continue reading Why I am not a Popperian<\/span><\/a><\/p>\n","protected":false},"author":12,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-86","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/blog.richmond.edu\/physicsbunn\/wp-json\/wp\/v2\/posts\/86","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.richmond.edu\/physicsbunn\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.richmond.edu\/physicsbunn\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.richmond.edu\/physicsbunn\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.richmond.edu\/physicsbunn\/wp-json\/wp\/v2\/comments?post=86"}],"version-history":[{"count":0,"href":"https:\/\/blog.richmond.edu\/physicsbunn\/wp-json\/wp\/v2\/posts\/86\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.richmond.edu\/physicsbunn\/wp-json\/wp\/v2\/media?parent=86"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.richmond.edu\/physicsbunn\/wp-json\/wp\/v2\/categories?post=86"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.richmond.edu\/physicsbunn\/wp-json\/wp\/v2\/tags?post=86"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}