Ted Bunn’s Blog

My recent post about Blacklight Power’s claim that there’s a lower-energy state of hydrogen (which they call a hydrino) seems to have gotten a bit of interest — at least enough to show that this blog isn’t completely a form of write-only memory. I want to follow up on it by explaining in a bit more detail why I’m so skeptical of this claim.  In the process, I’ll say a bit about Bayesian inference.  The idea of Bayesian inference is, in my opinion, at the heart of what science is all about, and it’s a shame that it’s not talked about more.

But before we get there, let me summarize my view on hydrinos.  If Randell Mills (the head of Blacklight Power, and the main man behind hydrinos) is right, then the best-tested theory in the history of science is not merely wrong, but really really wrong.  This is not a logical impossibility, but it’s wildly unlikely.

Let me be more precise about the two italicized phrases in the previous paragraph.

1. “The best-tested theory in the history of science.”  The theory I’m talking about is quantum physics, more specifically the quantum mechanics of charged  particles interacting electromagnetically, and even more specifically the theory of quantum electrodynamics (QED).  Part of the reason for calling it the best-tested theory in science is some amazingly high-precision measurements, where predictions of the theory are matched to something like 12 decimal places.  But more important than that are the tens of thousands of experiments done in labs around the world all the time, which aren’t designed as tests of QED, but which depend fundamentally on QED.

Pretty much all of atomic physics and most of solid state physics (which between them are a substantial majority of physics research) depends on QED.  Also, every time an experiment is done at a particle accelerator, even if its purpose is to test other physics, it ends up testing QED. This has been true for decades.  If there were a fundamental flaw in QED, it is inconceivable that none of these experiments would have turned it up by now.

2. “Really really wrong.“  There’s a hierarchy of levels of “wrongness” of scientific theories.  For instance, ever since Einstein came up with general relativity, we’ve known that Newton’s theory of gravity was wrong: in some regimes, the two theories disagree, and general relativity is the one that agrees with experiment in those cases.  But Newtonian gravity is merely wrong, not really really wrong.

It’s intuitively clear that there’s something deeply “right” about Newtonian gravity — if there weren’t, how could NASA use it so successfully (most of the time) to guide space probes to other planets?  The reason for this is that Newtonian gravity was subsumed, not replaced, by general relativity.  To be specific, general relativity contains Newtonian gravity as a special limiting case.  Within certain bounds, Newton’s laws are a provably good approximation to the more exact theory.  More importantly, the bedrock principles of Newtonian gravity, such as conservation of energy, momentum,  and mass, have a natural place in the broader theory.  Some of these principles (e.g., energy and momentum conservation) carry over into exact laws in the new theory.  Others (mass conservation) are only approximately valid within certain broad limits.

So Newtonian gravity is an example of a theory that’s wrong but not really really wrong.  I would describe a theory as really really wrong if its central ideas were found to be not even approximately valid, in a regime in which the theory is well-tested.  The existence of hydrinos would mean that QED was really really wrong in this sense.  To be specific, it would mean that bedrock principles of quantum physics, such as the Heisenberg uncertainty principle, were not even approximately valid in the arena of interactions of electrons and protons at length scales and energy scales of the order of atoms.  That’s an arena in which the theory has been unbelievably well tested.

There has never been an instance in the history of science when a theory that was tested even 1% as well as QED was later proved to be really really wrong.  In fact, my only hesitation in making that statement is that it’s probably a ridiculous understatement.

So what?  In the cartoon version of science, even one experiment that contradicts a theory proves the theory to be wrong.  If Randell Mills has done his experiment right, then quantum physics is wrong, no matter how many previous experiments have confirmed it.

The problem with this cartoon version is that results of experiments are never 100% clear-cut.  The probability that someone has made a mistake, or misinterpreted what they saw, might be very low (especially if an experiment has been replicated many times and many people have seen the data), but it’s never zero.  That means that beliefs about scientific hypotheses are always probabilistic beliefs.

When new evidence comes in, that evidence causes each person to update his or her beliefs about the probabilities of various hypotheses about the world.  Evidence that supports a hypothesis causes us to increase our mental probability that that hypothesis is true, and vice versa. All of this sounds obvious, but it’s quite different from the black-and-white cartoon version that people are often taught.  (I’m looking at you, Karl Popper.  Falsifiability?  Feh.)

All of this brings us at last to Bayesian inference.  This is the systematic way of understanding the way that probabilities get updated in the light of new evidence.

Bayes’s Theorem relates  a few different probabilities to each other:

• The posterior probability P(H | E),  which is the probability that a hypothesis is true, given an experimental result.
• The prior probability P(H), which is the probability that the hypothesis is true, without considering that experimental result.
• The evidence P(E | H), which is the probability that the experimental result would have occurred, assuming that the hypothesis is true.

The prior and posterior probabilities are your subjective assessments of the likelihood of the hypothesis, before and after you saw the experimental result.  Bayes’s Theorem tells you quantitatively how different the posterior probability is from the prior probability — that is, how much you’ve changed your mind  as a result of the new experiment.  Specifically, the theorem says that an experiment that supports a hypothesis (that is, one in which P(E|H) is large) causes you to raise your estimate of the probability of the hypothesis being correct, while an experiment that contradicts the hypothesis (one with a low value of P(E|H)) causes you to reduce it.

Here’s the thing:  in situations where the prior probability was already very large or very small, the posterior probability tends not to change very much unless the evidence is similarly extreme.  For example, say the hypothesis is that quantum physics is not really really wrong.  Before I’d ever heard of Randell Mills, the prior probability of that hypothesis was extremely high (because of the accumulation of nearly a century of experimental evidence).  Let’s put it at 0.999999 (although that’s actually way too low).  Now let’s suppose that Mills has done his experiment really well, so that there’s only a one in ten thousand chance that he’s made a mistake or misinterpreted his results.  That means that the evidence (the probability that quantum physics is OK given his results) is only 0.0001. If you put those numbers into Bayes’s theorem and turn the crank, you find that the posterior probability is still 99%.  That is, even if I have very high confidence in the quality of the experiment, the overwhelming prior evidence means that I’ll still think it’s probably wrong.

A good analogy here is the probability of getting a false positive result in a test for a rare disease: Even if the test has a very low rate of false positives, if the disease is sufficiently rare your positive result has a high probabliity of being false.

All of this is just a long-winded way of talking about the old scientific maxim that extraordinary claims require extraordinary evidence. The nice thing about it is that it’s also quantitative: it tells you how extraordinary the evidence must be.

Some of the comments on my last post reminded me of a common bit of science mythology, namely the idea that scientific advances come from lone geniuses who overthrow the existing orthodoxy, after years of ridicule and dismissal by the scientific establishment.  There are two things to remember about this idea:

1. To a truly excellent approximation, this never happens.  It’s just not how science generally works. In the modern era, Wegener and continental drift is about the only example I can think of that might count,  but I know essentially nothing about the history of that subject, so I can’t say. It certainly is not true, for instance, that they laughed at Einstein: his ideas were recognized as important and worthy of serious consideration pretty much right away.

2. Even if it does occasionally happen that lone geniuses who are ridiculed by the establishment have great ideas, the converse doesn’t follow: people who are ridiculed by the establishment aren’t necessarily lone geniuses with great ideas.  As Carl Sagan put it a long time ago, they laughed at Galileo, they laughed at the Wright brothers, but they also laughed at Bozo the Clown.

The history of science has very few crazy ideas that turned out to be right, in comparison with the number of crazy ideas that turned out to be crazy.

Update (Nov. 21): Mack in the comments has pointed out that Blacklight Power has an mp3 of the radio story I’m talking about on their web site.  Thanks for letting me know.  I just took a second listen.  It’s just as bad as I remembered.

Our local public radio station ran a piece today on the claims by Blacklight Power to have found a way to extract huge amounts of energy from ordinary hydrogen.  I’m sorry to say this, because I’m a big fan of public radio (yes, I’m a member, and you should be too)  but this was a really lousy piece of journalism.

It’s one of the only things I’ve heard on the station that’s even worse than the Virginia Stock Report: that’s just ludicrously pointless, whereas this report was actually harmful.

The people at Blacklight Power claim that there is another energy level of hydrogen, far below the usual ones, and they have a way of causing hydrogen atoms to drop into this lower state, releasing large amounts of energy.  There is an essentially complete consensus among physicists that this is impossible.  For one thing, the existence of this energy state would violate the Heisenberg uncertainty principle, one of the best-tested laws in modern physics.

The radio report adopts the usual pseudo-balanced tone, noting that “some scientists” are skeptical, but it completely fails to make clear that this is a fringe theory and that the overwhelming scientific consensus is that the Blacklight people are wrong.  As anyone who pays attention to science and the media knows all too well, this sort of pseudo-balance is exactly the sort of thing that gives aid and comfort to creationists.  If you’re a science journalist, and you actually believe in science, don’t do this.

A couple of notes:

1. The Blacklight people say that an independent lab at Rowan University has replicated their results.  But the lab uses samples prepared by Blacklight with unknown properties, and all they see is bursts of energy that they don’t know the cause of.  I’m quite prepared to believe there are bursts of energy, but it’s just some chemical reaction having to do with the way the sample was prepared.

2. I’m definitely not accusing Blacklight of deliberate fraud.  On the contrary, as a New York Times article points out,  the company’s adopting a very poor strategy if that’s their goal.  I think they genuinely believe they’re onto something, and they’re just wrong.

Of course, if they’re right and I’m wrong, then (a) they’ll get rich,  (b) I won’t, (c) they’ll solve the world’s energy problems, and (d) we’ll have a major revolution in physics.  I’ll be thrilled by (c) and (d) and perfectly content with (a), which will be well-deserved.  And I can live with (b), which will happen regardless of whether they’re right or wrong.

But anyway, it’s all irrelevant, because they’re not right.  A century of incredibly rigorously tested science says so.

Podcast: Play in new window | Download

The paper Austin Bourdon and I wrote (described in an earlier blog post, and available on the web) has been officially accepted for publication.  The referee accepted it as is, without asking us to change anything, which doesn’t usually happen, at least not to me.

Congratulations to Austin for joining the ranks of published scientists.  Sadly, he’s not even a physics major anymore.

Since I went after after Gregg Easterbrook for promoting intelligent design, Matt Trawick suggested that I should link to a couple of the good things he’s written about NASA and the space shuttle program. Here are a few examples.

Recently, Easterbrook has explained why plans for a lunar base make no sense. He wrote more broadly about NASA’s misplaced priorities for human space flight. He’s been a big space-shuttle skeptic since at least 1980.

I thought that he was the one who coined the phrase “billion-dollar flagpole sitting” to describe our recent priorities on human space flight, but I can’t find confirmation of that.