So, I guess I should’ve done this one sooner. Pseudoscience is pretty much the pinnacle of anathema to everything I’m struggling for on this blog (hey, writing dozens of words about stuff as often as five or six times a month is a real struggle sometimes). I’m all about science, and a worldview based on empirical data and testable theories. I’m an atheist, but the interesting fight isn’t just against religion, it’s against the irrationality and flawed thinking that underlies all kinds of non-reality-based beliefs and ideas, religion included.
Pseudoscience is what you get when a hopeful but misleading patina of science is used to try and smarten up some ideas which, however nice they might be, have no connection to the real world. It’s some phenomenon or notion whose fans will stand by it unwaveringly, regardless of whether it’s actually supported by any evidence. Astrology, for instance, is widely regarded as a pseudoscience. Its claims can be shown to be empty and meaningless once you bring a few actual scientific investigative techniques into it, and its adherents have to sacrifice intellectual honesty to scrape together a flimsy charade of supporting evidence.
Obviously nobody ever thinks that what they’re doing is pseudoscience. People don’t believe that they’re deliberately ignoring contradictory evidence and sticking to unsupported claims long after they’ve been shown conclusively to be untenable. They’re much more likely to think that they’re steadfastly fighting an uphill battle for a truth that the rest of the world is too blind to accept. As a result, it’s sometimes hard to untangle good, healthy debate and disagreement on the one hand, from actual pseudoscientific nonsense on the other. When people have conflicting ideas, how can you tell if there’s a reasonable, scientific difference in opposing parties’ interpretations of the data, or if one side’s just full of shit?
Well, despite what contradictory views different people might have on Ufology, or Bigfootonomy, or the current deadness-to-aliveness quotient of Elvis Presley, there are some definite protocols and standards which you have to adhere to if you want to legitimately call what you’re doing science.
When addressing pseudoscience, it’s not really constructive or desirable to simply declare “This entire field of study is bunk”, regardless of how tempting it might often be. There’s always the possibility that someone may come along and provide a robust scientific theory about something we might have written off as complete crap – and if there’s ever any evidence that this is what’s happened, we need to be open to it. But a lot of stuff is bullshit, has no supportive evidence, and isn’t likely to anytime soon.
So, rather than simply listing a number of disciplines which are stamped irreparably with the label “Pseudoscience” and may never be taken seriously by anyone who values their scientific credibility, more common is to provide a list of “red flags” – things which generally indicate poor methodology, irrational and ideology-driven research, and that you would do well to be more than usually doubtful about.
What follows is a list of these things to look out for, which should warn you that proper science might not be at the top of the agenda. I’m taking a lot of cues from similar lists at Skeptoid, and these three wikis, but with my own suggestions for how best to calibrate your bullshit detector.
Decrying the scientific method as inappropriate or inadequate to apply to this particular claim
Look, science is just awesome. As the internets are so often keen to point out (and score geek cred for referencing xkcd), it works, bitches. If you’re doing science, you really ought to have a pretty good understanding of how it works (which isn’t hard to grasp), and why it’s important to apply these principles to any new hypothesis before we credit it with being probably true.
This means that, if you’re going to claim that your new idea will revolutionise our understanding of the universe, you can’t get all touchy and offended when people start asking for proof, trying to knock it down, poking holes in it, and bringing up whatever pesky facts might cast doubt upon it. They just want to know you’re not as full of shit as all those loons with their own Grand Unifying Theories, who share your passion but whose ideas don’t make a lick of sense.
If you want people to take you seriously, and believe that you’re any different from the loons, you should be doing everything in your power to help them with their knocking and poking. Because however much this hypothesis is your beautiful darling baby, and you know it will change the world and make you a hero and persuade everyone to shove that haggard old Liberty bint out of the way to make room for a statue of you, you must never forget the crucial and constant scientific principle that it might all be total bollocks.
If you’re wrong, you should really be keen to find that out. If you’re right, you’ll have a theory that’s all the stronger and more convincing for having withstood everything that humanity’s current scientific understanding could hurl against it. This has been the path of every established theory in the whole of science. You are not above this process.
This includes medical practitioners who claim that they don’t have time to waste performing rigorous scientific tests on the alternative treatments they’re dishing out, because they’re “too busy curing people” to bother with any of that. As if all those researchers painstakingly performing controlled studies to determine the actual effects of their treatments are just trying to find ways to pass the time.
One person’s subjective interpretation of one small set of data points – say, how an individual doctor remembers the general feedback he’s got from a handful of patients about a particular pill he’s been giving them – is a far less effective way of finding out the real effects of a treatment than a proper, blinded, scientific study, which can include information from thousands of people and rule out countless potential sources of bias. These studies are why you’re not likely to get a prescription of leeches or thalidomide from your GP anytime soon. They’re the best way we have of finding out what reality is like. (Read Ben Goldacre‘s book for a more thorough discussion of things like the placebo effect, observer bias, and the numerous other phenomena which can make our personal judgments totally unreliable when it comes to the efficacy of medical treatments.)
Being batshit crazy
Now, granted, some batshit crazy stuff does in fact turn out to be real, like quantum mechanics or Mr. T, but these examples are relatively few. You can label yourself a mould-breaking freethinker unfettered by the constrictions of current paradigms, but that won’t stop people calling you an ignorant jackass. Yes, Galileo was right, even though he was viewed as heretical by an oppressive establishment dogmatically set in its ways. But just the second thing on its own isn’t enough.
It might not sit well with the part of us that wants to cheer on the underdog, and see some high-and-mighty ivory-tower types collapse under their own hubris, but most claims which totally contradict established science are going to turn out to be completely wrong. In most cases, such science is established for good reason, and has a lot of data backing it up. If all of this is going to be overturned, it probably won’t be because of a single set of results from one new experiment – particularly given how easy it is for the ignorant, scientifically illiterate, and borderline mentally unstable to make scientific claims.
Obviously this new claim may end up being borne out over time, and the old ideas will then need to be abandoned – but for every Galileo, there’s a thousand whining ideologues, raving lunatics, or honestly mistaken researchers who thought they might’ve discovered something they could publish a career-making paper on but are finding it too painful to admit to themselves that they’ve been barking up the wrong tree.
Science by press conference
“Good news, everyone! I’ve invented a new type of fish which completely vanishes when left unattended, leaving no decaying and unhygenic remains behind at all! It totally worked this one time, when Reid and Hofstadter from the physics lab challenged me to an office-chair race, and I left it completely unattended. Except for my cat, who’d been asleep by the test tube rack, but he definitely wasn’t involved. He’s not a scientist. He hasn’t even got a PhD. The point is, I’m a groundbreaking genius, and now I need substantial funding for further research. Yes, mine is the only lab to have produced any such results so far. Yes, it’s just the one result. But we’re all very excited by the empty, slightly greasy plate which constitutes our lone data point, and we look forward to developing this technology into something accessible to everyone. Did you hear what I said about funding?”
There’s a reason very little actual science tends to turn up this way, in sudden monumental bursts, where whole long-standing paradigms are suddenly overturned in one brief newscast. If someone gathers together a horde of journalists, camera crews, and other sundry spectators, to make some grand announcement about a world-shattering scientific accomplishment never before mentioned in the public sphere, then there’s a good chance that they may have taken one or two short-cuts in the actual science.
Science depends on peer review and replication of results – if you give the details of your experiments to other, independent researchers, they should be able to do the same stuff as you did, if they recreate the same conditions. You have to give other scientists a chance to try it for themselves, and maybe tighten up the protocols (like not letting the cat inside the lab) to see if there might be an explanation for your results which doesn’t imply that everything you know is wrong. A good scientist doing credible work will understand and appreciate the need for this kind of scientific rigour, and welcome the opportunity either to further bolster their claims with independent evidence, or to falsify their own findings before they do something silly like call a press conference over something that will turn out to be easily disproven by the emergence of a well fed cat.
Heads I’m right, tails you’re wrong
My first point was that the best way to prove the scientific merit of your idea is to go through all the usual rigmarole of the scientific method. One specific example of this is that you need to make sure that your idea is potentially falsifiable.
There should be a constant attitude in science – especially with regard to new and unproven ideas – which goes along the lines of, “Take THAT, supposed laws of nature!” You should be trying to bitchslap every contending theory down with the most awkward facts you can muster, and be prepared to chuck it out, if it can’t take the heat and collapses into either inconsistency or tears.
You need to be doing the kinds of experiments where you can say in advance, “We’re going to do this, this, and this, and we predict that will happen. If that does indeed happen, then great, we might be onto something – but if the other turns out to happen instead, then we’re going to have to rethink this theory.” You need to be able to point out, ahead of time, what observations could be made, which would blow your theory out of the water if they were ever reliably demonstrated. You try your damnedest to disprove it, and let everyone else have a go, and if they can’t, then you’ve got yourself a respectable theory.
All good science has something which could totally screw it up like this. Evolution? Precambrian rabbit. The Standard Model of particle physics? If the Higgs boson doesn’t turn up where it should be in the LHC. Science.
But how do you prove homeopathy doesn’t work? Well, you might have thought that repeated analysis of experimental data showing it to have no significant clinical effect beyond that of a placebo would count as disconfirming evidence, but its proponents don’t seem willing to take this as a sign that they need to seriously rethink their ideas. In actual medicine, new treatments are constantly being tested against those already in use, and if they don’t show a significant effect, nobody keeps pushing for them to be widely adopted. They scrap it, or make some significant changes before testing it again, and don’t keep prescribing it to people in the meantime as if it worked. Homeopaths don’t seem to work like this. If someone isn’t willing to suggest what results would falsify their hypothesis if observed, and genuinely rethink their ideas if what they predicted would happen didn’t happen, this should cast doubt on how scientific they’re being.
The pseudoscience, it ain’t a-changin’
It’s never a good sign when your supposedly scientific field goes for a long time without making any significant developments, or adapting to new information and more recent research. Any useful scientific theory makes predictions about future observations, and will generally gather supporting evidence over time as these predictions are vindicated – or, it will change and refine its ideas when new data contradicts the predictions it made.
Astrology is an excellent example in this case. There’s been almost no noticeable change to it in centuries, despite repeated disconfirming evidence, and the fact that the traditional astrological arrangement of zodiac signs simply doesn’t apply any more. I remember one day at school over a decade ago, we were discussing in class a newspaper article about the actual positions in the sky of the constellations of Leo, Aquarius, and so forth, in the modern world, compared with when the standard arrangement of western astrology was first put together. Technically, based on where the constellations actually are in the sky, it was said that my birthday should fall somewhere in Sagittarius, rather than Capricorn. But there’s been no actual progress in the study of astrology resulting from this or any other development in our understanding. It’s completely static, and oblivious to new data. This does not bode well for scientific integrity.
Whenever some new supposedly scientific practice or product throws the word “energy” around, take a shot. Wait, I mean, be skeptical. In science, “energy” is a term referring to a well defined concept, describing how much work (itself a well defined thermodynamical concept) can be performed by a force. In pseudoscience, it’s usually just some vague, wishy-washy notion of “life force“, which some subset of animate objects is assumed to possess, but which can apparently never be quantified, directly measured, or observed in any other way that might actually be useful. It can supposedly be “felt”, by those attuned to it, but this kind of claim doesn’t stand up even to a nine-year-old’s investigations.
If a new claim is based on harnessing “energy”, but never really explains what that means or how it’s consistent with our understanding of the physical laws of the universe, that’s a big red flag. It should never be enough that you’re expected to “feel” something working, because there are many, many ways that your “feelings” can be misleading.
Another magic word which, when it comes to a large number of alternative medical products, health supplements and the like, shouldn’t be nearly as persuasive as it often is. “From the ecosystem that brought you such previous best-sellers as arsenic, smallpox, cocaine, and HIV, comes our new all-natural sensation…”
Obviously that last one’s not such a great example, since we all know the AIDS virus is actually a divine punishment for gayness and/or was created by the government as a means of population control. But the point still stands that Nature’s a bitch, and you should not expect her to be on your side. Chemicals designed specifically to be as beneficial to humans as possible, on the other hand, might be a better option.
Don’t go too far the other way and assume that natural = bad, or your diet will take a serious downturn – but if the “natural” quality of some remedy is being touted as a plus, there’s a good chance it’s meant to be emotionally persuasive, because there’s really nothing rational or logical to be persuaded by.
It cures cancer, makes the bed, and house-trains your unicorn
If something’s too good to be true, then it’s tautologically bullshit. And if a new scientific development comes overflowing with promises of the many wonderful ways it will change your life for the better, the problems it will solve, and the quick fixes it will fix quickly, then that should be a hint that the people making these claims might be more interested in parting some fools from their money than genuinely breaking new scientific ground. (This is especially true if the grandiose promises are being made in a high-profile public announcement, and the practical results are all still yet to materialise.)
Does it work?
TRY BUY IT AND SEE FOR YOURSELF
If the people doing the research are also the people taking your money for the product whose efficacy they’ve been researching, that’s not a great sign. What should be even more suspicious is when they can’t provide any actual data to suggest that the product works, and their best suggestion is that you spend your own money (or even just your own time and effort) on performing a non-blinded and unreliable study by yourself, with a sample size of one. (That one being you. And nobody is a statistically significant sample size all on their own.)
If they’re promoting or selling it, and making claims for its effectiveness, there should really be data by now supporting the idea that it actually does something. “Don’t knock it till you’ve tried it” might be a fine way to approach, say, oysters, or bungee jumping, or homosexuality, but it’s not a sound principle on which to base scientific research.
It’s a conspiracy!
The usual reason for ideas not being accepted by the scientific community is that they’re bad science. People who claim that their amazing findings are being suppressed by a conspiracy are much more likely to fall into the “batshit crazy” category mentioned above, than to have actually achieved anything that anyone could possibly have reason to suppress. It’s much more likely that they just don’t have the data to suggest that their hypotheses are anything other than wishful thinking, and so the scientific community is justifiably uninterested.
It profoundly misunderstands the nature of science and the motives of scientists to suggest that there exists any kind of grand conspiracy which is innately hostile to new ideas, and strives to preserve the status quo. Science is all about discovery, and improving our understanding, and scientists love discovering new stuff they can’t explain, and for which they’ll have to come up with a new theory. If you’re even dimly aware of something called “the past”, and have an idea of what things were like there, and how different were the levels of technology and our understanding of the world, then it should be clear that science is anything but stagnant and unchanging.
Sometimes, an individual scientist will be too attached to their preferred, established theory to accept new data which should prompt them to update their ideas. But the process as a whole is geared entirely around going where the evidence points, and people complaining about their ideas not being accepted probably just don’t have any such data.
foorp fo nedruB
That’s a reversed burden of proof, for those of you busy trying to translate it from Klingon or something. If someone comes along with a new product or scientific claim, you’re under no obligation to take them seriously until they’ve demonstrated that it works. You’re not obliged to prove that it’s completely impossible before making any kind of judgment, or give them the benefit of the doubt until then.
Homeopathy and astrology, for instance, are both claimed to work by mechanisms that seem entirely implausible, based on our current understanding of multiple areas of science. This doesn’t prove with absolute certainty that nothing will ever come of them, but nobody’s interested in doing that. You can’t absolutely prove that my pet unicorn Hildegaard isn’t spying on you right now and telepathically reporting your every move back to me, but that doesn’t mean you need to treat it like a credible theory. These ideas all fail a number of basic tests for scientific plausibility, so until someone actually produces some convincing, repeatable, rigorously scientific results, you can ignore the crackpots continuing to promote them. If you’re not being presented with any data, but still being told to “trust” this idea, or told that your skepticism isn’t appropriate or justified, then you might just be looking at a big ol’ steaming pile of pseudoscience.
Impedimentarily obfuscatory collocution
As is so often the case, things go much more smoothly and productively in science if people know what the hell you’re talking about.
Science has jargon in almost every field, and this is fine and necessary. Physicists, for instance, often talk about neutrinos, and quarks, and bosons, and fermions, and many other terms not in common usage. But this doesn’t make them needlessly technical and opaque; they’re just labels for things which don’t often come up in discussion outside of particular scientific circles. Someone not familiar with the sport of badminton might not know the word “shuttlecock”, but they could probably get to grips with it and use it appropriately after being shown what one is. They wouldn’t insist on everyone avoiding the technical talk and referring constantly to “the ball thingy with the feathers on”.
Expecting physicists to go without these terms would be like abandoning the words “man” and “woman”, and attempting to describe people’s gender in terms of factors like their shape, or anatomy, or whether they smell nice. It doesn’t add anything to transparency, or simplify the discussion at all (in fact, quite the opposite).
Corporate jargon is an endlessly fun object of mockery, even though a lot of the phrases involved seem to be perfectly acceptable idioms communicating useful concepts that our language doesn’t otherwise account for. People usually start taking objection when it’s not really being used to communicate anything – when pointlessly verbose and grandiloquent language is used as if to deliberately obscure the meaning. (“Synergy” can actually mean something, but it can just be something to say if you want to sound business-savvy.)
A common sign of pseudoscience is to see lots of technical language being thrown around which looks plausibly scientific, but can’t be consistently reconciled with any other scientific field, or which doesn’t explain its jargon expressions in more mundane terms. SkepticWiki has some good examples, including “quantum biofeedback”, “Counter Clockwise Molecular Spin of Water Molecules”, and “total consciousness of the universe”. There’s also a lot of technical-sounding variants on the ill defined concept of “energy”, as mentioned above. This sort of thing should raise your skeptical hackles still further.
I’ll add more in future, but this seems like an adequate start.
Read Full Post »