Feb 20 2012
One of the hallmarks of science as it has been practiced for the last century or so is that scientists share their discoveries in the peer-reviewed literature, where their fellow scientists can evaluate them, decide if they’re interesting, and then replicate them, usually as a prelude to building upon them. While the system of publication and peer review in science is anything but perfect (and, indeed, we have discussed many of its shortcomings right here on this very blog), I tend to like to view it in much the same way Winston Churchill characterized democracy:
Many forms of Government have been tried and will be tried in this world of sin and woe. No one pretends that democracy is perfect or all-wise. Indeed, it has been said that democracy is the worst form of government except all those other forms that have been tried from time to time.
I would rephrase this as:
Many forms of evaluating science have been tried and will be tried in this world of sin and woe. No one pretends that peer review is perfect or all-wise. Indeed, it has been said (by me) that peer review is the worst form of evaluating science except all those other forms that have been tried from time to time.
As mainstream medicine has become more scientific over the last century in the wake of the Flexner Report, physicians and medical researchers have similarly come to view publication in the peer-reviewed literature to be a very important component of communicating and evaluating medical discoveries. It’s not as though this is even a particularly high bar to pass, either. After all, many are the absolutely execrable papers that I (and my partners in crime here at SBM) have discussed over the last four years, nearly all of which were in peer-reviewed journals, some very prestigious. After all, if papers on “energy chelation” can find their way into decent journals and the likes of Mark and David Geier can publish in the peer-reviewed literature, while someone like Christopher Shaw can get cringe-worthy confusions of correlation with causation published, I don’t take seriously the whines of cranks who claim that they can’t publish in the peer-reviewed literature for one reason or another.
That’s why I view being published in the peer-reviewed literature as a minimum, but by no means sufficient, requirement good science. It’s also why, whenever I see a new claim, my first reaction is to see if (1) the person making the claim has published on it and (2) there are publications in the peer reviewed literature that support the claim. The first criterion helps me judge whether the person is a serious scientist; the second, whether there is any plausibility to his ideas. Sure, it’s not a foolproof scheme, but it is helpful.
I only wish antivaccinationists would do the same. That they don’t explains why they seem to be embracing someone named Dr. Hanan Polansky.
Continue Reading »