Readers of Science Based Medicine are quite familiar with the distressingly common logical leap made by disgruntled healthcare consumers into alternative medicine. It goes something like this: I had a terrible experience with a doctor who [ignored/patronized/misdiagnosed] me and I also heard something horrible in the media about a pharmaceutical company’s misbehavior [hiding negative results/overstating efficacy/overcharging for medications], therefore alternative treatments [homeopathy/acupuncture/energy healing, etc.] must be more effective than traditional medicine.
Much to my dismay, a similar logical leap is being made about online health information. It goes something like this: Peer reviewing is biased and often keeps innovative research hidden to the world at large, therefore the best kind of peer review is open-access where anyone in the world can contribute.
You may feel free to slap your forehead now.
While I have absolutely no doubt that doctors have their shortcomings, and that some have created less than pleasant healthcare experiences for their patients – the solution to these shortcomings is not to dive headlong into snake oil. Moreover, I agree that the current peer-review process has its flaws and limitations – the solution is not to ask Aunt Enid in Omaha what she thinks of the recent meta-analysis of perioperative beta blockers in patients having non-cardiac surgery.
Peter Frishauf, the founder of Medscape, recently published a webcast editorial predicting that:
“Peer review as we know it will disappear. Rather than the secretive prepublication review process followed by most publishers today, including Medscape, most peer review will occur transparently, and after publication.”
He goes on to describe a Wikipedia-like review scenario where:
“Any user can start an article, link it to related sources, and publish revisions with a click of the mouse. Anyone who reads an article can edit it.”
I know and like Peter very much, and his foresight (that publishing should become open-access), combined with the leadership of editorial heavy-weight, Dr. George Lundberg, led to the creation of the first really successful, quality, free online medical journal. This was no small feat, and a sure victory for global medical education efforts.
But the reason for The Medscape Journal’s success is not the “democratization” of peer review – but the democratization of access to trustworthy information. The quality controls are still in place – and must remain so – otherwise its value as a peer-reviewed journal will be utterly lost. Who should trust the edits of unqualified readers? Should science be determined by popular vote? Should all research be published by journals, regardless of its fatal flaws?
Continue Reading »