One of the most frequent complaints about evidence-based medicine (EBM), in contrast to science-based medicine (SBM), is its elevation of the randomized clinical trial as the be-all and end-all for clinical evidence for an intervention for a particular disease or condition. Unknown but enormous quantities of “digital ink” have been spilled explaining this distinction right here on this blog, beginning with our founder’s very first post, continuing with Kimball Atwood’s series of posts explaining the shortcomings of EBM’s reliance on clinical trials über alles using homeopathy as his example, to my referring to this aspect of EBM as “methodolatry,” defined as profane worship of the randomized controlled clinical trial (RCT) as the only valid method of clinical investigation. The problem, of course, with methodolatry, is that it completely ignores prior plausibility, and when that prior plausibility is as close to zero as you can imagine (e.g., for clinical trials of homeopathy), then the only positive results that you see in such trials can reasonably be concluded to be due to noise, shortcomings in trial design, and bias. Unfortunately, a failure to realize this has led to many pointless clinical trials and contributed to the rise of a whole new “specialty” known as integrative medicine, dedicated to “integrating” quackery and pseudoscience into science-based medicine.
So we know that practitioners of “complementary and alternative medicine” (CAM), now referred to more frequently as integrative medicine, don’t like RCTs. They love pragmatic trials, because such trials are usually unblinded, often not randomized, and generally face a lower bar of evidence. That pragmatic trials are intended to test the “real world” use of medical and surgical interventions that have already been shown to be safe and effective in RCTs and that the vast majority of CAM nostrums have not met that standard appears not to concern them in the least. However, CAM practitioners are not the only ones critical of RCTs, as I learned when, via Steve Novella, I came across an article in The New England Journal of Medicine entitled “Assessing the Gold Standard — Lessons from the History of RCTs” by Bothwell et al. Given that the article is two weeks old, I wonder how I missed it. Be that as it may, although Bothwell et al make some good points, I tend to agree with Steve that the overall gist of the article is overly critical, to the point of, as Steve put it, portraying the RCT as broken rather than flawed and advocating revolution rather than reform.