As promised at the meeting. Let me know by comment if you think I left anything out.
Archive for Science and Medicine
Functional Medicine – What is it?
After extensive searching and examination, my answer is still – only the originators of “FM” know. Or, at least one must assume they know, because so far as I can see, I certainly see nothing that distinguishes “FM” from other descriptions of sectarian and “Complementary/Alternative Medicine” practices. A difference may lie in the advocates’ assumptions to have found some “imbalance” of body chemistry or physiology before applying one or more unproved methods or substances. From what I could determine, the “imbalance” or dysfunction is usually either imaginary or at least presumptive. And the general principles are so poorly defined as to allow practioners vast leeway to apply a host of unproven methods.
I figured there would be several ways to find out. One would be to read FM’s material – mainly what “they” placed on the Internet. Another would be to enter the system and find out as a patient or as a prospective practitioner what it is that “FM” claims to be. The third would be to listen to a practitioner or advocate on tape, disk, radio, etc.
The Science-Based Medicine Conference has begun! Val is Twittering it at:
Check it out at the tags #TAM7 and #SBM.
In case you’re coming late to this discussion (or have ADD), I’ve summarized Dr. Kimball Atwood’s terrific analysis of the ongoing clinical trial (TACT trial) in which convicted felons were awarded $30 million by the NIH.
In one of the most unethical clinical trial debacles of our time, the NIH approved a research study (called the TACT Trial – Trial to Assess Chelation Therapy – a supposed treatment for arteriosclerosis) in which the treatment had no evidence for potential benefit, and clear evidence of potential harm – and even the risk of death. Amazingly, the researchers neglected to mention this risk in their informed consent document. The NIH awarded $30 million of our tax dollars to ~100 researchers to enroll 2000 patients in this risky study (ongoing from 2003-present). Even more astounding is the fact that several of the researchers have been disciplined for substandard practices by state medical boards; several have been involved in insurance fraud; at least 3 are convicted felons.
But wait, there’s more.
The treatment under investigation, IV injection of Na2EDTA, is specifically contraindicated for “generalized arteriosclerosis” by the FDA. There have been over 30 reported cases of accidental death caused by the administration of this drug – and prior to the TACT, 4 RCTs and several substudies of chelation for either CAD or PVD, involving 285 subjects, had been reported. None found chelation superior to placebo.
So, Why Was This Study Approved?
The NIH and the TACT principal investigator (PI) argued that there was a substantial demand for chelation, creating a “public health imperative” to perform a large trial as soon as possible. In reality, the number of people using the therapy was only a small fraction of what the PI reported.
It’s hard to know exactly what happened “behind the scenes” to pressure NIH to go forward with the study – however a few things are clear: 1) the National Heart, Lung, and Blood Institute (NHLBI) initially declined to approve the study based on lack of scientific merit 2) congressman Dan Burton and at least one of his staffers (Beth Clay) and a lobbyist (Bill Chatfield) worked tirelessly to get the study approved through a different institute – NCCAM 3) some of the evidence used to support the trial was falsified (The RFA cited several articles by Edward McDonagh, the chelationist who had previously admitted in a court of law to having falsified his data.) 4) The NIH Special Emphasis Panel that approved the TACT protocol included L. Terry Chappell, whom the protocol had named as a participant in the TACT.
All evidence seems to suggest that political meddling managed to trump science in this case – putting the lives of 2000 study subjects at risk, without any likely benefit to them or medicine.
A formal analysis of the sordid history and ethical violations of the TACT trial was published by the Medscape Journal of Medicine on May 13, 2008. Atwood et al. provide a rigorous, 9-part commentary with 326 references in review of the case. Congressman Burton’s staffer, Beth Clay, published what is essentially a character assassination of Dr. Atwood in response.
The NIH Writes TACT Investigators a Strongly Worded Letter
On May 27, 2009 the Office for Human Research Protections Committee sent a letter to the investigators of TACT, stating that they found, “multiple instances of substandard practices, insurance fraud, and felony activity on the part of the investigators.” The letter describes a list of irregularities and recommends various changes to the research protocol.
It is almost unheard of for a letter from the NIH to state that research study investigators are guilty of fraud and felony activity – but what I don’t understand is why they haven’t shut down the study. Perhaps this is their first step towards that goal? Let’s hope so.
The TACT trial has subjected 2000 unwary subjects and $30 million of public money to an unethical trial of a dubious treatment that, had it been accurately represented and judged by the usual criteria, would certainly have been disqualified. Political meddling in health and medical affairs is dangerous business, and must be opposed as strongly as possible. Congressmen like Tom Harkin and Dan Burton should not be allowed to push their political agendas and requests for publicly funded pseudoscience on the NIH. I can only hope that the new NIH director will have the courage to fend off demands for unethical trials from political appointees.
One of the major themes here on the Science-Based Medicine (SBM) blog has been about one major shortcoming of the more commonly used evidence-based medicine paradigm (EBM) that has been in ascendance as the preferred method of evaluating clinical evidence. Specifically, as Kim Atwood (1, 2, 3, 4, 5, 6, 7, 8) has pointed out before, EBM values clinical studies above all else and devalues plausibility based on well-established basic science as one of the “lower” forms of evidence. While this sounds quite reasonable on the surface (after all, what we as physicians really want to know is whether a treatment works better than a placebo or not), it ignores one very important problem with clinical trials, namely that prior scientific probability matters. Indeed, four years ago, John Ioannidis made a bit of a splash with a paper published in JAMA entitled Contradicted and Initially Stronger Effects in Highly Cited Clinical Research and, more provocatively in PLoS Medicine, Why Most Published Research Findings Are Wrong. In his study, he examined a panel of highly cited clinical trials and determined that the results of many of them were not replicated and validated in subsequent studies. His conclusion was that a significant proportion, perhaps most, of the results of clinical trials turn out not to be true after further replication and that the likelihood of such incorrect results increases with increasing improbability of the hypothesis being tested.
Not surprisingly, CAM advocates piled onto these studies as “evidence” that clinical research is hopelessly flawed and biased, but that is not the correct interpretation. Basically, as Steve Novella and, especially, Alex Tabarrok pointed out, prior probability is critical. What Ioannidis’ research shows is that clinical trials examining highly improbable hypotheses are far more likely to produce false positive results than clinical trials examining hypotheses with a stronger basis in science. Of course, estimating prior probability can be tricky based on science. After all, if we could tell beforehand which modalities would work and which didn’t we wouldn’t need to do clinical trials, but there are modalities for which we can estimate the prior probability as being very close to zero. Not surprisingly (at least to readers of this blog), these modalities tend to be “alternative medicine” modalities. Indeed, the purest test of this phenomenon is homeopathy, which is nothing more than pure placebo, mainly because it is water. Of course, another principle that applies to clinical trials is that smaller, more preliminary studies often yield seemingly positive results that fail to hold up with repetition in larger, more rigorously designed randomized, double-blind clinical trials.
Last week, a paper was published in PLoS ONE Thomas by Thomas Pfeiffer at Harvard University and Robert Hoffmann at MIT that brings up another factor that may affect the reliability of research. Oddly enough, it is somewhat counterintuitive. Specifically, Pfeiffer and Hoffmann’s study was entitled Large-Scale Assessment of the Effect of Popularity on the Reliability of Research. In other words, the hypothesis being tested is whether the reliability of findings published in the scientific literature decreases with the popularity of a research field. Although this phenomenon is hypothesized based on theoretical reasoning, Pfeiffer and Hoffmann claim to present the first empirical evidence to support this hypothesis.
This month I will begin my third year of medical school, after a three-year break for laboratory research. Living alternately in the worlds of med school and grad school has prompted me to reflect on differences between these training programs.
[Obvious disclaimer: I have studied at a single institution, and only for five years.]
I am enrolled in a dual-degree MD/PhD program. About 120 US medical schools have such programs, and the National Institutes of Health funds a third of them (MSTP). The schedule of such programs is generally: 2 years of medical school (culminating in USMLE Step 1), 3+ years of graduate school (culminating in dissertation and PhD), and then the last 2 years of medical school (which I begin this month). The most popular residency choices for MD/PhD graduates are internal medicine, pediatrics, and pathology (match data). Other residencies that attract these graduates include dermatology, neurology, ophthamology, and radiology (survey data). The hopes of those funding the MD/PhD training programs and of those accepting the graduates is that these individuals will become physician-scientists, bridging the divide between lab bench and patient bedside with insights from both. (more…)
When it comes to “alternative medicine” trials, it seems that the NIH is willing to experiment on people in ways that would be unthinkable for real biomedical research. The federal Office for Human Research Protections (OHRP) has posted a preliminary determination letter, dated May 27, 2009, addressing some of the charges we had made against the politics-driven NIH Trial to Assess Chelation Therapy (TACT).
It is a remarkably damning statement, particularly regarding an NIH study. That is, it found—or the recipients admitted—that each of several charges was valid. Among these are misleading statements and unstated risks in the consent form, and the embarrassing backgrounds of TACT investigators. According to the determination letter,
…investigations revealed multiple instances of substandard practices, insurance fraud, and felony activity on the part of investigators.”
A long while back, at the original wordpress incarnation of my usual blog, I wrote a piece on the reasons that chiropractic is unscientific nonsense. Because it was popular, I resurrected it. Well, a chiropractor has come to bravely defend his field and left me a comment.
A study in the May 2007 issue of the Journal of Manipulative and Physiological Therapeutics reports health plans that use Chiropractors as Primary Care Providers (PCPs) reduce their health care utilization costs significantly.
The study covers the seven-year period from 1999 to 2005. Researchers compared costs and utilization data from an Independent Physicians Association (IPA) that uses Chiropractors as PCPs and a traditional HMO that doesn’t.
The Chiropractic PCPs had 59 percent fewer hospitalizations, 62 percent fewer outpatient surgical cases and 85 percent lower drug costs compared with the HMO plans.
The patients in the Chiropractic PCP group also reported higher satisfaction with their care than the HMO group. Over the seven-year period, Chiropractic patients consistently demonstrated a high degree of satisfaction with their care that ranged from 89 percent to 100 percent.
Study co-author James Winterstein, D.C. says that patients using Chiropractic PCP health care groups “experienced fewer hospitalizations, underwent fewer surgeries and used considerably fewer pharmaceuticals than HMO patients who received traditional medical care.”
Hmmm…interesting assertions. Let’s examine these assertions and the “article” they come from. (more…)
The Cultural Revolution
After investigating ‘acupuncture anesthesia’ in the People’s Republic of China in 1973, John Bonica wrote:
From the guarded comments made by several anesthesiologists, I concluded that this disuse [of ‘acupuncture anesthesia,’ after its introduction in 1958 until the Great Proletarian Cultural Revolution began in 1966] was the result of disappointing failures in a significant proportion of patients. During the Cultural Revolution this “negative” trend of not using acupuncture was considered the work of revisionists, and subsequently greater emphasis was given to the widespread use of acupuncture in all hospitals.
Similarly, according to Petr Skrabanek,
Those who dared ask such awkward questions [about ‘acupuncture anesthesia’] were branded as “counter-revolutionary revisionists.”
Skrabanek’s reference for that assertion was this 37-page pamphlet:
One of the common themes in biology and medicine is the feeling that somehow there must be more. Creationist cults simply know that life must be more than matter, and mind-body dualists (which includes most alternative medicine advocates) are certain that humans are more than an “ugly bag of mostly water” (sorry for the geek reference). If you can stick with me here, I’ll explain to you a bit of the history surrounding this fallacy.
Most of us intuitively feel that we are both a body and a person. In every day life, it makes a certain operational sense to think of our “mind” as being something distinct. From a biological standpoint, however, this doesn’t work as well.
Biology was one of the last of the “natural philosophies” to become a science. It was clear to those who studied chemistry and physics that certain principles seemed to explain the natural world, but those who studied living things were mostly involved in description. Still, biology has become a science in its own right. According to Ernst Mayr, one of the greatest biologists of the last century, a number of events preceded biology being recognized as a legitimate science. One vital event was the recognition that all biological processes were constrained by the laws of physics and chemistry. Another important step was the rejection of two erroneous principles: vitalism, and teleology. (more…)