This August was a tough month for SBM bloggers reading The New England Journal of Medicine (NEJM). Just one week after a review of acupuncture for back pain—in which the authors recommended referring patients to traditionally trained acupuncturists despite data showing that traditional needling does not outperform a blinded sham control (click here here here for the trifecta takedown)— NEJM featured an original article about a study of Tai Chi for fibromyalgia. As critiqued by Dr. Gorski, the control intervention for the Tai Chi study was arguably inappropriate: the test and control groups experienced different intensities of exercise, for different durations of time, led by different instructors with different levels of enthusiasm. The special pleading and the weak design were not of themselves surprising, only their presence in such an august journal.
A group of editorial authors in that same NEJM issue preemptively address the SBM critics by describing Tai Chi as a “complex, multi-component therapy” and thereby implying that an appropriate sham cannot easily be designed. I agree that studying Tai Chi must be trickier than matching drugs to sugar pills. But “complex, multi-component” interventions can indeed be studied in a way that leads to convincing conclusions, as illustrated in the August 25, 2010 issue of The Journal of the American Medical Association (JAMA). A team of Boston psychologists studied a complex, multi-component intervention for attention deficit-hyperactivity disorder (ADHD) and reported their findings in “Cognitive Behavioral Therapy vs Relaxation With Educational Support for Medication-Treated Adults With ADHD and Persistent Symptoms: A Randomized Controlled Trial.” The abstract: (more…)