Archive for Clinical Trials

Acupuncture for IVF Revisited – More Tooth Fairy Science?

I read this Reuters Health article on MedlinePlus, and then I read the study the article referred to (The impact of acupuncture on in vitro fertilization) and now my head hurts. The study found that acupuncture was not effective in increasing the pregnancy rate (PR) during in vitro fertilization (IVF). As quoted on MedlinePlus, the lead author, Alice Domar, seems to blame her patients (the presumably poor quality of their embryos) rather than acupuncture for the lack of success, and then she recommends using acupuncture even if it doesn’t work. That was bad enough, but “poor quality embryos” is a hypothesis that was actually tested and rejected in the study itself. Has Domar forgotten?

The headline of the MedlinePlus article says “acupuncture doesn’t boost IVF success for all” – suggesting that it boosts success for some? Then the first sentence says the study suggested that acupuncture doesn’t work, period. But wait…

The lead researcher says acupuncture may not have worked in her study because, unlike past research, her investigation wasn’t limited to women who had good quality embryos available for transfer. “I’m wondering if my sample was just not a good sample, in that most of the patients in my study were probably not the best-prognosis patients,”
Domar and her team say the most likely explanation for the lack of an acupuncture effect in their study was the fact that they included many women who didn’t have good quality embryos available for transfer. While acupuncture may help a woman become pregnant after the transfer of a healthy embryo, the researcher noted in an interview, it can’t repair an embryo with chromosomal defects or other abnormalities.

Hold the boat!! In the Discussion section of the paper itself, Domar et al point out that previous research has included mostly patients with good quality embryos. They ask if perhaps acupuncture only works for good quality embryos? They test that hypothesis by separately analyzing the subjects in this study who had good quality embryos. There was no increase in PR with acupuncture in this sub-group; the results were the same as for the entire sample. (more…)

Posted in: Acupuncture, Clinical Trials

Leave a Comment (17) →

Human subjects protections and research ethics: Where the rubber hits the road for science-based medicine

Arguably the most difficult aspect of science-based medicine is where the rubber hits the road, so to speak. That’s where scientists and physicians take the results of preclinical studies performed in vitro in biochemical assays and cell culture models and in vivo in animal models to humans. There are numerous reasons for this, not the least of which that preclinical models, contrary to what animal rights activists would like you to believe, do not predict human responses to new therapeutic agents as much as we would like. However, the single biggest reason that we cannot answer questions in human studies as easily as we can in cell culture and animal studies is ethics. Of course, answering questions using cell culture and animal studies is not “easy,” either, but performing studies using human beings as subjects is an order of magnitude (at least) more difficult because the potential to cause harm exists, and if harm is caused by the experimental treatment under study, that harm will be done to human beings, rather than cells in a dish or mice bred for research.

The “gold standard” type of study that we do to test the efficacy of a new drug is known as the randomized, placebo-controlled, double-blinded study, often abbreviated RCT. Indeed, this remains the gold standard and is accorded the highest level of “power” in the framework of evidence-based medicine. Of course, as we have argued time and time again, using the RCT to test therapies that are incredibly implausible on a strictly scientific basis (homeopathy or reiki, for instance) inevitably leads to numerous “false positives” in which the therapy appears to produce results statistically significantly better than the control. John Ioannidis has done numerous clever analyses that demonstrate how easily clinical research is led astray if it is not grounded in scientific plausibility. Indeed, the probability of false positive studies increases, the more improbable the modality. It is for these very reasons that we have proposed the concept of science-based medicine, which takes into account estimates of prior probability based on preclinical studies and basic scientific principles, rather than evidence-based medicine, which does not. Indeed, Wally Sampson has even proposed a “plausibility scale” for rating RCTs, and Steve Novella has pointed out how difficult it can be to interpret the medical literature.

Posted in: Clinical Trials, Medical Ethics, Politics and Regulation, Surgical Procedures, Vaccines

Leave a Comment (19) →

Mathematically modeling why quackery persists

ResearchBlogging.orgIt’s often puzzled me (and, I daresay, many other skeptics and boosters of science- and evidence-based medicine) why various forms of quackery and woo that have either about as close to zero prior probability as you can get and/or have failed to show evidence greater than placebo in clinical trials manage to retain so much traction among the public. Think homeopathy. Think reiki. The former is nothing more than sympathetic magic prettied up with science-y sounding terms, while the latter is nothing more than faith healing given a slant based on Eastern mysticism and religion instead of Christianity. Indeed, reiki was even inspired by stories of Jesus’ healing powers, complete with a trip into the wilderness for fasting and prayer, resulting in revelation. Or consider acupuncture, a modality that is seemingly more popular than ever, even invading the very sanctum sanctorum of the ivory towers of academic medicine, yet every study of which that is done under rigorous conditions with proper placebo controls shows it to be no more efficacious than a placebo. It’s easy enough to shake one’s head and chalk it up to irrationality, ignorance of science, or even religious faith, but I’ve always been dissatisfied with such glib explanations, even though admittedly I have myself used them on occasion.

That’s why a study released last week in PLoS One by Mark M. Tanaka, Jeremy R. Kendal, Kevin N. Laland out of the Evolution & Ecology Research Centre, School of Biotechnology & Biomolecular Sciences, University of New South Wales, the Department of Anthropology, University of Durham, and the School of Biology, University of St Andrews, Fife, respectively, entitled From Traditional Medicine to Witchcraft: Why Medical Treatments Are Not Always Efficacious. Besides loving the title, I also like the methodology, which in essence adapts the tools of modeling evolution and the spread of traits throughout a population and asks the question: Why do ineffective or even harmful (or, as the authors characterize them, “maladaptive”) treatments for various illnesses persist in populations? The results are surprising and counterintuitive, yet ring true. In essence, the authors conclude that the most efficacious self-treatments are not always the ones that spread and that even harmful treatments can spread. Both of these observations are entirely plausible based on the prevalence of usage of common woo and quackery, and what the authors have done, in essence, is to model mathematically why quackery persists.

Indeed, the authors set the stage:

Posted in: Basic Science, Clinical Trials, Science and Medicine

Leave a Comment (30) →


Recent comments on homeopathy again resulted in references to the 1994 Pediatrics paper by Jacobs et al on use of homeopathic remedies for childhood diarrhrea.  The authors of that paper concluded from their blinded study that homeopathic remedies, tailored to the individual infants and children, were effective in reducing the number of diarrhea stools and thus in shortening the illness.  The paper has been widely referenced and reported to have proved  homeopathy efficacy, and the critiques have been argued by homeopaths as irrelevant, as has been done by Mr. Ullman.

In this short series I want to recount my experience with the report, its predecessor, and its two major sequellae, as well as its effect on systematic reviews of homeopathy.  I will begin with a description of the first two studies, concentrating on their methods. Then I will discuss the results of the 1994 Pediatrics report and the authors’ interpretation of the results. Then (I hope last) I will discuss the third paper which the authors claimed supported findings of the first two and the meta-analysis which combined data from all three. If you are imagining why this  series interests me, and imagining the worst, you are probably right. The sequence will  help to reveal how some of the information in “holistic” and “alternative” systems become published, and despite critiques and disproofs through a sort of systematic deconstructions, still develop wheels of their own and enter the fund of general knowledge seemingly forever. Or, at least for several decades, until a social belief switch is finally turned off.

Posted in: Basic Science, Clinical Trials, Homeopathy

Leave a Comment (25) →

PSA – To Screen or Not to Screen

You’ve all heard the dramatic testimonials in the media: “I had a PSA test and they found my prostate cancer early enough to treat it. The test saved my life. You should get tested too.” The subject of screening tests is one that confuses the public. On the surface, it would seem that if you can screen everyone and find abnormalities before they become symptomatic, only good would result. That’s not true. Screening tests do harm as well as good, and we need to carefully consider the trade-offs.

About half of American men over the age of 50 have had a PSA (prostate-specific antigen) screening test for prostate cancer. Recommendations for screening vary. The US Preventive Services Taskforce (USPSTF) says there is insufficient evidence to recommend screening. The American Urological Association and the American Cancer Society recommend screening. Urologists practice what they preach: 95% of male urologists over the age of 50 have been screened. But other groups like the American Academy of Family Physicians recommend discussing the pros and cons of screening with patients and letting them make an informed choice.

Two recent studies published simultaneously in The New England Journal of Medicine have added to the controversy. One concluded that screening does not reduce deaths from prostate cancer; the other concluded that it reduces deaths by 20%. (more…)

Posted in: Clinical Trials, Diagnostic tests & procedures

Leave a Comment (19) →

Medical Propaganda Films

David Gorski suggested I expand on a comment I left recently on one of his November posts. His subject was the then new documentary movie, “A Beautiful Truth.“ “Truth” is about the Gerson method – the dietary deprivation cum coffee enema cancer treatment developed by Dr. Max Gerson, a refugeee from Germany I the 1930s. His daughter, Charlotte now runs the Gerson Institute in Tijuana, Mexico. Gerson is one of the models for the Gonzales method recently reviewed by Kim Atwood.

I had previously referred to the movie in a prior post (1) (but in a different context. Here I’ll explore the movie from a different angle – with its partners, propaganda documentaries.

David called my attention to “Truth” plus another by the same producer – with trailers on You Tube. When I watched the trailers last year I saw myself interviewed briefly, but could not recall being filmed, or even identify where the scene took place. I had to email Steve Barrett, also in the movie, who reminded me about filmmaker Steve Kroschel’s visits 2-3 years before, although neither did he have strong memory of the interview.

Posted in: Cancer, Clinical Trials, Energy Medicine, Health Fraud, Herbs & Supplements, Nutrition, Science and Medicine, Science and the Media

Leave a Comment (24) →

When fraud undermines science-based medicine

The overriding them, the raison d’être if you will, of this blog is science-based medicine. However, it goes beyond that in that we here at SBM believe that science- and evidence-based medicine is the best medicine. It’s more than the best medicine, though; it’s the best strategy for medicine to improve therapy for our patients. We frequently contrast science-based medicine with various forms of “complementary and alternative medicine,” specifically pointing out that SBM changes its practices as new science and new evidence mandates it while CAM tends to rely on ancient, vitalistic, pre-scientific or pre-modern scientific beliefs about how disease occurs as the basis for its therapies. Although it may be painfully slow and frustrating at times and even though there may be major stumbles along the way, the overall course of SBM over the last century has in general been to produce ever more effective therapies and to discard therapies that are either ineffective or whose risk-benefit ratios are insufficiently favorable. The one single most important thing behind the advancement of medicine is good science.

That’s why I really, really hate scientific fraud, and I’m really, really upset, perhaps even more so than Dr. Atwood, over the discovery last week of what is arguably one of the most massive scientific frauds in medical history. It doesn’t matter that Dr. Atwood is an anaesthesiologist and I am not, meaning that the specific scientific fraud unearthed, which was perpetrated by an anesthesiologist studying multimodal anesthesia, as reported in Anesthesiology News, the Wall Street Journal, and the New York Times. I am a surgeon, and the relief of surgical pain in my patients is an important part of my practice. If the scientific basis of what my colleagues in anesthesiology do before, during, and after my operations is called into doubt, I have to wonder if I am giving my patients the best surgical care. Aside from that, there is the intellectual outrage I feel as a result of seeing science and patients betrayed in such a systematic and blatant manner.

Posted in: Clinical Trials, Health Fraud, Pharmaceuticals, Science and Medicine, Surgical Procedures

Leave a Comment (9) →

Scientific Fraud Hits Home

Last week the story broke that Scott Reuben, an anesthesiologist and clinical researcher at Baystate Medical Center in Springfield, MA, had falsified data in at least 21 publications over a period of at least 12 years—making it one of the most enduring examples of scientific fraud in memory. Almost all of Reuben’s papers had reported innovative methods for providing post-operative pain relief (analgesia); many of them involved ‘multimodal’ regimens for painful orthopedic procedures such as spinal fusions and total knee replacements. Recent papers reported regimens that included celecoxib (Celebrex) and pregabalin (Lyrica), both made by Pfizer. Much of Reuben’s research had been funded by Pfizer, and Reuben has been a member of the Pfizer speaker’s bureau (that information is included because the reader would otherwise wonder, but there is no indication that Pfizer has been intentionally involved in Reuben’s fraud).

I will not discuss this case in detail; look for a more comprehensive piece on SBM next week. Rather, I present it now to offer a local example of how such a breach of trust affects those who rely on clinical research to inform their care of patients.


Posted in: Clinical Trials, Health Fraud, Pharmaceuticals, Science and Medicine

Leave a Comment (7) →

A Medical-Skeptical Classic

The medical literature slowly becomes outdated. As a result there are not that many ‘classics’ in the field, since their content becomes less relevant. The medical aphorism is that 10 years after graduation from medical school, half of everything you learned will no longer be valid. The problem for medical students is trying to figure out which half of their curriculum is not worth learning.

Old studies become increasingly irrelevant as diagnosis and treatment changes over time under the relentless pressure of medicine. I once came across the best of Osler, with his descriptions of typhoid fever and pneumococcal pneumonia. The essays were far more literary in style than today’s journal articles, describing the presentation of these diseases in Dickens-like detail, but of little practical help given the advances in treatment and the understanding of the microbiology of diseases.

Technology also expands and limits what papers are available. If there is not an electronic form of an article, it might as well not exist. Many classic articles are not yet available in digital form, and the article in question for this post I had to get as a scanned version of the original paper, rather than a pdf. As a result of time and lack of electronic access, much of the older medical literature is not easily accessible, and journal publishers are not particularly interested in the free dissemination of information. Which is a shame. There is the occasional older reference that is as applicable today as when it was published. (more…)

Posted in: Clinical Trials, Science and Medicine

Leave a Comment (20) →

Fakin’ it

Last week the Times of London revealed inside information from the General Medical Council (UK, responsible for physician licensing) of an ongoing investigation of Dr. Andrew Wakefield and from its own investigation. This revelation recalled other instances of fakery from reports of sectarian medicine (“CAM”) successes. The Medical Council information contained evidence that the data from the now famous Wakefield cases used to claim an association of the MMR vaccine with childhood autism and inflammatory bowel disease were misinterpreted, altered, and to some extent, faked. The report and history were reviewed by David Gorski last week. In eight of twelve cases, the dates of autism onset were “rearranged” to fit the needed time association, and many small bowel biopsies were “reinterpreted” to show inflammation.

The Wakefield claims were long suspected by reputable medical scientists and skeptics  as being erroneous or fraudulent.  Note: the Council hearings are still in progress, and the Times report is subject to legal complaint.  The original details can also be seen in the Times articles.

This expose’ adds to a growing list of reports with erroneous and faked information in medical journals used either for economic reward, undeserved fame, or to promote ideological claims for medical sects and cults. Although history of erroneous or false claims goes back hundreds of years, the altering or synthesizing of data passing the recently conceived peer review system is new,  illuminating defects in the journal peer review and editing system.

If journals were invented in the 18th century, and operated like journals of today, Mesmer’s demonstrations might have been published, and the Ben Franklin and Antoine Lavoisier and French Academy’s disproof might have been rejected. (Laughter here.) But journals continue to make major goofs in publishing implausible results despite the popularity of a famous specialty journal for that purpose.

Examples vary from acceptance of language manipulation – “alternative,” “healing,” “integrative,” etc., to the fakery of recent papers showing effects of prayer. The two famous studies of prayer in the cardiac care unit ranged from the unadmitted breaking of the blind in the Bird study (So Med J 1988; 81:826-826) to unadmitted imbalances of subject and control groups (Harris, Arch Int Med 1999;159:2273-2278.) And from those to the likely fakery of the distant prayer study of in vitro fertilization (Cha, Wirth, Lobo; J Reprod Med 2001:46;781-786) in which three separate prayer groups on two continents improved pregnancy rates in a group of women on a third continent by an implausible 100 percent. In all of these cases, the papers passed peer or editorial review despite the methodological defects that were picked up by us skeptics (K. Atwood, K.Courcey [an RN] B. Flamm, and others.)

Adding insult to the above, Annals of Internal Medicine published a systematic review of intercessory prayer (Astin et al, Ann Int Med, 2000;132: 903-910) containing not only the Bird and Harris studies counted as positive, but also the Targ study on brain tumors, found by reporter Po Bronson to have had its end point altered by the authors when the primary one showed no effect.

Posted in: Basic Science, Clinical Trials, Faith Healing & Spirituality, Health Fraud, Medical Academia, Science and Medicine, Vaccines

Leave a Comment (7) →
Page 27 of 34 «...10202526272829...»