In yet another round of science by press release, a particularly unimpressive acupuncture study is making the rounds of the major news outlets proclaiming that acupuncture works. I guess that is a sort-of answer to my title question – why are so many scientifically worthless acupuncture studies being done?
Let’s take a look at this particular study to see why it is so weak. All I have to go on is the press release, since the study is not published. It was presented at a scientific meeting – which is legitimate, I just don’t have access to it. (The bar for publication in a peer-reviewed journal is much higher than presentation at a meeting, and there may, in fact, be changes to the text prior to publication.) But we can still say a great deal about this study from the information provided.
Bisphenol A (BPA) is a chemical used in the manufacture of hard plastics which can be found in a wide range of products, including baby bottles, plastic utensiles, and plastic food containers. It has been the focus of some controversy over its safety, and the resulting debate reveals much about how the current system deals with such issues.
The concern is that BPA can leech from plastic containers into the food or liquid it contains, and when consumed can have negative health effects. The debate is over how to interpret existing evidence about BPA safety, which gives conflicting results. Essentially it is a debate about how to weight different kinds of evidence, and where safety thresholds should be.
The Science of Toxins
Toxicity is always a function of dose. Anything is toxic at high enough dose, and safe at a low enough dose. Regulatory agencies concerned with protecting the public health, therefore, typically use scientific evidence to establish doses that are likely to cause toxicity in humans and then set safe levels of exposure significantly below that level to create a buffer of safety. But what kind of evidence is used?
The Center for Disease Control (CDC) conducts an ongoing telephone survey of medical problems and health care utilization – called the National Health Interview Survey (NHIS). They recently released their data from 2007. This is the first year for which they specifically broke out questions assessing the use of so-called complementary and alternative medicine (CAM).
CAM is a political/ideological entity, not a scientific one. It is an artificial category created for the purpose of promoting a diverse set of dubious, untested, or fraudulent health practices. It is an excellent example of the (successful) use of language as a propaganda tool.
The fundamental intellectual flaw of “CAM” as a concept is that it is made to include modalities that are extremely diverse, even mutually contradictory, under one umbrella. Very deliberately modalities which are scientific and mainstream, like the proper use of nutrition, are often included under the CAM umbrella by proponents in order to make it seem like CAM is a bigger phenomenon than it actually is, and as a wedge to open the door for the more pseudoscientific modalities.
Peer-review is a critical part of the functioning of the scientific community, of quality control, and the self corrective nature of science. But it is no panacea. It is helpful to understand what it is, and what it isn’t, its uses and abuses.
When the statement is made that research is “peer-reviewed” this is usually meant to refer to the fact that it has been published in a peer-reviewed journal. Different scientific disciplines have different mechanisms for determining which journals are legitimately peer-reviewed. In medicine the National Library of Medicine (NLM) has rules for peer-review and they decide on a case by case basis which journals get their stamp of approval. Such journals are then listed as peer-reviewed.
Increasingly there is a cultural trend toward health care freedom and empowerment. This trend is partly a reaction to the paternalism of the past, and reflects an overall change in attitude by the public toward all institutions and authority. Within medicine there has also been a move toward the partnership model of practice – where patients are well-informed full partners in the decision-making process. But this trend has also been fueled by providers who want the public to have the freedom to choose their unconventional treatment, even if it does not meet reasonable standards for evidence or even ethics.
In addition the public must deal with an increasingly free health care market with an expanding array of products, and claims to back them up. The internet has served to facilitate and accelerate this process.
Therefore public education about common health matters is more important than ever. Part of the mission for this blog is to improve public health education, to correct common misconceptions, help put recent research into proper perspective, and to counter false or misleading propaganda or marketing claims. There seems to be an intense need for such correction, and mainstream media and the internet are full of misinformation. News outlets are a mixed-bag, sometimes providing helpful information, but more often emphasizing unusual or dramatic health risks while ignoring far more important but less interesting ones.
The public is often left to fend for themselves in the marketplace of medical devices and health aids. Current regulations in most countries are inadequate to prevent grossly misleading claims in advertising and to provide adequate evidence for safety and effectiveness for products on the market. So it is helpful for consumers to be aware of the red flags for dubious devices to watch out for.
I came across this ad for The Rebuilder, which purports to be a treatment for painful neuropathy. About 2.4% of the population has some kind of peripheral nerve damage (neuropathy), which means there are about 7.2 million Americans with neuropathy. In most cases there is no cure (although there is effective treatment for some of the symptoms of neuropathy) so it is not surprising that neuropathy is a common target for questionable treatments and devices.
The ad is full of misleading or unsupported claims and blatant misinformation and provides an excellent example of the many features of quackery marketing to look out for.
The internet is arguably the ultimate expression of democracy and the free market. For the cost of internet access anyone can pull up a virtual soap box and preach to the world. There are no real gatekeepers, and the public can vote with their search entries, clicks, and links. Every point of view can be catered to and every special interest satisfied. Type in any obscure term or concept into Google and see how many hits you get (“banana farming” yielded 1,470,000 hits).
There is potentially a downside to this as well, however. Because there are websites fashioned for every opinion and perspective no one has to venture far out of their intellectual comfort zone. Virtual communities of like-minded individuals can gather and reinforce their prejudices, and to varying degrees keep out contrary opinions. This is harmless when dealing with aesthetic tastes, but can be stifling to intellectual discourse.
On the other hand defining the mission, scope, and character of a blog, website, or forum is necessary to some degree. Every site does not have to be a free-for-all. If biologists want a forum to politely discuss biological topics in a collegial fashion they have the right to create a virtual space in which to do that, and whoever owns and operates the site has the right to mandate whatever rules they wish. Allowing political activists to overrun the site and hijack the conversation would be counterproductive. Like most things a healthy balance probably works best.
There is general agreement that the US, and the West in general, is in the midst of an obesity epidemic. Even if you think this is alarmist or overstating the situation, the data clearly shows a steady expansion of the American waistline. Weight loss is a multi-billion dollar industry and is an active area of research, and yet all the self-help books, low-carb diets, and whole grain foods do not seem to be translating into successful weight loss for the public. Why is this?
From my perspective the failure of the weight-loss industry and public health measures is due to a failed approach – focusing on factors that have a small overall effect on weight loss while neglecting those that have a huge impact.
From an individual perspective, weight loss is simple (although not easy). It is a matter of calories in vs calories out – you cannot escape this equation. This means eating less and moving more. Simple, basic strategies to help reduce caloric intake seem to be the most effective. This means portion control, and limiting calorie-dense foods. The latter requires knowing how many calories are in food you are likely to consume (that Starbucks Mocha Breve has 580 calories). Limiting total caloric intake also means keeping track of how much you eat – which is deceptively difficult to do. Most people fail on diets because they simply underestimate their total caloric intake.
People with HIV are living longer on the latest anti-retroviral therapy. This is something any infectious disease specialist knows from their own clinical experience – but it’s reassuring (I would even argue necessary) to have objective data to support experience. A study published in the latest issue of Lancet provides this objective data. (Lancet. 2008 Jul 26;372(9635):293-9.)
The press release from Bristol University, academic home of the lead author, says:
Professor Jonathan Sterne of Bristol University’s Department of Social Medicine and Professor Robert Hogg of British Columbia Centre for Excellence in HIV/AIDS and Simon Fraser University, Vancouver, Canada and colleagues from The Antiretroviral Therapy Cohort Collaboration (ART-CC) compared changes in mortality and life expectancy among HIV-positive individuals on cART.
This collaboration of 14 studies in Europe and North America analysed 18,587, 13,914, and 10,584 patients who started cART in 1996-99, 2000-02, and 2003-05 respectively.
A total of 2,056 patients died during the study period, with mortality decreasing from 16.3 deaths per 1000 person-years to in 1996-99 to 10.0 in 2003-05 – a drop of around 40 per cent.
Potential life years lost per 1000 person-years also decreased over the same time, from 366 to 189 — a fall of 48 per cent. Life expectancy increased from 36.1 years in 1996-99 to 49.4 years in 2003-05, an increase of more than 13 years.
In response to my NeuroLogica blog post on Monday, David Kirby wrote a response in the Huffington Post and Dr. Jon Poling (father of Hannah Poling) wrote an open letter to me, placed in the comment section and posted at Age of Autism. It seems only polite that I respond to their kind attention.The primary focus of my original post (which I further developed yesterday) was that the media is focusing too much attention on what celebrities and politicians are saying about the controversy surrounding the discredited notion that vaccines are a significant cause of autism. Over the past year Jenny McCarthy (now joined by her boyfriend Jim Carrey) has become the major spokesperson for a movement that, at its core, is anti-vaccine and is dedicated to the scientific opinion that vaccines are toxic and cause autism. Recently actress Amanda Peet joined the fray, professing her belief that vaccines are safe, are not associated with autism, and that parents who do not vaccinate their children are “parasites” for depending on other parents who do. (She later apologized for that remark, calling it “divisive”.)
While I appreciate Amanda Peet’s support, I feel strongly that scientific questions should be handled by the scientific community. Celebrities are great when they support causes – but when they second guess the scientific community and decide to advocate for their own scientific conclusions, they are more likely to cause harm than good. (more…)