Research brief · 2026-09-09
How to Spot a Bad Health Claim
A health claim does not need to be a lie to mislead. It only needs to skip a step a careful reader would ask about. Four real studies make each step concrete, and together they form a checklist you can run on almost any headline.
First, how big was the study? In 1996, Moseley and colleagues published a pilot trial in the American Journal of Sports Medicine testing arthroscopic knee surgery for osteoarthritis in just ten patients, five of them given placebo surgery. The placebo group reported less pain, but the authors wrote that the small numbers precluded valid statistical analysis and no conclusions could be drawn. A hint, not a finding.
Second, was there a real, blinded control? The follow-up came in 2002 in the New England Journal of Medicine. One hundred eighty patients were randomised to real arthroscopic surgery or a placebo operation with skin incisions only. Patients and assessors were blinded. At two years there was no meaningful difference in pain or function between the sham and either real procedure. A treatment that never faced a convincing fake has not ruled out belief, attention and time as the source of its effect.
Third, is a pattern a cause? In 2012, Messerli published a tongue-in-cheek analysis in the same journal showing a near-perfect correlation between a country's chocolate consumption and its Nobel laureates. Wealth drives both; a tight correlation says nothing about causation. Fourth, who paid? Kearns and colleagues in JAMA Internal Medicine in 2016 documented that the Sugar Research Foundation secretly funded a 1965 review that downplayed sugar's link to heart disease and pointed at fat instead.
None of these facts alone disqualifies a claim; plenty of small, industry-funded or correlational studies are honest. The limit is that no retrieved study tested whether running this checklist changes what people believe. It describes what a careful reader checks, which is still the best place to start.
Sources
- Moseley JB, Wray NP, Kuykendall D, et al. Arthroscopic treatment of osteoarthritis of the knee: results of a pilot study
- American Journal of Sports Medicine 1996
- Moseley JB, O'Malley K, Petersen NJ, et al. A controlled trial of arthroscopic surgery for osteoarthritis of the knee
- New England Journal of Medicine 2002
- Messerli FH. Chocolate consumption, cognitive function, and Nobel laureates
- New England Journal of Medicine 2012
- Kearns CE, Schmidt LA, Glantz SA. Sugar Industry and Coronary Heart Disease Research: A Historical Analysis of Internal Industry Documents
- JAMA Internal Medicine 2016
Peptide Proof reports what studies found. We do not give medical advice, dosing guidance, or treatment recommendations.