The Brain Health Insider

Blog

  • “Clinically proven” on a supplement box: a checklist for the study behind it

    “Clinically proven,” “clinically studied,” and “science-backed” appear on supplement packaging constantly. Sometimes there is a serious trial behind the phrase. Sometimes there is a study of twelve people, funded by the manufacturer, measuring something that is not the outcome you care about.

    The phrase itself will not tell you which. These six questions will.

    1. Was the study on this product, or on one ingredient?

    The most common gap. A trial establishing that a compound helps at 500 mg says nothing about a blend containing 50 mg of it alongside eleven other things. Ingredient research is legitimate evidence about the ingredient. It is not evidence about the formula.

    2. Was it randomized, placebo-controlled and blinded?

    Without a control group you cannot separate the supplement from the placebo effect, from regression to the mean, or from the fact that people who start taking a sleep supplement often also start going to bed earlier. Blinding — neither participant nor assessor knowing who got what — prevents expectation from leaking into the measurements.

    An uncontrolled study where participants report feeling better is not evidence that a product works. It is evidence that people who buy a sleep aid expect to sleep better.

    3. How many people, and for how long?

    Small trials produce unstable results in both directions. A twenty-person study finding a large effect is a reason to run a bigger study, not a reason to make a claim.

    Duration matters just as much and is quietly skipped in marketing. A four-week study cannot support a claim about long-term outcomes.

    4. Who paid for it?

    Industry funding does not make a study wrong, and it is worth saying plainly that much of the useful nutrition research in existence was industry-funded because nobody else would pay for it. But funding is disclosed in reputable journals for a reason, and it belongs in your weighting — particularly when the sponsor also chose which outcomes to report.

    5. Was the outcome the one that matters to you?

    This is where the most sophisticated sleight of hand happens. A study might report a statistically significant change in a surrogate marker — a blood value, a lab measurement — and the marketing translates that into a promise about how you will feel.

    A change in a biomarker is a legitimate scientific finding. It is not the same as a change in symptoms, and the distance between them is often where a product’s entire value proposition sits.

    6. Was it published and peer-reviewed, or is it “data on file”?

    “Data on file” means the company has a result it has not submitted to outside scrutiny. That is not automatically dishonest — but it means no independent reviewer has examined the methods, and you are being asked to trust the interested party’s summary of its own unexamined work.

    Statistical significance is not size

    One last trap that survives every other filter. A result can be statistically significant — unlikely to be chance — and still be far too small to notice. With a large enough sample, a trivial difference becomes significant.

    When a claim cites significance but never states the actual magnitude of the change, the magnitude is usually the reason.

    The short version

    Ask what was tested, on how many people, against what, for how long, paid by whom, measuring what. Six questions, most of which can be answered from a study abstract in under five minutes. If the manufacturer will not identify the study at all, that is itself the answer.

    This article may contain affiliate links. If you buy through one we may earn a commission at no extra cost to you. It does not affect what we write or which products we cover — see our affiliate disclosure.

  • Third-party testing: what USP, NSF and Informed Sport actually verify

    Because supplements are not reviewed by the FDA before sale, a private certification industry grew up to answer the question the regulator does not: is what is in the bottle actually what the label says?

    These programs are genuinely useful. They are also routinely misrepresented, so it is worth being precise about what each one certifies.

    What the main programs check

    USP Verified. The United States Pharmacopeia is a nonprofit that publishes quality standards for medicines and supplements. Its verification mark indicates the product contains the listed ingredients in the declared potency, does not contain harmful levels of specified contaminants, will break down and release into the body within a set time, and was made under good manufacturing practices.

    NSF Certified. NSF International tests that label contents match capsule contents and screens for contaminants. Its separate NSF Certified for Sport program adds screening against a list of substances banned in competitive sport, which is why it appears on products aimed at athletes.

    Informed Choice / Informed Sport. Programs operated by LGC that focus specifically on banned substance screening, with Informed Sport applying batch-level testing.

    ConsumerLab. A subscription testing service that buys products off the shelf and publishes results. Different model — it is closer to independent journalism than to certification — and being absent from it means nothing in particular.

    The one thing none of them certify

    None of these programs evaluate whether the supplement produces a health benefit.

    A product can be USP Verified and completely ineffective. The certification means the capsule contains what the label promised, uncontaminated. Whether that ingredient at that dose does anything useful is a separate question, answered by clinical research, not by a testing lab.

    This distinction gets erased constantly in marketing. “Third-party tested” placed next to a health claim invites the reader to transfer the credibility of the first to the second. They are unrelated.

    Why the verification question is not paranoid

    The reason identity and potency testing exists is that independent analyses have repeatedly found products whose contents did not match their labels, including cases of undeclared pharmaceutical ingredients in products sold as botanical supplements. The FDA maintains a public advisory list of tainted products marketed as supplements, which is worth knowing exists.

    The categories where this risk concentrates are predictable: weight loss, sexual enhancement, and bodybuilding — precisely the categories where an undeclared active drug would produce a noticeable effect and therefore a satisfied customer.

    Reading the seal honestly

    A certification mark is a real signal and it is reasonable to prefer certified products, particularly in the risk categories above. Two cautions:

    • Check the mark is real. Certification bodies publish searchable directories of certified products. A seal printed on a label is a graphic; the directory is the record.
    • Certification is per product, sometimes per batch. A company with one certified product does not thereby have a certified catalog.

    Verification tells you the bottle is honest. Whether the honest contents do anything is the subject of clinical evidence, which is a much messier question.

    This article may contain affiliate links. If you buy through one we may earn a commission at no extra cost to you. It does not affect what we write or which products we cover — see our affiliate disclosure.

  • Proprietary blends: what the label is allowed not to tell you

    A proprietary blend is a group of ingredients disclosed on a Supplement Facts panel as a single combined weight, with the individual amounts withheld. It is legal, it is common, and it is the single largest blind spot on a supplement label.

    What the rule actually requires

    For a proprietary blend, the manufacturer must disclose two things: the total weight of the blend, and the ingredients in descending order by weight.

    That is the whole requirement. The amount of each individual ingredient can be omitted.

    So a label reading:

    Proprietary Sleep Matrix — 1,200 mg Valerian root, passionflower, chamomile, melatonin

    tells you truthfully that there is more valerian than passionflower, more passionflower than chamomile, and more chamomile than melatonin. It is entirely consistent with that blend containing 1,190 mg of valerian and roughly ten milligrams split across the other three.

    Why this matters more than it sounds

    The pattern the disclosure rule permits is sometimes called fairy dusting: including a scientifically interesting ingredient in an amount far below any studied dose, so it can appear on the label and in the marketing without meaningfully contributing to the product.

    The order requirement is a real constraint and it is worth using. If the ingredient the entire advertisement is built around appears last in a four-item blend, you know it is the smallest component by weight. That is often enough to make a decision.

    The legitimate case for blends

    It would be unfair to treat every proprietary blend as concealment. The stated rationale — protecting a formulation from being copied by a competitor — is real, and formulation work does represent genuine investment.

    The problem is that the disclosure rule cannot distinguish between a company protecting real work and a company hiding an underdosed formula. Both look identical on the panel. So the burden lands on the buyer, and the reasonable response is not to assume bad faith, but to note that you have been given less information and to weight the product accordingly against a competitor that disclosed fully.

    A practical rule

    When comparing two products, treat full per-ingredient disclosure as a feature you are willing to pay for. A company that publishes exact amounts is inviting you to check its doses against the literature. A company that does not has declined that invitation, whatever its reason.

    If you want to go one step further, third-party testing answers a different question again: not what the label claims, but whether the capsule matches it.

    This article may contain affiliate links. If you buy through one we may earn a commission at no extra cost to you. It does not affect what we write or which products we cover — see our affiliate disclosure.

  • How to read a supplement facts label

    Most people buy a supplement based on the front of the bottle. The front is marketing. The back is regulated, and once you know how to read it, it tells you considerably more than the marketing does — including, sometimes, that there is very little in the bottle.

    The panel itself is required. The claims on the front are not verified.

    Under the Dietary Supplement Health and Education Act of 1994, dietary supplements in the United States are not approved by the FDA before they go on sale. The manufacturer is responsible for the safety and labeling of the product; the FDA generally acts after a product is already on the market.

    This is the single most important thing to internalize, because it inverts the assumption most shoppers bring from the pharmacy aisle. A prescription drug had to prove it works before it could be sold. A supplement did not.

    What is required is the Supplement Facts panel, and its format is specified in federal regulation. That is the part of the bottle that has to be truthful in a structured way.

    Reading the panel line by line

    Serving size. Check this before anything else, because every number below it is per serving, not per capsule. A bottle advertising “1,200 mg” that lists a serving size of three capsules contains 400 mg per capsule. A 60-count bottle at three capsules a day is a twenty-day supply, not two months.

    Amount per serving. The quantity of each ingredient. Compare this against the dose actually used in research on that ingredient, not against the largest number on the label.

    % Daily Value. Percentages are calculated against a general reference intake based on a 2,000 calorie diet. Ingredients with no established Daily Value show a dagger and a footnote instead. The absence of a %DV is not a red flag; it usually means the ingredient is a botanical or a compound without a federal reference intake.

    Other ingredients. Everything not counted as an active: binders, flow agents, capsule material, colorings. Worth reading if you avoid gelatin, particular allergens, or specific dyes.

    The part that is missing on purpose

    The panel tells you what is claimed to be in the bottle. It does not tell you:

    • whether the amount in the capsule matches the amount printed
    • whether the raw material was contaminated
    • whether the ingredient does anything at the dose listed

    Those three gaps are the reason independent testing exists, and the reason a label alone can never settle whether a product is worth buying.

    Structure/function claims, and the sentence that gives them away

    If the label says a product “supports immune health” or “promotes restful sleep,” you are reading a structure/function claim. Those are permitted without FDA review, and they come with a mandatory disclaimer, printed somewhere on the package in small type:

    These statements have not been evaluated by the Food and Drug Administration. This product is not intended to diagnose, treat, cure, or prevent any disease.

    That sentence is not boilerplate to skim past. It is the legal boundary of the claim. A product legally allowed to say it “supports joint comfort” is not legally allowed to say it treats arthritis — and if the marketing around it implies that it does, the marketing has crossed a line the label itself respects.

    What to actually do with this

    Photograph the panel and compare it against the published research on the two or three ingredients that the marketing leans on hardest. If the marketing rests on an ingredient present at a fraction of the studied dose, you have learned the most useful thing there is to learn about that product, and it took four minutes.

    Next, read what proprietary blends hide — because the comparison above only works when the label discloses per-ingredient amounts, and often it does not.

    This article may contain affiliate links. If you buy through one we may earn a commission at no extra cost to you. It does not affect what we write or which products we cover — see our affiliate disclosure.