Estimand
The precise question a trial result answers. Two estimands from one trial can differ by two points, and both are correct.
An estimand is a precise description of the treatment effect a trial is trying to estimate. The framework comes from the ICH E9(R1) addendum, adopted by drug regulators in November 2019. Its central problem is what the guideline calls intercurrent events: things that happen after randomisation, such as stopping the drug, switching to another treatment or needing rescue therapy, which change what the final number means.
The addendum lists five attributes that define an estimand: the treatment, the population, the variable (the endpoint), how intercurrent events are handled, and the summary measure, such as a difference in means.
The two you see in GLP-1 trials
- Treatment policy, or treatment regimen. Counts everyone randomised, whatever happened after. If someone stopped the drug at month four, their week 68 weight still counts. This answers: what happens to people who are prescribed this drug?
- Trial product, or efficacy. A hypothetical strategy. It estimates the result had everyone kept taking the drug as intended. This answers: what does the drug do in people who take it?
| Trial and arm | Treatment policy | Trial product / efficacy |
|---|---|---|
| STEP 1, semaglutide 2.4 mg, 68 weeks | -14.9% | -16.9% |
| STEP 1, placebo | -2.4% | -2.4% |
| SURMOUNT-1, tirzepatide 5 mg, 72 weeks | -15.0% | -16.0% |
| SURMOUNT-1, tirzepatide 10 mg | -19.5% | -21.4% |
| SURMOUNT-1, tirzepatide 15 mg | -20.9% | -22.5% |
| SURMOUNT-1, placebo | -3.1% | -2.4% |
The efficacy numbers are always larger, because people who stopped early and lost less are modelled as if they had stayed on. The SURMOUNT-1 efficacy figures above come from Lilly's April 2022 announcement; the NEJM paper's headline is the treatment-regimen estimand.
Other strategies
The addendum describes five strategies for handling intercurrent events: treatment policy, hypothetical, composite variable, while on treatment and principal stratum. Obesity trials mostly report the first two. A composite strategy would count stopping the drug as a failure outcome; a while-on-treatment strategy would look only at the period before stopping. Each answers a slightly different question, and a protocol has to say which one it uses before the data are unblinded. A different choice can move the headline by a couple of points without the drug changing at all.
Which number to use
Neither is wrong. They answer different questions. Treatment policy is closer to real life, where some people stop. The efficacy estimand is closer to what the drug does when taken. The mistake is comparing one trial's efficacy number with another trial's treatment-policy number, which makes the first drug look better by a point or two for reasons that have nothing to do with the drug. Press releases tend to lead with the larger figure; the published paper usually leads with treatment policy. Check which one you are reading. The drug comparison page and the clinical trials page label each figure.
Your own record is a treatment-policy estimand of one: missed doses and breaks included. The dose log captures those alongside weight, so the trend you see reflects how you actually took the drug.
Related terms: placebo-controlled trial, confidence interval, clinical trial phases, hazard ratio. Back to the glossary.
Questions people ask
What is an estimand?
A precise definition of the treatment effect a trial estimates, including how it handles events such as people stopping the drug. The framework is set out in the ICH E9(R1) addendum, adopted in 2019.
Why does STEP 1 report both 14.9 and 16.9 percent?
14.9 percent is the treatment-policy estimand, counting everyone randomised. 16.9 percent is the trial product estimand, which estimates the result had everyone stayed on semaglutide. Placebo was 2.4 percent under both.
Is the 22.5 percent tirzepatide figure real?
Yes. It is the efficacy estimand for 15 mg in SURMOUNT-1. The treatment-regimen estimand for the same arm is 20.9 percent.
Which estimand should I compare across trials?
The same one in each trial. Comparing one trial's efficacy estimand with another's treatment-policy estimand exaggerates the difference.
Sources
- ICH E9(R1): addendum on estimands and sensitivity analysis in clinical trials, International Council for Harmonisation, adopted 20 November 2019
- Once-weekly semaglutide in adults with overweight or obesity (STEP 1), New England Journal of Medicine, 2021
- Efficacy and safety of once-weekly subcutaneous semaglutide 2.4 mg in adults with overweight or obesity (STEP 1), trial product estimand, University of Leicester research repository, 2021
- Tirzepatide once weekly for the treatment of obesity (SURMOUNT-1), New England Journal of Medicine, 2022
- Lilly's tirzepatide delivered up to 22.5% weight loss in adults with obesity or overweight in SURMOUNT-1, Eli Lilly, April 2022
