[Question] how do you actually verify SURPASS
Slightly embarrassed to be asking this, but: how do you actually verify SURPASS.
Argued for a week about a result and then read the limitations section, which conceded most of my opponent’s point.
On means, which this board treats as targets and which are nothing of the sort.
A reported mean body weight change is the centre of a distribution that in these trials is very wide. Substantial numbers of participants did much better, and substantial numbers did considerably worse while remaining on the drug and in the analysis.
Quoting the mean as an expectation therefore misleads in both directions: it makes ordinary results look like failures and it makes exceptional results look normal. If a paper publishes the distribution — and several do, in the appendix — look at that instead. It is far more informative than the number in the abstract.
Why comparing across trials almost never works, with the specific failure modes.
Different populations: an obesity programme and a diabetes programme enrol different people with different baseline characteristics. Different endpoints: body weight change, glycaemic control and cardiovascular events are not convertible. Different durations: 68 weeks and 72 weeks are not the same, and the curves have not flattened by either.
Different analysis populations: one paper reports intention-to-treat, another emphasises completers. Different support: some trial designs include structured lifestyle contact that no member of this board receives.
Stack those and the "X beats Y" tables that circulate here are comparing five things at once and attributing the difference to the molecule.
Happy to answer the boring questions. Those are usually the ones worth asking.
best — the order this archive was captured in
Added the trial identifier to the title so this thread is findable in two years.
Not convinced. Cross-trial comparison between two programmes with different populations and designs is not a comparison.
Not convinced.
Agreed. And the interval, not the point estimate, is what the trial actually established.
Is that intention-to-treat or completers?
Is that intention-to-treat or completers?
Adding the check nobody runs — the registered protocol is public and takes two minutes to compare.
A confidence interval is the range of effects compatible with the data. Two trials with overlapping intervals have not disagreed, whatever their point estimates look like next to each other.
Quoted a figure here confidently, got asked whether it was ITT, went and checked, and it was not. Learned something.
Do you have the publication or the press release?
SURPASS is the diabetes programme and reports glycaemic endpoints
Right — trial participants get structured support. Comparing yourself to a trial mean is comparing across two different interventions.
- 1A confidence interval is the range of effects compatible with the data. Two…6 comments in this branch · started by u/customs_seizure_sid