{"id":1288,"date":"2016-04-14T20:39:47","date_gmt":"2016-04-14T19:39:47","guid":{"rendered":"https:\/\/blogs.bmj.com\/adc\/?p=1288"},"modified":"2016-04-14T17:27:42","modified_gmt":"2016-04-14T16:27:42","slug":"subgroups-and-multiple-analysis-truth-or-herrings","status":"publish","type":"post","link":"https:\/\/blogs.bmj.com\/adc\/2016\/04\/14\/subgroups-and-multiple-analysis-truth-or-herrings\/","title":{"rendered":"Subgroups and multiple analysis. Truth or herrings?"},"content":{"rendered":"

\"river_herring_2\"We recently published, in the F&N edition, a paper reporting an RCT looking at inhaled steroid in wee premature babies to see if the treatment reduced the incidence of death and chronic lung disease<\/a>.<\/p>\n

Did we do a good job?<\/p>\n

The trial was prospectively registered, before enrolling patients, randomised and\u00a0stated it was\u00a0assessing (on the registry) the primary outcome of:<\/p>\n

Death or use home oxygen therapy (HOT) for chronic lung disease<\/p>\n

and secondary outcomes of<\/p>\n

1. Death<\/p>\n

2. Death or Incidence of chronic lung disease at 28 days<\/p>\n

3. Death or Incidence of chronic lung disease at 36 weeks of postmenstrual age<\/p>\n

4. Neurological and developmental outcome at 1 and half year old<\/p>\n

5. Neurological and developmental outcome at 3 years of age<\/p>\n

The paper reported<\/p>\n

“The primary outcome measure used to indicate the morbidity of severe BPD was death or oxygen dependence at discharge. The secondary outcomes were death, severe BPD and neurodevelopmental outcomes at 18\u2005months of PMA and 3\u2005years of age.”<\/p><\/blockquote>\n

So – we may have failed to identify in our editorial processes that the secondary outcomes #2 and #3 weren’t reported, and the occurrence of severe BPD slipped into outcomes #4 and #5. I’m OK with the primary outcome – after all, oxygen at discharge == home oxygen therapy sort of.<\/p>\n

The paper also reports that<\/p>\n

“we evaluated subgroups divided by GW at birth (22\u201323, 24\u201326 and over 26), CAM [chorioamnionitis] and RDS. The p values for the subgroup analyses are p values for interaction. We did not control for multiplicity because these analyses were exploratory”<\/p><\/blockquote>\n

Now, I have an instinctive dislike for subgroup analysis to find The Truth about stuff – there’s an entire blog on it here if you like star signs and such<\/a> – but this seems like a very up front description. We did this as a fishing trip – see what popped up – what might be worth looking at. Great!<\/p>\n

But …<\/p>\n

The discussion mentions<\/p>\n

“we demonstrated that FP [fluticosone] treatment significantly decreased the risk of death or oxygen dependence at discharge in the subgroup of infants born at 24\u201326 GWs and in infants with CAM . Subgroup analyses also showed the benefits of inhaled steroids for infants born at 24\u201326 GWs with RDS.”<\/p><\/blockquote>\n

… not a lot of exploratory emphasis in that chunk … and the abstract’s results include<\/p>\n

” In subgroup analyses, the frequencies of death and oxygen dependence at discharge were significantly decreased in the FP group for infants born at 24\u201326 GWs and for infants with CAM, regardless of the GW at birth.”<\/p><\/blockquote>\n

.. though to be fair (assuming that gestational age and extremely low birth weight are fairly intimately linked) the conclusion is<\/p>\n

“Inhaled steroids have no effect on the prevention of severe BPD or long-term NDI [neurodevelopment] but might decrease the severity of BPD for ELBWIs with a risk factor.”<\/p><\/blockquote>\n

Hmmm.<\/p>\n

How did we do with this – in terms of reporting all outcomes and\u00a0sticking with the registered study protocol – not great. There may be a chance that this is over-interpreted by some readers as demonstrating ‘the truth’ of what an exploratory analysis showed. We desperately DO want to publish RCTs in children; unpublished studies are unethical and unhelpful. We do want to ensure that our published reports are as truthful and meaningful as possible.<\/p>\n

But as this blog KEEPS ON GOING ON ABOUT you shouldn’t read anything on face value <\/a>and always appraise … even if it’s from us.<\/p>\n