You don't need to be signed in to read BMJ Blogs, but you can register here to receive updates about other BMJ products and services via our site.


Guest post: The Systematic Review Speaks The Truth …… Or Does It?

27 Oct, 14 | by Bob Phillips

A good quality systematic review should identify and synthesise all the available evidence, for a particular question, through meta-analysis. Conclusions can then be made about the effect of the intervention on the outcome. As, in theory, all the available evidence is gathered and assessed, surely the conclusions from the meta-analysis must be the truth and we can then apply this to practice?

Well…..not quite. The transition from putting the conclusions of a systematic review into guideline development is not quite as simple. We need to assess the quality of the evidence presented and its application to practice.  more…


23 Oct, 14 | by Bob Phillips

ExplosiveWell, I thought that was a better title than ‘Volatility’ which, to be fair, is closer to what this meandering post is all about.

When we’re struggling our way through medicine, we have to face all sorts of uncertainties. Some of these are the frank face of ignorance (we just don’t know something), some of them are about the degree of chance that plays into our knowledge, some around the edges where we decide which side of an imaginary line things play, and on top of all these, we have situations where Stuff Changes. Not that we don’t currently know where things are going to end up – for example, that we don’t have the diagnosis yet because we haven’t worked it out – but that it actually alters as we go through time.


Why not look at what you already know?

16 Oct, 14 | by Bob Phillips

A little while ago we blogged on the surprisingly varied methods folk use to pick how how big an effect needs to be in order to be ‘clinically relevant’. A further paper on this theme has emerged that takes up a slightly different aspect of the challenge of getting the number right before doing a trial.

On the basics front, before you know how many people will be needed for a trial, you need to know

  • How big an effect you might see
  • How varied the effect is between people
  • What size of effect is gong to be ‘clinically relevant’ (ie above what level you want to prove the intervention will lie)
  • What chance of making the wrong call (“It works!” when it doesn’t, or vica versa) you are prepared to accept

It may be rather surprising to find that there hasn’t been, until very recently, a really well developed way of using systematic review / meta-analysis methodology to capture the stuff we already know before moving onwards to find out more, when moving between phase II (how-toxic-is-this-and-does-it-make-markers/images-better?) and phase III (are-there-fewer-dead-people?) trials. But now there is.


Publication bias.

2 Oct, 14 | by Bob Phillips

SO – you all know about publication bias? The fact that nasty, authoritarian Journal Editors, sat with their cigars, expensive brandy and well-roasted coffee look upon trials that don’t give positive results and consign them to the pit of Rejection?

(That’s just how it happens.)

Well, there’s another variants on this theme.

There’s the “we’ll only write up that outcome measure ’cause it says what we want it to show” bias (aka ‘selective outcome reporting’)

And then there’s the “can’t be arsed” bias, where studies just don’t even get written up or presented as their overwhelming lack of showing anything leads their authors to torpor. I particularly hate systematic reviews of case reports for this trouble.

And it happens with normal people too. A really lovely piece of work shows that Amazon dieting reviews show massive publication bias, probably by self-selection, and that folk buy into believing them wholeheartedly. As PT Barnum said – “there’s one born every minute”.

– Archi

StatsMiniBlog: Spot on, time and again.

22 Sep, 14 | by Bob Phillips


“Spot on!” is a rather anachronistic and very Anglophile phrase, redolent of croquet lawns, tweeds and well designed woven straw hats. It’s no wonder we tend to use  – if we are being technical – the word “accurate” instead.

But should we be using the word “precise” to make ourselves sound all academic? And what’s the difference?


Accuracy – the closeness a thing to it’s target

Precision – how close repeated attempts are to each other

Now those two things do not have to be connected – you may be accurate and imprecise, or inaccurate but very precise, or .. Oh forget it.

Let me just show you a picture …

Routine data vs research expense

18 Sep, 14 | by Bob Phillips

Lots of debates could be had off this title. When is an ‘audit’ and audit and when is it a cloaked piece of poor quality retrospective research? Why is ‘research’ considered better just because it’s ‘special’? What makes research study data forms nearly impossible to understand without spending 3 days in a steam hut wearing just a loincloth made of old patient information leaflets and drinking far too much Red Tea?

What I think it’s worth taking up, for a just a bit though, is ” What is routinely collected hospital data and it’s relationship with the real world? ”


A grain of sand.

15 Sep, 14 | by Bob Phillips

I am a glutton for podcasts, occasionally medical, but often way off this mark (sociology, philosophy & rugby league would fall into this category), yet they frequently play into each other. Some of you will recall this, as I note that when I can’t concentrate on a podcast, I know I’m becoming overloaded/over worried and need to step away from stuff to regain my good mental health. Podcasts are my pants drawer.

However, my own state of mind is not the key in this entry, but an ancient philosophical problem.

The Sorites Paradox.


Top tips for detecting adverse events in paediatrics

11 Sep, 14 | by Bob Phillips

How can we determine the safety if anything we do in paediatric prescribing? For chronic conditions, we’re generally pretty sure that if we let it wind on, it will harm the child. If we treat it, we’ll be managing the disease but causing adversity. The balance is making this tip where the good stuff overwhelms the poor stuff.

I think the commonest, extreme, example is chemotherapy. These agents are intended to treat a cancer to save a life. To do this, they may cause sufficient immunosupression to produce a fatal infection, or mucosal erosions to give a fatal intestinal perforation, or a thrombotic event that produces a cerebral infarct and death. The carefully measured doses of these drugs are placed to  make the tipping point in favour of benefit over harm; and we have improved survival in childhood cancer by this treatment approach.


Basics. Why bother with systematic reviews?

7 Sep, 14 | by Bob Phillips

If you’ve only recently bumped into this blog, you may not be aware of the near-obsessive compulsion for us to ask “Is there a systematic review of that?” at any opportunity. Why is this the case? Well, partly it’s the job. Mostly it’s because systematic reviews give us the best answers to our questions … and in this Basics blog we’ll cover

  • What is a systematic review?
  • What is meta-analysis?
  • What can a systematic review do for us?


How can we share treatment decisions?

3 Sep, 14 | by Bob Phillips

pot_of_gold_rainbow (107x160)I guess part of me wants to start this blog with “Never knowingly topical”, but in the UK an as yet unclear explosion of media interest has been generated around decision making and a child with a brain tumour.

Those who want to can find out more via reputable news sites – as a staunch middle-class Northerner, I’ll just link to the BBC from the start of the very long story.

Where much of this very difficult story seems to be around consent, and best interests, I’d like to take a more routine approach to the issue. How do we, in everyday care, make sure that our interactions with children, young people and their families share the decisions as much as possible?


ADC blog homeapage

ADC Online

Education, debate, and meandering thoughts on child health, using evidence and research.Visit site

Creative Comms logo

Latest from Archives of Disease in Childhood

Latest from Archives of Disease in Childhood