You don't need to be signed in to read BMJ Group Blogs, but you can register here to receive updates about other BMJ Group products and services via our Group site.

Diagnostic tests: as easy as I, II, III

21 Sep, 10 | by Bob Phillips

Diagnostic testing keeps coming back to bite Archi, and that’s not just because of a probability-based failure about a small relative and a missed diagnosis of congenital heart disease. No, the problem with diagnostic tests and their use and abuse remains difficult because the methods of research, the quality of research and the consequence of bad research aren’t generally as high-profile as therapeutic failures. Perhaps we could help with a bit of this by adopting a similar approach to evaluating diagnostic tests as we do new drugs: go for phase I, II and III studies.

Phase I diagnostic studies look at the very lowest level, not toxicity in this case but ability to separate out the grossly affected from the clearly well, for example IL8 levels in those with meningococcal sepsis and admissions for routine circumcision. Phase II studies work towards defining what the right cut-off should be for a test, in a group that are more reflective of the clinical setting we want it to be used in. Taking our example onwards, this would be the definition of a value of IL8 in children with fever in an admissions unit which shows best defines those with sepsis. Phase III studies then go further, and test the use of clear criteria in a group with uncertain diagnosis, compared with an effective reference standard.

Failure to recognise the phase of test leads to real problems in clinical interpretation. For instance, a test that can tell the difference between high-functioning adults with autism and those in volunteering for a quick MRI-head may well be useless in the community paediatrics clinic. Or may not – but there is no way of knowing with a phase I/II study. Showing that IL6 >1000pg/ml is almost invariably associated with gram-negative sepsis in one population of children with fever and neutropenia might mean that it’s a great diagnostic test for all new admissions. But such a phase II study doesn’t really prove this: it hints in the same way that radiological response of a tumour might mean that the drug is helpful, but not always.

So, when you’re next reading about an advance in diagnostic test technology, as well as the thoughts about prevalence, predictive values and likelihood ratios, try and peg the ‘phase’ first and it may save you lots of time and pain.

By submitting your comment you agree to adhere to these terms and conditions
You can follow any responses to this entry through the RSS 2.0 feed.
ADC blog homeapage

ADC Online

Education, debate, and meandering thoughts on child health, using evidence and research.Visit site

Latest from Archives of Disease in Childhood

Latest from Archives of Disease in Childhood

Latest Paediatrics jobs

Paediatrics jobs