{"id":111,"date":"2010-06-06T22:01:35","date_gmt":"2010-06-06T21:01:35","guid":{"rendered":"https:\/\/blogs.bmj.com\/adc-archimedes\/?p=111"},"modified":"2010-06-06T22:01:35","modified_gmt":"2010-06-06T21:01:35","slug":"its-how-ineffective","status":"publish","type":"post","link":"https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/","title":{"rendered":"It’s how ineffective?"},"content":{"rendered":"

\"\"<\/a>In the last post <\/a>I discussed the ‘p’ problem (not enuresis, which is subject to an upcoming NICE guideline) but statistical significance is only the first problem in deciding if something actually works. This post takes up the challenge of not just saying that something is likely to work, but just how well <\/em>it works. This is the realm of the comparative effectiveness measures – relative risk, odds ratio, risk difference and ‘number needed to treat’ – and the confidence interval… which will come later.<\/p>\n

Take a treatment for croup (say steroid) and compare it to placebo. Let’s say 10\/20\u00a0 of the steroid group go home from the ED, and 5\/20 of the placebo group do. The absolute benefit of steroid is 5 fewer hospitalisations for each 20 patients, which is the same as 1 patient for every 4 treated: the number needed to treat is 4. This can also be expressed as a risk difference (RD) of 0.25. (This is the absolute difference in proportions: 0.5 – 0.25 = 0.25.) The arithmetic among you will have noticed that the inverse of 0.25 (1\/0.25) is 4 – this is a quick route to the NNT. These are absolute<\/em> measures of effectiveness – they say how many people, or what proportion of a population, will benefit from your treatment over and above the ones who would have got better anyway.<\/p>\n

Now look at it a different way. The steroid has taken the chance of being sent home up from 25% to 50% – it has doubled each patient’s ‘risk’ of being sent home. Or, the ‘relative risk’ (RR) of going home is 2.\u00a0 This is a relative<\/em> measure of effectiveness – it says what the changing chance of an outcome is for each individual patient, family or the like. The odds ratio can be interpreted, in a clinical sense, the same way as a relative risk.<\/p>\n

So what’s the use of the two ways of thinking about the same stuff? Well, we can make more rational decisions about the balance of risk and benefits with absolute numbers (1 in 55 survive, but 1 in 14 go deaf…)\u00a0 and extend this to whole communities (can we afford to spend \u00a330,000 per patient for 1 in 121 to benefit?). Relative measures can be ‘transported’ across different settings with some ease … if the RR is 2 when the placebo send-home rate is 25%, it’s also likely to be 2 if the rate is 12.5% … if this were the case the RD would be 0.125 and the NNT would then be 8. The other thing that RR do is ‘sell’ something: what’s better, the treatment that works in only 1 in 4 people or the one that doubles the chance of success?<\/p>\n

So the simple measures of success are those for communities and balances – the absolute ones – and the personal, transportable and marketing\u00a0 – the relative ones. Recognise them, use them, and you’ll be lots further on in understanding rational decision making.<\/p>\n","protected":false},"excerpt":{"rendered":"

In the last post I discussed the ‘p’ problem (not enuresis, which is subject to an upcoming NICE guideline) but statistical significance is only the first problem in deciding if something actually works. This post takes up the challenge of not just saying that something is likely to work, but just how well it works. […]<\/p>\n

Read More…<\/a><\/p>\n","protected":false},"author":7,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[79,80],"tags":[],"class_list":["post-111","post","type-post","status-publish","format-standard","hentry","category-archimedes","category-critical-appraisal-note"],"yoast_head":"\nIt's how ineffective? - ADC Online Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"It's how ineffective? - ADC Online Blog\" \/>\n<meta property=\"og:description\" content=\"In the last post I discussed the ‘p’ problem (not enuresis, which is subject to an upcoming NICE guideline) but statistical significance is only the first problem in deciding if something actually works. This post takes up the challenge of not just saying that something is likely to work, but just how well it works. [...]Read More...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/\" \/>\n<meta property=\"og:site_name\" content=\"ADC Online Blog\" \/>\n<meta property=\"article:published_time\" content=\"2010-06-06T21:01:35+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/www.junkscience.com\/JSJ_Course\/jsjudocourse\/test3.jpg\" \/>\n<meta name=\"author\" content=\"Bob Phillips\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Bob Phillips\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/06\\\/06\\\/its-how-ineffective\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/06\\\/06\\\/its-how-ineffective\\\/\"},\"author\":{\"name\":\"Bob Phillips\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#\\\/schema\\\/person\\\/9e94029681ecf36e73bbd1eb2be2ef94\"},\"headline\":\"It’s how ineffective?\",\"datePublished\":\"2010-06-06T21:01:35+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/06\\\/06\\\/its-how-ineffective\\\/\"},\"wordCount\":476,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/06\\\/06\\\/its-how-ineffective\\\/#primaryimage\"},\"thumbnailUrl\":\"http:\\\/\\\/www.junkscience.com\\\/JSJ_Course\\\/jsjudocourse\\\/test3.jpg\",\"articleSection\":[\"archimedes\",\"critical appraisal note\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/06\\\/06\\\/its-how-ineffective\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/06\\\/06\\\/its-how-ineffective\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/06\\\/06\\\/its-how-ineffective\\\/\",\"name\":\"It's how ineffective? - ADC Online Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/06\\\/06\\\/its-how-ineffective\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/06\\\/06\\\/its-how-ineffective\\\/#primaryimage\"},\"thumbnailUrl\":\"http:\\\/\\\/www.junkscience.com\\\/JSJ_Course\\\/jsjudocourse\\\/test3.jpg\",\"datePublished\":\"2010-06-06T21:01:35+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/06\\\/06\\\/its-how-ineffective\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/06\\\/06\\\/its-how-ineffective\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/06\\\/06\\\/its-how-ineffective\\\/#primaryimage\",\"url\":\"http:\\\/\\\/www.junkscience.com\\\/JSJ_Course\\\/jsjudocourse\\\/test3.jpg\",\"contentUrl\":\"http:\\\/\\\/www.junkscience.com\\\/JSJ_Course\\\/jsjudocourse\\\/test3.jpg\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/06\\\/06\\\/its-how-ineffective\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"It’s how ineffective?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#website\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/\",\"name\":\"ADC Online Blog\",\"description\":\"Education, debate, and meandering thoughts on child health, using evidence and research.\",\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#organization\",\"name\":\"ADC Online Blog\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/files\\\/2017\\\/10\\\/blog-logo-adc.png\",\"contentUrl\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/files\\\/2017\\\/10\\\/blog-logo-adc.png\",\"width\":285,\"height\":34,\"caption\":\"ADC Online Blog\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#\\\/schema\\\/person\\\/9e94029681ecf36e73bbd1eb2be2ef94\",\"name\":\"Bob Phillips\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g\",\"caption\":\"Bob Phillips\"},\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/author\\\/bphillips\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"It's how ineffective? - ADC Online Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/","og_locale":"en_GB","og_type":"article","og_title":"It's how ineffective? - ADC Online Blog","og_description":"In the last post I discussed the ‘p’ problem (not enuresis, which is subject to an upcoming NICE guideline) but statistical significance is only the first problem in deciding if something actually works. This post takes up the challenge of not just saying that something is likely to work, but just how well it works. [...]Read More...","og_url":"https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/","og_site_name":"ADC Online Blog","article_published_time":"2010-06-06T21:01:35+00:00","og_image":[{"url":"http:\/\/www.junkscience.com\/JSJ_Course\/jsjudocourse\/test3.jpg","type":"","width":"","height":""}],"author":"Bob Phillips","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Bob Phillips","Estimated reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/#article","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/"},"author":{"name":"Bob Phillips","@id":"https:\/\/blogs.bmj.com\/adc\/#\/schema\/person\/9e94029681ecf36e73bbd1eb2be2ef94"},"headline":"It’s how ineffective?","datePublished":"2010-06-06T21:01:35+00:00","mainEntityOfPage":{"@id":"https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/"},"wordCount":476,"commentCount":0,"publisher":{"@id":"https:\/\/blogs.bmj.com\/adc\/#organization"},"image":{"@id":"https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/#primaryimage"},"thumbnailUrl":"http:\/\/www.junkscience.com\/JSJ_Course\/jsjudocourse\/test3.jpg","articleSection":["archimedes","critical appraisal note"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/","url":"https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/","name":"It's how ineffective? - ADC Online Blog","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/adc\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/#primaryimage"},"image":{"@id":"https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/#primaryimage"},"thumbnailUrl":"http:\/\/www.junkscience.com\/JSJ_Course\/jsjudocourse\/test3.jpg","datePublished":"2010-06-06T21:01:35+00:00","breadcrumb":{"@id":"https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/#primaryimage","url":"http:\/\/www.junkscience.com\/JSJ_Course\/jsjudocourse\/test3.jpg","contentUrl":"http:\/\/www.junkscience.com\/JSJ_Course\/jsjudocourse\/test3.jpg"},{"@type":"BreadcrumbList","@id":"https:\/\/blogs.bmj.com\/adc\/2010\/06\/06\/its-how-ineffective\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blogs.bmj.com\/adc\/"},{"@type":"ListItem","position":2,"name":"It’s how ineffective?"}]},{"@type":"WebSite","@id":"https:\/\/blogs.bmj.com\/adc\/#website","url":"https:\/\/blogs.bmj.com\/adc\/","name":"ADC Online Blog","description":"Education, debate, and meandering thoughts on child health, using evidence and research.","publisher":{"@id":"https:\/\/blogs.bmj.com\/adc\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.bmj.com\/adc\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/blogs.bmj.com\/adc\/#organization","name":"ADC Online Blog","url":"https:\/\/blogs.bmj.com\/adc\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/blogs.bmj.com\/adc\/#\/schema\/logo\/image\/","url":"https:\/\/blogs.bmj.com\/adc\/files\/2017\/10\/blog-logo-adc.png","contentUrl":"https:\/\/blogs.bmj.com\/adc\/files\/2017\/10\/blog-logo-adc.png","width":285,"height":34,"caption":"ADC Online Blog"},"image":{"@id":"https:\/\/blogs.bmj.com\/adc\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/blogs.bmj.com\/adc\/#\/schema\/person\/9e94029681ecf36e73bbd1eb2be2ef94","name":"Bob Phillips","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/secure.gravatar.com\/avatar\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g","caption":"Bob Phillips"},"url":"https:\/\/blogs.bmj.com\/adc\/author\/bphillips\/"}]}},"_links":{"self":[{"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/posts\/111","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/comments?post=111"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/posts\/111\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/media?parent=111"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/categories?post=111"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/tags?post=111"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}