{"id":128,"date":"2010-07-14T16:12:22","date_gmt":"2010-07-14T15:12:22","guid":{"rendered":"https:\/\/blogs.bmj.com\/adc-archimedes\/?p=128"},"modified":"2010-07-14T16:12:22","modified_gmt":"2010-07-14T15:12:22","slug":"many-outcomes-give-no-answer","status":"publish","type":"post","link":"https:\/\/blogs.bmj.com\/adc\/2010\/07\/14\/many-outcomes-give-no-answer\/","title":{"rendered":"Many outcomes give no answer?"},"content":{"rendered":"<p>Some systematic reviews are confusing. Sometimes this is just poor writing style. Sometimes it\u2019s because the techniques are difficult to grasp (meta-analytic item-response analysis, anyone?) And occasionally it\u2019s because the data don\u2019t seem to add up \u2018right\u2019.<!--more--><\/p>\n<p>Take, for example, the systematic review of an imaginary therapy which shows that when given to children with an asthma exacerbation it improves their clinical severity scores yet doesn\u2019t change their peak flow recordings.\u00a0 How\u2019s that work?<\/p>\n<p>One explanation <em>might<\/em> be \u2018selective outcome reporting bias\u2019. I find it easiest to think of this as a sort of within-study version of publication bias. (To recap, publication bias is the finding that studies with more dramatic outcomes tend to have a greater chance of being published, and be published more quickly, than those showing no or negative effects.) What happens in some instances is that certain favourable outcomes (e.g. clinical severity scores) are detailed in those papers which have \u2018positive\u2019 results, whereas other outcomes (e.g. PEFR) are reported in all studies, regardless of their outcome. \u00a0It can be best assessed by comparing the protocol, detailing which data are to be collected, with the output of the final paper. The description of the potential for such problems is now embedded in Cochrane reviews, but in other studies it is worth examining for when the results don\u2019t all add up.<!--TrendMD v2.4.8--><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Some systematic reviews are confusing. Sometimes this is just poor writing style. Sometimes it\u2019s because the techniques are difficult to grasp (meta-analytic item-response analysis, anyone?) And occasionally it\u2019s because the data don\u2019t seem to add up \u2018right\u2019. [&#8230;]<\/p>\n<p><a class=\"btn btn-secondary understrap-read-more-link\" href=\"https:\/\/blogs.bmj.com\/adc\/2010\/07\/14\/many-outcomes-give-no-answer\/\">Read More&#8230;<\/a><\/p>\n","protected":false},"author":7,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[79,80,145,82],"tags":[],"class_list":["post-128","post","type-post","status-publish","format-standard","hentry","category-archimedes","category-critical-appraisal-note","category-meta-analysis","category-therapy"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Many outcomes give no answer? - ADC Online Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.bmj.com\/adc\/2010\/07\/14\/many-outcomes-give-no-answer\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Many outcomes give no answer? - ADC Online Blog\" \/>\n<meta property=\"og:description\" content=\"Some systematic reviews are confusing. Sometimes this is just poor writing style. Sometimes it\u2019s because the techniques are difficult to grasp (meta-analytic item-response analysis, anyone?) And occasionally it\u2019s because the data don\u2019t seem to add up \u2018right\u2019. [...]Read More...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.bmj.com\/adc\/2010\/07\/14\/many-outcomes-give-no-answer\/\" \/>\n<meta property=\"og:site_name\" content=\"ADC Online Blog\" \/>\n<meta property=\"article:published_time\" content=\"2010-07-14T15:12:22+00:00\" \/>\n<meta name=\"author\" content=\"Bob Phillips\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Bob Phillips\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/07\\\/14\\\/many-outcomes-give-no-answer\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/07\\\/14\\\/many-outcomes-give-no-answer\\\/\"},\"author\":{\"name\":\"Bob Phillips\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#\\\/schema\\\/person\\\/9e94029681ecf36e73bbd1eb2be2ef94\"},\"headline\":\"Many outcomes give no answer?\",\"datePublished\":\"2010-07-14T15:12:22+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/07\\\/14\\\/many-outcomes-give-no-answer\\\/\"},\"wordCount\":236,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#organization\"},\"articleSection\":[\"archimedes\",\"critical appraisal note\",\"meta-analysis\",\"therapy\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/07\\\/14\\\/many-outcomes-give-no-answer\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/07\\\/14\\\/many-outcomes-give-no-answer\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/07\\\/14\\\/many-outcomes-give-no-answer\\\/\",\"name\":\"Many outcomes give no answer? - ADC Online Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#website\"},\"datePublished\":\"2010-07-14T15:12:22+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/07\\\/14\\\/many-outcomes-give-no-answer\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/07\\\/14\\\/many-outcomes-give-no-answer\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/07\\\/14\\\/many-outcomes-give-no-answer\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Many outcomes give no answer?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#website\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/\",\"name\":\"ADC Online Blog\",\"description\":\"Education, debate, and meandering thoughts on child health, using evidence and research.\",\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#organization\",\"name\":\"ADC Online Blog\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/files\\\/2017\\\/10\\\/blog-logo-adc.png\",\"contentUrl\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/files\\\/2017\\\/10\\\/blog-logo-adc.png\",\"width\":285,\"height\":34,\"caption\":\"ADC Online Blog\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#\\\/schema\\\/person\\\/9e94029681ecf36e73bbd1eb2be2ef94\",\"name\":\"Bob Phillips\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g\",\"caption\":\"Bob Phillips\"},\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/author\\\/bphillips\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Many outcomes give no answer? - ADC Online Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.bmj.com\/adc\/2010\/07\/14\/many-outcomes-give-no-answer\/","og_locale":"en_GB","og_type":"article","og_title":"Many outcomes give no answer? - ADC Online Blog","og_description":"Some systematic reviews are confusing. Sometimes this is just poor writing style. Sometimes it\u2019s because the techniques are difficult to grasp (meta-analytic item-response analysis, anyone?) And occasionally it\u2019s because the data don\u2019t seem to add up \u2018right\u2019. [...]Read More...","og_url":"https:\/\/blogs.bmj.com\/adc\/2010\/07\/14\/many-outcomes-give-no-answer\/","og_site_name":"ADC Online Blog","article_published_time":"2010-07-14T15:12:22+00:00","author":"Bob Phillips","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Bob Phillips","Estimated reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blogs.bmj.com\/adc\/2010\/07\/14\/many-outcomes-give-no-answer\/#article","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/adc\/2010\/07\/14\/many-outcomes-give-no-answer\/"},"author":{"name":"Bob Phillips","@id":"https:\/\/blogs.bmj.com\/adc\/#\/schema\/person\/9e94029681ecf36e73bbd1eb2be2ef94"},"headline":"Many outcomes give no answer?","datePublished":"2010-07-14T15:12:22+00:00","mainEntityOfPage":{"@id":"https:\/\/blogs.bmj.com\/adc\/2010\/07\/14\/many-outcomes-give-no-answer\/"},"wordCount":236,"commentCount":0,"publisher":{"@id":"https:\/\/blogs.bmj.com\/adc\/#organization"},"articleSection":["archimedes","critical appraisal note","meta-analysis","therapy"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/blogs.bmj.com\/adc\/2010\/07\/14\/many-outcomes-give-no-answer\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/blogs.bmj.com\/adc\/2010\/07\/14\/many-outcomes-give-no-answer\/","url":"https:\/\/blogs.bmj.com\/adc\/2010\/07\/14\/many-outcomes-give-no-answer\/","name":"Many outcomes give no answer? - ADC Online Blog","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/adc\/#website"},"datePublished":"2010-07-14T15:12:22+00:00","breadcrumb":{"@id":"https:\/\/blogs.bmj.com\/adc\/2010\/07\/14\/many-outcomes-give-no-answer\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.bmj.com\/adc\/2010\/07\/14\/many-outcomes-give-no-answer\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/blogs.bmj.com\/adc\/2010\/07\/14\/many-outcomes-give-no-answer\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blogs.bmj.com\/adc\/"},{"@type":"ListItem","position":2,"name":"Many outcomes give no answer?"}]},{"@type":"WebSite","@id":"https:\/\/blogs.bmj.com\/adc\/#website","url":"https:\/\/blogs.bmj.com\/adc\/","name":"ADC Online Blog","description":"Education, debate, and meandering thoughts on child health, using evidence and research.","publisher":{"@id":"https:\/\/blogs.bmj.com\/adc\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.bmj.com\/adc\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/blogs.bmj.com\/adc\/#organization","name":"ADC Online Blog","url":"https:\/\/blogs.bmj.com\/adc\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/blogs.bmj.com\/adc\/#\/schema\/logo\/image\/","url":"https:\/\/blogs.bmj.com\/adc\/files\/2017\/10\/blog-logo-adc.png","contentUrl":"https:\/\/blogs.bmj.com\/adc\/files\/2017\/10\/blog-logo-adc.png","width":285,"height":34,"caption":"ADC Online Blog"},"image":{"@id":"https:\/\/blogs.bmj.com\/adc\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/blogs.bmj.com\/adc\/#\/schema\/person\/9e94029681ecf36e73bbd1eb2be2ef94","name":"Bob Phillips","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/secure.gravatar.com\/avatar\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g","caption":"Bob Phillips"},"url":"https:\/\/blogs.bmj.com\/adc\/author\/bphillips\/"}]}},"_links":{"self":[{"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/posts\/128","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/comments?post=128"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/posts\/128\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/media?parent=128"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/categories?post=128"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/tags?post=128"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}