{"id":1066,"date":"2015-03-27T20:55:47","date_gmt":"2015-03-27T19:55:47","guid":{"rendered":"https:\/\/blogs.bmj.com\/adc\/?p=1066"},"modified":"2015-03-12T22:12:46","modified_gmt":"2015-03-12T21:12:46","slug":"what-about-mixedupness","status":"publish","type":"post","link":"https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/","title":{"rendered":"What about mixedupness?"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignleft\" src=\"http:\/\/www.tdgoodall.co.uk\/ESW\/Images\/homo_2.png\" alt=\"\" width=\"172\" height=\"162\" \/>The subject of heterogeneity (mixed~up~ness) in systematic reviews is tricky. A bit like &#8216;<a title=\"StatsMiniBlog: Significance tests. Step one.\" href=\"https:\/\/blogs.bmj.com\/adc\/2013\/06\/26\/statsminiblog-significance-tests-step-one\/\">significance<\/a>&#8216; you can think about it as both a clinical and statistical concept, and in the same way, you can get results\u00a0that aren&#8217;t always concordant.<\/p>\n<p>Many old lags will remember a blog post about a <a title=\"Ignore the platelet count in HSP if you\u2019re wondering about kidneys\" href=\"https:\/\/blogs.bmj.com\/adc\/2014\/11\/25\/ignore-the-platelet-count-in-hsp-if-youre-wondering-about-kidneys\/\">statistically significant association between platelets and renal involvement in HSP<\/a>. There, there was a statistical association that&#8217;s unlikely to be due to chance, but is clinically irrelevant.<\/p>\n<p>The same queries need to be asked of heterogeneity within studies.<\/p>\n<p><!--more--><\/p>\n<p>Ask first: are the clinically different, and any attempt to add them up is daft, or are they similar enough to try to combine? Then, if they make sense, you should look at if the results look like they are similar, or different, and perhaps have a look at the <a title=\"It\u2019s how mixed up? Meta analysis models step one.\" href=\"https:\/\/blogs.bmj.com\/adc\/2011\/03\/27\/its-how-mixed-up-meta-analysis-models-step-one\/\">statistical measures of heterogeneity<\/a> (which in this setting means &#8220;more different than you&#8217;d expect by chance&#8221;).<\/p>\n<p>But a quick &#8220;hold on&#8221; before the answer arrives\u00a0too simply.<\/p>\n<p>What does &#8216;clinically too mixed up mean&#8217;?\u00a0Remember, the differences between the studies &#8211; to make them too heterogenous &#8211; should mean that we expect the treatment* to actually have a different effect in the different study groups.<\/p>\n<p>Then\u00a0if you can explain why they\u00a0should, and why you&#8217;d be expecting to need to do something different with those groups of patients, you can quite reasonably say that any sort of lumping is the wrong thing to do and you&#8217;ll ignore any meta-analytic results that emerge.<\/p>\n<p>&#8211; Archi<\/p>\n<p>* clearly, its not always treatment but give a writer a break&#8230;<!--TrendMD v2.4.8--><\/p>\n","protected":false},"excerpt":{"rendered":"<p>The subject of heterogeneity (mixed~up~ness) in systematic reviews is tricky. A bit like &#8216;significance&#8216; you can think about it as both a clinical and statistical concept, and in the same way, you can get results\u00a0that aren&#8217;t always concordant. Many old lags will remember a blog post about a statistically significant association between platelets and renal [&#8230;]<\/p>\n<p><a class=\"btn btn-secondary understrap-read-more-link\" href=\"https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/\">Read More&#8230;<\/a><\/p>\n","protected":false},"author":7,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[79],"tags":[],"class_list":["post-1066","post","type-post","status-publish","format-standard","hentry","category-archimedes"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>What about mixedupness? - ADC Online Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What about mixedupness? - ADC Online Blog\" \/>\n<meta property=\"og:description\" content=\"The subject of heterogeneity (mixed~up~ness) in systematic reviews is tricky. A bit like &#8216;significance&#8216; you can think about it as both a clinical and statistical concept, and in the same way, you can get results\u00a0that aren&#8217;t always concordant. Many old lags will remember a blog post about a statistically significant association between platelets and renal [...]Read More...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/\" \/>\n<meta property=\"og:site_name\" content=\"ADC Online Blog\" \/>\n<meta property=\"article:published_time\" content=\"2015-03-27T19:55:47+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/www.tdgoodall.co.uk\/ESW\/Images\/homo_2.png\" \/>\n<meta name=\"author\" content=\"Bob Phillips\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Bob Phillips\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2015\\\/03\\\/27\\\/what-about-mixedupness\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2015\\\/03\\\/27\\\/what-about-mixedupness\\\/\"},\"author\":{\"name\":\"Bob Phillips\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#\\\/schema\\\/person\\\/9e94029681ecf36e73bbd1eb2be2ef94\"},\"headline\":\"What about mixedupness?\",\"datePublished\":\"2015-03-27T19:55:47+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2015\\\/03\\\/27\\\/what-about-mixedupness\\\/\"},\"wordCount\":273,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2015\\\/03\\\/27\\\/what-about-mixedupness\\\/#primaryimage\"},\"thumbnailUrl\":\"http:\\\/\\\/www.tdgoodall.co.uk\\\/ESW\\\/Images\\\/homo_2.png\",\"articleSection\":[\"archimedes\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2015\\\/03\\\/27\\\/what-about-mixedupness\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2015\\\/03\\\/27\\\/what-about-mixedupness\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2015\\\/03\\\/27\\\/what-about-mixedupness\\\/\",\"name\":\"What about mixedupness? - ADC Online Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2015\\\/03\\\/27\\\/what-about-mixedupness\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2015\\\/03\\\/27\\\/what-about-mixedupness\\\/#primaryimage\"},\"thumbnailUrl\":\"http:\\\/\\\/www.tdgoodall.co.uk\\\/ESW\\\/Images\\\/homo_2.png\",\"datePublished\":\"2015-03-27T19:55:47+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2015\\\/03\\\/27\\\/what-about-mixedupness\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2015\\\/03\\\/27\\\/what-about-mixedupness\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2015\\\/03\\\/27\\\/what-about-mixedupness\\\/#primaryimage\",\"url\":\"http:\\\/\\\/www.tdgoodall.co.uk\\\/ESW\\\/Images\\\/homo_2.png\",\"contentUrl\":\"http:\\\/\\\/www.tdgoodall.co.uk\\\/ESW\\\/Images\\\/homo_2.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2015\\\/03\\\/27\\\/what-about-mixedupness\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"What about mixedupness?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#website\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/\",\"name\":\"ADC Online Blog\",\"description\":\"Education, debate, and meandering thoughts on child health, using evidence and research.\",\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#organization\",\"name\":\"ADC Online Blog\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/files\\\/2017\\\/10\\\/blog-logo-adc.png\",\"contentUrl\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/files\\\/2017\\\/10\\\/blog-logo-adc.png\",\"width\":285,\"height\":34,\"caption\":\"ADC Online Blog\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#\\\/schema\\\/person\\\/9e94029681ecf36e73bbd1eb2be2ef94\",\"name\":\"Bob Phillips\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g\",\"caption\":\"Bob Phillips\"},\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/author\\\/bphillips\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"What about mixedupness? - ADC Online Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/","og_locale":"en_GB","og_type":"article","og_title":"What about mixedupness? - ADC Online Blog","og_description":"The subject of heterogeneity (mixed~up~ness) in systematic reviews is tricky. A bit like &#8216;significance&#8216; you can think about it as both a clinical and statistical concept, and in the same way, you can get results\u00a0that aren&#8217;t always concordant. Many old lags will remember a blog post about a statistically significant association between platelets and renal [...]Read More...","og_url":"https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/","og_site_name":"ADC Online Blog","article_published_time":"2015-03-27T19:55:47+00:00","og_image":[{"url":"http:\/\/www.tdgoodall.co.uk\/ESW\/Images\/homo_2.png","type":"","width":"","height":""}],"author":"Bob Phillips","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Bob Phillips","Estimated reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/#article","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/"},"author":{"name":"Bob Phillips","@id":"https:\/\/blogs.bmj.com\/adc\/#\/schema\/person\/9e94029681ecf36e73bbd1eb2be2ef94"},"headline":"What about mixedupness?","datePublished":"2015-03-27T19:55:47+00:00","mainEntityOfPage":{"@id":"https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/"},"wordCount":273,"commentCount":0,"publisher":{"@id":"https:\/\/blogs.bmj.com\/adc\/#organization"},"image":{"@id":"https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/#primaryimage"},"thumbnailUrl":"http:\/\/www.tdgoodall.co.uk\/ESW\/Images\/homo_2.png","articleSection":["archimedes"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/","url":"https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/","name":"What about mixedupness? - ADC Online Blog","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/adc\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/#primaryimage"},"image":{"@id":"https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/#primaryimage"},"thumbnailUrl":"http:\/\/www.tdgoodall.co.uk\/ESW\/Images\/homo_2.png","datePublished":"2015-03-27T19:55:47+00:00","breadcrumb":{"@id":"https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/#primaryimage","url":"http:\/\/www.tdgoodall.co.uk\/ESW\/Images\/homo_2.png","contentUrl":"http:\/\/www.tdgoodall.co.uk\/ESW\/Images\/homo_2.png"},{"@type":"BreadcrumbList","@id":"https:\/\/blogs.bmj.com\/adc\/2015\/03\/27\/what-about-mixedupness\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blogs.bmj.com\/adc\/"},{"@type":"ListItem","position":2,"name":"What about mixedupness?"}]},{"@type":"WebSite","@id":"https:\/\/blogs.bmj.com\/adc\/#website","url":"https:\/\/blogs.bmj.com\/adc\/","name":"ADC Online Blog","description":"Education, debate, and meandering thoughts on child health, using evidence and research.","publisher":{"@id":"https:\/\/blogs.bmj.com\/adc\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.bmj.com\/adc\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/blogs.bmj.com\/adc\/#organization","name":"ADC Online Blog","url":"https:\/\/blogs.bmj.com\/adc\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/blogs.bmj.com\/adc\/#\/schema\/logo\/image\/","url":"https:\/\/blogs.bmj.com\/adc\/files\/2017\/10\/blog-logo-adc.png","contentUrl":"https:\/\/blogs.bmj.com\/adc\/files\/2017\/10\/blog-logo-adc.png","width":285,"height":34,"caption":"ADC Online Blog"},"image":{"@id":"https:\/\/blogs.bmj.com\/adc\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/blogs.bmj.com\/adc\/#\/schema\/person\/9e94029681ecf36e73bbd1eb2be2ef94","name":"Bob Phillips","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/secure.gravatar.com\/avatar\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g","caption":"Bob Phillips"},"url":"https:\/\/blogs.bmj.com\/adc\/author\/bphillips\/"}]}},"_links":{"self":[{"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/posts\/1066","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/comments?post=1066"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/posts\/1066\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/media?parent=1066"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/categories?post=1066"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/tags?post=1066"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}