{"id":44335,"date":"2019-03-29T09:39:35","date_gmt":"2019-03-29T08:39:35","guid":{"rendered":"https:\/\/blogs.bmj.com\/bmj\/?p=44335"},"modified":"2019-04-01T13:13:57","modified_gmt":"2019-04-01T12:13:57","slug":"holger-j-schunemann-all-evidence-is-real-world-evidence","status":"publish","type":"post","link":"https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/","title":{"rendered":"Holger J. Sch\u00fcnemann: All evidence is real world evidence"},"content":{"rendered":"<p><span style=\"font-weight: 400\">Clinical guidelines a<\/span><span style=\"font-weight: 400\">re often criticized for not paying enough attention to \u201c<\/span><a href=\"https:\/\/www.fda.gov\/scienceresearch\/specialtopics\/realworldevidence\/default.htm\"><span style=\"font-weight: 400\">real world evidence<\/span><\/a><span style=\"font-weight: 400\">\u201d (RWE) such as big data, patient generated data, data from registries, or electronic health records. Real world evidence is usually thought to more accurately reflect what happens outside a controlled research environment. In this context, <\/span><a href=\"https:\/\/en.wikipedia.org\/wiki\/Real_world_evidence\"><span style=\"font-weight: 400\">randomised controlled trials (RCTs) can be dismissed as evidence which does not reflect the real world<\/span><\/a><span style=\"font-weight: 400\">. The rationale for this is that evidence obtained outside of RCTs may more directly apply to th<\/span><span style=\"font-weight: 400\">e populations, interventions, comparators, and outcomes (PICOs) th<\/span><span style=\"font-weight: 400\">at practising clinicians, healthcare professionals, researchers, policymakers, and patients deal<\/span><span style=\"font-weight: 400\"> with, and that this evidence is better suited to support personalized medicine or individualized healthcare. T<\/span><span style=\"font-weight: 400\">his emphasis on applicability, generalizability, external validity, or transferability\u2014concepts which one can simply label as indirectness\u2014seems sensible; in particular, for trustworthy guideline recommendations which should inform the best interventions and decisions in daily practice. [1] However, <\/span><span style=\"font-weight: 400\">undue emphasis on real world evidence<\/span><span style=\"font-weight: 400\"> is potentially risky for guidelines and beyond. <\/span><\/p>\n<p><span style=\"font-weight: 400\">Firstly, the current concept of &#8220;<\/span><span style=\"font-weight: 400\">real world&#8221; evidence<\/span><span style=\"font-weight: 400\"> suggests that RCTs come from an unreal world. But evidence from RCTs is part of the real world which researchers are studying by including real, although often selected, PICOs. Our language should reflect that they are still part of that real world. <\/span><\/p>\n<p><span style=\"font-weight: 400\">Secondly, focusing only on\u00a0<\/span><span style=\"font-weight: 400\">real world evidence obscures concerns about risk of systematic errors (bias) by emphasizing directness<\/span><span style=\"font-weight: 400\">. Even the most direct real world evidence will not be sufficient to provide certainty that an intervention has the intended effects if other bias is introduced when decision makers assign interventions and fail to achieve a fair comparison between an intervention and an alternative in producing real world evidence. Who is served if evidence is more applicable but the effects are spurious? <\/span><span style=\"font-weight: 400\">Indeed, certainty in the effects of interventions arises only if data are obtained from research that has no limitations to study design and execution (risk of bias) and directly applies to the PICO of interest, but the data also are not a random result, are consistent across similarly conducted studies, and are fully disclosed and considered. [2]<\/span><\/p>\n<p><span style=\"font-weight: 400\">Among these considerations, indirectness and imprecision are often the key area of concern with RCTs. Real world evidence, on the other hand, may reduce concerns about indirectness, but it does not eliminate them. For example, believing that real world evidence is superior because it more directly applies to the PICO of interest and using it to demonstrate that an intervention is effective ignores the fact that <\/span><b>any<\/b><span style=\"font-weight: 400\"> evidence influences future decisions, not actual decisions. Regardless of how well the PICOs are represented in real world evidence, when an actual decision is made based on real world evidence, then decision-makers extrapolate from other situations. Thus, all evidence is indirect and labelling evidence as real world evidence does not overcome this problem. Simultaneously, guideline developers should apply approaches to integrate all types of evidence into their guidelines to reduce concerns about indirectness and then judge its strength. \u00a0[1, 3]<\/span><\/p>\n<p><span style=\"font-weight: 400\">Real world evidence also often provides more precise evidence through large-scale routine data collection, but this does not reduce its disposition to confounding and selection bias. What may result from real world evidence are precise, but biased effects of interventions. GRADE domains for increasing certainty in evidence and mitigating these risks of bias, provide the few exceptions for when there is less trade-off between indirectness and risk of bias. When confounding or selection bias are unlikely to cause precise large effects, dose effect relations exist or plausible opposing confounding bias is present, our certainty in effects increases. [4] This must be kept in mind.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Thirdly, emphasis on real world evidence plays into the hands of those manipulating data for gain: bias in real world evidence is harder to assess by those evaluating it because the available tools for doing this are more demanding; the analyses are often less transparent and easier to manipulate; and registration of protocols of planned analyses is not done. <\/span><\/p>\n<p><span style=\"font-weight: 400\">Glorifying real world data by (indirectly) undermining other research and evidence from RCTs tarnishes pragmatic trials or large international trials that mitigate concerns about indirectness without sacrificing principles to reduce risk of bias. \u00a0\u00a0\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">Finally, the phrase &#8220;real world evidence&#8221; waters down what we should be focusing on. Trustworthy recommendations should be based on an evaluation of the evidence and an assessment of how reliably the evidence supports all factors that determine a recommendation or decision. These factors include the importance of a health problem, the balance between health benefits and harms, values that people attach to outcomes, resource use, equity, acceptability, and feasibility. Ideally this evidence should be transparently displayed in a GRADE evidence to decision (EtD) framework (5). \u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">However, not all criteria in an EtD framework require RCT evidence. Those emphasizing real world evidence often intentionally confuse this by stating that it is inappropriate to demand an RCT to determine the importance or burden of a health care problem, or to understand people\u2019s values or integrate qualitative data. They are quite right. But emphasizing that real world evidence is sufficient for trustworthy recommendations all together confuses the issues. This is because real world evidence is sufficient for only certain aspects of an EtD framework and these nuances can be challenging to understand. EtD frameworks should explicitly mention the certainty of the evidence based on the appropriate and relevant study designs for all those factors, e.g. non-randomized studies for prognosis and baseline risk, without the need for real world evidence terminology and labelling. <\/span><\/p>\n<p><span style=\"font-weight: 400\">In my opinion, we should stop using the phrase \u201creal world evidence\u201d in a way that suggests superiority to RCTs, or even excludes RCTs, and we should be cautious about using the term real world evidence to deflect conversations about bias. All evidence is real in our world. Guideline developers should judge if big data, patient generated data, or data from registries or electronic health records can mitigate \u00a0the key concerns raised about evidence from RCTs to inform decisions: primarily indirectness, imprecision, and use of appropriate evidence to inform factors that influence trustworthy recommendations. They should then assess the certainty of the evidence, regardless of its label. The GRADE approach already provides detailed guidance for this. [5]<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/blogs.bmj.com\/bmj\/files\/2018\/12\/holger.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-full wp-image-43793\" src=\"https:\/\/blogs.bmj.com\/bmj\/files\/2018\/12\/holger.jpg\" alt=\"\" width=\"160\" height=\"160\" srcset=\"https:\/\/blogs.bmj.com\/bmj\/files\/2018\/12\/holger.jpg 160w, https:\/\/blogs.bmj.com\/bmj\/files\/2018\/12\/holger-150x150.jpg 150w\" sizes=\"auto, (max-width: 160px) 100vw, 160px\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<p><b><i>Holger J. Sch\u00fcnemann<\/i><\/b><i><span style=\"font-weight: 400\"> is chair of the department of health research methods, evidence, and impact. He is the director of Cochrane Canada and co-chair of the GRADE working group but the opinion expresssed here are his own and may not represent that of the organizations he is affiliated with.<\/span><\/i><\/p>\n<p>&nbsp;<\/p>\n<p><em><b>Competing interests\u00a0<\/b><\/em><\/p>\n<p><em><span style=\"font-weight: 400\">I have read and understood the BMJ policy on declaration of interests and declare the following interests: I am co-chair of the GRADE working group. I have no direct financial conflicts of interest although GRADE\u2019s acceptance as a tool contributes to my academic successes.<\/span><\/em><\/p>\n<p><b>References<\/b><\/p>\n<ol>\n<li><span style=\"font-weight: 400\">Sch\u00fcnemann HJ, Tugwell P, Reeves BC, Akl EA, Santesso N, Spencer FA, et al. Non-randomized studies as a source of complementary, sequential or replacement evidence for randomized controlled trials in systematic reviews on the effects of interventions. Research Synthesis Methods. 2013;4(1):49-62.<\/span><\/li>\n<li><span style=\"font-weight: 400\">Guyatt GH, Oxman AD, Kunz R, Vist GE, Falck-Ytter Y, Schunemann HJ. What is &#8220;quality of evidence&#8221; and why is it important to clinicians? BMJ. 2008;336(7651):995-8.<\/span><\/li>\n<li><span style=\"font-weight: 400\">Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, et al. GRADE guidelines: 8. Rating the quality of evidence&#8211;indirectness. J Clin Epidemiol. 2011;64(12):1303-10.<\/span><\/li>\n<li><span style=\"font-weight: 400\">Guyatt GH, Oxman AD, Sultan S, Glasziou P, Akl EA, Alonso-Coello P, et al. GRADE guidelines: 9. Rating up the quality of evidence. J Clin Epidemiol. 2011;64(12):1311-6.<\/span><\/li>\n<li><span style=\"font-weight: 400\">Alonso-Coello P, Schunemann HJ, Moberg J, Brignardello-Petersen R, Akl EA, Davoli M, et al. GRADE Evidence to Decision (EtD) frameworks: a systematic and transparent approach to making well informed healthcare choices. 1: Introduction. BMJ. 2016;353:i2016.<\/span><\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Clinical guidelines are often criticized for not paying enough attention to \u201creal world evidence\u201d (RWE) such as big data, patient generated data, data from registries, or electronic health records. Real [&#8230;]<\/p>\n<p><a class=\"btn btn-secondary understrap-read-more-link\" href=\"https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/\">More&#8230;<\/a><\/p>\n","protected":false},"author":1,"featured_media":38417,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[223],"tags":[],"class_list":["post-44335","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-guest-bloggers"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Holger J. Sch\u00fcnemann: All evidence is real world evidence - The BMJ<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Holger J. Sch\u00fcnemann: All evidence is real world evidence - The BMJ\" \/>\n<meta property=\"og:description\" content=\"Clinical guidelines are often criticized for not paying enough attention to \u201creal world evidence\u201d (RWE) such as big data, patient generated data, data from registries, or electronic health records. Real [...]More...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/\" \/>\n<meta property=\"og:site_name\" content=\"The BMJ\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/bmjdotcom\/\" \/>\n<meta property=\"article:published_time\" content=\"2019-03-29T08:39:35+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-04-01T12:13:57+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/blogs.bmj.com\/bmj\/files\/2017\/02\/data_reader.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"540\" \/>\n\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"BMJ\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@bmj_latest\" \/>\n<meta name=\"twitter:site\" content=\"@bmj_latest\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"BMJ\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2019\\\/03\\\/29\\\/holger-j-schunemann-all-evidence-is-real-world-evidence\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2019\\\/03\\\/29\\\/holger-j-schunemann-all-evidence-is-real-world-evidence\\\/\"},\"author\":{\"name\":\"BMJ\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#\\\/schema\\\/person\\\/ba3da426ed20e8f1d933ca367d8216fe\"},\"headline\":\"Holger J. Sch\u00fcnemann: All evidence is real world evidence\",\"datePublished\":\"2019-03-29T08:39:35+00:00\",\"dateModified\":\"2019-04-01T12:13:57+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2019\\\/03\\\/29\\\/holger-j-schunemann-all-evidence-is-real-world-evidence\\\/\"},\"wordCount\":1295,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2019\\\/03\\\/29\\\/holger-j-schunemann-all-evidence-is-real-world-evidence\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/files\\\/2017\\\/02\\\/data_reader.jpg\",\"articleSection\":[\"Guest writers\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2019\\\/03\\\/29\\\/holger-j-schunemann-all-evidence-is-real-world-evidence\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2019\\\/03\\\/29\\\/holger-j-schunemann-all-evidence-is-real-world-evidence\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2019\\\/03\\\/29\\\/holger-j-schunemann-all-evidence-is-real-world-evidence\\\/\",\"name\":\"Holger J. Sch\u00fcnemann: All evidence is real world evidence - The BMJ\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2019\\\/03\\\/29\\\/holger-j-schunemann-all-evidence-is-real-world-evidence\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2019\\\/03\\\/29\\\/holger-j-schunemann-all-evidence-is-real-world-evidence\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/files\\\/2017\\\/02\\\/data_reader.jpg\",\"datePublished\":\"2019-03-29T08:39:35+00:00\",\"dateModified\":\"2019-04-01T12:13:57+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2019\\\/03\\\/29\\\/holger-j-schunemann-all-evidence-is-real-world-evidence\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2019\\\/03\\\/29\\\/holger-j-schunemann-all-evidence-is-real-world-evidence\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2019\\\/03\\\/29\\\/holger-j-schunemann-all-evidence-is-real-world-evidence\\\/#primaryimage\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/files\\\/2017\\\/02\\\/data_reader.jpg\",\"contentUrl\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/files\\\/2017\\\/02\\\/data_reader.jpg\",\"width\":540,\"height\":350},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2019\\\/03\\\/29\\\/holger-j-schunemann-all-evidence-is-real-world-evidence\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Holger J. Sch\u00fcnemann: All evidence is real world evidence\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#website\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/\",\"name\":\"The BMJ\",\"description\":\"Helping doctors make better decisions.\",\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#organization\",\"name\":\"The BMJ\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/files\\\/2018\\\/05\\\/The-BMJ-logo.jpg\",\"contentUrl\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/files\\\/2018\\\/05\\\/The-BMJ-logo.jpg\",\"width\":852,\"height\":568,\"caption\":\"The BMJ\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/bmjdotcom\\\/\",\"https:\\\/\\\/x.com\\\/bmj_latest\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#\\\/schema\\\/person\\\/ba3da426ed20e8f1d933ca367d8216fe\",\"name\":\"BMJ\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g\",\"caption\":\"BMJ\"},\"sameAs\":[\"https:\\\/\\\/blogs.bmj.com\\\/\"],\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/author\\\/admin\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Holger J. Sch\u00fcnemann: All evidence is real world evidence - The BMJ","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/","og_locale":"en_US","og_type":"article","og_title":"Holger J. Sch\u00fcnemann: All evidence is real world evidence - The BMJ","og_description":"Clinical guidelines are often criticized for not paying enough attention to \u201creal world evidence\u201d (RWE) such as big data, patient generated data, data from registries, or electronic health records. Real [...]More...","og_url":"https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/","og_site_name":"The BMJ","article_publisher":"https:\/\/www.facebook.com\/bmjdotcom\/","article_published_time":"2019-03-29T08:39:35+00:00","article_modified_time":"2019-04-01T12:13:57+00:00","og_image":[{"width":540,"height":350,"url":"https:\/\/blogs.bmj.com\/bmj\/files\/2017\/02\/data_reader.jpg","type":"image\/jpeg"}],"author":"BMJ","twitter_card":"summary_large_image","twitter_creator":"@bmj_latest","twitter_site":"@bmj_latest","twitter_misc":{"Written by":"BMJ","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/#article","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/"},"author":{"name":"BMJ","@id":"https:\/\/blogs.bmj.com\/bmj\/#\/schema\/person\/ba3da426ed20e8f1d933ca367d8216fe"},"headline":"Holger J. Sch\u00fcnemann: All evidence is real world evidence","datePublished":"2019-03-29T08:39:35+00:00","dateModified":"2019-04-01T12:13:57+00:00","mainEntityOfPage":{"@id":"https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/"},"wordCount":1295,"commentCount":0,"publisher":{"@id":"https:\/\/blogs.bmj.com\/bmj\/#organization"},"image":{"@id":"https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/#primaryimage"},"thumbnailUrl":"https:\/\/blogs.bmj.com\/bmj\/files\/2017\/02\/data_reader.jpg","articleSection":["Guest writers"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/","url":"https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/","name":"Holger J. Sch\u00fcnemann: All evidence is real world evidence - The BMJ","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/bmj\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/#primaryimage"},"image":{"@id":"https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/#primaryimage"},"thumbnailUrl":"https:\/\/blogs.bmj.com\/bmj\/files\/2017\/02\/data_reader.jpg","datePublished":"2019-03-29T08:39:35+00:00","dateModified":"2019-04-01T12:13:57+00:00","breadcrumb":{"@id":"https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/#primaryimage","url":"https:\/\/blogs.bmj.com\/bmj\/files\/2017\/02\/data_reader.jpg","contentUrl":"https:\/\/blogs.bmj.com\/bmj\/files\/2017\/02\/data_reader.jpg","width":540,"height":350},{"@type":"BreadcrumbList","@id":"https:\/\/blogs.bmj.com\/bmj\/2019\/03\/29\/holger-j-schunemann-all-evidence-is-real-world-evidence\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blogs.bmj.com\/bmj\/"},{"@type":"ListItem","position":2,"name":"Holger J. Sch\u00fcnemann: All evidence is real world evidence"}]},{"@type":"WebSite","@id":"https:\/\/blogs.bmj.com\/bmj\/#website","url":"https:\/\/blogs.bmj.com\/bmj\/","name":"The BMJ","description":"Helping doctors make better decisions.","publisher":{"@id":"https:\/\/blogs.bmj.com\/bmj\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.bmj.com\/bmj\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/blogs.bmj.com\/bmj\/#organization","name":"The BMJ","url":"https:\/\/blogs.bmj.com\/bmj\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blogs.bmj.com\/bmj\/#\/schema\/logo\/image\/","url":"https:\/\/blogs.bmj.com\/bmj\/files\/2018\/05\/The-BMJ-logo.jpg","contentUrl":"https:\/\/blogs.bmj.com\/bmj\/files\/2018\/05\/The-BMJ-logo.jpg","width":852,"height":568,"caption":"The BMJ"},"image":{"@id":"https:\/\/blogs.bmj.com\/bmj\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/bmjdotcom\/","https:\/\/x.com\/bmj_latest"]},{"@type":"Person","@id":"https:\/\/blogs.bmj.com\/bmj\/#\/schema\/person\/ba3da426ed20e8f1d933ca367d8216fe","name":"BMJ","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g","caption":"BMJ"},"sameAs":["https:\/\/blogs.bmj.com\/"],"url":"https:\/\/blogs.bmj.com\/bmj\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/posts\/44335","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/comments?post=44335"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/posts\/44335\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/media\/38417"}],"wp:attachment":[{"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/media?parent=44335"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/categories?post=44335"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/tags?post=44335"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}