{"id":119,"date":"2010-08-16T18:30:33","date_gmt":"2010-08-16T17:30:33","guid":{"rendered":"https:\/\/blogs.bmj.com\/adc-archimedes\/?p=119"},"modified":"2010-08-17T15:15:15","modified_gmt":"2010-08-17T14:15:15","slug":"unknowns-known-unknown-and-uncertain","status":"publish","type":"post","link":"https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/","title":{"rendered":"Unknowns: known, unknown and uncertain"},"content":{"rendered":"

\"\"<\/a>Along with Rumsfelt, the drug-addled Dr. House and everyone who’s ever sat an exam,\u00a0 we can all recollect times when we know that we don’t know something.<\/p>\n

And we have times when we know something.<\/p>\n

And we have times when we learn about something we didn’t know we were unaware of. (Varenicline anyone?)<\/p>\n

And we also have times when we think we know something, but aren’t quite sure. I think these are the most common ones. These are the times when it would be nice to be able to describe and understand the limit of our certainty. This is the concept of the ‘95% confidence interval’ (CI).<\/p>\n

The confidence interval is the interpreted as the range within which the “true effect” of treatment (or prognostic estimate, or whatever) may lie. In most cases, we use a 95% confidence interval – that is to say that the “true effect” has a 2.5% chance of being lower, and a 2.5% chance of being higher. They don’t have to be 95% – but usually are – so if we have a 90% confidence interval, then it’s 5% chance of being lower or a 5% chance of being higher.<\/p>\n

The value of the confidence interval, as opposed to the p-value, is in the estimate of effect. Take the fictitious Drug A vs Drug B, with RR = 2, 95% CI = 1.01 to 4.0, and p = 0.049 . The p-value tells you ‘drug A is about 1 in 20 likely to be better than drug B’, but the CI describes ‘drug A probably doubles the chances of success, might be as bad as just a bit better, might be as good as 4 times the success rate’.<\/p>\n

It’s relatively easy to find CI now in most major journal articles, but if they don’t exist for the study you’re looking at, there are some good online tools that can calculate them for you.<\/p>\n

Confidence can be gauged, and this much more clinically useful than telling us the chance of something being nothing.<\/p>\n

Acknowledgment: Excellent blog article on related topic here<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Along with Rumsfelt, the drug-addled Dr. House and everyone who’s ever sat an exam,\u00a0 we can all recollect times when we know that we don’t know something. And we have times when we know something. And we have times when we learn about something we didn’t know we were unaware of. (Varenicline anyone?) And we […]<\/p>\n

Read More…<\/a><\/p>\n","protected":false},"author":7,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[79,80],"tags":[],"class_list":["post-119","post","type-post","status-publish","format-standard","hentry","category-archimedes","category-critical-appraisal-note"],"yoast_head":"\nUnknowns: known, unknown and uncertain - ADC Online Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Unknowns: known, unknown and uncertain - ADC Online Blog\" \/>\n<meta property=\"og:description\" content=\"Along with Rumsfelt, the drug-addled Dr. House and everyone who’s ever sat an exam,\u00a0 we can all recollect times when we know that we don’t know something. And we have times when we know something. And we have times when we learn about something we didn’t know we were unaware of. (Varenicline anyone?) And we [...]Read More...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/\" \/>\n<meta property=\"og:site_name\" content=\"ADC Online Blog\" \/>\n<meta property=\"article:published_time\" content=\"2010-08-16T17:30:33+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2010-08-17T14:15:15+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/www.cerebralmastication.com\/wp-content\/uploads\/2010\/04\/rummy.jpg\" \/>\n<meta name=\"author\" content=\"Bob Phillips\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Bob Phillips\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/08\\\/16\\\/unknowns-known-unknown-and-uncertain\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/08\\\/16\\\/unknowns-known-unknown-and-uncertain\\\/\"},\"author\":{\"name\":\"Bob Phillips\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#\\\/schema\\\/person\\\/9e94029681ecf36e73bbd1eb2be2ef94\"},\"headline\":\"Unknowns: known, unknown and uncertain\",\"datePublished\":\"2010-08-16T17:30:33+00:00\",\"dateModified\":\"2010-08-17T14:15:15+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/08\\\/16\\\/unknowns-known-unknown-and-uncertain\\\/\"},\"wordCount\":340,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/08\\\/16\\\/unknowns-known-unknown-and-uncertain\\\/#primaryimage\"},\"thumbnailUrl\":\"http:\\\/\\\/www.cerebralmastication.com\\\/wp-content\\\/uploads\\\/2010\\\/04\\\/rummy.jpg\",\"articleSection\":[\"archimedes\",\"critical appraisal note\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/08\\\/16\\\/unknowns-known-unknown-and-uncertain\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/08\\\/16\\\/unknowns-known-unknown-and-uncertain\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/08\\\/16\\\/unknowns-known-unknown-and-uncertain\\\/\",\"name\":\"Unknowns: known, unknown and uncertain - ADC Online Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/08\\\/16\\\/unknowns-known-unknown-and-uncertain\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/08\\\/16\\\/unknowns-known-unknown-and-uncertain\\\/#primaryimage\"},\"thumbnailUrl\":\"http:\\\/\\\/www.cerebralmastication.com\\\/wp-content\\\/uploads\\\/2010\\\/04\\\/rummy.jpg\",\"datePublished\":\"2010-08-16T17:30:33+00:00\",\"dateModified\":\"2010-08-17T14:15:15+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/08\\\/16\\\/unknowns-known-unknown-and-uncertain\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/08\\\/16\\\/unknowns-known-unknown-and-uncertain\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/08\\\/16\\\/unknowns-known-unknown-and-uncertain\\\/#primaryimage\",\"url\":\"http:\\\/\\\/www.cerebralmastication.com\\\/wp-content\\\/uploads\\\/2010\\\/04\\\/rummy.jpg\",\"contentUrl\":\"http:\\\/\\\/www.cerebralmastication.com\\\/wp-content\\\/uploads\\\/2010\\\/04\\\/rummy.jpg\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/2010\\\/08\\\/16\\\/unknowns-known-unknown-and-uncertain\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Unknowns: known, unknown and uncertain\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#website\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/\",\"name\":\"ADC Online Blog\",\"description\":\"Education, debate, and meandering thoughts on child health, using evidence and research.\",\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#organization\",\"name\":\"ADC Online Blog\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/files\\\/2017\\\/10\\\/blog-logo-adc.png\",\"contentUrl\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/files\\\/2017\\\/10\\\/blog-logo-adc.png\",\"width\":285,\"height\":34,\"caption\":\"ADC Online Blog\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/#\\\/schema\\\/person\\\/9e94029681ecf36e73bbd1eb2be2ef94\",\"name\":\"Bob Phillips\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g\",\"caption\":\"Bob Phillips\"},\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/adc\\\/author\\\/bphillips\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Unknowns: known, unknown and uncertain - ADC Online Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/","og_locale":"en_GB","og_type":"article","og_title":"Unknowns: known, unknown and uncertain - ADC Online Blog","og_description":"Along with Rumsfelt, the drug-addled Dr. House and everyone who’s ever sat an exam,\u00a0 we can all recollect times when we know that we don’t know something. And we have times when we know something. And we have times when we learn about something we didn’t know we were unaware of. (Varenicline anyone?) And we [...]Read More...","og_url":"https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/","og_site_name":"ADC Online Blog","article_published_time":"2010-08-16T17:30:33+00:00","article_modified_time":"2010-08-17T14:15:15+00:00","og_image":[{"url":"http:\/\/www.cerebralmastication.com\/wp-content\/uploads\/2010\/04\/rummy.jpg","type":"","width":"","height":""}],"author":"Bob Phillips","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Bob Phillips","Estimated reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/#article","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/"},"author":{"name":"Bob Phillips","@id":"https:\/\/blogs.bmj.com\/adc\/#\/schema\/person\/9e94029681ecf36e73bbd1eb2be2ef94"},"headline":"Unknowns: known, unknown and uncertain","datePublished":"2010-08-16T17:30:33+00:00","dateModified":"2010-08-17T14:15:15+00:00","mainEntityOfPage":{"@id":"https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/"},"wordCount":340,"commentCount":0,"publisher":{"@id":"https:\/\/blogs.bmj.com\/adc\/#organization"},"image":{"@id":"https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/#primaryimage"},"thumbnailUrl":"http:\/\/www.cerebralmastication.com\/wp-content\/uploads\/2010\/04\/rummy.jpg","articleSection":["archimedes","critical appraisal note"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/","url":"https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/","name":"Unknowns: known, unknown and uncertain - ADC Online Blog","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/adc\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/#primaryimage"},"image":{"@id":"https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/#primaryimage"},"thumbnailUrl":"http:\/\/www.cerebralmastication.com\/wp-content\/uploads\/2010\/04\/rummy.jpg","datePublished":"2010-08-16T17:30:33+00:00","dateModified":"2010-08-17T14:15:15+00:00","breadcrumb":{"@id":"https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/#primaryimage","url":"http:\/\/www.cerebralmastication.com\/wp-content\/uploads\/2010\/04\/rummy.jpg","contentUrl":"http:\/\/www.cerebralmastication.com\/wp-content\/uploads\/2010\/04\/rummy.jpg"},{"@type":"BreadcrumbList","@id":"https:\/\/blogs.bmj.com\/adc\/2010\/08\/16\/unknowns-known-unknown-and-uncertain\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blogs.bmj.com\/adc\/"},{"@type":"ListItem","position":2,"name":"Unknowns: known, unknown and uncertain"}]},{"@type":"WebSite","@id":"https:\/\/blogs.bmj.com\/adc\/#website","url":"https:\/\/blogs.bmj.com\/adc\/","name":"ADC Online Blog","description":"Education, debate, and meandering thoughts on child health, using evidence and research.","publisher":{"@id":"https:\/\/blogs.bmj.com\/adc\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.bmj.com\/adc\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/blogs.bmj.com\/adc\/#organization","name":"ADC Online Blog","url":"https:\/\/blogs.bmj.com\/adc\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/blogs.bmj.com\/adc\/#\/schema\/logo\/image\/","url":"https:\/\/blogs.bmj.com\/adc\/files\/2017\/10\/blog-logo-adc.png","contentUrl":"https:\/\/blogs.bmj.com\/adc\/files\/2017\/10\/blog-logo-adc.png","width":285,"height":34,"caption":"ADC Online Blog"},"image":{"@id":"https:\/\/blogs.bmj.com\/adc\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/blogs.bmj.com\/adc\/#\/schema\/person\/9e94029681ecf36e73bbd1eb2be2ef94","name":"Bob Phillips","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/secure.gravatar.com\/avatar\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9ce6165c429dd8d36e6532db799ebe58e6f9c614c44e05e60d553e4bac662441?s=96&d=mm&r=g","caption":"Bob Phillips"},"url":"https:\/\/blogs.bmj.com\/adc\/author\/bphillips\/"}]}},"_links":{"self":[{"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/posts\/119","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/comments?post=119"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/posts\/119\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/media?parent=119"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/categories?post=119"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bmj.com\/adc\/wp-json\/wp\/v2\/tags?post=119"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}