{"id":148,"date":"2020-06-02T08:52:15","date_gmt":"2020-06-02T08:52:15","guid":{"rendered":"https:\/\/blogs.bmj.com\/openscience\/?p=148"},"modified":"2020-06-02T08:52:44","modified_gmt":"2020-06-02T08:52:44","slug":"embracing-variation-to-improve-reproducibility","status":"publish","type":"post","link":"https:\/\/blogs.bmj.com\/openscience\/2020\/06\/02\/embracing-variation-to-improve-reproducibility\/","title":{"rendered":"Embracing variation to improve reproducibility"},"content":{"rendered":"

 <\/p>\n

By Natasha Karp<\/b><\/p>\n

\n

To improve the reproducibility, we need to change the way we design our in vivo experiments<\/strong><\/p>\n

To understand the effect of a treatment, our experiments simplify a complex world by generating control and treatment groups allowing us to isolate cause and effect. This generates an inference or testing space, which arises from the population sampled. From these studies, we then draw conclusions and generalise the results to a broader population. The level of complexity in biology is such that we do have to make hard choices when we design experiments. We cannot explore the impact of all sources of variation on the treatment effect, rather to progress our scientific understanding we need to generate \u201cdoable problems\u201d [1<\/a>] allowing us to incrementally unravel the biological story. The danger presented by too narrow a testing space is that external validity will be low, and results will be so context-dependant that they are hard to reproduce or generalise. The value of many animal studies could be improved by giving further consideration to these effects<\/p>\n

\u00a0<\/strong>The reality of our testing space<\/strong><\/p>\n

The primary strategy used to manage potential sources of variation within in vivo<\/em> research is strict standardisation. We typically standardise the animals (e.g.\u00a0 inbred animals of one sex), the environment (e.g. standard housing and husbandry conditions), the testing procedure and time (e.g. conducting the experiment in one batch in time). The drivers behind this are two-fold. Firstly, to manage potential confounders to ensure that the only difference between the control and treated groups is the treatment. The second driver arises from the objective to reduce the variation in the data with the argument that this will result in fewer animals being needed to detect a defined effect size of interest. This argument frequently dominates our discussion when selecting the right experimental design because of the historic interpretation of \u201cReduction\u201d from the 3R (Replace, Reduce and Refine) ethical framework where we focused on minimizing the number of animals within a single experiment. If we relate this to a clinical study, this would be equivalent to testing a treatment on 30-year-old identical twin brothers who all live in the same town, followed the same career path and now live a life with the same monotonous diet and exercise routine [2<\/a>]. Reflecting on the scenario raises several questions. Why would this observed effect in such a standardised situation be representative of a population?\u00a0 Why do we expect an effect observed in this standardised situation, with artificially low variation, to translate to a meaningful effect once normal biological variation is present?<\/p>\n

In reality, for most scenarios, the treatment effect is context dependent.\u00a0\u00a0<\/strong><\/p>\n

Living organisms are highly responsive to the environment with phenotypic changes with both long (e.g. development) and short-term (e.g. acclimation) duration [3<\/a>]. This phenotypic plasticity is an essential component for survival and is an evolutionary adaption methodology to ensure optimal fit.\u00a0 Without phenotypic plasticity there would be no treatment effect.\u00a0 For some treatments, the effect could be robust and only depend on the nature, duration and intensity of the treatment. It is more likely that the effect of the treatment also depends on the animal\u2019s current phenotype which arises from its history, genotype and the experimental context. The initial reaction to this problem was a call to standardise further and report the context [4<\/a>–6<\/a>].\u00a0 However, research has shown that this leads you down a rabbit hole. Animals are so responsive that you cannot standardise sufficiently to reproduce the context [7<\/a>, 8<\/a>]. It raises the question of what is the value of identifying effects that are idiosyncratic to a unique environment and only significant when bench marked against technical variation as biological variation has been minimised.<\/p>\n

\u00a0<\/strong>We need a paradigm shift in our designs, reporting and conclusions<\/strong><\/p>\n

Eleven experts, working on this arena, have proposed a paradigm shift in how we conduct our experiments to improve reproducibility [9<\/a>].\u00a0 They propose we should embrace variation, but not randomly; rather, they recommend systematic heterogenization by utilising random block designs (Fig. 1). With a block design, the conditions (environment or aspects of the animal) are standardised within a block; however, between blocks conditions can vary.\u00a0 With this type of design, we can estimate the average effect across the blocks but also explore the consistency of this response.<\/b><\/p>\n

Such a design has recently been demonstrated for tumour studies [10<\/a>] to deliver a confidence estimate of the treatment effect for a defined environment by splitting the experiment into a series of small independent mini-experiments. The research showed that the design reduced the need to replicate the experiment, which can reduce the total number of animals used. \u00a0There are questions still to answer, such as what factors to heterogenise on.<\/p>\n

\"\"
Figure 1: Embracing variation through a random block design<\/figcaption><\/figure>\n

\u00a0<\/strong>Meeting our ethical obligations requires us to change practice<\/strong><\/p>\n

Our current practice with highly standardised experiments, tests a narrow inference space, which leads to a significant risk that the estimated effects will be over confident and idiosyncratic and will not be reproducible. We need a mindset change, to focus on maximizing the amount of knowledge gain per animal and\/or per study rather than minimizing the number of animals per study. The focus on the sample size within a single experiment is resulting in poor quality experiments that will lead to more animal use in the long run.\u00a0 The need to change our interpretation is reflected in the contemporary definition of Reduction by the National Centre for the Replacement, Refinement and Reduction of animals in Research (NC3Rs), which now includes \u201c\u2026 experiments that are robust, reproducible and truly add to the knowledge base<\/em>\u201d[11<\/a>]. The first steps on this journey is to acknowledge the reality of the testing space we are working within.\u00a0 The second step is to embrace block designs to gain more confidence in the observed treatment effects.\u00a0 These together will enable us to understand the limitations of our testing space and actively improve the inference space we are working within.<\/p>\n

\n

References:<\/strong><\/p>\n

    \n
  1. Gompers, A., Dec 10 Dec 10 Three Years In:\u201cSex as a Biological Variable\u201d Policy in Practice-and an Invitation to Collaborate.<\/em><\/a><\/li>\n
  2. Garner, J.P., et al., Introducing Therioepistemology: the study of how knowledge is gained from animal research.<\/em> 2017. 46<\/strong>(4): p. 103.<\/a><\/li>\n
  3. Voelkl, B. and H.J.T.i.p.s. W\u00fcrbel, Reproducibility crisis: are we ignoring reaction norms?<\/em> 2016. 37<\/strong>(7): p. 509-510.<\/a><\/li>\n
  4. Omary, M.B., et al., Not all mice are the same: standardization of animal research data presentation.<\/em> 2016. 65<\/strong>(6): p. 894-895.<\/a><\/li>\n
  5. Beynen, A., M. Festing, and M. van Montford, Design of animal experiments. Principles of Laboratory Animal Science, 2nd edn. van Zutphen LFM, Baumans V, Beynen AC, eds<\/em>. 2003, Amsterdam: Elsevier.<\/a><\/li>\n
  6. Mering, S., E. Kaliste-Korhonen, and T.J.L.A. Nevalainen, Estimates of appropriate number of rats: interaction with housing environment.<\/em> 2001. 35<\/strong>(1): p. 80-90.<\/a><\/li>\n
  7. Crabbe, J.C., D. Wahlsten, and B.C. Dudek, Genetics of mouse behavior: interactions with laboratory environment.<\/em> Science, 1999. 284<\/strong>(5420): p. 1670-1672.<\/a><\/li>\n
  8. Karp, N.A., et al., Impact of temporal variation on design and analysis of mouse knockout phenotyping studies.<\/em> PloS one, 2014. 9<\/strong>(10): p. e111239.<\/a><\/li>\n
  9. Voelkl, B., Altman, N.S., Forsman, A.\u00a0et al.<\/i>\u00a0Reproducibility of animal research in light of biological variation.\u00a0Nat Rev Neurosci<\/i> (2020).<\/a><\/li>\n
  10. Karp, N.A., et al., A multi-batch design to deliver robust estimates of efficacy and reduce animal use\u2013a syngeneic tumour case study.<\/em> 2020. 10<\/strong>(1): p. 1-10.<\/a><\/li>\n
  11. NC3Rs. The 3Rs<\/em>. 2018 [cited 2018 16th January 2018].<\/a><\/li>\n<\/ol>\n
    \n
    \"\"
    Sanger Insitute – Wellcome Trust. Photo by Phil Mynott<\/figcaption><\/figure>\n

    Natasha A Karp, Data Sciences & Quantitative Biology, Discovery Sciences, R&D, AstraZeneca, Cambridge, UK<\/p>\n

    Conflict of interest:<\/strong>\u00a0 Natasha Karp, is an employee of AstraZeneca and holds shares in this pharmaceutical company. However, as a blog on experimental methodology, there are no conflicts of interest with the subject matter or materials discussed to declare.<\/p>\n

     <\/p>\n

    \u00a0<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"

      By Natasha Karp To improve the reproducibility, we need to change the way we design our in vivo experiments To understand the effect of a treatment, our experiments simplify a complex world by generating control and treatment groups allowing us to isolate cause and effect. This generates an inference or testing space, which arises […]<\/p>\n

    Read More…<\/a><\/p>\n","protected":false},"author":348,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[36],"tags":[],"class_list":["post-148","post","type-post","status-publish","format-standard","hentry","category-reproducibility"],"yoast_head":"\nEmbracing variation to improve reproducibility - BMJ Open Science<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.bmj.com\/openscience\/2020\/06\/02\/embracing-variation-to-improve-reproducibility\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Embracing variation to improve reproducibility - BMJ Open Science\" \/>\n<meta property=\"og:description\" content=\"  By Natasha Karp To improve the reproducibility, we need to change the way we design our in vivo experiments To understand the effect of a treatment, our experiments simplify a complex world by generating control and treatment groups allowing us to isolate cause and effect. This generates an inference or testing space, which arises [...]Read More...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.bmj.com\/openscience\/2020\/06\/02\/embracing-variation-to-improve-reproducibility\/\" \/>\n<meta property=\"og:site_name\" content=\"BMJ Open Science\" \/>\n<meta property=\"article:published_time\" content=\"2020-06-02T08:52:15+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-06-02T08:52:44+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/blogs.bmj.com\/openscience\/files\/2020\/06\/PossibleFigure1.png\" \/>\n<meta name=\"author\" content=\"Kaitlyn Hair\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Kaitlyn Hair\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/2020\\\/06\\\/02\\\/embracing-variation-to-improve-reproducibility\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/2020\\\/06\\\/02\\\/embracing-variation-to-improve-reproducibility\\\/\"},\"author\":{\"name\":\"Kaitlyn Hair\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/#\\\/schema\\\/person\\\/85f4f196ae9e44e2e9a22def1af575ed\"},\"headline\":\"Embracing variation to improve reproducibility\",\"datePublished\":\"2020-06-02T08:52:15+00:00\",\"dateModified\":\"2020-06-02T08:52:44+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/2020\\\/06\\\/02\\\/embracing-variation-to-improve-reproducibility\\\/\"},\"wordCount\":1297,\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/2020\\\/06\\\/02\\\/embracing-variation-to-improve-reproducibility\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/files\\\/2020\\\/06\\\/PossibleFigure1.png\",\"articleSection\":[\"Reproducibility\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/2020\\\/06\\\/02\\\/embracing-variation-to-improve-reproducibility\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/2020\\\/06\\\/02\\\/embracing-variation-to-improve-reproducibility\\\/\",\"name\":\"Embracing variation to improve reproducibility - BMJ Open Science\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/2020\\\/06\\\/02\\\/embracing-variation-to-improve-reproducibility\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/2020\\\/06\\\/02\\\/embracing-variation-to-improve-reproducibility\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/files\\\/2020\\\/06\\\/PossibleFigure1.png\",\"datePublished\":\"2020-06-02T08:52:15+00:00\",\"dateModified\":\"2020-06-02T08:52:44+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/2020\\\/06\\\/02\\\/embracing-variation-to-improve-reproducibility\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/2020\\\/06\\\/02\\\/embracing-variation-to-improve-reproducibility\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/2020\\\/06\\\/02\\\/embracing-variation-to-improve-reproducibility\\\/#primaryimage\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/files\\\/2020\\\/06\\\/PossibleFigure1.png\",\"contentUrl\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/files\\\/2020\\\/06\\\/PossibleFigure1.png\",\"width\":1280,\"height\":720},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/2020\\\/06\\\/02\\\/embracing-variation-to-improve-reproducibility\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Embracing variation to improve reproducibility\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/#website\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/\",\"name\":\"BMJ Open Science\",\"description\":\"Blogging about our preclinical research and improving the transparency, integrity, and reproducibility of research closely aligned to medicine.\",\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/#organization\",\"name\":\"BMJ Open Science\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/files\\\/2017\\\/11\\\/blog-logo-bmj-open-science.png\",\"contentUrl\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/files\\\/2017\\\/11\\\/blog-logo-bmj-open-science.png\",\"width\":263,\"height\":34,\"caption\":\"BMJ Open Science\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/#\\\/schema\\\/person\\\/85f4f196ae9e44e2e9a22def1af575ed\",\"name\":\"Kaitlyn Hair\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1c6f20ca1562ea09157370c8e97ca84d5d66677fdecc6fe7b44f50953abc6f38?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1c6f20ca1562ea09157370c8e97ca84d5d66677fdecc6fe7b44f50953abc6f38?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1c6f20ca1562ea09157370c8e97ca84d5d66677fdecc6fe7b44f50953abc6f38?s=96&d=mm&r=g\",\"caption\":\"Kaitlyn Hair\"},\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/openscience\\\/author\\\/khair\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Embracing variation to improve reproducibility - BMJ Open Science","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.bmj.com\/openscience\/2020\/06\/02\/embracing-variation-to-improve-reproducibility\/","og_locale":"en_US","og_type":"article","og_title":"Embracing variation to improve reproducibility - BMJ Open Science","og_description":"  By Natasha Karp To improve the reproducibility, we need to change the way we design our in vivo experiments To understand the effect of a treatment, our experiments simplify a complex world by generating control and treatment groups allowing us to isolate cause and effect. This generates an inference or testing space, which arises [...]Read More...","og_url":"https:\/\/blogs.bmj.com\/openscience\/2020\/06\/02\/embracing-variation-to-improve-reproducibility\/","og_site_name":"BMJ Open Science","article_published_time":"2020-06-02T08:52:15+00:00","article_modified_time":"2020-06-02T08:52:44+00:00","og_image":[{"url":"https:\/\/blogs.bmj.com\/openscience\/files\/2020\/06\/PossibleFigure1.png","type":"","width":"","height":""}],"author":"Kaitlyn Hair","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Kaitlyn Hair","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blogs.bmj.com\/openscience\/2020\/06\/02\/embracing-variation-to-improve-reproducibility\/#article","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/openscience\/2020\/06\/02\/embracing-variation-to-improve-reproducibility\/"},"author":{"name":"Kaitlyn Hair","@id":"https:\/\/blogs.bmj.com\/openscience\/#\/schema\/person\/85f4f196ae9e44e2e9a22def1af575ed"},"headline":"Embracing variation to improve reproducibility","datePublished":"2020-06-02T08:52:15+00:00","dateModified":"2020-06-02T08:52:44+00:00","mainEntityOfPage":{"@id":"https:\/\/blogs.bmj.com\/openscience\/2020\/06\/02\/embracing-variation-to-improve-reproducibility\/"},"wordCount":1297,"publisher":{"@id":"https:\/\/blogs.bmj.com\/openscience\/#organization"},"image":{"@id":"https:\/\/blogs.bmj.com\/openscience\/2020\/06\/02\/embracing-variation-to-improve-reproducibility\/#primaryimage"},"thumbnailUrl":"https:\/\/blogs.bmj.com\/openscience\/files\/2020\/06\/PossibleFigure1.png","articleSection":["Reproducibility"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/blogs.bmj.com\/openscience\/2020\/06\/02\/embracing-variation-to-improve-reproducibility\/","url":"https:\/\/blogs.bmj.com\/openscience\/2020\/06\/02\/embracing-variation-to-improve-reproducibility\/","name":"Embracing variation to improve reproducibility - BMJ Open Science","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/openscience\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blogs.bmj.com\/openscience\/2020\/06\/02\/embracing-variation-to-improve-reproducibility\/#primaryimage"},"image":{"@id":"https:\/\/blogs.bmj.com\/openscience\/2020\/06\/02\/embracing-variation-to-improve-reproducibility\/#primaryimage"},"thumbnailUrl":"https:\/\/blogs.bmj.com\/openscience\/files\/2020\/06\/PossibleFigure1.png","datePublished":"2020-06-02T08:52:15+00:00","dateModified":"2020-06-02T08:52:44+00:00","breadcrumb":{"@id":"https:\/\/blogs.bmj.com\/openscience\/2020\/06\/02\/embracing-variation-to-improve-reproducibility\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.bmj.com\/openscience\/2020\/06\/02\/embracing-variation-to-improve-reproducibility\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blogs.bmj.com\/openscience\/2020\/06\/02\/embracing-variation-to-improve-reproducibility\/#primaryimage","url":"https:\/\/blogs.bmj.com\/openscience\/files\/2020\/06\/PossibleFigure1.png","contentUrl":"https:\/\/blogs.bmj.com\/openscience\/files\/2020\/06\/PossibleFigure1.png","width":1280,"height":720},{"@type":"BreadcrumbList","@id":"https:\/\/blogs.bmj.com\/openscience\/2020\/06\/02\/embracing-variation-to-improve-reproducibility\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blogs.bmj.com\/openscience\/"},{"@type":"ListItem","position":2,"name":"Embracing variation to improve reproducibility"}]},{"@type":"WebSite","@id":"https:\/\/blogs.bmj.com\/openscience\/#website","url":"https:\/\/blogs.bmj.com\/openscience\/","name":"BMJ Open Science","description":"Blogging about our preclinical research and improving the transparency, integrity, and reproducibility of research closely aligned to medicine.","publisher":{"@id":"https:\/\/blogs.bmj.com\/openscience\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.bmj.com\/openscience\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/blogs.bmj.com\/openscience\/#organization","name":"BMJ Open Science","url":"https:\/\/blogs.bmj.com\/openscience\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blogs.bmj.com\/openscience\/#\/schema\/logo\/image\/","url":"https:\/\/blogs.bmj.com\/openscience\/files\/2017\/11\/blog-logo-bmj-open-science.png","contentUrl":"https:\/\/blogs.bmj.com\/openscience\/files\/2017\/11\/blog-logo-bmj-open-science.png","width":263,"height":34,"caption":"BMJ Open Science"},"image":{"@id":"https:\/\/blogs.bmj.com\/openscience\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/blogs.bmj.com\/openscience\/#\/schema\/person\/85f4f196ae9e44e2e9a22def1af575ed","name":"Kaitlyn Hair","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/1c6f20ca1562ea09157370c8e97ca84d5d66677fdecc6fe7b44f50953abc6f38?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/1c6f20ca1562ea09157370c8e97ca84d5d66677fdecc6fe7b44f50953abc6f38?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1c6f20ca1562ea09157370c8e97ca84d5d66677fdecc6fe7b44f50953abc6f38?s=96&d=mm&r=g","caption":"Kaitlyn Hair"},"url":"https:\/\/blogs.bmj.com\/openscience\/author\/khair\/"}]}},"_links":{"self":[{"href":"https:\/\/blogs.bmj.com\/openscience\/wp-json\/wp\/v2\/posts\/148","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bmj.com\/openscience\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bmj.com\/openscience\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/openscience\/wp-json\/wp\/v2\/users\/348"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/openscience\/wp-json\/wp\/v2\/comments?post=148"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bmj.com\/openscience\/wp-json\/wp\/v2\/posts\/148\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.bmj.com\/openscience\/wp-json\/wp\/v2\/media?parent=148"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bmj.com\/openscience\/wp-json\/wp\/v2\/categories?post=148"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bmj.com\/openscience\/wp-json\/wp\/v2\/tags?post=148"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}