{"id":286,"date":"2015-02-11T11:23:31","date_gmt":"2015-02-11T11:23:31","guid":{"rendered":"https:\/\/blogs.bmj.com\/quality\/?p=286"},"modified":"2015-02-11T11:23:31","modified_gmt":"2015-02-11T11:23:31","slug":"the-limits-of-quality-improvement","status":"publish","type":"post","link":"https:\/\/blogs.bmj.com\/quality\/2015\/02\/11\/the-limits-of-quality-improvement\/","title":{"rendered":"The limits of quality improvement"},"content":{"rendered":"
\"Rob<\/a>

Rob Bethune is a surgical registrar in the Severn Deanery. Follow him on twitter – @robbethune<\/a><\/p><\/div>\n

If, like me, you believe in the power and importance of clinical teams running small scale quality improvement work, then you must find 15 minutes to watch this excellent and challenging presentation by Mary Dixon-Woods<\/a> describing the evaluation of the Safer Clinical system project (the full written report is available here<\/a>).\u00a0 If you have limited time then I would watch the video rather than reading my blog below; however, I will expand on some of her points and disagree slightly with part of what she says.\u00a0 The main message is that the impact of small groups of clinicians doing quality improvement (QI) work appears to be less than we might have hoped.<\/strong><\/p>\n

QI methodology does not solve all our problems<\/strong><\/h3>\n

The key point that Mary Dixon-Woods makes is that quality improvement methodology (and here I mean the model for improvement, lean etc) cannot address all problems that healthcare faces, and I fully agree with this \u2013 although I would have disagreed if you\u2019d asked me five years ago. \u00a0The table below summaries this; if you cannot measure something often (at least monthly) in an effective and reasonable way, then improvement methodology falls down.\u00a0 Equally if you are looking at things that can only be addressed at institutional (ie national) level, then small groups of frontline clinicians and managers will not be able to influence this.\u00a0 For example, making epidural catheters incompatible with intravenous catheters or standardising the production of kits to place central lines.<\/p>\n\n\n\n\n\n
\n

Simple<\/strong><\/h4>\n<\/td>\n

\n

Complicated <\/strong><\/h4>\n<\/td>\n

\n

Complex<\/strong><\/h4>\n<\/td>\n<\/tr>\n

\n
    \n
  • Making bread<\/li>\n
  • Inserting central lines<\/li>\n
  • Managing intra-operative normothermia<\/li>\n
  • Elements and interactions known<\/li>\n
  • Recipes\/checklists help<\/li>\n<\/ul>\n

     <\/td>\n

\n
    \n
  • Rocket to the moon<\/li>\n
  • Organising outpatients<\/li>\n
  • Door to balloon time for acute myocardial infarction<\/li>\n
  • Elements and interactions are knowable<\/li>\n
  • Algorithms help<\/li>\n<\/ul>\n

     <\/td>\n

\n
    \n
  • Raising a child<\/li>\n
  • Avoiding rare safety events<\/li>\n
  • Managing emergency patients with multiple co morbidities<\/li>\n
  • Elements and interactions are not knowable<\/li>\n
  • Culture and relationships matter<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n
\n
    \n
  • Reliability is reasonable<\/li>\n<\/ul>\n<\/td>\n
\n
    \n
  • Reliability is possible<\/li>\n<\/ul>\n<\/td>\n
\n
    \n
  • Reliability is impossible<\/li>\n
  • Resilience is a better aim<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

    (Adapted from Paul Batalden\u2019s “textbook” of QI)<\/em><\/p>\n

    If you are trying to improve the care of rare conditions or presentations of diseases then QI methodology is not going to help you, and you need to target your interventions to improving culture (which of course is extremely hard).\u00a0 Whereas if you want it improve the quality and timeliness of discharge summaries, then QI methodology is perfect.\u00a0 Between these two relative extremes lies a grey area where small scale clinical teams doing QI are not going to achieve improvement alone, but the more comprehensive, well funded improvement work will.\u00a0 Mary Dixon-Woods gives the example of improving the timeliness of angioplasty for acute myocardial infarction.\u00a0 This was a very well done quality improvement programme (although the cardiologists doing it might well not have called it that).\u00a0 They followed the model for improvement: a clear aim, continuous measurement (which has carried on beyond the timescale of the initial interventions), and multiple PDSA cycles.\u00a0 The big difference between this and most small scale QI work is funding.\u00a0 Primary angioplasty required a whole infrastructure to be built around if with a completely new set of staff; think of all those additional cardiac nurses and hundreds of interventional cardiologists.\u00a0 If sepsis (and in fact more specifically time to first antibiotic) had the same resources and used QI methodology then many more septic patients would get antibiotics sooner.<\/p>\n

    Small scale QI work as a tool for staff engagement<\/strong><\/h3>\n

    Working in systems that are inefficient and irritating has a negative impact on our ability to deliver safer care.\u00a0 For me one of the key aspects of doing small scale quality improvement work is that it can straighten out some of the irritations and genuinely engage staff in their working environment.[1]\u00a0 Even if their quality improvement work does not directly increase quality, its influence on staff morale ultimately will.[2]\u00a0For this reason alone it is worth doing small scale quality improvement work.\u00a0 We must try and develop systems that then go on to make these changes sustainable and last beyond the enthusiasm of the clinicians and mangers involved, but this is proving to be difficult.<\/p>\n

    Finding the problems<\/strong><\/h3>\n

    The one area I would disagree with Professor Dixon-Woods is in identifying the quality problems.\u00a0 In the safer clinical system (SCS) programme a significant amount of time (five months) is spent analysing the current state of affairs to find out where the weaknesses lie, using techniques such as failure mode effect analysis (FMEA) and hierarchical task analysis (HTA).\u00a0 These methods were used in response to the inability of incident investigations in health care to find the real underlying causes of failure.\u00a0 On one hand these techniques do seem to find the real issues but I would strongly say that you don\u2019t always need to do them.\u00a0 In the South West of England we have been running a programme for five years where we get first year doctors to run structured supported quality improvement work, where they chose the areas of work that they feel are the least safe and most inefficient.\u00a0 The list of projects they choose correlates extremely closely to the findings from the diagnostic phase of SCS.\u00a0 So you don\u2019t need to spend five months (and a lot of money) doing HTA and FMEA, you just need to ask your frontline staff what doesn\u2019t work and is unsafe \u2013 they have the answers!\u00a0 These methods do have their uses in healthcare but I do not think they need to be done routinely.<\/p>\n

    The road ahead<\/strong><\/h3>\n

    As a believer in quality improvement I found Mary Dixon-Woods video challenging, but this is no bad thing. It has helped me understand better the limits of small (and large) scale QI work and will hopefully allow me to be more refined in its application as the years go on and we continue with our never ending journey to improve the care we give our patients.<\/p>\n

      \n
    1. Bethune R, Soo E, Woodhead P, Van Hamel C, Watson J. Engaging all doctors in continuous quality improvement: a structured, supported programme for first-year doctors across a training deanery in England. BMJ Qual Saf<\/em> 2013;22(8):613-7.<\/li>\n
    2. West M. Employer Engagement and NHS Performance. Kings Fund<\/em> 2012.<\/li>\n<\/ol>\n

      <\/p>\n","protected":false},"excerpt":{"rendered":"

      If, like me, you believe in the power and importance of clinical teams running small scale quality improvement work, then you must find 15 minutes to watch this excellent and challenging presentation by Mary Dixon-Woods describing the evaluation of the Safer Clinical system project (the full written report is available here).\u00a0 If you have limited […]<\/p>\n","protected":false},"author":178,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-286","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/blogs.bmj.com\/quality\/wp-json\/wp\/v2\/posts\/286","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bmj.com\/quality\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bmj.com\/quality\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/quality\/wp-json\/wp\/v2\/users\/178"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/quality\/wp-json\/wp\/v2\/comments?post=286"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bmj.com\/quality\/wp-json\/wp\/v2\/posts\/286\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.bmj.com\/quality\/wp-json\/wp\/v2\/media?parent=286"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bmj.com\/quality\/wp-json\/wp\/v2\/categories?post=286"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bmj.com\/quality\/wp-json\/wp\/v2\/tags?post=286"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}