Evidence suggests that engaging patients in the diagnostic process is critical to prevent diagnostic error.1<\/sup> Over the last decade, we\u2019ve learnt that sharing visit notes electronically with patients and families (referred to as \u201copen notes\u201d) helps them remember diagnostic tests and referrals, strengthen relationships with providers, and identify breakdowns in the diagnostic process.3-5<\/sup> Based on this experience, we decided to develop a new tool, OurDX, to more actively co-produce the diagnostic process with patients and families.\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/span><\/p>\n Using data from diagnostic breakdowns to develop OurDX<\/b><\/p>\n We started by convening <\/span>a <\/span>14-member <\/span>multistakeholder group including patients and families, diagnostic error and patient engagement experts, clinicians, and healthcare delivery researchers. <\/span>Participating patients and families included <\/span>individuals from diverse racial backgrounds, and who had lived experience with chronic illness, complex care, or disability. The group\u2019s work focused on establishing a patient-centred framework to understand and describe diagnostic breakdowns experienced by patients and families.6<\/sup> <\/span>We defined a patient-reported diagnostic process-related breakdown as a problem or delay identified by patients that mapped to any step of the diagnostic process, as outlined in the NAM conceptual model.1<\/sup> <\/span>Three researchers (one internal medicine doctor [SB], one paediatrician [FB], and one patient [LS]) then applied the framework to analyse<\/span>\u2014<\/span><\/i>using standard qualitative methods<\/span>\u2014<\/span><\/i>over 2000 patient-reported ambulatory errors in two existing datasets: a national Institute for Healthcare Improvement (IHI) survey on the American public perception of medical errors,7<\/sup> and a survey of patients using open notes at three health organisations in the United States.8<\/sup><\/span><\/p>\n This study<\/span> showed that the main patient-identified problems which can lead to diagnostic breakdowns include: 1) <\/span>failure to accurately capture and record patients<\/span>\u2019 history; 2) inadequate communication, including patients not feeling heard or misalignment between patients\u2019 and providers\u2019 views about what’s important; 3) failure or delays related to the explanation of symptoms or next steps; and 4) test or referral breakdowns, such as missing orders<\/span> for recommended tests<\/span>, scheduling delays, or problems with interpretation and communication of results.6<\/sup><\/span>\u00a0<\/span><\/p>\n On the basis of this analysis, a workgroup<\/span>\u2014<\/span><\/i>including patients and family members who receive care at several different organisations, physicians, a user-centred design expert, and<\/span> representatives from the office of patient experience<\/span>\u2014<\/span><\/i>began designing OurDX to help tackle these problems.<\/span> OurDX builds on using the electronic health record (EHR) as a common shared vehicle for full exchange of information between patients and clinicians.\u00a0 In addition to encouraging patients to read notes, it provides a dedicated space in the EHR for patients to set out their priorities for the clinic visit, document their symptoms and concerns, and include any information they have about potential breakdowns related to the diagnostic process. Patients\u2019 contributions become part of the EHR, and clinicians can include their comments in the notes they write after the consultation, potentially decreasing documentation burden. OurDX builds on \u201cOpen Notes,\u201d9<\/sup> \u201cOur Notes\u201d10<\/sup><\/span> (<\/span><\/i>which invites patient contributions to note), and IHI\u2019s \u201c<\/span>What Matters To You<\/span><\/a>,\u201d by creating an <\/span>engagement cycle<\/span><\/i> before and after the visit that is focused on the diagnostic process [Fig 1].\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/span><\/p>\n During our planning discussions with patients and families, we learnt about the physical and emotional impacts of diagnostic error and the absence of an effective way to provide feedback to clinicians about diagnostic breakdowns in real time. Patients expressed gratitude for access to their health information and for the opportunity to help healthcare providers \u201cget it right.\u201d They also prioritised using a positive frame for OurDx that is relationship-centred<\/span>.\u00a0\u00a0<\/span><\/p>\n Design of OurDX to reflect patient and clinician priorities\u00a0<\/b><\/p>\n Clinicians worried that OurDX content might create additional burdens in time constrained visits. But evidence demonstrates the value of patient contributions to raise awareness about clinically relevant diagnostic breakdowns, some of which may otherwise be invisible to clinicians.4<\/sup><\/span> Bearing these factors in mind, we designed questions to focus on actionable information related to the current visit. In addition to open ended items, we used checkboxes for patients to indicate if they had recent visits to an emergency department or another healthcare system for the same problem, or other factors that could help clinicians quickly flag visits that are at higher risk for a diagnostic breakdown. We designed OurDX with a collaborative spirit<\/span>\u2014<\/span><\/i>inviting patients to help clinicians get it right<\/span>\u2014<\/span><\/i>and included a positive feedback question to also identify things that are going well. Finally, we underscored provider feedback about workload and relevance in our assessment.<\/span><\/p>\n We developed <\/span>educational materials<\/span><\/a> and tested OurDX with members of the patient and family advisory council, seeking additional feedback from one hospital\u2019s quality improvement group and the clinics at both hospitals where the tool was planned for implementation. We discussed the system with participating providers and described how to find patient responses to OurDX in the EHR, and how to import them into progress notes. Then we set up a system<\/span> in which patients receive an invitation from the clinic to complete the OurDX tool electronically several days before their scheduled visit through the patient portal or by email. We implemented OurDX in 2021 in five clinics, including both primary care and specialty care at Boston Children\u2019s Hospital and Dartmouth Hitchcock Medical Center<\/span>. <\/span>No new technology has been required since most standard EHRs have built-in functionality for a pre-visit survey.<\/span><\/p>\n Betsy Lowe, volunteer patient\/family adviser with multiple chronic conditions and 11 years of experience at Beth Israel Deaconess Medical Center in Boston, MA\u00a0\u00a0\u00a0<\/i><\/b><\/p>\n As a mother of three children, I interact regularly with doctors, nurses, and physician assistants, and feel responsible for the health and wellbeing of our family in ways that are visible and invisible to providers. For our family, the process of reaching a diagnosis has on occasions been a complicated, confusing, and emotionally exhausting journey. But this experience is rarely discussed in clinic visits, nor is it documented in our notes\u2014even though it becomes a core piece of who we are, how we move through the world, and how we interact with healthcare professionals. It also affects how we live with our diagnoses, our trust in our providers, and our willingness to engage in treatment. I have often wondered how and when to share these parts of our story.\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/span><\/p>\n My work on OurDX included participation in the development of the patient-centred framework for diagnostic breakdowns and the Our DX tool. The experience was rewarding because it gave me insight into the problems providers face on a daily basis, trying to balance the strong desire to care for patients with constrained resources and time. Imagining how I would respond to the OurDX questions before a visit for myself or my children helped me see how inviting patient and family contributions before the visit might encourage open and honest discussion about what it is like for us to go through a challenging diagnostic process. Listening to clinicians and patients on the team enabled me to understand how easily some important pieces of the patient\u2019s story or clinical history can be unintentionally overlooked or mistaken, and how these problems can affect diagnosis or treatment.\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/span><\/p>\n I continue to wonder how and when patients like me can and should share more of our story and how organisations can seek systematic feedback on our experiences. Access to electronic medical records has been valuable because I have gained a better understanding of how clinicians think, and I use my record to orient myself ahead of my next visit. I believe that all healthcare organisations need to find creative ways to invite patients and families to share more about their <\/span>journey<\/span><\/i>, in order to improve care.<\/span><\/p>\n Liz Salmi, patient-researcher<\/i><\/b> and<\/i><\/b> person living with cancer<\/i><\/b><\/p>\n The first time I read my medical record was eight years after my brain cancer diagnosis. Viewing my record was eye opening: it answered my questions, reminded me of my care plan, and reinforced that my doctors were truly listening to me. After enduring two brain surgeries and two years of chemotherapy, I wish I could have seen my record sooner.<\/span><\/p>\n When my insurance changed, I switched doctors and requested my records. I was surprised by the $725.40 fee, which I\u2019ve learnt was a not uncommon barrier to patient record access before the <\/span>21<\/span>st<\/span> Century <\/span>Cures Act<\/span><\/a>,<\/span> which mandates patient access to their electronic records<\/a> in the US<\/span>.11 12<\/sup> I noticed some mistakes in my chart: my age at diagnosis was listed as 19 instead of 29, and my brain cancer type was incorrect.<\/span>\u00a0\u00a0\u00a0\u00a0\u00a0<\/span><\/p>\n I\u2019m not the only person to spot inaccuracies in my medical record. Research shows that one in five people who read their notes find errors, many of which they consider important.4<\/sup><\/span> However, the process for patients to report errors is complicated, varies by organisation, or simply does not exist. A tool like OurDX could help me alert my doctor to the errors in my record. It also sends patients the message that our input is valued and welcomed.<\/span><\/p>\n As a patient-researcher, I participated as a patient-coder in the qualitative analysis of patient reports of medical error, informing OurDX design. The most surprising thing I discovered from reading these patient accounts is how my view of \u201cdiagnosis\u201d changed. I used to think of diagnosis as a \u201cthing I have\u201d\u2014an unchanging attribute. <\/span>\u201cShe is left-handed, she has recurrent grade II astrocytoma.\u201d<\/span><\/i> I now understand diagnosis is not just a thing, but also a <\/span>process.<\/span><\/i> \u00a0 \u00a0 <\/span>\u00a0<\/span><\/p>\n Preliminary findings and future directions<\/b><\/p>\n Sigall Bell, Fabienne Bourgeois, Stephen Liu, and Eric Thomas<\/i><\/strong><\/p>\n So far, the number of patient responses to OurDX is over 3000, which has exceeded our expectations<\/span>.<\/span> A few<\/span> patients have declined use of OurDX due to pandemic-related survey fatigue. As anticipated, t<\/span>he number of <\/span>patient-reported breakdowns has been relatively small,6<\/sup><\/span> and we have found that giving patients the opportunity to write about their experience and views has resulted in patients sharing positive feedback as well. Some clinicians<\/span> report that receiving agenda items and patient-reported histories before or at the visit helps organise the visit, engage patients, and accelerate diagnosis in some instances. For example, patient-provided descriptions of current symptoms have prompted diagnostic studies such as lab tests or imaging to be arranged before the visit, so that results are available sooner. Early concerns about time to read OurDX or pressure to address clinically unimportant concerns have not emerged as major issues, and may be offset by greater clinician efficiency in gathering information and patients who are more prepared for visits. Early data<\/span> suggest OurDX may decrease documentation burden by shortening provider-generated patient histories in notes with OurDX patient contributions.\u00a0<\/span><\/p>\n Co-developing OurDX with patients and families has helped us to learn more about how to engage patients in the ambulatory diagnostic process, which is challenging since it may involve multiple clinic visits and interactions with several different doctors. Formal evaluations of patient reports and clinician surveys are underway and we have translated the tool into Spanish. We believe OurDX can better align patient priorities with clinician agendas, ensure the patient story is captured correctly, facilitate timely completion of diagnostic tests or referrals, and help patients feel heard<\/span>\u2014<\/span>underscoring their vital role in the diagnostic process.\u00a0<\/span><\/p>\n Key messages:<\/strong><\/p>\n Figure 1: The OurDX patient engagement cycle before and after the visit<\/span><\/p>\n *OurDX development team: Sigall Bell, Fabienne Bourgeois, Michele Domey, Stephen Liu, Elizabeth Lowe, Aniqa Mian, Sandy Novack, James Ralston, Lisa Rubino, Liz Salmi, Eric Thomas<\/span><\/i><\/p>\n Sigall K Bell<\/b> is associate professor of medicine at Harvard Medical School and director of patient safety and discovery at OpenNotes, Beth Israel Deaconess Medical Center, Boston, MA.<\/span><\/em><\/p>\n Fabienne Bourgeois<\/b> is assistant professor of pediatrics, Harvard Medical School and associate chief medical information officer at Boston Children\u2019s Hospital, Boston, MA.<\/span><\/em><\/p>\n Stephen Liu<\/b> is associate professor of medicine at the Geisel School of Medicine at Dartmouth, Hanover, NH.<\/span><\/em><\/p>\n Eric J Thomas<\/b> is professor of medicine at the <\/span>McGovern Medical School at the University of Texas Health Science Center at Houston (UTHealth), and director of the UT Houston-Memorial Hermann Center for Healthcare Quality and Safety and associate dean for healthcare quality, in Houston, TX.\u00a0<\/span><\/em><\/p>\n Elizabeth Lowe<\/b> is a patient advocate and member of the patient and family advisory council at Beth Israel Deaconess Medical Center, Boston, MA.<\/span><\/em><\/p>\n Liz Salmi<\/b> is a patient-researcher, person living with cancer, and senior strategist at OpenNotes, Beth Israel Deaconess Medical Center, Boston, MA.<\/span><\/em><\/p>\n Statement:<\/strong> The authors have read and understood BMJ policy on declaration of interests and declare the following interests: This work was supported by funding from the Agency for Healthcare Research and Quality (SB, FB, SL, ET, LS). SB and FB also report funding from the Society to Improve Diagnosis in Medicine for developing OurDX for Spanish-preferring patients.<\/span><\/p>\n Acknowledgement:<\/strong> The authors thank the patients and families who participated in surveys and feedback informing this work; Amanda Norris for her design of the OurDX figure; Nicolas Hart and Brianna Mahon for their assistance in implementing OurDX; Kendall Harcourt for her assistance in project management; Jan Walker and the OurNotes team for contributions from the OurNotes effort; members of the multistakeholder advisory group that guided development of the Patient-Centered Framework, including: Feleshia Battles-Byrdsong, Cait DesRoches, Patricia McGaffigan, Lauge Sokol-Hessner, Suzanne Schrandt, Sue Sheridan, and Glenda Thomas; and additional patient advocates and patient experience contributors to the OurDX development team, including Michele Domey, Aniqa Mian, Sandy Novack, James Ralston, Lisa Rubino, and Sara Toomey.<\/span><\/i><\/p>\n References<\/strong><\/p>\n [1] Balogh EP, Miller BT, Ball JR, et al. Improving Diagnosis in Health Care; 2015. Available at: <\/span>https:\/\/www.nap.edu\/read\/21794\/chapter\/1<\/span><\/a><\/p>\n [2] Croskerry P. The Feedback Sanction. <\/span>Acad Emerg Med<\/span><\/i>. 2000;7(11):1232-1238. doi:10.1111\/j.1553-2712.2000.tb00468.<\/span><\/p>\n [3] Bell SK, Folcarelli P, Fossa A, et al. Tackling Ambulatory Safety Risks Through Patient Engagement, Journal of Patient Safety<\/em>: April 27, 2018 – doi: 10.1097\/PTS.0000000000000494.\u00a0<\/span><\/p>\n [4] <\/span>Bell SK, Delbanco T, Elmore JG, et al. Frequency and Types of Patient-Reported Errors in Electronic Health Record Ambulatory Care Notes. <\/span>JAMA Netw Open<\/span><\/i>. 2020;3(6):e205867-e205867. doi:10.1001\/jamanetworkopen.2020.5867<\/span><\/p>\n [5] Blease CR and Bell SK. <\/span>Patients as diagnostic collaborators: sharing visit notes to promote accuracy and safety.<\/span><\/a> Diagnosis (Berl). 2019 Aug 27;6(3):213-221. doi: 10.1515\/dx-2018-0106.<\/span><\/p>\n [6] <\/span>Bell SK, Bourgeois F, DesRoches C, et al. Filling a Gap in Safety Metrics: Development of a Patient-Centered Framework to Identify and Categorize Patient-Reported Breakdowns related to the Diagnostic Process in Ambulatory Care. BMJ Qual Saf <\/em><\/span>in press.<\/span><\/i><\/p>\n [7] Americans\u2019 experiences with medical errors and views on patient safety.\u00a0 Final report. Available at: <\/span>http:\/\/www.ihi.org\/about\/news\/Documents\/IHI_NPSF_NORC_Patient_Safety_Survey_2017_Final_Report.pdf<\/span><\/a><\/p>\n [8] Walker J, Leveille S, Bell SK, et al. OpenNotes After 7 Years: Patient experiences with ongoing access to their clinicians\u2019 outpatient visit notes. <\/span>J Med Internet Res<\/em> 2019;21(5):e13876<\/span><\/p>\n [9] <\/span>Delbanco T, Walker J, Bell SK, et al . Inviting patients to read their doctors\u2019 notes: A quasi-experimental study and a look ahead. Ann Intern Med<\/em> 2012;<\/span> 157:461-470<\/span><\/p>\n [10] Mafi JN, Gerard M, Chimowitz H,et al.\u00a0Patients Contributing to Their Doctors’ Notes: Insights From Expert Interviews<\/span>.\u00a0<\/b>Ann Intern Med<\/em>\u00a02017; DOI:\u00a0<\/span>10.7326\/M17-0583<\/span><\/a><\/p>\n\n
![\"OurDX\"](\"https:\/\/blogs.bmj.com\/bmj\/files\/2021\/10\/ourdx_final3.jpg\")
<\/p>\n