{"id":765,"date":"2024-05-03T09:00:13","date_gmt":"2024-05-03T09:00:13","guid":{"rendered":"https:\/\/blogs.bmj.com\/bmjleader\/?p=765"},"modified":"2024-05-01T11:32:04","modified_gmt":"2024-05-01T11:32:04","slug":"visualising-the-invisible-narrative-of-differential-attainment-by-dr-nagina-khan-prof-partha-kar-and-prof-subodh-dave","status":"publish","type":"post","link":"https:\/\/blogs.bmj.com\/bmjleader\/2024\/05\/03\/visualising-the-invisible-narrative-of-differential-attainment-by-dr-nagina-khan-prof-partha-kar-and-prof-subodh-dave\/","title":{"rendered":"Visualising the invisible narrative of \u2018Differential Attainment\u2019. By Dr. Nagina Khan, Prof. Partha Kar and Prof. Subodh Dave"},"content":{"rendered":"

Differential Attainment <\/strong><\/p>\n

Many medical educators \u2018have been\u2019 and \u2018remain\u2019 challenged by the concept of Differential Attainment (DA). The term DA describes a variation in levels of educational achievement that occurs between different demographic groups undertaking the same assessments<\/a>. But this is not limited to medical education, Regan De Bere et al, have shown that DA is a common characteristic of \u2018professional education\u2019.<\/p>\n

Widely reported definitions for DA include increased feelings of segregation owing to representing a \u2018minority culture\u2019 or \u2018religion\u2019<\/a>; unsatisfied with the higher education experience<\/a> compared to White colleagues; Typecast risk, for instance negatively stereotyped groups can experience increased anxiety at the prospect of compliance to a stereotype, leads to an underperformance in assessments<\/a>.<\/p>\n

There is some consensus that the explicit prejudice of examiner bias<\/a> is unlikely to be the \u2018sole\u2019 cause, as anonymously marked \u2018multiple choice\u2019 exam findings have also demonstrated inconsistencies amongst White and Black, Asian, and Minority Ethnic (BAME) students. Yeates et al. also explored whether there was evidence of \u2018examiner bias\u2019s against BAME students in an experimental study,1<\/sup> the occurrence of bias was not substantiated.2<\/sup> However, employing a \u201clexical assessment assignment\u201d, Yeates et al., confirmed the existence of \u2018Asian typecasts\u2019 in examiners\u2019 way of thinking.1<\/sup> \u00a0This was the exact opposite to the studies anticipations, this finding transpired irrespective of whether assessors detected \u2018stereotype-consistent or -inconsistent in performances.\u20191<\/sup><\/p>\n

However, clinical grades are understood to play a part in choice for \u2018residency training\u2019, furthermore Woolf et al., propose poorer clinical results for BAME students may contribute to their \u2018underrepresentation\u2019 in \u2018residency training\u2019 and more crucially in the healthcare labour force. A visible and consistent picture is also now emerging from research which adopted a cross disciplinary approach.3<\/sup> The unease around DA has been substantiated by numerous studies that provide evidence, that ethnic minorities medical students have underperformed compared with those from the ethnic majority in clinical (rater-based) evaluations, despite controlling for prior attainment.4<\/sup> BAME medical students are around \u20182.5 times\u2019 likely to not pass an examination when matched to the White majority.5,6<\/sup><\/p>\n

DA appears prevalent amongst \u2018international medical school graduates\u2019 (IMGs).7<\/sup> This may be a linked to the difference between inequality and inequity, which has been seen to subsequently play a part in DA<\/a>. This is especially noticeable when it comes to IMGs who actually need more support in their training for exams \u2018not the same\u2019 as their starting position is different. This can be due to cultural issues, understanding of language, nuances- as well as simple yet important things such as relevant textbooks, tips from colleagues, question banks etc DA is also seen throughout various assessment processes, plus \u2018practical examinations\u2019 (for instance Objective Structured Clinical Examinations – OSCE), \u2018multiple-choice questions\u2019 (MCQ) as well as pass-fail assessments.8<\/sup> Comparable findings have been detected amongst medical students in the United States, the Netherlands and Australia.2<\/sup> Yet, doctors from BAME backgrounds make up a third of the National Health Service (NHS) workforce in the United Kingdom (UK). Indian doctors (11%) are a noticeable minority group, followed by doctors from Pakistan (5%).9<\/sup><\/p>\n

Preventative future interventions <\/strong><\/p>\n

To fully understand the effects and tackle DA, we need to stop tinkering at the sides and direct our struggles to change the core focus a on the issue that is, of the educational assessment itself and perhaps consider the very definition of what an examination sets out to achieve and for whom. We must honestly allow a \u2018visualised\u2019 picture with the proven factors that account for DA to emerge and understand that confronting DA is not only important from a \u2018social justice\u2019 standpoint, but also from a \u2018service delivery\u2019 perspective. In the UK, the NHS honours diversity<\/a> and serves a diverse population. Moreover, the RCGP and BAPIO<\/a> have identified, that failing to focus on inequalities can be costly and have legal and moral challenges.<\/p>\n

Accordingly, underperformance can be attributed to a mismatch between the student and the educational environments that they become a part of, and justifications can be seen equally from both viewpoints, that is in terms of \u2018them\u2019 or \u2018us?9<\/sup> Stegers-Jager offers some crucial guidance on this, that when placed in an alternative way, \u201cDo ethnic minority students perform worse or do their assessors think they do so?\u201d.\u00a0 This is highly relevant, to indicate \u201cwhat\u201d leads to racial and cultural disparities in performance and is a precondition for constructing interventions directed at safeguarding decent \u2018clinical grades\u2019 for BAME students. The reasons underlying DA in undergraduate medical students is uncertain and \u2018examiner bias, prior educational attainment (e.g., A-Level grades), socioeconomic status and psychological factors have all not been able to fully explain the differences seen between White and non-White students\u201d2,9<\/sup> Still, tackling the factors impacting DA requires appropriate considerations and posing proper questions of the institutions within which DA occurs. \u2018How should assessment programs be constructed and regulated to encourage the right type of institutionalization, one that is based on fairness? This can occur by reviewing the objectives of examinations, the conditions of medical institutions, and the characteristics of colleges that favour or weaken calls to set the record straight on DA and explore the contextual causes.<\/p>\n

The foundation and basic goal of assessment is to guarantee educational excellence and more importantly the outcome of \u2018quality\u2019. The approach taken by the \u201cprofessional model\u201d depends on several contributing factors; the significance of detailed specifications of the \u2018providers of services\u2019, and the assumption that the \u201cprofessional’ s knowledge and code of ethics, supported by the vigilance of the profession, are the best guarantees of quality.\u201d Conventional descriptions of professional excellence have been focused more on “input” and “process” measures rather than on “outcomes”\u00a0 such as \u2018quality\u2019 however (\u2026) the intricacy of professional assessment requires that the \u2018professional community\u2019 itself to be the decisive authority of \u2018quality.\u2019 Assessment now needs to promote a fair and equitable educational \u2018quality\u2019 by fostering a revamped professional code of conduct, one that acknowledges the importance of learning outcomes and accepts the principle and practice of accountability to BAME audiences, and the collective faculty must assume responsibility for the overall learning of BAME students. Institutional culture also has a powerful role as contextual causes of DA may indicate gaps in the institutional system. Given the culture and organizational environment of higher education, gaining acceptance for this revamped definition of professional responsibility is no small task and will require the will of other key performers and leaders in healthcare education.<\/p>\n

References <\/strong><\/p>\n

    \n
  1. Yeates P, Woolf K, Benbow E, Davies B, Boohan M, Eva K. A randomised trial of the influence of racial stereotype bias on examiners\u2019 scores, feedback and recollections in undergraduate clinical exams. BMC Med. 2017 Oct 25;15(1):179.<\/li>\n
  2. Low D, Pollack SW, Liao ZC, Maestas R, Kirven LE, Eacker AM, et al. Racial\/Ethnic Disparities in Clinical Grading in Medical School. Teach Learn Med. 2019;31(5):487\u201396.<\/li>\n
  3. Stegers-Jager KM. Is it them or is it us? Unravelling ethnic disparities in undergraduate clinical performance. BMC Med. 2017;15(1):190.<\/li>\n
  4. Stegers-Jager KM, Steyerberg EW, Cohen-Schotanus J, Themmen APN. Ethnic disparities in undergraduate pre-clinical and clinical performance. Med Educ. 2012;46(6):575\u201385.<\/li>\n
  5. Marshall IJ, Wolfe CDA, McKevitt C. Lay perspectives on hypertension and drug adherence: Systematic review of qualitative research. BMJ. 2012;<\/li>\n
  6. Goldacre MJ, Davidson JM, Lambert TW. Country of training and ethnic origin of UK doctors: Database and survey studies. Br Med J. 2004;329(7466):597\u2013600.<\/li>\n
  7. Robinson DBT, Hopkins L, James OP, Brown C, Powell AG, Abdelrahman T, et al. Egalitarianism in surgical training: let equity prevail. Postgrad Med J. 2020;postgradmedj-2020-137563.<\/li>\n
  8. De Vet R, Van Luijtelaar MJA, Brilleslijper-Kater SN, Vanderplasschen W, Beijersbergen MD, Wolf JRLM. Effectiveness of case management for homeless persons: A systematic review. American Journal of Public Health. 2013.<\/li>\n
  9. Woolf K, Mcmanus IC, Potts HWW, Dacre J. The mediators of minority ethnic underperformance in final medical school examinations. Br J Educ Psychol. 2013;83(1):135\u201359.<\/li>\n<\/ol>\n

    Authors<\/strong><\/p>\n

    \"Photo<\/p>\n

    Dr. Nagina Khan, BHSc, PGCert, Ph.D.<\/strong><\/p>\n

    Nagina is a Senior Clinical Research Fellow in Primary Care, Centre for Health\u00a0Services Studies (CHSS), Division of Law, Society and Social Justice, School of\u00a0Social Policy, Sociology &amp; Social Research, University of Kent. She is the CHSS\u00a0PGR Lead (interim) and Director of the MSc Applied Health Research Programme,\u00a0University of Kent.<\/p>\n

    Nagina\u2019s current research supports the Integrated Care Systems (ICS) to capitalise\u00a0on emerging existing networks in its research duty and mitigate the current risk of\u00a0future research being conducted in silos and without focus on priorities and\u00a0underserved populations. This work will diversify the public voice listened to and\u00a0strengthen ICS strategic links within local research infrastructure to support\u00a0evidence-based practice, apply solutions, and spread innovation.<\/p>\n

    Nagina was a senior postdoctoral researcher and Visiting Researcher, Department of\u00a0Psychiatry, University of Oxford. She has worked as a Scientist at Centre for\u00a0Addiction and Mental Health (CAMH). Nagina also worked with Touro University\u00a0Nevada, Las Vegas, US, and with the Royal College of Psychiatrists. Nagina was a\u00a0Medical Research Council (MRC) Research Training Fellow, her research was\u00a0centred on complex interventions for people with depression, University of\u00a0Manchester. Her post-doctoral studies were undertaken at the NIHR School for\u00a0Primary Care Research, UK focusing on First episode Psychosis in young people\u00a0using Early Intervention Services. Nagina\u2019s research interests include Medical\u00a0Education, Professionalism, Social Justice in Healthcare, Complex Interventions for\u00a0Depression, First episode Psychosis in Young People, Culturally Appropriate Mental\u00a0Health Care, Women\u2019s Mental Health, Incentivisation Schemes (P4P) in Healthcare\u00a0for HICs and LMICs and Global Health. Nagina is the Associate Editor at BMJ\u00a0Mental Health, she is also the BMJ Leader Editorial Fellow and was an Editorial\u00a0Board Member of the BioMed Central Medical Education Journal.<\/p>\n

    \"Photo<\/p>\n

    Professor Partha Kar<\/strong><\/p>\n

    Partha Kar is the Type 1 Diabetes & Technology lead for NHS England and co-lead of the Getting it Right First Time (Diabetes) and Consultant, Diabetes & Endocrinology in Portsmouth.<\/p>\n

    In his role with NHS England, he has helped to expand use of technology in Type 1 Diabetes – namely use of Flash Glucose\/CGM & implementation of use of CGM in T1D pregnancy along with use of online digital self-management platforms, while recently leading on real world data collection on Closed Loops for subsequent NICE review. He has worked subsequently with NICE on updating relevant guidelines in non-invasive glucose monitoring access in Type 1 and Type 2 Diabetes.<\/p>\n

    Partha has been involved in the introduction of frailty into Quality Of Framework (QoF) treatment targets, Diabulimia pilot projects in the NHS; championing \u201cLanguage Matters\u201d and helping to create an overview of Diabetes care in Primary Care Networks. Recent work has included principles of Peer support for Type 1 Diabetes as well as a Decision Support Tool for those with Type 1 Diabetes.<\/p>\n

    He has also been recognised as one of the most influential figures from the ethnic minority population across healthcare in the UK by the Healthcare Service Journal in 2020,2021, 2022 & 2023 and received an OBE for services to Diabetes care in 2021.<\/p>\n

    \"Photo<\/p>\n

    Professor<\/strong> Subodh Dave <\/strong><\/p>\n

    Subodh is an international medical graduate having done his MD and DNB (Psychiatry) from Grant Medical College, Mumbai, India. He moved to the UK in 1995 and obtained his CCT in General Adult Psychiatry with an endorsement in Liaison Psychiatry. He works as Consultant Liaison Psychiatrist in Derbyshire Healthcare Foundation Trust and is Professor of Psychiatry at the University of Bolton. He is Deputy Director of Undergraduate Medical Education and in that role has led innovations in introducing and embedding simulation and lived-experience involvement in the training of medical students at the University of Nottingham.<\/p>\n

    Subodh has held training roles at all levels spanning undergraduate, foundation and postgraduate training both in the UK and internationally.<\/p>\n

    He is passionate about ensuring that training, assessment structures and CPD (Continuing Professional Development) programmes lead to improvements in patient care and clinical outcomes.<\/p>\n

    Declaration of interests<\/strong><\/p>\n

    We have read and understood the BMJ Group policy on declaration of interests and declare the following interests: none.<\/p>\n","protected":false},"excerpt":{"rendered":"

    Differential Attainment Many medical educators \u2018have been\u2019 and \u2018remain\u2019 challenged by the concept of Differential Attainment (DA). The term DA describes a variation in levels of educational achievement that occurs between different demographic groups undertaking the same assessments. But this is not limited to medical education, Regan De Bere et al, have shown that DA […]<\/p>\n

    Read More…<\/a><\/p>\n","protected":false},"author":470,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[54],"tags":[],"class_list":["post-765","post","type-post","status-publish","format-standard","hentry","category-healthcare-inequalities-and-social-justice"],"_links":{"self":[{"href":"https:\/\/blogs.bmj.com\/bmjleader\/wp-json\/wp\/v2\/posts\/765","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bmj.com\/bmjleader\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bmj.com\/bmjleader\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/bmjleader\/wp-json\/wp\/v2\/users\/470"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/bmjleader\/wp-json\/wp\/v2\/comments?post=765"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bmj.com\/bmjleader\/wp-json\/wp\/v2\/posts\/765\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.bmj.com\/bmjleader\/wp-json\/wp\/v2\/media?parent=765"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bmj.com\/bmjleader\/wp-json\/wp\/v2\/categories?post=765"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bmj.com\/bmjleader\/wp-json\/wp\/v2\/tags?post=765"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}