{"id":4500,"date":"2023-09-25T10:50:46","date_gmt":"2023-09-25T09:50:46","guid":{"rendered":"https:\/\/blogs.bmj.com\/medical-ethics\/?p=4500"},"modified":"2023-09-25T10:51:04","modified_gmt":"2023-09-25T09:51:04","slug":"outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health","status":"publish","type":"post","link":"https:\/\/blogs.bmj.com\/medical-ethics\/2023\/09\/25\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\/","title":{"rendered":"Outgrowing the infancy? The concept of “Meaningful Human Control” in health"},"content":{"rendered":"

By Eva Maria Hille, Patrik Hummel and Matthias Braun.<\/p>\n

It takes its first steps over time, some of which are successful, some which aren\u2019t. Its steps are becoming more regular and steady until the tempo picks up and it strives to run. As time goes by, it\u2019s outgrowing its infancy. Similar to the steps of an infant, over the last decade, the concept of “Meaningful Human Control” passed through different levels in the discussion on autonomous weapon systems. Until today, the concept has been extensively discussed, and has even made it to the big stage: The European Parliament passed a resolution<\/a> for banning autonomous weapon systems without Meaningful Human Control in 2018. Since 2015, the First Committee on Disarmament and International Security of the United Nations<\/a> has devoted itself to the ongoing discussions on the concept of Meaningful Human Control within its side event series and panel discussions. Furthermore, associations like the UK-NGO \u2018Article 36\u2019<\/a> argued in 2015 for applying Meaningful Human Control for every single attack.<\/p>\n

But what is behind the concept of Meaningful Human Control? First of all, a look into its application fields helps: It is discussed in the context of automated systems that act autonomously to a certain degree. These systems can make processes faster, more efficient, or better in other ways. However, when these kinds of systems are applied in areas where decision-making is a matter of life and death or could result in severe health damages, the question of who can control these systems or intervene in case of unintended consequences arises. To ensure the possibility of control and intervention, the concept of Meaningful Human Control was introduced.<\/p>\n

What exactly does the concept of Meaningful Human Control entail? The researchers Filippo Santoni de Sio and Jeroen van den Hoven named two necessary conditions for an autonomous system to stay under control:<\/a> The tracing condition says that the system\u2019s design must enable it to trace back the results to humans taking part in the design or operation process. The tracking condition refers to the responsiveness of the system \u2013 it should be able to act in accordance with the moral reasons of those involved.<\/p>\n

To avoid unintended consequences and harms, without having to completely forgo automated systems, Meaningful Human Control is applied in the health sector. In this field, more and more automated systems are being used, especially for diagnostics, treatment recommendations, surgery, care, telemedicine, public health, and many others. How exactly Meaningful Human Control can be deployed in these fields has not been researched yet. The concept of Meaningful Human Control in health is still in its infancy. Nevertheless, there are first approaches and ideas: Some of them deal with the concept superficially, while a few others have thoroughly thought through its application for a specific area of use. We have examined this status in our systematic review<\/a>.<\/p>\n

During our research, we came across some important findings. Compared to the context of defence and warfare, the health sector presents some specifics. On one hand, a variety of actors come into play: not only the often-mentioned physicians and designers but also the medical staff in general, as well as patients, their relatives, and others. All of them have their individual values and perceptions, resulting in the emergence of different needs and treatment options, which makes the area of health extremely complex. Against this background, there seems to be a theoretical gap regarding the concept of Meaningful Human Control in the health sector. Nonetheless, it must be stressed that Meaningful Human Control should not become just a label applied like a sticker to a health domain or a specific technical application without any theoretical consideration and resulting practical consequences. This could lead to ‘MHC-washing’, similar to the common phenomenon of ‘green-washing’.<\/p>\n

Whether the concept of Meaningful Human Control can go beyond its initial steps in health or even fully outgrow its infancy depends on how successfully this complexity is considered and how well pitfalls are avoided. As a small contribution to that purpose, we propose a broader take on MHC along the three strands of enabling, enacting, and evaluating control<\/a>.<\/p>\n

We are positive that, if understood along these dimensions, the concept of Meaningful Human Control can help various stakeholders in the health sector leverage AI for better outcomes.<\/p>\n

 <\/p>\n

Paper title<\/strong>: Meaningful Human Control for Health? A Review<\/a><\/p>\n

Authors<\/strong>: Eva Maria Hille1<\/sup>, Patrik Hummel2<\/sup>, Matthias Braun1<\/sup><\/p>\n

Affiliations:<\/strong><\/p>\n

1<\/sup>Chair of Social Ethics & Ethics of Technology, Rheinische Friedrich-Wilhelms-Universit\u00e4t Bonn, Bonn, Germany<\/p>\n

2<\/sup>Department of Industrial Engineering and Innovation Sciences, Eindhoven University of Technology, Eindhoven, The Netherlands<\/p>\n

Competing interests<\/strong>: None declared<\/p>\n

Social media accounts of post author<\/strong>: Twitter @EvaMariaHille<\/a>; @pat_humm <\/a>@brau_matt<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

By Eva Maria Hille, Patrik Hummel and Matthias Braun. It takes its first steps over time, some of which are successful, some which aren\u2019t. Its steps are becoming more regular and steady until the tempo picks up and it strives to run. As time goes by, it\u2019s outgrowing its infancy. Similar to the steps of […]<\/p>\n

Read More…<\/a><\/p>\n","protected":false},"author":354,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8068,8057],"tags":[],"class_list":["post-4500","post","type-post","status-publish","format-standard","hentry","category-artificial-intelligence","category-medical-ethics"],"yoast_head":"\nOutgrowing the infancy? The concept of "Meaningful Human Control" in health - Journal of Medical Ethics blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.bmj.com\/medical-ethics\/2023\/09\/25\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Outgrowing the infancy? The concept of "Meaningful Human Control" in health - Journal of Medical Ethics blog\" \/>\n<meta property=\"og:description\" content=\"By Eva Maria Hille, Patrik Hummel and Matthias Braun. It takes its first steps over time, some of which are successful, some which aren\u2019t. Its steps are becoming more regular and steady until the tempo picks up and it strives to run. As time goes by, it\u2019s outgrowing its infancy. Similar to the steps of [...]Read More...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.bmj.com\/medical-ethics\/2023\/09\/25\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\/\" \/>\n<meta property=\"og:site_name\" content=\"Journal of Medical Ethics blog\" \/>\n<meta property=\"article:published_time\" content=\"2023-09-25T09:50:46+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-09-25T09:51:04+00:00\" \/>\n<meta name=\"author\" content=\"Hazem Zohny\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Hazem Zohny\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2023\\\/09\\\/25\\\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2023\\\/09\\\/25\\\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\\\/\"},\"author\":{\"name\":\"Hazem Zohny\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#\\\/schema\\\/person\\\/e73152f6aa4e164c7d625d77cf4fed35\"},\"headline\":\"Outgrowing the infancy? The concept of “Meaningful Human Control” in health\",\"datePublished\":\"2023-09-25T09:50:46+00:00\",\"dateModified\":\"2023-09-25T09:51:04+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2023\\\/09\\\/25\\\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\\\/\"},\"wordCount\":784,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#organization\"},\"articleSection\":[\"Artificial intelligence\",\"Medical ethics\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2023\\\/09\\\/25\\\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2023\\\/09\\\/25\\\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2023\\\/09\\\/25\\\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\\\/\",\"name\":\"Outgrowing the infancy? The concept of \\\"Meaningful Human Control\\\" in health - Journal of Medical Ethics blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#website\"},\"datePublished\":\"2023-09-25T09:50:46+00:00\",\"dateModified\":\"2023-09-25T09:51:04+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2023\\\/09\\\/25\\\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2023\\\/09\\\/25\\\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2023\\\/09\\\/25\\\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Outgrowing the infancy? The concept of “Meaningful Human Control” in health\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#website\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/\",\"name\":\"Journal of Medical Ethics blog\",\"description\":\"A blog to discuss the ethics of medicine in its many guises and formats.\",\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#organization\",\"name\":\"Journal of Medical Ethics blog\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/files\\\/2026\\\/04\\\/jme-logo.png\",\"contentUrl\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/files\\\/2026\\\/04\\\/jme-logo.png\",\"width\":200,\"height\":50,\"caption\":\"Journal of Medical Ethics blog\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#\\\/schema\\\/person\\\/e73152f6aa4e164c7d625d77cf4fed35\",\"name\":\"Hazem Zohny\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/4d1bd322d5ff8e6f31a624003143903d0ba7346af8cdb1fd6b5e95924b92ece1?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/4d1bd322d5ff8e6f31a624003143903d0ba7346af8cdb1fd6b5e95924b92ece1?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/4d1bd322d5ff8e6f31a624003143903d0ba7346af8cdb1fd6b5e95924b92ece1?s=96&d=mm&r=g\",\"caption\":\"Hazem Zohny\"},\"sameAs\":[\"https:\\\/\\\/www.practicalethics.ox.ac.uk\\\/people\\\/dr-hazem-zohny\"],\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/author\\\/zohnyh\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Outgrowing the infancy? The concept of \"Meaningful Human Control\" in health - Journal of Medical Ethics blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.bmj.com\/medical-ethics\/2023\/09\/25\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\/","og_locale":"en_US","og_type":"article","og_title":"Outgrowing the infancy? The concept of \"Meaningful Human Control\" in health - Journal of Medical Ethics blog","og_description":"By Eva Maria Hille, Patrik Hummel and Matthias Braun. It takes its first steps over time, some of which are successful, some which aren\u2019t. Its steps are becoming more regular and steady until the tempo picks up and it strives to run. As time goes by, it\u2019s outgrowing its infancy. Similar to the steps of [...]Read More...","og_url":"https:\/\/blogs.bmj.com\/medical-ethics\/2023\/09\/25\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\/","og_site_name":"Journal of Medical Ethics blog","article_published_time":"2023-09-25T09:50:46+00:00","article_modified_time":"2023-09-25T09:51:04+00:00","author":"Hazem Zohny","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Hazem Zohny","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2023\/09\/25\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\/#article","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2023\/09\/25\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\/"},"author":{"name":"Hazem Zohny","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#\/schema\/person\/e73152f6aa4e164c7d625d77cf4fed35"},"headline":"Outgrowing the infancy? The concept of “Meaningful Human Control” in health","datePublished":"2023-09-25T09:50:46+00:00","dateModified":"2023-09-25T09:51:04+00:00","mainEntityOfPage":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2023\/09\/25\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\/"},"wordCount":784,"commentCount":0,"publisher":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#organization"},"articleSection":["Artificial intelligence","Medical ethics"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/blogs.bmj.com\/medical-ethics\/2023\/09\/25\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2023\/09\/25\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\/","url":"https:\/\/blogs.bmj.com\/medical-ethics\/2023\/09\/25\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\/","name":"Outgrowing the infancy? The concept of \"Meaningful Human Control\" in health - Journal of Medical Ethics blog","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#website"},"datePublished":"2023-09-25T09:50:46+00:00","dateModified":"2023-09-25T09:51:04+00:00","breadcrumb":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2023\/09\/25\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.bmj.com\/medical-ethics\/2023\/09\/25\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2023\/09\/25\/outgrowing-the-infancy-the-concept-of-meaningful-human-control-in-health\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blogs.bmj.com\/medical-ethics\/"},{"@type":"ListItem","position":2,"name":"Outgrowing the infancy? The concept of “Meaningful Human Control” in health"}]},{"@type":"WebSite","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#website","url":"https:\/\/blogs.bmj.com\/medical-ethics\/","name":"Journal of Medical Ethics blog","description":"A blog to discuss the ethics of medicine in its many guises and formats.","publisher":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.bmj.com\/medical-ethics\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#organization","name":"Journal of Medical Ethics blog","url":"https:\/\/blogs.bmj.com\/medical-ethics\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#\/schema\/logo\/image\/","url":"https:\/\/blogs.bmj.com\/medical-ethics\/files\/2026\/04\/jme-logo.png","contentUrl":"https:\/\/blogs.bmj.com\/medical-ethics\/files\/2026\/04\/jme-logo.png","width":200,"height":50,"caption":"Journal of Medical Ethics blog"},"image":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#\/schema\/person\/e73152f6aa4e164c7d625d77cf4fed35","name":"Hazem Zohny","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/4d1bd322d5ff8e6f31a624003143903d0ba7346af8cdb1fd6b5e95924b92ece1?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/4d1bd322d5ff8e6f31a624003143903d0ba7346af8cdb1fd6b5e95924b92ece1?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/4d1bd322d5ff8e6f31a624003143903d0ba7346af8cdb1fd6b5e95924b92ece1?s=96&d=mm&r=g","caption":"Hazem Zohny"},"sameAs":["https:\/\/www.practicalethics.ox.ac.uk\/people\/dr-hazem-zohny"],"url":"https:\/\/blogs.bmj.com\/medical-ethics\/author\/zohnyh\/"}]}},"_links":{"self":[{"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/posts\/4500","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/users\/354"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/comments?post=4500"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/posts\/4500\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/media?parent=4500"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/categories?post=4500"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/tags?post=4500"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}