{"id":4185,"date":"2021-07-28T13:53:09","date_gmt":"2021-07-28T12:53:09","guid":{"rendered":"https:\/\/blogs.bmj.com\/medical-ethics\/?p=4185"},"modified":"2021-07-28T13:53:09","modified_gmt":"2021-07-28T12:53:09","slug":"demystifying-a-part-of-the-wild-west-of-healthcare-ai","status":"publish","type":"post","link":"https:\/\/blogs.bmj.com\/medical-ethics\/2021\/07\/28\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\/","title":{"rendered":"Demystifying a part of the Wild West of healthcare AI"},"content":{"rendered":"

By Jordan Joseph Wadden.<\/p>\n

The pace at which we can see technological developments in healthcare is truly amazing. Sometimes it almost seems like technology is moving too fast, which raises some familiar concerns about patient safety, job security, and sometimes even what it means to be human<\/a>.<\/p>\n

One of the fastest growing uses of technology in healthcare is the application of artificial intelligence. What sometimes isn\u2019t fully grasped is the range of AI that can exist. While there is no uniform set of definitions, typically we see two or three levels or categories. I like to refer to these<\/a> as \u201cweak AI\u201d, \u201cgeneral AI\u201d, and \u201cstrong AI\u201d. Weak AI are those systems that are built for specific purposes, like Siri or Alexa, while general AI are those systems that can learn and grow beyond their initial application, such as IBM\u2019s Watson. Strong AI are those human-level and beyond systems that currently only exist in science-fiction \u2013 think Terminators or HAL 9000.<\/p>\n

Other terms such as \u201cnarrow AI\u201d, \u201csuper AI\u201d, or \u201cartificial general intelligence\u201d can equally be found in media and academic sources. Likewise, the terms I use can sometimes have different definitions than how I have come to represent them \u2013 for example, some consider general AI and strong AI to be synonymous<\/a>. So, as you can see, defining AI is truly a Wild West kind of endeavour.<\/p>\n

But why does all this matter for healthcare?<\/p>\n

As we move to integrate more and more complex technology in our hospitals, clinics, and other patient-centred services, we need to contend with the fact that there are varying definitions of the systems we choose to employ. One area this can be seen is in the application of so-called black box AI systems. These belong to both the weak AI and general AI categories, which already complicates our ability to reckon with how best to ethically evaluate them.<\/p>\n

What is especially tricky with these black box systems is the fact that we don\u2019t know how they reach their recommendations. We know their inputs and outputs, and sure we can know their basic architecture, but we cannot examine or explain their inner workings. The problem here is trying to decide what counts as a black box system.<\/p>\n

In my paper<\/a>, I survey the existing literature and develop a three-part classification of definitions for black box systems. The first category relates to those definitions that say a black box is anything that is opaque to experts \u2013 so long as a programmer can understand the system, it does not matter if anyone else can. The second category are those definitions that say a black box is anything opaque to non-experts, such as the clinicians and patients in a healthcare setting. The third way these systems can be described is being opaque to some unspecified person\/people. These are the most generalist definitions and provide little guidance.<\/p>\n

I argue that this vast spread of definitions can be detrimental to patient care, and thus we need to come to a uniform definition. I develop a definition that I believe fits this need \u2013 one that is centred on patient understanding and a recognition that they are a specific sub-group of the non-expert category. To do this, I work through several criteria I believe any good definition of the black box should consider.<\/p>\n

The speed of technological development is truly amazing, but we need to be careful that we don\u2019t put patients at risk simply because something seems cool. Being more cautious, and working together with uniform definitions of these Wild West terms, can help us ensure we move forward in the best way possible.<\/p>\n

 <\/p>\n

Paper Title:<\/strong> Defining the Undefinable: The Black Box Problem in Healthcare Artificial Intelligence<\/a><\/p>\n

Author: <\/strong>Jordan Joseph Wadden<\/p>\n

Affiliation:<\/strong> Department of Philosophy, University of British Columbia<\/p>\n

Competing Interests:<\/strong> None to disclose.<\/p>\n

Social Media:<\/strong> https:\/\/twitter.com\/BioethicsBeau<\/a><\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

By Jordan Joseph Wadden. The pace at which we can see technological developments in healthcare is truly amazing. Sometimes it almost seems like technology is moving too fast, which raises some familiar concerns about patient safety, job security, and sometimes even what it means to be human. One of the fastest growing uses of technology […]<\/p>\n

Read More…<\/a><\/p>\n","protected":false},"author":354,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8068,8088],"tags":[],"class_list":["post-4185","post","type-post","status-publish","format-standard","hentry","category-artificial-intelligence","category-healthcare"],"yoast_head":"\nDemystifying a part of the Wild West of healthcare AI - Journal of Medical Ethics blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.bmj.com\/medical-ethics\/2021\/07\/28\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Demystifying a part of the Wild West of healthcare AI - Journal of Medical Ethics blog\" \/>\n<meta property=\"og:description\" content=\"By Jordan Joseph Wadden. The pace at which we can see technological developments in healthcare is truly amazing. Sometimes it almost seems like technology is moving too fast, which raises some familiar concerns about patient safety, job security, and sometimes even what it means to be human. One of the fastest growing uses of technology [...]Read More...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.bmj.com\/medical-ethics\/2021\/07\/28\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\/\" \/>\n<meta property=\"og:site_name\" content=\"Journal of Medical Ethics blog\" \/>\n<meta property=\"article:published_time\" content=\"2021-07-28T12:53:09+00:00\" \/>\n<meta name=\"author\" content=\"Hazem Zohny\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Hazem Zohny\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2021\\\/07\\\/28\\\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2021\\\/07\\\/28\\\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\\\/\"},\"author\":{\"name\":\"Hazem Zohny\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#\\\/schema\\\/person\\\/e73152f6aa4e164c7d625d77cf4fed35\"},\"headline\":\"Demystifying a part of the Wild West of healthcare AI\",\"datePublished\":\"2021-07-28T12:53:09+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2021\\\/07\\\/28\\\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\\\/\"},\"wordCount\":653,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#organization\"},\"articleSection\":[\"Artificial intelligence\",\"healthcare\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2021\\\/07\\\/28\\\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2021\\\/07\\\/28\\\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2021\\\/07\\\/28\\\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\\\/\",\"name\":\"Demystifying a part of the Wild West of healthcare AI - Journal of Medical Ethics blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#website\"},\"datePublished\":\"2021-07-28T12:53:09+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2021\\\/07\\\/28\\\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2021\\\/07\\\/28\\\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2021\\\/07\\\/28\\\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Demystifying a part of the Wild West of healthcare AI\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#website\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/\",\"name\":\"Journal of Medical Ethics blog\",\"description\":\"A blog to discuss the ethics of medicine in its many guises and formats.\",\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#organization\",\"name\":\"Journal of Medical Ethics blog\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/files\\\/2026\\\/04\\\/jme-logo.png\",\"contentUrl\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/files\\\/2026\\\/04\\\/jme-logo.png\",\"width\":200,\"height\":50,\"caption\":\"Journal of Medical Ethics blog\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#\\\/schema\\\/person\\\/e73152f6aa4e164c7d625d77cf4fed35\",\"name\":\"Hazem Zohny\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/4d1bd322d5ff8e6f31a624003143903d0ba7346af8cdb1fd6b5e95924b92ece1?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/4d1bd322d5ff8e6f31a624003143903d0ba7346af8cdb1fd6b5e95924b92ece1?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/4d1bd322d5ff8e6f31a624003143903d0ba7346af8cdb1fd6b5e95924b92ece1?s=96&d=mm&r=g\",\"caption\":\"Hazem Zohny\"},\"sameAs\":[\"https:\\\/\\\/www.practicalethics.ox.ac.uk\\\/people\\\/dr-hazem-zohny\"],\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/author\\\/zohnyh\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Demystifying a part of the Wild West of healthcare AI - Journal of Medical Ethics blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.bmj.com\/medical-ethics\/2021\/07\/28\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\/","og_locale":"en_US","og_type":"article","og_title":"Demystifying a part of the Wild West of healthcare AI - Journal of Medical Ethics blog","og_description":"By Jordan Joseph Wadden. The pace at which we can see technological developments in healthcare is truly amazing. Sometimes it almost seems like technology is moving too fast, which raises some familiar concerns about patient safety, job security, and sometimes even what it means to be human. One of the fastest growing uses of technology [...]Read More...","og_url":"https:\/\/blogs.bmj.com\/medical-ethics\/2021\/07\/28\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\/","og_site_name":"Journal of Medical Ethics blog","article_published_time":"2021-07-28T12:53:09+00:00","author":"Hazem Zohny","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Hazem Zohny","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2021\/07\/28\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\/#article","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2021\/07\/28\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\/"},"author":{"name":"Hazem Zohny","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#\/schema\/person\/e73152f6aa4e164c7d625d77cf4fed35"},"headline":"Demystifying a part of the Wild West of healthcare AI","datePublished":"2021-07-28T12:53:09+00:00","mainEntityOfPage":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2021\/07\/28\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\/"},"wordCount":653,"commentCount":0,"publisher":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#organization"},"articleSection":["Artificial intelligence","healthcare"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/blogs.bmj.com\/medical-ethics\/2021\/07\/28\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2021\/07\/28\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\/","url":"https:\/\/blogs.bmj.com\/medical-ethics\/2021\/07\/28\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\/","name":"Demystifying a part of the Wild West of healthcare AI - Journal of Medical Ethics blog","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#website"},"datePublished":"2021-07-28T12:53:09+00:00","breadcrumb":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2021\/07\/28\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.bmj.com\/medical-ethics\/2021\/07\/28\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2021\/07\/28\/demystifying-a-part-of-the-wild-west-of-healthcare-ai\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blogs.bmj.com\/medical-ethics\/"},{"@type":"ListItem","position":2,"name":"Demystifying a part of the Wild West of healthcare AI"}]},{"@type":"WebSite","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#website","url":"https:\/\/blogs.bmj.com\/medical-ethics\/","name":"Journal of Medical Ethics blog","description":"A blog to discuss the ethics of medicine in its many guises and formats.","publisher":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.bmj.com\/medical-ethics\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#organization","name":"Journal of Medical Ethics blog","url":"https:\/\/blogs.bmj.com\/medical-ethics\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#\/schema\/logo\/image\/","url":"https:\/\/blogs.bmj.com\/medical-ethics\/files\/2026\/04\/jme-logo.png","contentUrl":"https:\/\/blogs.bmj.com\/medical-ethics\/files\/2026\/04\/jme-logo.png","width":200,"height":50,"caption":"Journal of Medical Ethics blog"},"image":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#\/schema\/person\/e73152f6aa4e164c7d625d77cf4fed35","name":"Hazem Zohny","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/4d1bd322d5ff8e6f31a624003143903d0ba7346af8cdb1fd6b5e95924b92ece1?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/4d1bd322d5ff8e6f31a624003143903d0ba7346af8cdb1fd6b5e95924b92ece1?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/4d1bd322d5ff8e6f31a624003143903d0ba7346af8cdb1fd6b5e95924b92ece1?s=96&d=mm&r=g","caption":"Hazem Zohny"},"sameAs":["https:\/\/www.practicalethics.ox.ac.uk\/people\/dr-hazem-zohny"],"url":"https:\/\/blogs.bmj.com\/medical-ethics\/author\/zohnyh\/"}]}},"_links":{"self":[{"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/posts\/4185","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/users\/354"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/comments?post=4185"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/posts\/4185\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/media?parent=4185"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/categories?post=4185"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/tags?post=4185"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}