{"id":31248,"date":"2023-05-26T14:54:13","date_gmt":"2023-05-26T21:54:13","guid":{"rendered":"https:\/\/sop.washington.edu\/?p=31248"},"modified":"2024-12-12T16:34:40","modified_gmt":"2024-12-13T00:34:40","slug":"uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study","status":"publish","type":"post","link":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\/","title":{"rendered":"UW Professor Anirban Basu Addresses \u2018Algorithmic Discrimination\u2019 With New Study"},"content":{"rendered":"<p><strong>Seattle, WA \u2013 <\/strong>University of Washington Professor <strong>Anirban Basu<\/strong>, the Stergachis Family Endowed Director of the CHOICE Institute, has published <a href=\"https:\/\/www.science.org\/journal\/sciadv\">a paper in <em>Science Advances<\/em><\/a> on a controversial topic regarding whether variables such as race and ethnicity belong in clinical prediction algorithms.<\/p>\n<p>Basu said the impetus for the paper was motivated by concerns raised by several federal and state committees about &#8220;algorithmic discrimination&#8221; as an unintentional outcome of how big data technologies and structures are used and can potentially encode discrimination in automated or humanistic decisions.<\/p>\n<p>\u201cThis work tries to answer to what extent can the inclusion or exclusion of race or ethnicity variables as predictors or features in developing clinical algorithms induce algorithmic discrimination,\u201d he said.<\/p>\n<p>These questions, and the framework presented in this paper for thinking about this issue, readily extend to all types of machine learning and AI algorithms, even outside health.<\/p>\n<p>\u201cRace is a social and not a biological construct,\u201d said Basu. \u201cThis distinction matters because certain arguments against using Race in developing clinical prediction models invoke this notion of Race not being a biological feature.\u201d<\/p>\n<p>Basu noted that often researchers take a utilitarian approach that aims to maximize a (positive) outcome in the population, irrespective of who can do so, suggesting allocating resources to those with the most opportunities to generate outcomes or utilities.<\/p>\n<p>\u201cSuch an approach would suggest that race\/ethnicity variables should always be included in algorithms,\u201d Basu added. \u201cHowever, incorporating any notion of fairness in such predictions would likely result in a different prescription.\u201d<\/p>\n<p>For this study, Basu applied the normative Equality of Opportunity (E.O.) framework, broadly used in many other fairness contexts in social sciences and law, and especially used by the U.S. Supreme Court for several landmark rulings.<\/p>\n<p>\u201cThis is the first time anyone will apply this framework to hold machine learning and other artificial intelligence algorithms to the same standard of equity and, in the process, answer whether race should be included in these algorithms under ideal and real data conditions,\u201d he said.<\/p>\n<p>Basu\u2019s work follows two main ex ante E.O. principles: 1) inequality of outcomes is unethical if it arises due to differences in immutable circumstances. Such unethicality can be remedied by compensating individuals with disadvantaged circumstances, giving them the same opportunity to generate outcomes; and 2) inequality in outcomes arising from differential effort across individuals within each level of circumstances is not a moral bad (i.e., acceptable). Two individuals with the same circumstance should be rewarded differentially to preserve differences in their expected outcomes. The work takes these principles to evaluate algorithms and categorize them as 1) diagnostic algorithms (outcome already realized at the time point when decision-making happens using the predictions) and 2) prognostic algorithms that predict future outcomes relative to the time point of decision-making.<\/p>\n<p>Basu shows that in ideal and practical settings, failure to include race corrections will propagate systemic inequities and discrimination in diagnostic models and specific prognostic models that inform decisions by invoking an ex-ante compensation principle. In contrast, including race in prognostic models that inform resource allocations following an ex-ante reward principle can compromise equal opportunities for patients from different races.<\/p>\n<p>\u201cTo support these arguments, I use simulations studying how an established algorithmic discrimination metric is affected under different versions of algorithms that include race or not,\u201d said Basu. \u201cIn these simulations, I also study issues around measurement errors in outcomes, features, and race. Each has its own set of biases, but none changes the basic conclusions of the paper, based on the E.O. approach.\u201d<\/p>\n<p>&nbsp;<\/p>\n<p>***<\/p>\n<p><strong>Media Inquiries<\/strong>: Contact Scott Braswell at <a href=\"mailto:braswels@uw.edu\">braswels@uw.edu<\/a>.<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Seattle, WA \u2013 University of Washington Professor Anirban Basu, the Stergachis Family Endowed Director of the CHOICE Institute, has published a paper in Science Advances on a controversial topic regarding whether variables such as race&#8230;<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[298,319],"tags":[],"class_list":["post-31248","post","type-post","status-publish","format-standard","hentry","category-choice-news","category-plein-center-news"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.8 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>UW Professor Anirban Basu Addresses \u2018Algorithmic Discrimination\u2019 With New Study - School of Pharmacy<\/title>\n<meta name=\"description\" content=\"Seattle, WA \u2013 University of Washington Professor Anirban Basu, the Stergachis Family Endowed Director of the CHOICE Institute, has published a paper in\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/staff.washington.edu\/twentzel\/wordpress\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"UW Professor Anirban Basu Addresses \u2018Algorithmic Discrimination\u2019 With New Study - School of Pharmacy\" \/>\n<meta property=\"og:description\" content=\"Seattle, WA \u2013 University of Washington Professor Anirban Basu, the Stergachis Family Endowed Director of the CHOICE Institute, has published a paper in\" \/>\n<meta property=\"og:url\" content=\"https:\/\/staff.washington.edu\/twentzel\/wordpress\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\/\" \/>\n<meta property=\"og:site_name\" content=\"School of Pharmacy\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/UWSOP\" \/>\n<meta property=\"article:published_time\" content=\"2023-05-26T21:54:13+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-12-13T00:34:40+00:00\" \/>\n<meta name=\"author\" content=\"Tim Wentzel\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@UW_Pharmacy\" \/>\n<meta name=\"twitter:site\" content=\"@UW_Pharmacy\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tim Wentzel\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\\\/\"},\"author\":{\"name\":\"Tim Wentzel\",\"@id\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/#\\\/schema\\\/person\\\/21859bae0c32073fc2c8d833a054b09f\"},\"headline\":\"UW Professor Anirban Basu Addresses \u2018Algorithmic Discrimination\u2019 With New Study\",\"datePublished\":\"2023-05-26T21:54:13+00:00\",\"dateModified\":\"2024-12-13T00:34:40+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\\\/\"},\"wordCount\":609,\"publisher\":{\"@id\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/#organization\"},\"articleSection\":[\"CHOICE News\",\"Plein Center News\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\\\/\",\"url\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\\\/\",\"name\":\"UW Professor Anirban Basu Addresses \u2018Algorithmic Discrimination\u2019 With New Study - School of Pharmacy\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/#website\"},\"datePublished\":\"2023-05-26T21:54:13+00:00\",\"dateModified\":\"2024-12-13T00:34:40+00:00\",\"description\":\"Seattle, WA \u2013 University of Washington Professor Anirban Basu, the Stergachis Family Endowed Director of the CHOICE Institute, has published a paper in\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"UW Professor Anirban Basu Addresses \u2018Algorithmic Discrimination\u2019 With New Study\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/#website\",\"url\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/\",\"name\":\"University of Washington School of Pharmacy\",\"description\":\"University of Washington\",\"publisher\":{\"@id\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/#organization\"},\"alternateName\":\"UW School of Pharmacy\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/#organization\",\"name\":\"University of Washington School of Pharmacy\",\"alternateName\":\"UW School of Pharmacy\",\"url\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/sop.washington.edu\\\/wp-content\\\/uploads\\\/W-Logo.png\",\"contentUrl\":\"https:\\\/\\\/sop.washington.edu\\\/wp-content\\\/uploads\\\/W-Logo.png\",\"width\":526,\"height\":527,\"caption\":\"University of Washington School of Pharmacy\"},\"image\":{\"@id\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"http:\\\/\\\/www.facebook.com\\\/UWSOP\",\"https:\\\/\\\/x.com\\\/UW_Pharmacy\",\"https:\\\/\\\/www.instagram.com\\\/uw_pharmacy\\\/\",\"https:\\\/\\\/www.youtube.com\\\/user\\\/UWPharmacySchool\",\"https:\\\/\\\/www.linkedin.com\\\/groups\\\/3820716\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/staff.washington.edu\\\/twentzel\\\/wordpress\\\/#\\\/schema\\\/person\\\/21859bae0c32073fc2c8d833a054b09f\",\"name\":\"Tim Wentzel\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"UW Professor Anirban Basu Addresses \u2018Algorithmic Discrimination\u2019 With New Study - School of Pharmacy","description":"Seattle, WA \u2013 University of Washington Professor Anirban Basu, the Stergachis Family Endowed Director of the CHOICE Institute, has published a paper in","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\/","og_locale":"en_US","og_type":"article","og_title":"UW Professor Anirban Basu Addresses \u2018Algorithmic Discrimination\u2019 With New Study - School of Pharmacy","og_description":"Seattle, WA \u2013 University of Washington Professor Anirban Basu, the Stergachis Family Endowed Director of the CHOICE Institute, has published a paper in","og_url":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\/","og_site_name":"School of Pharmacy","article_publisher":"http:\/\/www.facebook.com\/UWSOP","article_published_time":"2023-05-26T21:54:13+00:00","article_modified_time":"2024-12-13T00:34:40+00:00","author":"Tim Wentzel","twitter_card":"summary_large_image","twitter_creator":"@UW_Pharmacy","twitter_site":"@UW_Pharmacy","twitter_misc":{"Written by":"Tim Wentzel","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\/#article","isPartOf":{"@id":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\/"},"author":{"name":"Tim Wentzel","@id":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/#\/schema\/person\/21859bae0c32073fc2c8d833a054b09f"},"headline":"UW Professor Anirban Basu Addresses \u2018Algorithmic Discrimination\u2019 With New Study","datePublished":"2023-05-26T21:54:13+00:00","dateModified":"2024-12-13T00:34:40+00:00","mainEntityOfPage":{"@id":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\/"},"wordCount":609,"publisher":{"@id":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/#organization"},"articleSection":["CHOICE News","Plein Center News"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\/","url":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\/","name":"UW Professor Anirban Basu Addresses \u2018Algorithmic Discrimination\u2019 With New Study - School of Pharmacy","isPartOf":{"@id":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/#website"},"datePublished":"2023-05-26T21:54:13+00:00","dateModified":"2024-12-13T00:34:40+00:00","description":"Seattle, WA \u2013 University of Washington Professor Anirban Basu, the Stergachis Family Endowed Director of the CHOICE Institute, has published a paper in","breadcrumb":{"@id":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/staff.washington.edu\/twentzel\/wordpress\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/uw-professor-anirban-basu-addresses-algorithmic-discrimination-with-new-study\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/"},{"@type":"ListItem","position":2,"name":"UW Professor Anirban Basu Addresses \u2018Algorithmic Discrimination\u2019 With New Study"}]},{"@type":"WebSite","@id":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/#website","url":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/","name":"University of Washington School of Pharmacy","description":"University of Washington","publisher":{"@id":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/#organization"},"alternateName":"UW School of Pharmacy","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/#organization","name":"University of Washington School of Pharmacy","alternateName":"UW School of Pharmacy","url":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/#\/schema\/logo\/image\/","url":"https:\/\/sop.washington.edu\/wp-content\/uploads\/W-Logo.png","contentUrl":"https:\/\/sop.washington.edu\/wp-content\/uploads\/W-Logo.png","width":526,"height":527,"caption":"University of Washington School of Pharmacy"},"image":{"@id":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/#\/schema\/logo\/image\/"},"sameAs":["http:\/\/www.facebook.com\/UWSOP","https:\/\/x.com\/UW_Pharmacy","https:\/\/www.instagram.com\/uw_pharmacy\/","https:\/\/www.youtube.com\/user\/UWPharmacySchool","https:\/\/www.linkedin.com\/groups\/3820716"]},{"@type":"Person","@id":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/#\/schema\/person\/21859bae0c32073fc2c8d833a054b09f","name":"Tim Wentzel"}]}},"acf":[],"_links":{"self":[{"href":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/wp-json\/wp\/v2\/posts\/31248","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/wp-json\/wp\/v2\/comments?post=31248"}],"version-history":[{"count":0,"href":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/wp-json\/wp\/v2\/posts\/31248\/revisions"}],"wp:attachment":[{"href":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/wp-json\/wp\/v2\/media?parent=31248"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/wp-json\/wp\/v2\/categories?post=31248"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/staff.washington.edu\/twentzel\/wordpress\/wp-json\/wp\/v2\/tags?post=31248"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}