Date:
Location:
This Week's Speaker
Amanda Coston (Microsoft Research), "Addressing confounding in decision-making algorithms"
Abstract
Machine learning algorithms are used for decision-making in societally high-stakes settings from child welfare and criminal justice to healthcare and consumer lending. These algorithms are often intended to predict outcomes under a proposed decision. It is challenging to evaluate how well these algorithms perform because we only observe the relevant outcome under a biased sample of the population. In this talk, we explore how to use techniques from causal inference to estimate performance on the full population. We will consider several strategies to account for confounding factors that affect the decision and the outcome. First, we study runtime confounding where all relevant factors are captured in the historical data, but it is either undesirable or impermissible to use some such factors in the prediction model. Second, we study the setting with unobserved confounders where we can bound the degree to which the outcome varies on average between units receiving different decisions conditional on observed covariates and identified nuisance parameters. We develop debiased machine learning estimators for the learning target and predictive performance estimands under both settings. We present empirical results in the consumer lending and child welfare domains.
The Applied Statistics Workshop (Gov 3009) meets all academic year, Wednesdays, 12pm-1:30pm, in CGIS K354. This workshop is a forum for advanced graduate students, faculty, and visiting scholars to present and discuss methodological or empirical work in progress in an interdisciplinary setting. The workshop features a tour of Harvard's statistical innovations and applications with weekly stops in different fields and disciplines and includes occasional presentations by invited speakers.
More information is available at the Gov 3009 website: https://projects.iq.harvard.edu/applied.stats.workshop-gov3009
All interested Harvard affiliates are invited to attend.