Videos

Randomization, Neutrality, and Fairness: When Personalization Harms Performance

Presenter
October 23, 2023
Keywords:
  • Algorithms
  • Fairness
  • mechanism design
  • graphs and networks
  • machine learning
  • policy social choice
  • computational sampling
  • Markov Chain Monte Carlo
Abstract
Machine learning models often include group attributes like sex, age, and HIV status for the sake of personalization – i.e., to assign more accurate predictions to heterogeneous subpopulations. In this talk, I will describe how such practices inadvertently lead to worsenalization, by assigning unnecessarily inaccurate predictions to minority groups. I will discuss how these effects violate our basic expectations from personalization and describe how these violations arise due to standard practices in model development. I will end by highlighting recent work on how to address these issues in practice – first, by setting "personalization budgets" to test for worsenalization; second, by developing models where individuals can consent to personalization at prediction time.