Randomization, Neutrality, and Fairness: When Personalization Harms Performance
Presenter
October 23, 2023
Keywords:
- Algorithms
- Fairness
- mechanism design
- graphs and networks
- machine learning
- policy social choice
- computational sampling
- Markov Chain Monte Carlo
Abstract
Machine learning models often include group attributes like sex, age, and HIV status for the sake of personalization – i.e., to assign more accurate predictions to heterogeneous subpopulations. In this talk, I will describe how such practices inadvertently lead to worsenalization, by assigning unnecessarily inaccurate predictions to minority groups. I will discuss how these effects violate our basic expectations from personalization and describe how these violations arise due to standard practices in model development. I will end by highlighting recent work on how to address these issues in practice – first, by setting "personalization budgets" to test for worsenalization; second, by developing models where individuals can consent to personalization at prediction time.