Project - | Simulation of Long-term Impact of AI on Fairness |
Objective | Machine learning systems have been deployed to aid in high-impact decision-making, such as determining criminal sentencing, child welfare assessments, who receive medical attention, loan approval, etc., and many other settings. Understanding whether such systems are fair is crucial and requires an understanding of models' short- and long-term effects. There are a good number of fairness algorithms and toolkits to develop unbiased AI models that exist (e.g., AIF 360). There are ways to robustify these models to perturbations in population distributions. However, fairness is guaranteed at the initial stage only, and little has been studied on the recursive use of these models. Also, the AI interventions in use would affect the population that in turn would affect the data collected for training the future AI models.
There hasn't been much exploration in simulating and understanding the long term behavior or stability of the model and enable a what-if-modeler. Typically there are multiple players/enterprises in the ecosystem, all with different AI models interacting with the same population, and the effects of enterprises using AI with varying degrees of fairness are not understood. Consequently, the disparities in payoffs/profits to these enterprises are not well understood which guides us to ask the question "Would the fairer enterprises survive?" or what policies or governance has to be in place to ensure fairness in a multi-enterprise setting.
The purpose of this challenge is to build a simulation framework that would enable us to discover the evolution of fairness in a setting of multi-enterprises interacting with a diverse population. |
Outcomes | Business Impact:
Collaboration with external organizations (working in the social justice area) and deliver the product along with them to reach a broader social impact.
Provide solutions to IBM products like Watson OpenScale, Watson NLU having products impacted by Trust and Ethics.
Science Impact:
Publication in top AI and NLP conferences like AAAI, IJCAI, FAccT, ICML, etc. |
Apply by Date | 17/02/2021 |
Applied Teams | 3 / 4 |
Duration | 1 year |
College | All College |
Tools-Technologies | Jupyter Python Notebooks, NLP API, Python |
Mentor | Pranay Lohia |
Platform | 1 ) IBM Bluemix www.bluemix.com
2 ) Watson Data Platform
|
Documents | |