Trustworthy AI: Fairness, Interpretability and Privacy

Instructors: Dr. Mattia Cerrato; Xenia Beatrice Heilmann
Shortname: 08.079.22041
Course No.: 08.079.22041
Course Type: Vorlesung/Übung

Requirements / organisational issues

Basic knowledge of probability and linear algebra.

Anwesenheitspflicht

The attendance to the tutorials is not compulsory but graded. People who do not attend the tutorials have differentiated assignments.

Contents

Machine Learning models, especially based on neural networks, are now part of our everyday life, being deployed in smartphones and embedded systems. Computer Vision algorithms recognize our pets in the photos we take; Natural Language Processing models are able to fix our grammar and even generate human-passing text.

While the new wave of so-called “deep learning” systems displays impressive performance in various tasks, these models are very hard to understand in various ways. To cite one issue among others, the GPT family of models employs 175 billion learnable parameters. When something goes wrong, it is almost impossible to understand “why” a model has made a particular decision.

The technical optimism and excitement around Machine Learning has also pushed businesses to apply it in situations where it may impact people’s well-being directly, such as loan applications, candidate selection for job offers and evaluating the chance of re-offending for people who commited crimes. Computer vision applications based on neural networks have even been employed to judge beauty contests.
When we do not fully understand AI algorithms, consequences of their application are hard to predict.

In such contexts, opaque models are particularly problematic as there is a concrete risk for discrimination against certain groups of people. Protected characteristics such as gender and ethnicity might be used in the computation of the final decision, which is problematic on moral grounds and unlawful. The existence of the gender pay gap, for example, shows how there are complex correlations between law-protected attributes (gender) and other, non-sensitive attributes such as a person’s yearly salary.

If models are learning from biased data, it follows that they will learn to output biased decisions; if we are unable to explain those decisions, we are left with very little human control over what ultimately is a software process. On top of being philosophically troubling and unethical, recent legislation might see these methodologies as unlawful.
Taking the General Data Protection Regulation in the European Union as an example, transparency and fairness have to be guaranteed to individuals who are subject to automatic decision-making software systems.

During this class, you will learn about the current discussion in the AI and ML literature about how to control AI and ML algorithms so that they are trustworthy. We will be focusing on three characteristics especially:

Fairness: how can we learn non-discriminating models from biased data?
Interpretability: how can we make sense of a model’s decisions?
Privacy: how do we make sure that a model trained with our personal data does not leak our data to third parties?

Inhalt der Veranstaltungen

Short Description :
Syllabus

Description:

Additional Information

Dates

Date (Day of the week) Time Location
10/22/2024 (Tuesday) 10:15 - 11:45 04 432
2413 - Neubau Physik/Mathematik
10/29/2024 (Tuesday) 10:15 - 11:45 04 432
2413 - Neubau Physik/Mathematik
11/05/2024 (Tuesday) 10:15 - 11:45 04 432
2413 - Neubau Physik/Mathematik
11/12/2024 (Tuesday) 10:15 - 11:45 04 432
2413 - Neubau Physik/Mathematik
11/19/2024 (Tuesday) 10:15 - 11:45 04 432
2413 - Neubau Physik/Mathematik
11/26/2024 (Tuesday) 10:15 - 11:45 04 432
2413 - Neubau Physik/Mathematik
12/03/2024 (Tuesday) 10:15 - 11:45 04 432
2413 - Neubau Physik/Mathematik
12/10/2024 (Tuesday) 10:15 - 11:45 04 432
2413 - Neubau Physik/Mathematik
12/17/2024 (Tuesday) 10:15 - 11:45 04 432
2413 - Neubau Physik/Mathematik
01/07/2025 (Tuesday) 10:15 - 11:45 04 432
2413 - Neubau Physik/Mathematik
01/14/2025 (Tuesday) 10:15 - 11:45 04 432
2413 - Neubau Physik/Mathematik
01/21/2025 (Tuesday) 10:15 - 11:45 04 432
2413 - Neubau Physik/Mathematik
01/28/2025 (Tuesday) 10:15 - 11:45 04 432
2413 - Neubau Physik/Mathematik
02/04/2025 (Tuesday) 10:15 - 11:45 04 432
2413 - Neubau Physik/Mathematik