Trustworthy AI: Fairness, Interpretability and Privacy

Dozent:innen: Dr. Mattia Cerrato
Kurzname: 08.079.22041
Kurs-Nr.: 08.079.22041
Kurstyp: Vorlesung/Übung

Voraussetzungen / Organisatorisches

Machine Learning or Data Mining or Stochastics - suggested.

The class is taught in English.

Anwesenheitspflicht

Graded discussions will take place during the tutorials. Individuals who are not able to participate will have other assignments.

Inhalt

Machine Learning models, especially based on neural networks, are now part of our everyday life, being deployed in smartphones and embedded systems. Computer Vision algorithms recognize our pets in the photos we take; Natural Language Processing models are able to fix our grammar and even generate human-passing text.

While the new wave of so-called “deep learning” systems displays impressive performance in various tasks, these models are very hard to understand in various ways. To cite one issue among others, the GPT family of models employs 175 billion learnable parameters. When something goes wrong, it is almost impossible to understand “why” a model has made a particular decision.

The technical optimism and excitement around Machine Learning has also pushed businesses to apply it in situations where it may impact people’s well-being directly, such as loan applications, candidate selection for job offers and evaluating the chance of re-offending for people who commited crimes. Computer vision applications based on neural networks have even been employed to judge beauty contests.
When we do not fully understand AI algorithms, consequences of their application are hard to predict.

In such contexts, opaque models are particularly problematic as there is a concrete risk for discrimination against certain groups of people. Protected characteristics such as gender and ethnicity might be used in the computation of the final decision, which is problematic on moral grounds and unlawful. The existence of the gender pay gap, for example, shows how there are complex correlations between law-protected attributes (gender) and other, non-sensitive attributes such as a person’s yearly salary.

If models are learning from biased data, it follows that they will learn to output biased decisions; if we are unable to explain those decisions, we are left with very little human control over what ultimately is a software process. On top of being philosophically troubling and unethical, recent legislation might see these methodologies as unlawful.
Taking the General Data Protection Regulation in the European Union as an example, transparency and fairness have to be guaranteed to individuals who are subject to automatic decision-making software systems.

During this class, you will learn about the current discussion in the AI and ML literature about how to control AI and ML algorithms so that they are trustworthy. We will be focusing on three characteristics especially:

Fairness: how can we learn non-discriminating models from biased data?
Interpretability: how can we make sense of a model’s decisions?
Privacy: how do we make sure that a model trained with our personal data does not leak our data to third parties?

Termine

Datum (Wochentag) Zeit Ort
24.10.2023 (Dienstag) 10:15 - 11:45 04 426
2413 - Neubau Physik/Mathematik
31.10.2023 (Dienstag) 10:15 - 11:45 04 426
2413 - Neubau Physik/Mathematik
07.11.2023 (Dienstag) 10:15 - 11:45 04 426
2413 - Neubau Physik/Mathematik
14.11.2023 (Dienstag) 10:15 - 11:45 04 426
2413 - Neubau Physik/Mathematik
21.11.2023 (Dienstag) 10:15 - 11:45 04 426
2413 - Neubau Physik/Mathematik
28.11.2023 (Dienstag) 10:15 - 11:45 04 426
2413 - Neubau Physik/Mathematik
05.12.2023 (Dienstag) 10:15 - 11:45 04 426
2413 - Neubau Physik/Mathematik
12.12.2023 (Dienstag) 10:15 - 11:45 04 426
2413 - Neubau Physik/Mathematik
19.12.2023 (Dienstag) 10:15 - 11:45 04 426
2413 - Neubau Physik/Mathematik
09.01.2024 (Dienstag) 10:15 - 11:45 04 426
2413 - Neubau Physik/Mathematik
16.01.2024 (Dienstag) 10:15 - 11:45 04 426
2413 - Neubau Physik/Mathematik
23.01.2024 (Dienstag) 10:15 - 11:45 04 426
2413 - Neubau Physik/Mathematik
30.01.2024 (Dienstag) 10:15 - 11:45 04 426
2413 - Neubau Physik/Mathematik
06.02.2024 (Dienstag) 10:15 - 11:45 04 426
2413 - Neubau Physik/Mathematik