Concept-based Interpretable Deep Learning
Pennsylvania Convention Center (Room 120A), Philadelphia, USA
February 25th, 2025 from 14:00 to 18:00
Introduction
As notoriously opaque deep neural networks (DNNs) become commonplace in powerful Artificial Intelligence (AI) systems, there has been a sharp increase in making DNNs interpretable by construction. Concept representation Learning (CL) [1, 2, 3, 4, 5, 6], a subfield in eXplainable AI (XAI), has emerged as a promising direction for designing high-performing interpretable neural architectures. At their core, CL methods learn an intermediate set of high-level concept representations (e.g., “stripped texture”, “round object”, etc.) from which they can predict a downstream task.
Driven by recent rich representations extracted from large datasets and models, CL has moved from a field constrained by the need for concept annotations to one where practical, powerful concept representations can be exploited without costly annotations. This tutorial aims to capitalise on the surge of interest in CL by equipping AI researchers and engineers with the necessary background to understand the current state of this body of work and build on it for their own research. Specifically, this tutorial will provide an overview of foundational and recent works in (i) supervised concept learning, (ii) unsupervised concept learning, and (iii) concept-based neuro-symbolic reasoning. We will conclude by highlighting several connections between CL and other areas in AI (e.g., disentanglement learning, representation learning, bias mitigation, etc.) and bringing forth key open questions within the field.
Required Background
Our material will assume a basic knowledge of ML (e.g., foundations of supervised learning, experimental design, basic probabilistic modelling, etc.), with particular emphasis on a solid Deep Learning foundation (e.g., tensor calculus, neural networks, backpropagation, etc.). Concepts that may require mathematical tools/expertise beyond those one would expect to be shared among the AAAI community will be (re)introduced in our tutorial.
All relevant material used and discussed during the tutorial, including a recording of the tutorial, will be made available here.
Important Details
- Date: This tutorial will be held on February 25, 2025 from 14:00 to 18:00.
- Conference: The Thirty-ninth Annual AAAI Conference on Artificial Intelligence.
- Location: Room 120A of the Pennsylvania Convention Center, Philadelphia, USA.
- Modality: In-person event with the option to join online via Underline (requires AAAI tutorial registration).
Presenters
Contact
For any questions, please do not hesitate to contact Mateo at me466@cam.ac.uk.