GRA 4162 Deep Learning and Explainable AI
GRA 4162 Deep Learning and Explainable AI
The performance of deep learning models in tasks such as image classification, representation learning or data generation has reached state-of-the-art results in recent years.
In this course we will study different deep learning models, such as convolutional neural networks, recurrent neural networks, and autoencoders as well as probabilistic graphical models for deep learning like variational autoencoders. In addition, this course provides students with skills to implement and train deep learning models by exposing them to Python libraries such as TensorFlow. Finally, since some real-world applications require models to be interpretable, this course addresses the concept of explainable artificial intelligence (XAI).
By the end of the course, the student will
- Know how to use and implement state-of-the-art deep learning models for different types of data.
- Know basic techniques in XAI to explain models and their predictions.
- Know how to use generative models to deal with limited amount of data.
By the end of the course, the student will
- Implement and train state-of-the-art deep learning models in TensorFlow.
- Explain the main difference between the different deep learning models and their learning algorithms.
- Choose the appropriate methodology for a given learning problem and given data set.
Students should be able to
- Understand state-of-the-art literature on deep learning.
- Re-implement deep learning methods for their own problems.
- Provide interpretations for the predictions of deep learning models.
To address the learning outcomes listed above, the course will have the following content:
Generative modeling: Many datasets have limited training data or limited labeled data. The course introduces generative modeling techniques that can deal with this challenge by learning generative models that are able to create new observations.
State-of-the-art deep learning architectures: Different data types and different input/output pairs require different architectures, e.g., a neural network architecture designed for time-series is not necessarily a good fit for tabular data. In this course, we will introduce and use state-of-the-art neural network architectures that fit different types of data, which will enable the student to make better choices when creating new models.
Explainable AI: Many real-world use cases require a model to be explainable. For example, the GDPR regulation requires that a decision made by a system should be understandable for a lay person. This part of the course will introduce some basic techniques for probing and understanding predictions made by a machine learning system.
Probabilistic Machine Learning: Probabilistic modeling and deep learning have been succesfully coupled in methodologies such as the variational autoendocer (VAE). VAEs are not only useful as generative models, but also for making predictions on binomial or multinomial outcomes. Thus, VAE predictions are drawn from a probability density funcion, which allow us to say something about their degree of certainty.
Learning activities will combine lectures, case discussions, and laboratory sessions. Students are expected to prepare for lectures by reading assigned material and actively participate in discussion of the lecture topics. In addition, students will work on a practical assigment, which will be answered in groups of 2-3 students. The software tool is Python, with emphasis on TensorFlow.
Please note that while attendance is not compulsory in all courses, it is the student’s own responsibility to obtain any information provided in class.
All parts of the assessment must be passed in order to get a grade in the course.
All courses in the Masters programme will assume that students have fulfilled the admission requirements for the programme. In addition, courses in second, third and/or fourth semester can have spesific prerequisites and will assume that students have followed normal study progression. For double degree and exchange students, please note that equivalent courses are accepted.
GRA4153, GRA4160, GRA4152, and 15 ECTS undergraduate credits in mathematics or statistics/data science, and programming. The graduate courses can be compensated with 18 ECTS in mathematics or statistics/data science, and programming.
Assessments |
---|
Exam category: School Exam Form of assessment: Written School Exam - pen and paper Exam/hand-in semester: First Semester Weight: 40 Grouping: Individual Support materials:
Duration: 3 Hour(s) Comment: . Exam code: GRA 41621 Grading scale: ECTS Resit: Examination when next scheduled course |
Exam category: Submission Form of assessment: Handin - all file types Exam/hand-in semester: First Semester Weight: 60 Grouping: Group (2 - 3) Duration: 1 Semester(s) Comment: Written assignment. Exam code: GRA 41622 Grading scale: ECTS Resit: Examination when next scheduled course |
All exams must be passed to get a grade in this course.
Activity | Duration | Comment |
---|---|---|
Teaching | 36 Hour(s) | |
Seminar groups | 14 Hour(s) | |
Student's own work with learning resources | 130 Hour(s) |
A course of 1 ECTS credit corresponds to a workload of 26-30 hours. Therefore a course of 6 ECTS credits corresponds to a workload of at least 160 hours.