Home

Deep Learning

This is the website for the Deep Learning for Natural Language Processing (NLP) course (OPT7) of Master 2 AIC (2019-2020).

About

Recently, neural networks trained end-to-end have obtained impressive results in many problems related to natural languages (e.g. machine translation). These deep learning techniques do not rely on manual feature extraction or rule-based systems. However, behind the scenes a large part of this success is due to the development of neural architectures that are able to handle structured inputs and outputs.

In this course, we will study how build neural networks for problems related to natural languages. Specifically, we will learn how to:

  • build dynamic computation graphs for sequential inputs,
  • predict structures (e.g. text generation, semantic parsing),
  • introduce inductive bias.

Moreover, we will develop a critical analysis of state-of-the-art NLP models:

  • do they actually learn what we expect?
  • how does deep for learning for NLP handle bias in training data?

Grading Scheme

  • 25%: Paper presentation
  • 25%: Lab exercises
  • 50%: Project

Contact

You can contact me at caio.corro@u-psud.fr, either in French or English, with a subject starting with [OPT7]. Please, do not worry about typos or not being overly formal enough (just treat your instructors and colleagues with the same respect you would like to be treated).

WARNING: Each mail must discuss at most one point. Never send me a single mail about project and paper presentation, or submit 2 lab exercises in one mail. Thank you.