WARNING: This is the webpage of the 2019-2020 course!
Please check: http://caio-corro.fr/teaching/
Schedule
27 nov. 2019
9:00 - 11:00

E105

Introduction to deep learning for NLP

  • What makes NLP different from other ML problems?
  • Word embeddings
  • Language modeling
  • N-grams models
  • Convolutions
[Download slides]

References:

4 dec. 2019
9:00 - 11:00

E105

Recurrent Neural Networks

  • Long Short Term Memory networks (LSTMs)
  • Gated Recurrent Units (GRUs)
[Download slides]

References:

To go further:

Blog posts:

18 dec. 2019
10:00 - 12:00

E105
Attention mechanism
  • Sequence to sequence with attention
  • Interpretability of attention
  • Formal definition of attention and extensions
  • Transformers
[Download slides]

References:

The transformer architecture is based on "tricks" that where proposed in these papers: To go further:

Blog post:

8 janv. 2020
14:00 - 17:15

E105

Word Representation

  • Distributional semantics
  • word2vec: skip-grams, CBOW
  • Elmo, Bert
[Download slides]

References:

Useful notes: To go further:
15 janv. 2020
14:00 - 17:15

E105
Research paper presentation
22 janv. 2020
14:00 - 17:15

E105
Structured prediction
29 janv. 2020
14:00 - 17:15

E105
Project defense