Machine learning

Deep learning has revolutionized an increasing number of domains, e.g., computer vision, natural language processing, games, etc. Structured learning is machine learning which aims to output data, e.g., sequences, matrix, graphs, which have components under some dependencies, e.g., words in a sentence. In this course, we aim to introduce fundamental concepts, theories and advanced techniques in deep structured learning, covering in particular sequence to sequence learning and Generative Adversarial Network (GAN). A number of practical works will be scheduled, including for instance image generation, image to text generation, text-to-image generation, style transfer, etc.

Sequence to sequence learning

• Recursive Network, LSTM, GRU
• Attention-based Model
• Transformer
• Language models, ELMO, BERT, GPT

Generative Adversarial Network (GAN)

• Basics
• Conditional GAN
• Unsupervised cGAN
• Theory and General framework of GANs
• WGAN, EBGAN, InfoGAN, VAE-GAN, BiGAN
• Evaluation of GAN
• Applications: face editing, speech generation