019 Recurrent Neural Networks

目录

• Recurrent Neural Networks
• Why sequence models
• Notation
• Recurrent Neural Network Model
• Backpropagation through time
• Different types of RNNs
• Language model and sequence generation
• Sampling novel sequences
• Vanishing gradients with RNNs
• Gated Recurrent Unit(GRU)
• Long Short Term Memory
• Birdirectional RNN
• Deep RNNs

Recurrent Neural Networks

Why sequence models

Notation

Recurrent Neural Network Model

Backpropagation through time

Different types of RNNs

Language model and sequence generation

Sampling novel sequences

Vanishing gradients with RNNs

Gated Recurrent Unit(GRU)

Long Short Term Memory

Birdirectional RNN

Deep RNNs