recurrent neural networks (rnn)
Tags: ml
- good for tasks that require sequential input
- processes and input sequence one element at a time, maintaining a hidden “state vector”
- has a vanishing problem since backpropagated gardients grow or shrink at each time step
- very good at predicting the next character in the text or the next word in a sequence
- https://www.youtube.com/watch?v=UNmqTiOnRfg
