Structurally Constrained Recurrent Neural Network (SCRNN)
Structurally Constrained Recurrent Neural Network
This is a self contained software accompanying the paper titled: Learning Longer Memory in Recurrent Neural Networks. The code allows you to reproduce our results on two language modeling datasets:
- PenntreeBank
- Text8
The code implements three recurrent models:
- Standard Recurrent Neural Networks
- Long Short Term Memory Recurrent Neural Networks
- Structurally Constrained Recurrent Neural Networks
It also allows you to play around with various hyper-parameters.