IndyLSTMs: Independently Recurrent LSTMs

The recurrent weights are not modeled as a full matrix, but as a diagonal matrix… consistently outperform regular LSTMs both in terms of accuracy per parameter, and in best accuracy overall

For more details, visit the source.