Neumann Optimizer: A Practical Optimization Algorithm for Deep Neural Networks

Neumann Optimizer. Nearly 1% validation accuracy on imagenet; can use very large batch sizes

For more details, visit the source.