This is a Keras + Tensorflow 1.xxx version of the AdaMod Optimizer from the paper An Adaptive and Momental Bound Method for Stochastic Learning https://arxiv.org/abs/1910.12249v1
This is a Keras + Tensorflow 1.xxx version of the AdaMod Optimizer from the paper An Adaptive and Momental Bound Method for Stochastic Learning https://arxiv.org/abs/1910.12249v1