Skip to content

Commit

Permalink
Cite Adam paper in solver.hpp
Browse files Browse the repository at this point in the history
  • Loading branch information
ronghanghu committed Aug 14, 2015
1 parent cca6a5c commit 0cd8f32
Showing 1 changed file with 8 additions and 0 deletions.
8 changes: 8 additions & 0 deletions include/caffe/solver.hpp
Original file line number Diff line number Diff line change
Expand Up @@ -217,6 +217,14 @@ class AdaDeltaSolver : public SGDSolver<Dtype> {
DISABLE_COPY_AND_ASSIGN(AdaDeltaSolver);
};

/**
* @brief AdamSolver, an algorithm for first-order gradient-based optimization
* of stochastic objective functions, based on adaptive estimates of
* lower-order moments. Described in [1].
*
* [1] D. P. Kingma and J. L. Ba, "ADAM: A Method for Stochastic Optimization."
* arXiv preprint arXiv:1412.6980v8 (2014).
*/
template <typename Dtype>
class AdamSolver : public SGDSolver<Dtype> {
public:
Expand Down

0 comments on commit 0cd8f32

Please sign in to comment.