Are there any plans to add Adam solver to Caffe in the near future?
Adam: A Method for Stochastic Optimization
Python implementation (Theano)
Lua implementation (Torch)
I have been using the Lua implemenation for training neural networks for low-level image processing (such as noise reduction and super-resolution) with great success, but could not reproduce results of similar quality in Caffe with SGD/Adagrad/Nesterov. There are reports of better results (faster, more accurate) when training various types of deep networks using Adam.