From 19c8283af4dc4f5ce4441d3a7eb0a3ad02375588 Mon Sep 17 00:00:00 2001 From: Amir Arsalan Soltani Date: Tue, 7 Feb 2017 20:19:24 -0500 Subject: [PATCH] Update algos.md --- doc/algos.md | 3 +++ 1 file changed, 3 insertions(+) diff --git a/doc/algos.md b/doc/algos.md index a8dba9f..a3013d9 100644 --- a/doc/algos.md +++ b/doc/algos.md @@ -180,6 +180,8 @@ Arguments: * `x`: the initial point * `config`: a table with configuration parameters for the optimizer * `config.learningRate`: learning rate + * `config.learningRateDecay`: learning rate decay + * `config.weightDecay`: weight decay coefficient for regularization * `state`: a table describing the state of the optimizer; after each call the state is modified * `state.paramVariance`: vector of temporal variances of parameters @@ -201,6 +203,7 @@ Arguments: * `config`: a table with configuration parameters for the optimizer * `config.learningRate`: learning rate * `config.learningRateDecay`: learning rate decay + * `config.weightDecay`: weight decay coefficient for regularization * `config.beta1`: first moment coefficient * `config.beta2`: second moment coefficient * `config.epsilon`: for numerical stability