adaptive moment estimation(自适应矩估计)

tf.train.AdamOptimizer(
    learning_rate=0.001,
    beta1=0.9,
    beta2=0.999,
    epsilon=1e-08,
    use_locking=False,
    name='Adam'
)
参数:
learning_rate: (学习率)张量或者浮点数
beta1:  浮点数或者常量张量 ,表示 The exponential decay rate for the 1st moment estimates.
beta2:  浮点数或者常量张量 ,表示 The exponential decay rate for the 2nd moment estimates.
epsilon: A small constant for numerical stability. This epsilon is "epsilon hat" in the Kingma and Ba paper (in the formula just before Section 2.1), not the epsilon in         Algorithm 1 of the paper.
use_locking: 为True时锁定更新
name:  梯度下降名称,默认为 "Adam"

相关文章:

  • 2021-06-17
  • 2021-10-17
  • 2022-01-08
  • 2022-02-04
  • 2021-08-23
  • 2021-10-03
  • 2022-02-05
  • 2022-12-23
猜你喜欢
  • 2022-12-23
  • 2021-10-08
  • 2021-08-24
  • 2021-08-15
  • 2021-12-19
相关资源
相似解决方案