tf.keras.experimental.NoisyLinearCosineDecay

View source on GitHub

A LearningRateSchedule that uses a noisy linear cosine decay schedule.

Inherits From: LearningRateSchedule

View aliases

Compat aliases for migration

See Migration guide for more details.

tf.compat.v1.keras.experimental.NoisyLinearCosineDecay, `tf.compat.v2.keras.experimental.NoisyLinearCosineDecay`

tf.keras.experimental.NoisyLinearCosineDecay(
    initial_learning_rate, decay_steps, initial_variance=1.0, variance_decay=0.55,
    num_periods=0.5, alpha=0.0, beta=0.001, name=None
)

Args
initial_learning_rate	A scalar float32 or float64 Tensor or a Python number. The initial learning rate.
decay_steps	A scalar int32 or int64 Tensor or a Python number. Number of steps to decay over.
initial_variance	initial variance for the noise. See computation above.
variance_decay	decay for the noise's variance. See computation above.
num_periods	Number of periods in the cosine part of the decay. See computation above.
alpha	See computation above.
beta	See computation above.
name	String. Optional name of the operation. Defaults to 'NoisyLinearCosineDecay'.

Methods

from_config

View source

@classmethod
from_config(
    config
)

Instantiates a LearningRateSchedule from its config.

Args
config	Output of get_config().

Returns
A LearningRateSchedule instance.

get_config

View source

get_config()

__call__

View source

__call__(
    step
)

Call self as a function.