tensorplay.optim
Classes
class Adagrad [source]
python
Adagrad(params, lr=0.01, lr_decay=0, weight_decay=0, initial_accumulator_value=0, eps=1e-10)Bases: Optimizer
Methods
__init__(self, params, lr=0.01, lr_decay=0, weight_decay=0, initial_accumulator_value=0, eps=1e-10) [source]
Initialize self. See help(type(self)) for accurate signature.
add_param_group(self, param_group) [source]
load_state_dict(self, state_dict) [source]
state_dict(self) [source]
step(self, closure=None) [source]
zero_grad(self, set_to_none=False) [source]
class Adam [source]
python
Adam(params, lr=0.001, betas=(0.9, 0.999), eps=1e-08, weight_decay=0, amsgrad=False)Bases: Optimizer
Methods
__init__(self, params, lr=0.001, betas=(0.9, 0.999), eps=1e-08, weight_decay=0, amsgrad=False) [source]
Initialize self. See help(type(self)) for accurate signature.
add_param_group(self, param_group) [source]
load_state_dict(self, state_dict) [source]
state_dict(self) [source]
step(self, closure=None) [source]
zero_grad(self, set_to_none=False) [source]
class AdamW [source]
python
AdamW(params, lr=0.001, betas=(0.9, 0.999), eps=1e-08, weight_decay=0.01, amsgrad=False)Bases: Optimizer
Methods
__init__(self, params, lr=0.001, betas=(0.9, 0.999), eps=1e-08, weight_decay=0.01, amsgrad=False) [source]
Initialize self. See help(type(self)) for accurate signature.
add_param_group(self, param_group) [source]
load_state_dict(self, state_dict) [source]
state_dict(self) [source]
step(self, closure=None) [source]
zero_grad(self, set_to_none=False) [source]
class Optimizer [source]
python
Optimizer(params, defaults)Base class for optimizers.
Args
- params (
iterable): an iterable ofTensors ordicts. Specifies what Tensors should be optimized. - defaults: (dict): a dict containing default values of optimization options (used when a parameter group doesn't specify them).
Methods
__init__(self, params, defaults) [source]
Initialize self. See help(type(self)) for accurate signature.
add_param_group(self, param_group) [source]
load_state_dict(self, state_dict) [source]
state_dict(self) [source]
step(self, closure=None) [source]
zero_grad(self, set_to_none=False) [source]
class RMSprop [source]
python
RMSprop(params, lr=0.01, alpha=0.99, eps=1e-08, weight_decay=0, momentum=0, centered=False)Bases: Optimizer
Methods
__init__(self, params, lr=0.01, alpha=0.99, eps=1e-08, weight_decay=0, momentum=0, centered=False) [source]
Initialize self. See help(type(self)) for accurate signature.
add_param_group(self, param_group) [source]
load_state_dict(self, state_dict) [source]
state_dict(self) [source]
step(self, closure=None) [source]
zero_grad(self, set_to_none=False) [source]
class SGD [source]
python
SGD(params, lr=0.001, momentum=0, dampening=0, weight_decay=0, nesterov=False)Bases: Optimizer
Methods
__init__(self, params, lr=0.001, momentum=0, dampening=0, weight_decay=0, nesterov=False) [source]
Initialize self. See help(type(self)) for accurate signature.