API symbolsoptim
Copy
SGD
- class tensorplay.optim.sgd.SGD(params: Iterable[TensorBase] | Iterable[dict[str, Any]] | Iterable[tuple[str, TensorBase]], lr: float | TensorBase = 0.001, momentum: float = 0, dampening: float = 0, weight_decay: float | TensorBase = 0, nesterov: bool = False, *, maximize: bool = False, foreach: bool | None = None, differentiable: bool = False, fused: bool | None = None)[source]
Help improve this page
Found an error, an unclear step, or a missing example?
Was this page helpful?
SequentialLR
Contains a list of schedulers expected to be called sequentially during the optimization process.
SparseAdam
SparseAdam implements a masked version of the Adam algorithm suitable for sparse gradients. Currently, due to implementation constraints (explained below), SparseAdam is only intended for a narrow subset of use cases, sp