TensorPlay
API symbolsdistributed
Copy
View MarkdownDownload .md

tensorplay.distributed.algorithms.model_averaging.utils.average_parameters_or_parameter_groups

tensorplay.distributed.algorithms.model_averaging.utils.average_parameters_or_parameter_groups(params: Iterable[Parameter] | Iterable[dict[str, Parameter]], process_group: ProcessGroup)[source]

Averages parameters of a model or parameter groups of an optimizer.

tensorplay.distributed.algorithms.model_averaging.utils.average_parameters

Averages all the given parameters.

tensorplay.distributed.algorithms.model_averaging.utils.get_params_to_average

Return a list of parameters that need to average.

Ask DeepWiki