# tensorplay.distributed.algorithms.model_averaging.utils.average_parameters

Source: https://www.tensorplay.cn/docs/generated/tensorplay.distributed.algorithms.model_averaging.utils.average_parameters.html

# tensorplay.distributed.algorithms.model_averaging.utils.average_parameters

tensorplay.distributed.algorithms.model_averaging.utils.average_parameters(params: [Iterator](https://docs.python.org/3/library/collections.abc.html#collections.abc.Iterator)[[Parameter](tensorplay.nn.Parameter.html#tensorplay.nn.Parameter)], process_group: ProcessGroup)[[source]](../_modules/tensorplay/distributed/algorithms/model_averaging/utils.html#average_parameters)

Averages all the given parameters.

For allreduce efficiency, all the parameters are flattened into a contiguous buffer.
Thus, it requires extra memory of the same size as the given parameters.