# tensorplay.distributed.nn.functional API

Source: https://www.tensorplay.cn/docs/api/tensorplay.distributed.nn.functional.html

## Functions 10

[#](#api-tensorplay.distributed.nn.functional.all_gather_single)

### all_gather_single

function[Full reference ↗](/docs/generated/tensorplay.distributed.nn.functional.all_gather_single.html)

```python
tensorplay.distributed.nn.functional.all_gather_single(output_tensor, input_tensor, group=None)
```

[#](#api-tensorplay.distributed.nn.functional.all_gather)

### all_gather

function[Full reference ↗](/docs/generated/tensorplay.distributed.nn.functional.all_gather.html)

```python
tensorplay.distributed.nn.functional.all_gather(tensor: Tensor, group=None)
```

[#](#api-tensorplay.distributed.nn.functional.all_reduce)

### all_reduce

function[Full reference ↗](/docs/generated/tensorplay.distributed.nn.functional.all_reduce.html)

```python
tensorplay.distributed.nn.functional.all_reduce(tensor: Tensor, op: int = 0, group=None)
```

[#](#api-tensorplay.distributed.nn.functional.all_to_all_single)

### all_to_all_single

function[Full reference ↗](/docs/generated/tensorplay.distributed.nn.functional.all_to_all_single.html)

```python
tensorplay.distributed.nn.functional.all_to_all_single(output, input, output_split_sizes=None, input_split_sizes=None, group=None)
```

[#](#api-tensorplay.distributed.nn.functional.all_to_all)

### all_to_all

function[Full reference ↗](/docs/generated/tensorplay.distributed.nn.functional.all_to_all.html)

```python
tensorplay.distributed.nn.functional.all_to_all(output_tensor_list, input_tensor_list, group=None)
```

[#](#api-tensorplay.distributed.nn.functional.broadcast)

### broadcast

function[Full reference ↗](/docs/generated/tensorplay.distributed.nn.functional.broadcast.html)

```python
tensorplay.distributed.nn.functional.broadcast(tensor: Tensor, src: int, group=None)
```

[#](#api-tensorplay.distributed.nn.functional.gather)

### gather

function[Full reference ↗](/docs/generated/tensorplay.distributed.nn.functional.gather.html)

```python
tensorplay.distributed.nn.functional.gather(tensor: Tensor, dst: int = 0, group=None)
```

[#](#api-tensorplay.distributed.nn.functional.reduce_scatter)

### reduce_scatter

function[Full reference ↗](/docs/generated/tensorplay.distributed.nn.functional.reduce_scatter.html)

```python
tensorplay.distributed.nn.functional.reduce_scatter(output, input_list, op: int = 0, group=None)
```

[#](#api-tensorplay.distributed.nn.functional.reduce)

### reduce

function[Full reference ↗](/docs/generated/tensorplay.distributed.nn.functional.reduce.html)

```python
tensorplay.distributed.nn.functional.reduce(tensor: Tensor, dst: int, op: int = 0, group=None)
```

[#](#api-tensorplay.distributed.nn.functional.scatter)

### scatter

function[Full reference ↗](/docs/generated/tensorplay.distributed.nn.functional.scatter.html)

```python
tensorplay.distributed.nn.functional.scatter(tensors, src: int = 0, group=None)
```