# tensorplay.distributed.tensor.parallel API

Source: https://www.tensorplay.cn/docs/api/tensorplay.distributed.tensor.parallel.html

## Functions 2

[#](#api-tensorplay.distributed.tensor.parallel.loss_parallel)

### loss_parallel

function[Full reference ↗](/docs/generated/tensorplay.distributed.tensor.parallel.loss_parallel.html)

```python
tensorplay.distributed.tensor.parallel.loss_parallel()
```

[#](#api-tensorplay.distributed.tensor.parallel.parallelize_module)

### parallelize_module

function[Full reference ↗](/docs/generated/tensorplay.distributed.tensor.parallel.parallelize_module.html)

```python
tensorplay.distributed.tensor.parallel.parallelize_module(module: Any, device_mesh: Any = None, parallelize_plan: ParallelStyle | dict[str, ParallelStyle] | None = None, *, src_data_rank: int | None = 0) → Any
```

## Classes 7

[#](#api-tensorplay.distributed.tensor.parallel.ColwiseParallel)

### ColwiseParallel

class[Full reference ↗](/docs/generated/tensorplay.distributed.tensor.parallel.ColwiseParallel.html)

```python
class tensorplay.distributed.tensor.parallel.ColwiseParallel(*, input_layouts: Placement | None = None, output_layouts: Placement | None = None, use_local_output: bool = True)
```

[#](#api-tensorplay.distributed.tensor.parallel.ParallelStyle)

### ParallelStyle

class[Full reference ↗](/docs/generated/tensorplay.distributed.tensor.parallel.ParallelStyle.html)

```python
class tensorplay.distributed.tensor.parallel.ParallelStyle
```

[#](#api-tensorplay.distributed.tensor.parallel.PrepareModuleInput)

### PrepareModuleInput

class[Full reference ↗](/docs/generated/tensorplay.distributed.tensor.parallel.PrepareModuleInput.html)

```python
class tensorplay.distributed.tensor.parallel.PrepareModuleInput(*, input_layouts: Placement | tuple[Placement | None, ...] | None = None, desired_input_layouts: Placement | tuple[Placement | None, ...] | None = None, input_kwarg_layouts: dict[str, Placement] | None = None, desired_input_kwarg_layouts: dict[str, Placement] | None = None, use_local_output: bool = False)
```

[#](#api-tensorplay.distributed.tensor.parallel.PrepareModuleInputOutput)

### PrepareModuleInputOutput

class[Full reference ↗](/docs/generated/tensorplay.distributed.tensor.parallel.PrepareModuleInputOutput.html)

```python
class tensorplay.distributed.tensor.parallel.PrepareModuleInputOutput(*, input_layouts: Placement | tuple[Placement | None, ...] | None = None, desired_input_layouts: Placement | tuple[Placement | None, ...] | None = None, input_kwarg_layouts: dict[str, Placement] | None = None, desired_input_kwarg_layouts: dict[str, Placement] | None = None, use_local_input: bool = False, output_layouts: Placement | tuple[Placement | None, ...], desired_output_layouts: Placement | tuple[Placement, ...], use_local_output: bool = True)
```

[#](#api-tensorplay.distributed.tensor.parallel.PrepareModuleOutput)

### PrepareModuleOutput

class[Full reference ↗](/docs/generated/tensorplay.distributed.tensor.parallel.PrepareModuleOutput.html)

```python
class tensorplay.distributed.tensor.parallel.PrepareModuleOutput(*, output_layouts: Placement | tuple[Placement | None, ...], desired_output_layouts: Placement | tuple[Placement, ...], use_local_output: bool = True)
```

[#](#api-tensorplay.distributed.tensor.parallel.RowwiseParallel)

### RowwiseParallel

class[Full reference ↗](/docs/generated/tensorplay.distributed.tensor.parallel.RowwiseParallel.html)

```python
class tensorplay.distributed.tensor.parallel.RowwiseParallel(*, input_layouts: Placement | None = None, output_layouts: Placement | None = None, use_local_output: bool = True)
```

[#](#api-tensorplay.distributed.tensor.parallel.SequenceParallel)

### SequenceParallel

class[Full reference ↗](/docs/generated/tensorplay.distributed.tensor.parallel.SequenceParallel.html)

```python
class tensorplay.distributed.tensor.parallel.SequenceParallel(*, sequence_dim: int = 1, use_local_output: bool = False)
```