API symbolsdistributed
Copy
tensorplay.distributed.distributed_c10d.batch_isend_irecv
- tensorplay.distributed.distributed_c10d.batch_isend_irecv(p2p_op_list: List[P2POp]) List[Work][source]
Send or receive a batch of tensors asynchronously (torch parity).
All operations are treated as a single NCCL group so ordering of sends vs receives cannot deadlock. Every rank in
groupmust participate.
Help improve this page
Found an error, an unclear step, or a missing example?
Was this page helpful?