latest (dev)
Copy
Latest development documentation · Updated 2026-10-08
tensorplay.distributed.elastic.rendezvous API
Functions 1
create_handler
functionFull reference ↗- tensorplay.distributed.elastic.rendezvous.create_handler(params: RendezvousParameters) RendezvousHandler[source]
Create a handler from the process-wide registry.
Classes 9
DynamicRendezvousHandler
classFull reference ↗- class tensorplay.distributed.elastic.rendezvous.DynamicRendezvousHandler(backend: RendezvousBackend | _NodeDesc | None = None, settings: RendezvousSettings | None = None, local_addr: str | None = None, node_rank: int = 0, run_id: str = '', store: Store | None = None, backend_name: str = 'core', state_holder: _RendezvousStateHolder | None = None, node: _NodeDesc | None = None)[source]
Coordinate membership, ranks, heartbeats, and round transitions.
- pre_shutdown() None
Optional hook invoked before
shutdown()during agent teardown.
P10dRendezvousBackend
classFull reference ↗RendezvousHandler
classFull reference ↗- class tensorplay.distributed.elastic.rendezvous.RendezvousHandler[source]
Algorithmic interface of one rendezvous backend.
- abstractmethod next_rendezvous() RendezvousInfo[source]
Join or re-join the rendezvous; blocks until this round completes.
- abstractmethod num_nodes_waiting() int[source]
Number of nodes queued for the next round (pending scale-up).
- pre_shutdown() None[source]
Optional hook invoked before
shutdown()during agent teardown.
- abstractmethod shutdown() bool[source]
Release rendezvous resources; returns True when the backend shut down.
- property use_agent_store: bool
Whether workers can reuse the agent-held store as their bootstrap store.
RendezvousInfo
classFull reference ↗- class tensorplay.distributed.elastic.rendezvous.RendezvousInfo(store: Store, rank: int, world_size: int, bootstrap_store_info: RendezvousStoreInfo | None = None, participants: list | None = None, wait_list: list | None = None)[source]
Outcome of a successful rendezvous for one agent.
- property bootstrap_store_info: RendezvousStoreInfo | None
Connection info for the worker-facing bootstrap store.
- property participants: list
Nodes participating in this round.
- property rank: int
This agent’s rank within the rendezvous.
- property store: Store
Shared store for this rendezvous round.
- property wait_list: list
Nodes waiting for a future round.
- property world_size: int
Number of participating agents.
RendezvousParameters
classFull reference ↗- class tensorplay.distributed.elastic.rendezvous.RendezvousParameters(backend: str, endpoint: str, run_id: str, *args, min_nodes: int | None = None, max_nodes: int | None = None, local_addr: str | None = None, node_rank: int = 0, local_world_size: int = 1, config: dict | None = None, **kwargs)[source]
Parameters describing one rendezvous request.
endpointishost:portof the rendezvous store,local_addrthe address of this node (autodetected when empty), andconfigcarries backend-specific options accessible throughget().- get_as_bool(key: str, default: bool | None = None) bool | None[source]
Return
keycoerced to bool (accepts 1/0/true/false).
- property timeout: RendezvousTimeout
Timeouts assembled from
join/last_call/close/heartbeatparams (seconds).
RendezvousSettings
classFull reference ↗- class tensorplay.distributed.elastic.rendezvous.RendezvousSettings(*args: Any, join: timedelta | None = None, last_call: timedelta | None = None, close: timedelta | None = None, heartbeat: timedelta | None = None, min_nodes: int = 1, max_nodes: int = 1, run_id: str = '', timeout: RendezvousTimeout | None = None, keep_alive_interval: timedelta | None = None, keep_alive_max_attempt: int = 3)[source]
Configuration shared by the rendezvous state machine.
RendezvousStoreInfo
classFull reference ↗- class tensorplay.distributed.elastic.rendezvous.RendezvousStoreInfo(master_addr: str, port: int)[source]
Connection information for the bootstrap store handed to workers.
- property addr: str
Alias of
master_addr.
- classmethod build(rank: int, store: Store, local_addr: str | None = None, server_port: int | None = None)[source]
Derive store info for
rankfrom the rendezvous store.Rank 0 owns the address/port pair: it uses the store’s own listening endpoint when available and otherwise publishes one through the store so every other rank can read it.
StaticTCPRendezvous
classFull reference ↗- class tensorplay.distributed.elastic.rendezvous.StaticTCPRendezvous(params: RendezvousParameters | str, master_port: int | None = None, rank: int = 0, world_size: int = 1, run_id: str = '', timeout: int = 600)[source]
One-shot rendezvous over a static TCPStore endpoint.
- pre_shutdown() None
Optional hook invoked before
shutdown()during agent teardown.
TpRendezvousBackend
classFull reference ↗Exceptions 7
RendezvousClosedError
exceptionFull reference ↗- exception tensorplay.distributed.elastic.rendezvous.RendezvousClosedError[source]
The rendezvous has been closed and accepts no more participants.
RendezvousConnectionError
exceptionFull reference ↗- exception tensorplay.distributed.elastic.rendezvous.RendezvousConnectionError[source]
The rendezvous backend store could not be reached.
RendezvousError
exceptionFull reference ↗- exception tensorplay.distributed.elastic.rendezvous.RendezvousError[source]
Base class for all rendezvous failures.
RendezvousExhaustedError
exceptionFull reference ↗- exception tensorplay.distributed.elastic.rendezvous.RendezvousExhaustedError(config, timeout)[source]
The rendezvous join window elapsed without reaching min nodes.
RendezvousGracefulExitError
exceptionFull reference ↗- exception tensorplay.distributed.elastic.rendezvous.RendezvousGracefulExitError[source]
Raised to unwind an agent when it is the last node leaving.
RendezvousStateError
exceptionFull reference ↗- exception tensorplay.distributed.elastic.rendezvous.RendezvousStateError[source]
The rendezvous state is corrupt or the backend rejected an update.
RendezvousTimeoutError
exceptionFull reference ↗- exception tensorplay.distributed.elastic.rendezvous.RendezvousTimeoutError[source]
A rendezvous phase exceeded its time budget.
Help improve this page
Found an error, an unclear step, or a missing example?
tensorplay.distributed.elastic.multiprocessing API
Complete API reference for tensorplay.distributed.elastic.multiprocessing, including signatures, parameters, examples and members.
tensorplay.distributed.elastic.timer API
Complete API reference for tensorplay.distributed.elastic.timer, including signatures, parameters, examples and members.

