tensorplay.distributed.rendezvous.register_rendezvous_handler

tensorplay.distributed.rendezvous.register_rendezvous_handler(scheme, handler)[source]

Register a new rendezvous handler.

Before we can run collective algorithms, participating processes need to find each other and exchange information to be able to communicate. We call this process rendezvous.

The outcome of the rendezvous process is a triplet containing a shared key/value store, the rank of the process, and the total number of participating processes.

If none of the bundled rendezvous methods apply to your execution environment you can opt to register your own rendezvous handler. Pick a unique name and use the URL scheme to identify it when calling the rendezvous() function.

Parameters:

• scheme (str) – URL scheme to identify your rendezvous handler.

• handler (function) – Handler that is invoked when the rendezvous() function is called with a URL that uses the corresponding scheme. It must be a generator function that yields the triplet.