Moved mscclpp_ncclGetUniqueId call into ncclCommInitRankFunc (#1332)

* Moved call to `mscclpp_ncclGetUniqueId` into `ncclCommInitRankFunc` to avoid setting up transport early in environments where MSCCL++ isn't valid.

* Checking `mscclEnabled` for the process and the topology to gate MSCCL++.

* Allowed `mscclForceEnable` to enable MSCCL++.
This commit is contained in:
corey-derochie-amd
2024-09-16 16:41:40 -06:00
committed by GitHub
parent ad94c651ad
commit 853a0586b4
3 changed files with 38 additions and 33 deletions
+2
View File
@@ -49,4 +49,6 @@ namespace std {
bool operator ==(const ncclUniqueId& a, const ncclUniqueId& b);
bool mscclppCommCompatible(ncclComm_t comm);
#endif