Ziyue Yang f0c47d085e Move MSCCL algorithm loading to initialization to workaround HIP graph conflict (#982) ...

* MSCCL: pre-specify channels and pre-load algorithms

* add mutex

* fix bug

* clean include

* disable all-gathers temporarily

[ROCm/rccl commit: 4bb0b4a380]

2023-11-30 09:47:20 -08:00

..

rccl

Move MSCCL algorithm loading to initialization to workaround HIP graph conflict (#982)

2023-11-30 09:47:20 -08:00