Introduce multi-rank support per device.

This is a single commit of the source code changes required to
introduce support for multiple ranks per device.
A new interface (ncclCommRankInitMulti) has to be used to make use of
this new feature.


[ROCm/rccl commit: 0336ffdf70]
此提交包含在:
Edgar
2022-03-14 14:55:24 -04:00
提交者 Edgar Gabriel
父節點 11a6cdd52f
當前提交 8953f5b5ca
共有 23 個檔案被更改,包括 1232 行新增87 行删除
+1
查看文件
@@ -112,6 +112,7 @@ struct ncclComm {
int64_t busId; // my PCI bus ID in int format
cpu_set_t cpuAffinity; // CPU affinity of the GPU
int WarpSize;
int virtualId;
int node;
int nNodes;