Add new NVLS algorithm for allreduce using NVLink SHARP (intra-node only).
Add new config options: cgaClusterSize, minCTAs, maxCTAs, netName.
Enable LL128 when we use PXN to close rings.
NVTX3 includes update.
Fix crash when one CollNet (SHARP) rail fails to initialize.
Esse commit está contido em:
Sylvain Jeaugey committed 2023-03-01 00:39:04 -08:00
1 pai f3d5166783
commit 5d3ab08b69
72 files changed
+4541 -2391

No files matched your search

+1
Ver Arquivo
@@ -24,6 +24,7 @@ typedef enum : uint8_t {
ncclPatternTreeUpDown,
ncclPatternCollnetChain,
ncclPatternCollnetDirect,
ncclPatternNvls,
ncclPatternSend,
ncclPatternRecv
} ncclPattern_t;