Use One Slice per Basic Primitive for AllReduce, ReduceScatter, AllGather (#1681) for Single Node on Some GFX9 Systems

Using a single slice rather than the typical two provides about 5% speedup (sometimes more or less) on some GFX9 systems for single node.
Este commit está contenido en:
alex-breslow-amd
2025-05-29 16:17:35 -07:00
cometido por GitHub
padre 12517a957e
commit 2f6b20c00a
Se han modificado 9 ficheros con 66 adiciones y 10 borrados
+1
Ver fichero
@@ -481,6 +481,7 @@ struct ncclComm {
int node;
int nNodes;
int rcclUseOneSlice; // RCCL: true if this comm is using one slice per primitive
int localRank;
int localRanks;
int maxLocalRanks;