Add direct allgather algorithm (#1868)

* add direct allgather algorithm * minor fix * add debug print for memory allocation tracker * add message size threshold for direct allgather * scatter transfers across ranks * update changelog * minor fix * Update CHANGELOG.md Co-authored-by: Jeffrey Novotny <jnovotny@amd.com> * enable direct AG when pxn is ON on MI300X or MI350 --------- Co-authored-by: Jeffrey Novotny <jnovotny@amd.com>
2025-08-25 07:55:10 -05:00
parent b88c134874
commit 5e7937effb
5 changed files with 44 additions and 3 deletions
@@ -690,6 +690,9 @@ struct ncclComm {
  // Unroll factor for comm [RCCL]
  int unroll;

+  // custom collective
+  bool enableCustColl;
+
  uint64_t endMagic;
 };