Support fused all reduce and elementwise operations (#1729)

* Support fused all reduce and elementwise operations

Add additional "acc" parameter to RCCL Replayer logs

Add flag which indicates availability of new API

* Fix Recorder json parsing

* Remove unreachable code

* Remove extra acc pointer check

* .

* Revert "[DEVICE] Adding ability to choose unroll factor at runtime (#1734)"

This reverts commit 4cadf3597c.

* Use noinline to reduce kernels linking time

* Don't use noinline for gfx942 and gfx950 to avoid perf regression

---------

Co-authored-by: AtlantaPepsi <timhu102@amd.com>
Co-authored-by: BertanDogancay <bertan.dogancay@gmail.com>

[ROCm/rccl commit: 9a4213356d]
Αυτή η υποβολή περιλαμβάνεται σε:
Wenkai Du
2025-07-23 09:04:17 -07:00
υποβλήθηκε από GitHub
γονέας cbb648505a
υποβολή caff9764d3
24 αρχεία άλλαξαν με 656 προσθήκες και 231 διαγραφές
@@ -195,6 +195,7 @@ struct ncclTaskColl {
ncclFunc_t func;
void const* sendbuff;
void* recvbuff;
void const* acc;
size_t count;
int root;
ncclDataType_t datatype;