7 Commits

Author	SHA1	Message	Date
Wenkai Du	abd0615351	Merge remote-tracking branch 'nccl/master' into develop	2023-06-26 22:51:56 +00:00
Ziyue Yang	11676267b5	fix min, max and avg (#745)	2023-05-18 11:02:59 -07:00
Wen-Heng (Jack) Chung	ca4a1dfd67	Address review feedbacks and make the flag be disabled by default.	2023-05-17 17:50:25 +00:00
Wen-Heng (Jack) Chung	12dba425de	Skip doneEvent inside MSCCL by default. ... Added a RCCL_MSCCL_ENABLE_DONE_EVENT env var, set it be 0 by default. The env var is to control whether to use doneEvent when invoking MSCCL kernels. Skipping doneEvent would cause the firmware to skip L2 cache flush, resulting in overall performance improvement.	2023-05-17 16:49:42 +00:00
Wenkai Du	4b09ffba43	msccl: print stack and memory usage (#723) ... * msccl: print stack and memory usage * Update number of kernels calculation	2023-04-14 14:59:03 -07:00
Ziyue Yang	e3b2342f39	MSCCL: Improve executor and integrate scheduler (#694) ... * MSCCL: improve executor and add scheduler for testing * Use external scheduler * Fix cmake error * Address comments * Fix thread safe issue * Make MSCCL lifecycle APIs thread safe * Make MSCCL internal scheduler aware of topology hint * Revise error message	2023-03-14 14:34:25 -07:00
Ziyue Yang	adafc0f759	Add MSCCL Support (#658) ... * Add MSCCL support * Add alignment and message size checking * Fix nRanks checking, in-place and out-of-place tests and group call handling * Fix hipGraph unit test * Change MSCCL init warning to INFO * Revise license info	2022-12-12 15:51:04 -08:00