 Ziyue Yang
|
0a53077c9c
|
Improve MSCCL algorithms (#1023)
|
2024-01-03 14:51:34 -08:00 |
|
|
Ziyue Yang
|
bb144dcd50
|
Tune MSCCL all-reduce algorithm (#1009)
|
2023-12-08 17:47:02 -06:00 |
|
 Wen-Heng (Jack) Chung
|
8e8323252a
|
Let 320KB message size uses LL protocol. (#1006)
|
2023-12-06 18:14:31 -06:00 |
|
|
Ziyue Yang
|
e44e112a17
|
Fix mscclAlgoHandle not initialized issue (#995)
|
2023-12-01 07:58:01 -08:00 |
|
|
Ziyue Yang
|
4bb0b4a380
|
Move MSCCL algorithm loading to initialization to workaround HIP graph conflict (#982)
* MSCCL: pre-specify channels and pre-load algorithms
* add mutex
* fix bug
* clean include
* disable all-gathers temporarily
|
2023-11-30 09:47:20 -08:00 |
|
|
Ziyue Yang
|
7ae95db5b8
|
Optimize MSCCL all-gather algorithms for gfx942 (#964)
|
2023-11-15 08:18:59 -08:00 |
|
 akolliasAMD
|
9f02ee8dea
|
Revert "Introduce allgather for MSCCL on 8 sockets up to 320KB. (#931)" (#939)
This reverts commit bfb8642450.
|
2023-10-30 23:52:58 -06:00 |
|
|
Wen-Heng (Jack) Chung
|
bfb8642450
|
Introduce allgather for MSCCL on 8 sockets up to 320KB. (#931)
|
2023-10-24 18:41:12 -05:00 |
|
|
Wen-Heng (Jack) Chung
|
3f9ffe4788
|
Introduce allgather MSCCL XML specification for MI250X up to 320KB. (#930)
|
2023-10-24 18:35:55 -05:00 |
|
|
Wen-Heng (Jack) Chung
|
72d5fbddfd
|
Introduce 1-shot allreduce for MI250X Hayabusa. (#929)
|
2023-10-24 16:31:18 -05:00 |
|
|
Wen-Heng (Jack) Chung
|
341926c60a
|
Introduce 1pass allreduce. Tailor it for very small message sizes <= 20KB. (#919)
|
2023-10-16 16:31:08 -05:00 |
|
 Wenkai Du
|
aeca1af374
|
Add MSCCL xml files (#861)
|
2023-08-23 14:12:34 -07:00 |
|
|
Ziyue Yang
|
e3b2342f39
|
MSCCL: Improve executor and integrate scheduler (#694)
* MSCCL: improve executor and add scheduler for testing
* Use external scheduler
* Fix cmake error
* Address comments
* Fix thread safe issue
* Make MSCCL lifecycle APIs thread safe
* Make MSCCL internal scheduler aware of topology hint
* Revise error message
|
2023-03-14 14:34:25 -07:00 |
|