366cd12bed
topo-expl: fix broken build ( #1048 )
...
[ROCm/rccl commit: 600b44fee5
2024-01-17 08:59:03 -08:00
cd7a346297
Doubling buffer size to fix NCCL INFO corruption with increased channels ( #1035 )
...
[ROCm/rccl commit: f7e39fced2
2024-01-08 08:14:33 -08:00
4eaf90f84c
p2p-latency-tests: fix build by switching to gcnArchName ( #1030 )
...
* p2p-latency-tests: fix build by switching to gcnArchName
* rccl-prim-test: switch to gcnArchName
[ROCm/rccl commit: cfc04a8aef
2024-01-04 13:36:48 -08:00
e3d45f9de4
Improve MSCCL algorithms ( #1023 )
...
[ROCm/rccl commit: 0a53077c9c
2024-01-03 14:51:34 -08:00
62299668bd
Tune MSCCL all-reduce algorithm ( #1009 )
...
[ROCm/rccl commit: bb144dcd50
2023-12-08 17:47:02 -06:00
0266febb31
Let 320KB message size uses LL protocol. ( #1006 )
...
[ROCm/rccl commit: 8e8323252a
2023-12-06 18:14:31 -06:00
cef45b8311
Fix mscclAlgoHandle not initialized issue ( #995 )
...
[ROCm/rccl commit: e44e112a17
2023-12-01 07:58:01 -08:00
f0c47d085e
Move MSCCL algorithm loading to initialization to workaround HIP graph conflict ( #982 )
...
* MSCCL: pre-specify channels and pre-load algorithms
* add mutex
* fix bug
* clean include
* disable all-gathers temporarily
[ROCm/rccl commit: 4bb0b4a380
2023-11-30 09:47:20 -08:00
81cc39899b
npkit trace script now syncs the on average difference per rank ( #981 )
...
[ROCm/rccl commit: c71bae1608
2023-11-28 11:03:55 -07:00
d0a194ec16
JitterBench ( #975 )
...
[ROCm/rccl commit: 213869a6b4
2023-11-23 11:14:11 -07:00
dcf623f2ec
Add special handling of gfx940 ( #976 )
...
* Add special handling of gfx940
* Update ring base
[ROCm/rccl commit: 50b2dd9fd7
2023-11-22 15:07:36 -08:00
2351578d5b
Optimize MSCCL all-gather algorithms for gfx942 ( #964 )
...
[ROCm/rccl commit: 7ae95db5b8
2023-11-15 08:18:59 -08:00
d8471eaddf
Adding LaunchBench tool ( #952 )
...
[ROCm/rccl commit: d50bab28bf
2023-11-03 12:04:52 -06:00
691df735a3
Revert "Introduce allgather for MSCCL on 8 sockets up to 320KB. ( #931 )" ( #939 )
...
This reverts commit 769f00db5c9f02ee8dea
2023-10-30 23:52:58 -06:00
769f00db5c
Introduce allgather for MSCCL on 8 sockets up to 320KB. ( #931 )
...
[ROCm/rccl commit: bfb8642450
2023-10-24 18:41:12 -05:00
89a8493ef8
Introduce allgather MSCCL XML specification for MI250X up to 320KB. ( #930 )
...
[ROCm/rccl commit: 3f9ffe4788
2023-10-24 18:35:55 -05:00
fc2a13c077
Introduce 1-shot allreduce for MI250X Hayabusa. ( #929 )
...
[ROCm/rccl commit: 72d5fbddfd
2023-10-24 16:31:18 -05:00
49e52e7269
Introduce 1pass allreduce. Tailor it for very small message sizes <= 20KB. ( #919 )
...
[ROCm/rccl commit: 341926c60a
2023-10-16 16:31:08 -05:00
9a0c9ba3e9
adding cuda support for EmptyKernelTest ( #913 )
...
[ROCm/rccl commit: 7e2d905376
2023-10-11 14:11:12 -05:00
c1a7b56b9b
Adding a simple EmptyKernelTest to measure launch latency ( #910 )
...
[ROCm/rccl commit: 7dbf47e07b
2023-10-04 17:22:48 -06:00
279da575be
Adding a script that will download/compile/run TransferBench/RCCL/UCX/RCCL-tests/RCCL-Unittests/hip-mpi-testsuite ( #895 )
...
[ROCm/rccl commit: 3f6c2b9b32
2023-09-27 12:44:36 -04:00
8685535346
Fixed topo_expl ( #891 )
...
[ROCm/rccl commit: 762a42859e
2023-09-13 12:05:35 -06:00
2e3d45a53a
Gcn arch name ( #886 )
...
We use CMake to determine if we're compiling against a version of ROCm that supports gcnArchName and handles architecture checking appropriately. It includes a few helper functions as drop ins for the functionality we used gcnArch for before; sometimes to enable flags, and sometimes to set frequencies.
[ROCm/rccl commit: e58ec78d35
2023-09-12 15:34:40 -04:00
be412b848b
Update ll_latency_test and add CUDA version ( #873 )
...
[ROCm/rccl commit: c6dd6f6237
2023-08-30 16:29:42 -07:00
4fefe1ce7d
rccl-prim-test: use non-temporal access ( #867 )
...
[ROCm/rccl commit: aa95985867
2023-08-28 08:28:05 -07:00
af04103d72
Add MSCCL xml files ( #861 )
...
[ROCm/rccl commit: aeca1af374
2023-08-23 14:12:34 -07:00
56129830a6
NCCL_TREES variable and rome model fixes ( #856 )
...
[ROCm/rccl commit: d33cd5a233
2023-08-21 10:35:37 -06:00
47330a62a6
p2p/ll-latency-test: convert to single thread tests ( #857 )
...
[ROCm/rccl commit: 148e3430f4
2023-08-21 07:48:37 -07:00
0c31452135
Add new model support ( #847 )
...
* Add new model support
* Update new rings
[ROCm/rccl commit: 7044599575
2023-08-10 17:14:51 -07:00
56ab1e8771
p2p_latency_test: clean up IPC temp files at exit ( #832 )
...
[ROCm/rccl commit: 0441eec32e
2023-07-31 08:11:07 -07:00
13922baf76
ll_latency_test: fix time calculation ( #825 )
...
* ll_latency_test: fix time calculation
* Measure time after barrier
* Read time stamp only from thread 0
[ROCm/rccl commit: c424979c14
2023-07-27 09:04:35 -07:00
f069aba363
tools: Add LL latency test ( #820 )
...
* Add LL latency test
* Correct name in usage
[ROCm/rccl commit: 1c1ec096e2
2023-07-25 20:08:04 -07:00
0508fa569a
Implement RCCL Replayer ( #817 )
...
* Implement RCCL Replayer
[ROCm/rccl commit: 8bab4f04b7
2023-07-24 16:26:22 -06:00
dfda1d6fab
Enable gfx94x ( #808 ) ( #816 )
...
(cherry picked from commit 94da229a7788d74685d1591a4e75a8341de64f41)
[ROCm/rccl commit: a7fcd58a97
2023-07-21 07:31:27 -07:00
75671adf82
Add GPU P2P ping-pong latency test tool ( #804 )
...
* Add GPU P2P ping-pong latency test tool
* Address comments
* Fix IPC issue in gfx94x
[ROCm/rccl commit: b1cddcaf9a
2023-07-14 07:41:29 -07:00
d2a1142cf3
rccl-prim-test: calculate iterations' standard deviation ( #803 )
...
* rccl-prim-test: calculate iterations' standard deviation
* Add default ring configuration for gfx940
* Use hipDeviceMallocUncached on gfx94x
[ROCm/rccl commit: f41ea11444
2023-07-13 11:05:50 -07:00
a5feda50b9
rccl-prim-test: calculate throughput standard deviations ( #802 )
...
[ROCm/rccl commit: 43f13cd25a
2023-07-12 10:04:40 -07:00
f98715baea
Merge remote-tracking branch 'nccl/master' into develop
...
[ROCm/rccl commit: abd0615351
2023-06-26 22:51:56 +00:00
d411d52b19
Disable Colltrace for --fast option ( #778 )
...
* Disable Colltrace for --fast option
* Limit nprocs for CI
[ROCm/rccl commit: 0c77c66221
2023-06-21 14:16:09 -06:00
1ae071944e
improve compilation time and create timetrace plot ( #773 )
...
* improve compilation time and create time-trace plot
* set default value for nproc
[ROCm/rccl commit: f35777e9b0
2023-06-14 09:17:51 -06:00
8438fd9e42
Wall clock update and npkit trace script Update ( #771 )
...
* changed builtin clock to wall_clock64
* updated npkit_Trace_generator to the new version of npkit
[ROCm/rccl commit: 9cdac774ea
2023-06-07 17:47:10 -06:00
05b8523a7b
Updating NOTICES.txt and LICENSE.txt ( #770 )
...
[ROCm/rccl commit: 20b567caac
2023-06-07 09:45:03 -06:00
90cbef7042
Add NCCL_NCHANNELS_PER_PEER override ( #767 )
...
Also fix topol_expl build issue
[ROCm/rccl commit: 3af90902c8
2023-06-06 08:41:38 -07:00
fd64cb242d
added time results on npkit generator ( #749 )
...
[ROCm/rccl commit: 2b1efa9e9a
2023-05-30 12:57:25 -06:00
a26ca6d766
added modified npkit_trace_generator.py to scripts ( #738 )
...
* added modified npkit_trace_generator.py to scripts
[ROCm/rccl commit: c88475462b
2023-05-09 10:11:35 -06:00
6f3d035396
rccl-prim-test: minor update ( #718 )
...
[ROCm/rccl commit: addbf4bd90
2023-04-03 07:30:04 -07:00
f7f669e7f0
MSCCL: Improve executor and integrate scheduler ( #694 )
...
* MSCCL: improve executor and add scheduler for testing
* Use external scheduler
* Fix cmake error
* Address comments
* Fix thread safe issue
* Make MSCCL lifecycle APIs thread safe
* Make MSCCL internal scheduler aware of topology hint
* Revise error message
[ROCm/rccl commit: e3b2342f39
2023-03-14 14:34:25 -07:00
c76bc214c8
Merge remote-tracking branch 'nccl/master' into HEAD
...
[ROCm/rccl commit: e1cb45ff22
2023-02-04 01:44:43 +00:00
7be2c55b32
topo_expl: fix broken build by adding hipify steps ( #670 )
...
[ROCm/rccl commit: a0dd8e0b84
2023-01-06 07:29:40 -08:00
431c7d2cb9
Add MSCCL Support ( #658 )
...
* Add MSCCL support
* Add alignment and message size checking
* Fix nRanks checking, in-place and out-of-place tests and group call handling
* Fix hipGraph unit test
* Change MSCCL init warning to INFO
* Revise license info
[ROCm/rccl commit: adafc0f759
2022-12-12 15:51:04 -08:00
Wenkai Du
Ziyue Yang
Wen-Heng (Jack) Chung
akolliasAMD
gilbertlee-amd
mberenjk
Pedram Alizadeh
Audrey MP
Bertan Dogancay
Wenkai Du