99c7fc29ba
NPKit: doubling size of event buffers following MAXCHANNELS change ( #1135 )
...
[ROCm/rccl commit: 0ce68f21d4
2024-04-09 08:02:58 -07:00
0941d6bc6e
Fix buffer overflow when parsing kernel cmdline ( #1133 )
...
[ROCm/rccl commit: 137571fa01
2024-04-08 11:12:20 -07:00
43bbee4dcc
Remove hipEventDisableSystemFence ( #1122 )
...
There is no indication that disabling system fence has any latency improvement.
Removing it per recommendation from HIP.
[ROCm/rccl commit: 5976f757dd
2024-03-25 08:01:57 -07:00
e373bd44bf
Enable fp8 support ( #1101 )
...
* initial checkin
* resolve cr comments
* resolve the build issue
* fix the data correctless issue
* update fp8 header file and update the unit test for fp8 support
* remove fp16 from fp8 headers
* fix ut issue and catch up the latest code from develop
* udate according to cr comments
* update ut according to cr comments
* update num floats for each SumPostDiv from 4 to 6
* update fp8 header file name
* fix the typo
[ROCm/rccl commit: 6777e65c1d
2024-03-08 15:17:53 -08:00
2354601589
Improve debug messages of memory allocations ( #1107 )
...
[ROCm/rccl commit: ff951e607d
2024-03-08 10:55:10 -08:00
6dd45024f8
msccl: fix scratch memory allocation after API change ( #1103 )
...
[ROCm/rccl commit: 77615cce28
2024-03-06 11:11:04 -08:00
e5aedb153e
Add support for using contiguous for GPU direct RDMA ( #1096 )
...
Enabled by env var RCCL_NET_CONTIGUOUS_MEM=1
[ROCm/rccl commit: cbd955627e
2024-02-29 10:06:43 -08:00
058886cb20
Add another Rome model ( #1095 )
...
[ROCm/rccl commit: df98a6957d
2024-02-28 10:46:05 -08:00
cee279fd99
Implement ROCTX ( #1094 )
...
* Implement roctx
[ROCm/rccl commit: b617aecc31
2024-02-27 15:46:15 -07:00
874998033f
Add new GPU model ( #1080 )
...
[ROCm/rccl commit: 74f9e5db64
2024-02-23 12:19:42 -08:00
4b31894d70
Update RCCL/MSCCL work FIFO depth to 256K ( #1091 )
...
[ROCm/rccl commit: c5ab37211b
2024-02-21 17:15:11 -08:00
4b4bdd904e
LL128 check if all XGMI ( #1089 )
...
[ROCm/rccl commit: b275ed0b56
2024-02-21 09:41:40 -07:00
32e1c8cba0
Merge pull request #1079 from BertanDogancay/2.19.4-sync
...
2.19.4 Sync
[ROCm/rccl commit: 2fb12a9358
2024-02-16 09:50:11 -07:00
e0dd21028f
Allow bus id to be null ( #1085 )
...
* Allow bus id to be null
[ROCm/rccl commit: bac57421c7
2024-02-15 16:36:51 -07:00
ef72944015
Disable unsupported ld/st instructions
...
[ROCm/rccl commit: 6f3310605c
2024-02-15 13:58:16 -08:00
7842411fb3
Merge remote-tracking branch 'rccl/develop' into 2.19.4
...
[ROCm/rccl commit: 76f83f95ab
2024-02-15 13:37:14 -08:00
c4e9e2b18a
Use native half without conversion ( #1083 )
...
[ROCm/rccl commit: 51003c9980
2024-02-13 16:57:34 -08:00
2f14acf770
Fix undefined symbol when nvtx is not enabled ( #1082 )
...
[ROCm/rccl commit: 1f0af90206
2024-02-13 14:03:43 -08:00
de6f20b7ae
Fix docs
...
[ROCm/rccl commit: 32cca51894
2024-02-11 22:32:55 -08:00
d5f5091e5d
Merge remote-tracking branch 'rccl/develop' into 2.19.4
...
[ROCm/rccl commit: d999d9ad21
2024-02-09 11:31:03 -06:00
6775a75906
2.18.5 fix ( #1077 )
...
* Revert "Revert "2.18.5-1""
This reverts commit 7cc572ecf95669b0d7b6
2024-02-09 09:18:38 -08:00
45ed3ef4e7
Nvtx support ( #1076 )
...
* NVTX support
[ROCm/rccl commit: 8a442faa12
2024-02-08 14:08:24 -07:00
1538b908ac
msccl: use relaxed atomics on scratch buffer ( #1075 )
...
[ROCm/rccl commit: 5257c753c5
2024-02-08 12:09:56 -08:00
ce39eefe65
Doubling P2P channels per peer on single node gfx94x only ( #1074 )
...
[ROCm/rccl commit: 704c9ef0d1
2024-02-07 14:05:57 -08:00
57e508f2e4
Doubling P2P channels per peer on single node only ( #1069 )
...
[ROCm/rccl commit: 1d989f6524
2024-02-02 12:41:00 -08:00
b17f5947ba
Revert re-usage of connect and listen ports
...
[ROCm/rccl commit: 12ac20ade5
2024-02-01 10:03:13 -08:00
ef57c82b60
Clean up
...
[ROCm/rccl commit: 00fdb1ef51
2024-01-31 17:27:15 -08:00
5ce968f570
Fix stack size
...
[ROCm/rccl commit: da85abab54
2024-01-31 17:09:07 -08:00
fad3417dc1
Fix transport merge
...
[ROCm/rccl commit: 95f87232c4
2024-01-31 17:35:12 -06:00
4f4e52aafe
Merge remote-tracking branch 'rccl/develop' into 2.19.4
...
[ROCm/rccl commit: 1a134b283b
2024-01-31 11:53:10 -06:00
c2c9ed2acb
Merge remote-tracking branch 'nccl/master' into develop
...
[ROCm/rccl commit: 9ff53eeeae
2024-01-30 14:43:43 -08:00
96479caeda
Include common.h in enqueue.cc instead ( #1067 )
...
[ROCm/rccl commit: 01b359027b
2024-01-30 08:24:22 -08:00
3e66d42d95
msccl: ensure memory coherence after data receive ( #1062 )
...
[ROCm/rccl commit: f7550d83b8
2024-01-30 08:22:50 -08:00
a2b3e1ab2d
correct data type
...
[ROCm/rccl commit: 31ec5d5cb0
2024-01-28 19:55:19 -08:00
a184aabda5
modifying the tuning table to improve the performance of allreduce for 8MB and 16MB for single-node MI300X ( #1063 )
...
[ROCm/rccl commit: ccfb35fa6d
2024-01-26 09:05:53 -05:00
cbc6aa13e7
colltrace: fix dropped trace messages ( #1059 )
...
* colltrace: fix dropped trace messages
* Remove extra space
[ROCm/rccl commit: be8ef4367f
2024-01-25 13:31:53 -08:00
71a356670f
Increase P2P channels per peer ( #1060 )
...
[ROCm/rccl commit: ffde530af5
2024-01-25 11:21:58 -08:00
a7a60a06ec
Fix sendrecv merge
...
[ROCm/rccl commit: 4aafb2a3c5
2024-01-24 16:23:53 -08:00
404d398bac
Merge remote-tracking branch 'nccl/v2.19' into develop
...
[ROCm/rccl commit: 81ddf9de89
2024-01-24 15:25:33 -08:00
17f70df058
Revert "msccl: build same number of kernels as in ROCm 5.7" ( #1058 )
...
This reverts commit f960174d03be7e5174baa83b256526d388a38842.
[ROCm/rccl commit: 7987015a19
2024-01-24 08:43:50 -08:00
645411f8f4
Use binary search for direct function calls ( #1057 )
...
* Use binary search for direct function calls
* fix scratch mem issue on MI300
[ROCm/rccl commit: 5564d65e71
2024-01-22 17:37:56 -07:00
56482a8be8
Fix collective trace when rccl is configured ( #1056 )
...
* Fix collective trace when rccl is configured
[ROCm/rccl commit: c4dbf8a914
2024-01-22 09:26:44 -07:00
8b8179a689
Use new HIP graph API compatible with CUDA 11030 ( #991 )
...
* Use new HIP graph API compatible with CUDA 11030
* Update dependency to ROCm 6.1
* Fix single stream use case
[ROCm/rccl commit: 7e25d5bc55
2024-01-21 19:00:50 -08:00
1c9b4fab39
COLLECTIVES: Switch to unroll 2 for MI300 ( #1051 )
...
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com >
[ROCm/rccl commit: 8b97a20943
2024-01-19 12:16:05 -06:00
11674674fc
[DEV] Configure functions in RCCL ( #986 )
...
* configure functions in rccl
[ROCm/rccl commit: 28d9b170c9
2024-01-18 15:07:16 -07:00
dbf906d8fa
Only use full MAXCHANNELS for gfx94x ( #1050 )
...
[ROCm/rccl commit: 3325f96c56
2024-01-17 09:00:49 -08:00
5c349cd729
adding rccl tuning parameters for MI300X gfx942 with 8 GPUs single and multi-node ( #1047 )
...
[ROCm/rccl commit: b08124c85d
2024-01-16 13:44:32 -05:00
8d38747c65
Add option to force enable network transport on single node ( #1046 )
...
[ROCm/rccl commit: 261707d90a
2024-01-16 07:54:18 -08:00
7cc572ecf9
Revert "2.18.5-1"
...
This reverts commit 26b91b9dbb767fde8210
2024-01-12 16:54:19 +00:00
a056463d4d
Addressing the compiler warning ( #988 )
...
[ROCm/rccl commit: cf248d9402
2024-01-10 14:59:40 -07:00
Wenkai Du
Andy li
Bertan Dogancay
akolliasAMD
BertanDogancay
Wenkai Du
Pedram Alizadeh
Nilesh M Negi