Wenkai Du
5bebcb0015
Setup collectives threshold for enabling intranet ( #387 )
...
* Setup collectives threshold for enabling intranet
* Use separate operation counters for coll and p2p
[ROCm/rccl commit: b815a2800f ]
2021-06-09 13:24:26 -07:00
Wenkai Du
c8a432dc25
Allow intranode use of network connection ( #383 )
...
* Allow intranode use of network connection
* Checking for graph for null pointer
[ROCm/rccl commit: a3a8c2d56b ]
2021-06-08 07:37:59 -07:00
Wenkai Du
cdf2780687
topo_expl: update to 2.9.9
...
[ROCm/rccl commit: 13dc80ee14 ]
2021-05-26 09:24:34 -07:00
Wenkai Du
a76bebf8b6
Merge remote-tracking branch 'nccl/master' into develop
...
[ROCm/rccl commit: a4ea1fed5b ]
2021-05-05 16:01:01 -07:00
Wenkai Du
b4a7fa7011
Cleanup number of channels calculation ( #340 )
...
[ROCm/rccl commit: e26ad2995e ]
2021-04-05 17:51:56 -07:00
Wenkai Du
8927d8bf17
Fix incorrect net counting ( #339 )
...
* Fix incorrect net counting
* Add comments
[ROCm/rccl commit: 17491c918e ]
2021-04-05 12:21:57 -07:00
Wenkai Du
065bde98d8
collnet: support multiple NICs ( #335 )
...
[ROCm/rccl commit: d87dc7c2e8 ]
2021-03-25 20:59:32 -07:00
Wenkai Du
287ed0f18a
Enable collnet in RCCL ( #333 )
...
* Enable CollNet and use different number of channels
* topo_expl: enable collnet
[ROCm/rccl commit: 1d6244b18d ]
2021-03-19 12:58:13 -07:00
Wenkai Du
b7253710ca
Revert "Port alltoall[v]" ( #325 )
...
This reverts commit 2c49121171 .
[ROCm/rccl commit: 8e180cf087 ]
2021-03-06 13:59:31 -08:00
Wenkai Du
bcf4ecb0e3
Enable local sendrecv over network if GDR is available on all GPUs ( #324 )
...
[ROCm/rccl commit: c018edf0f2 ]
2021-03-05 19:59:41 -08:00
Wenkai Du
6c3ccc2192
Add support to another Rome model
...
[ROCm/rccl commit: 95f178324c ]
2021-02-18 02:00:31 +00:00
Wenkai Du
d4382de267
Improve collective trace
...
[ROCm/rccl commit: 2ddbe6646b ]
2021-01-14 19:28:01 -05:00
Wenkai Du
2c49121171
Port alltoall[v]
...
[ROCm/rccl commit: f4d5d3d620 ]
2021-01-14 19:28:01 -05:00
Wenkai Du
adff98765c
Merge remote-tracking branch 'nccl/master' into no-target-id
...
[ROCm/rccl commit: d469947641 ]
2021-01-14 19:27:53 -05:00
Wenkai Du
41260bb948
Rework Rome detection and add multiple network ports models ( #274 )
...
* Rework Rome detection and add multiple network ports models
* Remove unused opCount in p2p transport
[ROCm/rccl commit: ae008fd2db ]
2020-10-07 13:37:36 -07:00
Wenkai Du
dbde26e681
Add Alltoallv RCCL kernel implementation ( #269 )
...
* Add alltoallv API and implementation
* Extend Rome P2P channel limit to multinode and alltoall kernels
* topo_expl: fix compilation and sync up with main
* gtest: use RCCL alltoallv API
* Code review changes
[ROCm/rccl commit: b871ea3c0c ]
2020-09-30 16:25:36 -07:00
Wenkai Du
03bb6bcb54
Increase minimal channels for gfx908 ( #259 )
...
[ROCm/rccl commit: c5cbece6d0 ]
2020-08-26 11:40:11 -07:00
Wenkai Du
3e2c9054cd
Change default channels duplication for chordal ring ( #233 )
...
[ROCm/rccl commit: ab787c767e ]
2020-07-14 15:16:50 -07:00
Wenkai Du
e8da2a0da6
topo_expl: fix broken build ( #224 )
...
[ROCm/rccl commit: a6be82f5ab ]
2020-06-30 11:11:23 -07:00
Wenkai Du
15cd2aff3c
Add gather, scatter and alltoall collectives
...
Introducing 3 new APIs:
ncclResult_t ncclGather(const void* sendbuff, void* recvbuff, size_t sendcount,
ncclDataType_t datatype, int root, ncclComm_t comm, hipStream_t stream);
ncclResult_t ncclScatter(const void* sendbuff, void* recvbuff,
size_t recvcount, ncclDataType_t datatype, int root, ncclComm_t comm,
hipStream_t stream);
ncclResult_t ncclAllToAll(const void* sendbuff, void* recvbuff, size_t count,
ncclDataType_t datatype, ncclComm_t comm, hipStream_t stream);
Only out of place operation is supported.
Preprocessor symbol RCCL_GATHER_SCATTER=1 indicates API availibility.
By default the APIs launche RCCL kernel implementation, which can be disabled by
RCCL_ALLTOALL_KERNEL_DISABLE=1. Then the APIs use wrapper around ncclSend and ncclRecv.
[ROCm/rccl commit: e80e29573c ]
2020-06-09 17:44:08 -07:00
Wenkai Du
69eb70ce43
tpol_expl: update to 2.7
...
[ROCm/rccl commit: 71ec3e09df ]
2020-06-09 17:40:24 -07:00
Wenkai Du
8852e54181
topo_expl: update to 2.6
...
[ROCm/rccl commit: 6f54b23503 ]
2020-04-01 13:37:08 -07:00
Wenkai Du
00f421ccbd
Add topology explorer
...
[ROCm/rccl commit: 55f8e2dec7 ]
2020-02-19 14:42:06 -08:00