2f99c7bbad
topo_expl: each rank needs to have its own memory for graphs ( #225 )
...
[ROCm/rccl commit: d3548cc474
2020-07-01 15:11:02 -07:00
e8da2a0da6
topo_expl: fix broken build ( #224 )
...
[ROCm/rccl commit: a6be82f5ab
2020-06-30 11:11:23 -07:00
ac87c9db37
gtest: extend testing up to 8 GPUs
...
[ROCm/rccl commit: 8db0aa8f4c
2020-06-29 09:32:31 -07:00
77d94493c3
Merge sendrecv kernel from NCCL 2.7.3
...
This commit was cherry-picked and modified from
https://github.com/NVIDIA/nccl/commit/89072c82e551d7c8bf7bd5ca77780ef540b7611e
[ROCm/rccl commit: 964c4c2061
2020-06-29 08:47:46 -07:00
3c674c9c1f
Use separate threads for send and receive
...
[ROCm/rccl commit: b90735c935
2020-06-29 08:47:15 -07:00
117f0f6e6e
Revert use posix_memalign for network buffer allocation on host memory ( #222 )
...
[ROCm/rccl commit: 84f8ba3bb0
2020-06-24 11:25:55 -07:00
e7d664200f
Use posix_memalign for network buffer allocation on host memory ( #221 )
...
* Use posix_memalign for network buffer allocation on host memory
* ib-test: add ability to specify run iterations
* ib-test: define iterations as multiple of default cycles
* Add checking to posix_memalign return value
[ROCm/rccl commit: 0eb19a563a
2020-06-22 13:06:25 -07:00
2dc0cfcbf5
ib-test: support host memory allocation through posix_memalign ( #220 )
...
* ib-test: support host memory allocation through posix_memalign
* ib-test: add missing CUDACHECK to hip calls
[ROCm/rccl commit: dc739c4e70
2020-06-17 16:16:54 -07:00
dafe176570
Documentation updates for NCCL 2.7.0 ( #219 )
...
* Making hip-clang the default compiler; documentation update
* Adding back --hip-clang to install.sh as a silent option for CI
* Documentation updates for NCCL 2.7
* Restoring deleted line in install script
[ROCm/rccl commit: 8d21adb5e3
2020-06-16 16:48:11 -06:00
9ca3176346
Add IB/RDMA unit test
...
[ROCm/rccl commit: cfa97eccd3
2020-06-16 18:29:17 +00:00
5d93f83ae3
Limit network profiling support to simple protocol and avoid overflow
...
[ROCm/rccl commit: 95b8f70d15
2020-06-15 20:51:36 +00:00
3389838def
Rework network proxy profiling
...
[ROCm/rccl commit: 7484e53ff7
2020-06-13 03:13:58 +00:00
a8952356d1
Reduce RCCL kernel count as we don't pass first coll in argument
...
[ROCm/rccl commit: b257676f30
2020-06-12 21:30:04 +00:00
a90fac8579
Sender rank's opCount maybe ahead by one if it finishes earlier
...
[ROCm/rccl commit: a6d621176c
2020-06-12 03:39:45 +00:00
d1f8fdc3a8
gtest: add scatter, gather and all to all unit tests
...
[ROCm/rccl commit: fee1a20b74
2020-06-09 17:44:15 -07:00
e7dd92dc87
Log NUMA node of RDMA host buffer allocation
...
[ROCm/rccl commit: e98891d039
2020-06-09 17:44:15 -07:00
846e1a4427
Add network proxy profiling support
...
[ROCm/rccl commit: 812543104d
2020-06-09 17:44:15 -07:00
bc6840f937
Calculate and use total wait cycles for RCCL profiling
...
[ROCm/rccl commit: c9aa11928a
2020-06-09 17:44:15 -07:00
15cd2aff3c
Add gather, scatter and alltoall collectives
...
Introducing 3 new APIs:
ncclResult_t ncclGather(const void* sendbuff, void* recvbuff, size_t sendcount,
ncclDataType_t datatype, int root, ncclComm_t comm, hipStream_t stream);
ncclResult_t ncclScatter(const void* sendbuff, void* recvbuff,
size_t recvcount, ncclDataType_t datatype, int root, ncclComm_t comm,
hipStream_t stream);
ncclResult_t ncclAllToAll(const void* sendbuff, void* recvbuff, size_t count,
ncclDataType_t datatype, ncclComm_t comm, hipStream_t stream);
Only out of place operation is supported.
Preprocessor symbol RCCL_GATHER_SCATTER=1 indicates API availibility.
By default the APIs launche RCCL kernel implementation, which can be disabled by
RCCL_ALLTOALL_KERNEL_DISABLE=1. Then the APIs use wrapper around ncclSend and ncclRecv.
[ROCm/rccl commit: e80e29573c
2020-06-09 17:44:08 -07:00
69eb70ce43
tpol_expl: update to 2.7
...
[ROCm/rccl commit: 71ec3e09df
2020-06-09 17:40:24 -07:00
67fb4f6cdb
Merge remote-tracking branch 'nccl/master' into develop
...
[ROCm/rccl commit: 26a0fd2517
2020-06-09 17:40:11 -07:00
89072c82e5
2.7.3-1
...
Add support for A100 GPU and related platforms.
Add support for CUDA 11.
Add support for send/receive operations (beta).
[ROCm/rccl commit: 5949d96f36
2020-06-08 09:31:44 -07:00
3077902de6
Fixing CI as install.sh script should not install dependencies without user request ( #217 )
...
[ROCm/rccl commit: 87db65f22d
2020-06-05 11:04:03 -06:00
8e43b854f1
Making hip-clang the default compiler; documentation update ( #216 )
...
* Making hip-clang the default compiler; documentation update
* Adding back --hip-clang to install.sh as a silent option for CI
[ROCm/rccl commit: dc403e0ca2
2020-06-04 11:58:27 -06:00
0108a1219d
Use cached value for detecting GDR support only once
...
[ROCm/rccl commit: 67c8e72ce3
2020-05-22 17:19:10 +00:00
b449a3b36d
Report HIP version in logs
...
[ROCm/rccl commit: e41ab173cf
2020-05-20 18:15:32 +00:00
e7eff47be4
Revert "Tuning the inline and unroll to reduce the scratch usage"
...
This reverts commit d8a06589c9ca493a6b51
2020-05-15 14:15:40 -07:00
5780637fff
Merge pull request #209 from wenkaidu/hip-clang
...
Rename files which only diffs in extension
[ROCm/rccl commit: c245f1507e
2020-05-15 13:51:12 -07:00
61a82ff572
Merge pull request #208 from wenkaidu/perf_xgmi
...
Give preference to path with more XGMI connections
[ROCm/rccl commit: 706de76046
2020-05-15 10:07:22 -07:00
c2afb1f4ca
Rename files which only diffs in extension
...
[ROCm/rccl commit: e7b36304c8
2020-05-15 09:16:32 -07:00
27519fd019
Give preference to path with more XGMI connections
...
[ROCm/rccl commit: b3c9852634
2020-05-14 15:33:16 -07:00
ced9958094
rccl-prim-test: add flags when calling hipExtLaunchMultiKernelMultiDevice in hip-clang
...
[ROCm/rccl commit: f1058b6353
2020-05-12 23:54:07 +00:00
abba9d5504
Restoring doxygen documentation to nccl.h.in.
...
[ROCm/rccl commit: 787ac13486
2020-05-12 22:03:31 +00:00
e35e4d3401
Updating README and readthedocs documentation.
...
[ROCm/rccl commit: b59b9d328b
2020-05-12 20:11:49 +00:00
5ba51914f1
Update rccl_bfloat16.h to match rocBLAS
...
[ROCm/rccl commit: d5a07a7b5c
2020-05-08 22:48:07 +00:00
069322d05a
Set flags when calling hipExtLaunchMultiKernelMultiDevice in hip-clang
...
[ROCm/rccl commit: 24ea2ef6dd
2020-05-08 15:57:14 +00:00
65ad48404b
Merge remote-tracking branch 'upstream/master' into develop
...
[ROCm/rccl commit: 33c23fdcda
2020-04-29 16:12:37 -07:00
75863c97a4
Refactoring packaging ( #193 )
...
[ROCm/rccl commit: 308e96877e
2020-04-29 16:24:21 -06:00
2badecfa20
Merge pull request #199 from wenkaidu/para_jobs
...
Enable parallel jobs for hip-clang build
[ROCm/rccl commit: 914b6ca27c
2020-04-29 13:49:48 -07:00
fa25190ddb
Junit test storage call corrected ( #197 )
...
* Focus testing on Centos for now
* storing junit
* Reducing test suite to Ubuntu
[ROCm/rccl commit: 65390f9872
2020-04-29 14:22:03 -06:00
52096f2cb6
Enable parallel jobs for hip-clang build
...
[ROCm/rccl commit: 3f471ab5b1
2020-04-29 17:58:16 +00:00
c0c0e92ef5
Adding NCCL_DEBUG=INFO Logging to CI ( #196 )
...
[ROCm/rccl commit: 6b1d70b03b
2020-04-27 15:12:15 -06:00
779ee97ada
topo_expl: fix build error
...
[ROCm/rccl commit: 5743c6b7d2
2020-04-27 17:17:05 +00:00
9813d67cd1
Merge remote-tracking branch 'nccl/master' into HEAD
...
[ROCm/rccl commit: c4edc257b0
2020-04-27 17:16:54 +00:00
5f57e6b466
Merge pull request #194 from wenkaidu/search
...
Fix incorrect next device ID in PCI ordered search
[ROCm/rccl commit: cf5070f6c0
2020-04-27 09:54:09 -07:00
7b7f781658
Fix incorrect next device ID in PCI ordered search
...
[ROCm/rccl commit: edb49ed2d5
2020-04-25 01:01:13 +00:00
b9acac2db6
Enabling CI Testing Again ( #192 )
...
Adding CI support based on AMD internal CI refactor.
[ROCm/rccl commit: cc66dd46e9
2020-04-24 10:36:57 -06:00
eebc6f2844
Adding option to re-use streams instead of re-creating per topology
...
[ROCm/rccl commit: 339bf9ff19
2020-04-23 15:53:40 +00:00
c43022b9d8
Fix crash when only a subset of GPUs are visible within a container.
...
Fixes #326 .
[ROCm/rccl commit: f36540f55a
2020-04-17 10:03:14 -07:00
5df2502deb
Improve robustness of PCI detection
...
Fallback to default values when class/speed is unknown.
[ROCm/rccl commit: 23a9fbb788
2020-04-16 14:27:50 -07:00
Wenkai Du
Wenkai Du
Stanley Tsang
Sylvain Jeaugey
saadrahim
Saad Rahim
Gilbert Lee