Wenkai Du
0d1940e18e
Prioritize NCCL_HOME
2020-09-24 14:18:23 -04:00
Wenkai Du
58dcd35af2
Add alltoallv test
2020-09-01 18:55:25 +00:00
Wenkai Du
3d63a84d97
Add cumask option
2020-08-21 21:34:55 +00:00
Wenkai Du
346cb16442
Change scatter and gather bandwidth calculation to match alltoall ( #7 )
2020-07-06 17:12:50 -07:00
Wenkai Du
5361dd8177
Merge remote-tracking branch 'nccl/master' into HEAD
2020-07-06 17:54:31 +00:00
Sylvain Jeaugey
bd0755c95c
Merge pull request #48 from NVIDIA/fix-makefile-typo
...
Fix typo in src/Makefile
2020-06-24 14:52:55 -07:00
Luke Yeager
afdaf59b3b
Fix typo in src/Makefile
2020-06-24 14:39:22 -07:00
Sylvain Jeaugey
b2603a2e85
Add gencode for CUDA11
2020-06-23 18:16:46 -07:00
Sylvain Jeaugey
ec1b5e22e6
Change all_gather/reduce_scatter algbw to match the documentation.
...
Fix #45 : All_gather and reduce_scatter algorithm bandwidth was
computed as time/count*(nranks-1) which is not consistent with the
way we compute it for other collectives.
This change makes algbw higher; busbw is unchanged.
2020-06-19 10:42:19 -07:00
Sylvain Jeaugey
07ac716c1a
Fix #47 : compilation error on NCCL<2.7
...
Return an error when trying to run alltoall test when compiled
against NCCL<2.7.
2020-06-18 15:02:51 -07:00
Sylvain Jeaugey
a7b304dde5
Merge pull request #46 from NVIDIA/p2p
...
Add alltoall perf test
2020-06-17 10:45:29 -07:00
Luke Yeager
af4fa0f4cf
Fix some memory leaks
2020-06-17 10:44:32 -07:00
Sylvain Jeaugey
7a833631b2
Remove sm_30
2020-06-15 08:54:21 -07:00
Wenkai Du
83b846cf4f
Correct szie when init sendbuff
2020-06-10 23:24:08 +00:00
Sylvain Jeaugey
ba924dac95
Fix #43 : Add .gitignore for build dir
2020-06-03 15:10:38 -07:00
saadrahim
622771cc4e
Removing old Jenkinsfile that is no longer needed
2020-06-02 10:19:38 -06:00
saadrahim
97a26afc26
Update common.groovy
2020-05-22 09:58:42 -06:00
Wenkai Du
a698b55cf5
Update rccl_bfloat16.h to match rocBLAS
2020-05-11 15:21:19 -07:00
saadrahim
95e498c939
Restarting CI ( #6 )
2020-05-11 15:21:19 -07:00
Wenkai Du
2813c96826
Add option to use alltoall, gather and scatter API
...
These APIs launche RCCL kernel implementation by default. If environmental
variable RCCL_ALLTOALL_KERNEL_DISABLE=1, then the APIs use wrapper around
ncclSend and ncclRecv.
2020-05-11 15:21:19 -07:00
Sourav Chakraborty
0d7c4db33e
Add sendrecv benchmark
2020-04-10 14:45:17 -07:00
Sourav Chakraborty
07b8876277
Improve makefile to avoid LD_LIBRARY_PATH
2020-04-10 14:45:17 -07:00
Wenkai Du
6932a583e7
Add gather and scatter test
2020-04-10 14:45:10 -07:00
Wenkai Du
c2dc7b613b
Merge remote-tracking branch 'nccl/p2p' into p2p
2020-04-02 15:06:36 -07:00
Sylvain Jeaugey
119a0ecf60
Add alltoall perf test
2020-03-17 12:00:19 -07:00
Wenkai Du
6e9e05972b
Add option for stress testing
2020-03-11 13:40:17 -07:00
Sylvain Jeaugey
c864b73a27
Merge pull request #31 from wzamazon/fix_makefile
...
Add -L$(MPI_HOME)/lib64 to NVLDFLAGS
2020-01-06 10:38:40 -08:00
Wei Zhang
0f173234bb
Add -L$(MPI_HOME)/lib64 to NVLDFLAGS
...
In some cases, the MPI library is not in $(MPI_HOME)/lib but
in $(MPI_HOME)/lib64. For example, on RedHat like Linux system
(CentOS, Amazon Linux), and MPI is installed by yum or rpm.
Under such circumstance, the current make file will cause failure.
This patch address this issue by adding -L$(MPI_HOME)/lib64 to
NVLDFLAGS in src/Makefile.
Signed-off-by: Wei Zhang <wzam@amazon.com >
2019-12-16 16:18:22 -08:00
Wenkai Du
bd53e98df3
Fix build error with hip-clang
2019-11-22 10:31:31 -08:00
Wenkai Du
1cda2f52b6
Add bf16 support in rccl-tests
2019-11-18 13:18:34 -08:00
Wenkai Du
32399955af
Fix build with RCCL 1.x API
2019-11-12 23:04:39 +00:00
Wenkai Du
19e43e3b97
Merge pull request #5 from paklui/master
...
fix syntax error for string comparison
2019-11-11 11:47:16 -08:00
Wenkai Du
aa0f02bee0
Fix incorrect print out when data size is greater than 4GB
2019-11-11 11:39:59 -08:00
Pak Lui
24eb972cae
fix syntax error for string comparison
2019-10-17 15:38:37 -07:00
Sylvain Jeaugey
a2af1d959d
Update README.md
...
Checks are now fully local, no need to disable them at scale.
2019-10-10 10:51:05 -07:00
Wenkai Du
13d0ddd12e
Init data for throughput iterations to avoid all zero data
2019-09-27 09:12:00 -07:00
Sylvain Jeaugey
ca7a565236
Update README.md
2019-08-16 09:06:28 -07:00
Wenkai Du
ab82f1af6f
Fix memory leak and possible buffer overrun
2019-08-09 10:22:14 -07:00
Wenkai Du
23c374475f
Allow call ncclCommAbort on Ctrl+C
2019-07-26 00:15:16 +00:00
Gilbert Lee
043eef6999
Checking that number of requested GPUs is not more than number of available GPUs
2019-07-11 15:36:21 +00:00
Stanley Tsang
924521ff57
Adding unit tests and files for CI ( #4 )
...
* Adding initial unit test and Jenkins code.
Fixing scope of unit tests
Adding unit tests and files for CI
Fixing Jenkinsfile
* Removing typos from Jenkinsfile
* Making some fixes to the Jenkins file; temporarily disabling MPI
* Making corrections to Jenkinsfile
* Correcting dockerNodes entry in Jenkinsfile
* Fixed Jenkinsfile for CI
* Correcting Jenkinsfile for CI
* Updating README to include instructions on how to run unit tests.
2019-06-28 08:52:44 -07:00
Wenkai Du
3fac1d679b
Fix missing space in Makefile
2019-05-16 13:18:23 -07:00
Stanley Tsang
3aa32972f4
Update README.md
2019-05-15 11:22:34 -06:00
Stanley Tsang
79356ec218
Updating README to include CUSTOM_RCCL_LIB.
2019-05-15 16:59:47 +00:00
Wenkai Du
86f053be84
enable building with mpich
...
Use following command to build: MPICH=1 make
2019-05-13 23:45:28 +00:00
Stanley Tsang
677e2701e7
Adding copyright notice.
2019-05-07 18:27:25 +00:00
Wenkai Du
3f89175af5
allow using different memory types for input and output buffers
2019-05-01 12:58:04 -07:00
Wenkai Du
7e80ea9d3a
fix build with 1.0 library
2019-04-26 17:06:05 -07:00
Gilbert Lee
10e1572f72
Adding way to specify a custom RCCL shared library file to link against
2019-04-22 10:25:49 -07:00
Wenkai Du
4474fe168d
workaround weak symbol issue
...
hcc prints "error: alias must point to a defined variable or function"
2019-04-18 10:34:55 -07:00