コミットグラフ

65 コミット

作成者 SHA1 メッセージ 日付
Wenkai Du 0d1940e18e Prioritize NCCL_HOME 2020-09-24 14:18:23 -04:00
Wenkai Du 58dcd35af2 Add alltoallv test 2020-09-01 18:55:25 +00:00
Wenkai Du 3d63a84d97 Add cumask option 2020-08-21 21:34:55 +00:00
Wenkai Du 346cb16442 Change scatter and gather bandwidth calculation to match alltoall (#7) 2020-07-06 17:12:50 -07:00
Wenkai Du 5361dd8177 Merge remote-tracking branch 'nccl/master' into HEAD 2020-07-06 17:54:31 +00:00
Sylvain Jeaugey bd0755c95c Merge pull request #48 from NVIDIA/fix-makefile-typo
Fix typo in src/Makefile
2020-06-24 14:52:55 -07:00
Luke Yeager afdaf59b3b Fix typo in src/Makefile 2020-06-24 14:39:22 -07:00
Sylvain Jeaugey b2603a2e85 Add gencode for CUDA11 2020-06-23 18:16:46 -07:00
Sylvain Jeaugey ec1b5e22e6 Change all_gather/reduce_scatter algbw to match the documentation.
Fix #45 : All_gather and reduce_scatter algorithm bandwidth was
computed as time/count*(nranks-1) which is not consistent with the
way we compute it for other collectives.

This change makes algbw higher; busbw is unchanged.
2020-06-19 10:42:19 -07:00
Sylvain Jeaugey 07ac716c1a Fix #47 : compilation error on NCCL<2.7
Return an error when trying to run alltoall test when compiled
against NCCL<2.7.
2020-06-18 15:02:51 -07:00
Sylvain Jeaugey a7b304dde5 Merge pull request #46 from NVIDIA/p2p
Add alltoall perf test
2020-06-17 10:45:29 -07:00
Luke Yeager af4fa0f4cf Fix some memory leaks 2020-06-17 10:44:32 -07:00
Sylvain Jeaugey 7a833631b2 Remove sm_30 2020-06-15 08:54:21 -07:00
Wenkai Du 83b846cf4f Correct szie when init sendbuff 2020-06-10 23:24:08 +00:00
Sylvain Jeaugey ba924dac95 Fix #43 : Add .gitignore for build dir 2020-06-03 15:10:38 -07:00
saadrahim 622771cc4e Removing old Jenkinsfile that is no longer needed 2020-06-02 10:19:38 -06:00
saadrahim 97a26afc26 Update common.groovy 2020-05-22 09:58:42 -06:00
Wenkai Du a698b55cf5 Update rccl_bfloat16.h to match rocBLAS 2020-05-11 15:21:19 -07:00
saadrahim 95e498c939 Restarting CI (#6) 2020-05-11 15:21:19 -07:00
Wenkai Du 2813c96826 Add option to use alltoall, gather and scatter API
These APIs launche RCCL kernel implementation by default. If environmental
variable RCCL_ALLTOALL_KERNEL_DISABLE=1, then the APIs use wrapper around
ncclSend and ncclRecv.
2020-05-11 15:21:19 -07:00
Sourav Chakraborty 0d7c4db33e Add sendrecv benchmark 2020-04-10 14:45:17 -07:00
Sourav Chakraborty 07b8876277 Improve makefile to avoid LD_LIBRARY_PATH 2020-04-10 14:45:17 -07:00
Wenkai Du 6932a583e7 Add gather and scatter test 2020-04-10 14:45:10 -07:00
Wenkai Du c2dc7b613b Merge remote-tracking branch 'nccl/p2p' into p2p 2020-04-02 15:06:36 -07:00
Sylvain Jeaugey 119a0ecf60 Add alltoall perf test 2020-03-17 12:00:19 -07:00
Wenkai Du 6e9e05972b Add option for stress testing 2020-03-11 13:40:17 -07:00
Sylvain Jeaugey c864b73a27 Merge pull request #31 from wzamazon/fix_makefile
Add -L$(MPI_HOME)/lib64 to NVLDFLAGS
2020-01-06 10:38:40 -08:00
Wei Zhang 0f173234bb Add -L$(MPI_HOME)/lib64 to NVLDFLAGS
In some cases, the MPI library is not in $(MPI_HOME)/lib but
in $(MPI_HOME)/lib64. For example, on RedHat like Linux system
(CentOS, Amazon Linux), and MPI is installed by yum or rpm.

Under such circumstance, the current make file will cause failure.
This patch address this issue by adding -L$(MPI_HOME)/lib64 to
NVLDFLAGS in src/Makefile.

Signed-off-by: Wei Zhang <wzam@amazon.com>
2019-12-16 16:18:22 -08:00
Wenkai Du bd53e98df3 Fix build error with hip-clang 2019-11-22 10:31:31 -08:00
Wenkai Du 1cda2f52b6 Add bf16 support in rccl-tests 2019-11-18 13:18:34 -08:00
Wenkai Du 32399955af Fix build with RCCL 1.x API 2019-11-12 23:04:39 +00:00
Wenkai Du 19e43e3b97 Merge pull request #5 from paklui/master
fix syntax error for string comparison
2019-11-11 11:47:16 -08:00
Wenkai Du aa0f02bee0 Fix incorrect print out when data size is greater than 4GB 2019-11-11 11:39:59 -08:00
Pak Lui 24eb972cae fix syntax error for string comparison 2019-10-17 15:38:37 -07:00
Sylvain Jeaugey a2af1d959d Update README.md
Checks are now fully local, no need to disable them at scale.
2019-10-10 10:51:05 -07:00
Wenkai Du 13d0ddd12e Init data for throughput iterations to avoid all zero data 2019-09-27 09:12:00 -07:00
Sylvain Jeaugey ca7a565236 Update README.md 2019-08-16 09:06:28 -07:00
Wenkai Du ab82f1af6f Fix memory leak and possible buffer overrun 2019-08-09 10:22:14 -07:00
Wenkai Du 23c374475f Allow call ncclCommAbort on Ctrl+C 2019-07-26 00:15:16 +00:00
Gilbert Lee 043eef6999 Checking that number of requested GPUs is not more than number of available GPUs 2019-07-11 15:36:21 +00:00
Stanley Tsang 924521ff57 Adding unit tests and files for CI (#4)
* Adding initial unit test and Jenkins code.

Fixing scope of unit tests

Adding unit tests and files for CI

Fixing Jenkinsfile

* Removing typos from Jenkinsfile

* Making some fixes to the Jenkins file; temporarily disabling MPI

* Making corrections to Jenkinsfile

* Correcting dockerNodes entry in Jenkinsfile

* Fixed Jenkinsfile for CI

* Correcting Jenkinsfile for CI

* Updating README to include instructions on how to run unit tests.
2019-06-28 08:52:44 -07:00
Wenkai Du 3fac1d679b Fix missing space in Makefile 2019-05-16 13:18:23 -07:00
Stanley Tsang 3aa32972f4 Update README.md 2019-05-15 11:22:34 -06:00
Stanley Tsang 79356ec218 Updating README to include CUSTOM_RCCL_LIB. 2019-05-15 16:59:47 +00:00
Wenkai Du 86f053be84 enable building with mpich
Use following command to build: MPICH=1 make
2019-05-13 23:45:28 +00:00
Stanley Tsang 677e2701e7 Adding copyright notice. 2019-05-07 18:27:25 +00:00
Wenkai Du 3f89175af5 allow using different memory types for input and output buffers 2019-05-01 12:58:04 -07:00
Wenkai Du 7e80ea9d3a fix build with 1.0 library 2019-04-26 17:06:05 -07:00
Gilbert Lee 10e1572f72 Adding way to specify a custom RCCL shared library file to link against 2019-04-22 10:25:49 -07:00
Wenkai Du 4474fe168d workaround weak symbol issue
hcc prints "error: alias must point to a defined variable or function"
2019-04-18 10:34:55 -07:00