Commit Graph

51 Commits

Author SHA1 Message Date
Wenkai Du 5cc7ff0931 Fix missing error checking for AllocateBuffs due to merge (#17)
[ROCm/rccl-tests commit: 9025051bbb]
2022-08-09 11:04:38 -07:00
Edgar dad6d819d0 implementation of multi-rank support in rccl-tests.
[ROCm/rccl-tests commit: 0500f2f132]
2022-06-10 14:54:10 -04:00
Edgar b199d173a2 create branch up-to-date with rccl-test
[ROCm/rccl-tests commit: 5cd2374edb]
2022-06-10 12:41:56 -04:00
Wenkai Du ab30a6bd32 Print GPU's full PCI bus ID
[ROCm/rccl-tests commit: 6156759a40]
2022-04-06 16:46:17 +00:00
Wenkai Du db075a1fab Add missing hipStreamDestroy at test exit
[ROCm/rccl-tests commit: 602b745ff4]
2021-11-16 07:50:18 -08:00
Wenkai Du f87bbaf041 Use rccl_bfloat16 class
[ROCm/rccl-tests commit: 8b35847d36]
2021-09-23 16:39:11 -07:00
Wenkai Du cc55343b88 Fix divide by zero error
[ROCm/rccl-tests commit: dc1ad4853d]
2021-09-22 08:43:01 -07:00
Wenkai Du 669a778efb Merge remote-tracking branch 'nccl/master' into develop
[ROCm/rccl-tests commit: 213abee002]
2021-09-20 14:01:22 -07:00
David Addison 56ff821802 Resync with NCCL 2.11
New operator: mulsum
New test: gather


[ROCm/rccl-tests commit: f773748b46]
2021-09-17 09:02:45 -07:00
Wenkai Du 68be54e52a Merge remote-tracking branch 'nccl/master'
[ROCm/rccl-tests commit: 2d9be62621]
2021-07-15 13:54:43 -07:00
David Addison f81f5baaed Add CUDA graph support only for CUDA 11.3 and later builds
Fixes #90


[ROCm/rccl-tests commit: 1f8f541686]
2021-07-13 10:47:47 -07:00
Wenkai Du 06f4ccd9d2 Merge remote-tracking branch 'nccl/master' into develop
[ROCm/rccl-tests commit: 9f8ddadcdf]
2021-07-13 08:11:44 -07:00
David Addison 6719794fc8 Removed MPI_SUPPORT conditional compilation of average flag
[ROCm/rccl-tests commit: b9f90d12a9]
2021-07-12 11:43:57 -07:00
David Addison d3061dc2a9 Fix issues with MPI_Allreduce and multi-threaded tests
[ROCm/rccl-tests commit: 547e119d35]
2021-07-08 16:42:40 -07:00
David Addison 230983c84e Merge branch 'bfloat16'
[ROCm/rccl-tests commit: f476f4a17a]
2021-07-06 10:20:32 -07:00
David Addison a23cffe28a Added new option to report average iteration time
[ROCm/rccl-tests commit: 1dfc76eccc]
2021-06-30 19:36:07 -07:00
David Addison 1044cd1f32 Resync with changes in gitilab-master code
[ROCm/rccl-tests commit: 1ae8cdc315]
2021-06-30 13:16:04 -07:00
David Addison e73e5a239b Added support for CUDA graph capture/replay (-G)
[ROCm/rccl-tests commit: e55ad3796d]
2021-06-28 14:19:45 -07:00
David Addison a41268e26e Add support for ncclAvg operation
[ROCm/rccl-tests commit: cde7e769c1]
2021-06-28 09:41:58 -07:00
Greg Inozemtsev 45c28c6c36 Cleanup argument error handling and messages
Add error checking for minbytes and maxbytes arguments

Also accept lowercase literals when parsing size arguments and print errors and usage on stderr.


[ROCm/rccl-tests commit: c4de829d91]
2021-06-04 21:47:40 +00:00
David Addison 882c60210b Add support for new datatype: bfloat16
[ROCm/rccl-tests commit: e37545e491]
2021-03-15 17:13:35 -07:00
Wenkai Du 1a07751dbe Revert "Allow call ncclCommAbort on Ctrl+C"
This reverts commit 5b5cf00cbe.


[ROCm/rccl-tests commit: 39086cdc0a]
2021-02-03 21:16:18 -05:00
David Addison c62bde3272 Do not allocate memory for expected buffer if checking disabled
This allows the tests to be run with larger buffers


[ROCm/rccl-tests commit: 7677f3f608]
2021-01-20 17:08:40 -08:00
Wenkai Du dbd8add7d1 Add tests code that can print info and reset input/output buffers
[ROCm/rccl-tests commit: e5f1482efb]
2021-01-04 16:51:16 -05:00
Wenkai Du 5624e4fcb3 Add support for testing memory allocated with hipMallocManaged
[ROCm/rccl-tests commit: 3117033150]
2020-12-15 22:05:50 -05:00
Wenkai Du ead006c5d7 Add alltoallv test
[ROCm/rccl-tests commit: 58dcd35af2]
2020-09-01 18:55:25 +00:00
Wenkai Du e73a11283b Add cumask option
[ROCm/rccl-tests commit: 3d63a84d97]
2020-08-21 21:34:55 +00:00
Wenkai Du 075041a9fa Merge remote-tracking branch 'nccl/master' into HEAD
[ROCm/rccl-tests commit: 5361dd8177]
2020-07-06 17:54:31 +00:00
Sylvain Jeaugey cf70df2498 Merge pull request #46 from NVIDIA/p2p
Add alltoall perf test

[ROCm/rccl-tests commit: a7b304dde5]
2020-06-17 10:45:29 -07:00
Luke Yeager 3a6293b748 Fix some memory leaks
[ROCm/rccl-tests commit: af4fa0f4cf]
2020-06-17 10:44:32 -07:00
Wenkai Du 0b235b136a Correct szie when init sendbuff
[ROCm/rccl-tests commit: 83b846cf4f]
2020-06-10 23:24:08 +00:00
Wenkai Du af08abefb0 Add gather and scatter test
[ROCm/rccl-tests commit: 6932a583e7]
2020-04-10 14:45:10 -07:00
Wenkai Du b132257d16 Merge remote-tracking branch 'nccl/p2p' into p2p
[ROCm/rccl-tests commit: c2dc7b613b]
2020-04-02 15:06:36 -07:00
Sylvain Jeaugey c633de20d6 Add alltoall perf test
[ROCm/rccl-tests commit: 119a0ecf60]
2020-03-17 12:00:19 -07:00
Wenkai Du c947fe45ff Add option for stress testing
[ROCm/rccl-tests commit: 6e9e05972b]
2020-03-11 13:40:17 -07:00
Wenkai Du e1d118e925 Fix build error with hip-clang
[ROCm/rccl-tests commit: bd53e98df3]
2019-11-22 10:31:31 -08:00
Wenkai Du 907877df59 Add bf16 support in rccl-tests
[ROCm/rccl-tests commit: 1cda2f52b6]
2019-11-18 13:18:34 -08:00
Wenkai Du 123ea97750 Fix build with RCCL 1.x API
[ROCm/rccl-tests commit: 32399955af]
2019-11-12 23:04:39 +00:00
Wenkai Du 9c89b0f8bd Fix incorrect print out when data size is greater than 4GB
[ROCm/rccl-tests commit: aa0f02bee0]
2019-11-11 11:39:59 -08:00
Wenkai Du 55749e6e97 Init data for throughput iterations to avoid all zero data
[ROCm/rccl-tests commit: 13d0ddd12e]
2019-09-27 09:12:00 -07:00
Wenkai Du b74c00f548 Fix memory leak and possible buffer overrun
[ROCm/rccl-tests commit: ab82f1af6f]
2019-08-09 10:22:14 -07:00
Wenkai Du 5b5cf00cbe Allow call ncclCommAbort on Ctrl+C
[ROCm/rccl-tests commit: 23c374475f]
2019-07-26 00:15:16 +00:00
Gilbert Lee 0288eeef75 Checking that number of requested GPUs is not more than number of available GPUs
[ROCm/rccl-tests commit: 043eef6999]
2019-07-11 15:36:21 +00:00
Stanley Tsang 30d348de0e Adding unit tests and files for CI (#4)
* Adding initial unit test and Jenkins code.

Fixing scope of unit tests

Adding unit tests and files for CI

Fixing Jenkinsfile

* Removing typos from Jenkinsfile

* Making some fixes to the Jenkins file; temporarily disabling MPI

* Making corrections to Jenkinsfile

* Correcting dockerNodes entry in Jenkinsfile

* Fixed Jenkinsfile for CI

* Correcting Jenkinsfile for CI

* Updating README to include instructions on how to run unit tests.


[ROCm/rccl-tests commit: 924521ff57]
2019-06-28 08:52:44 -07:00
Wenkai Du b0e3a2ac64 allow using different memory types for input and output buffers
[ROCm/rccl-tests commit: 3f89175af5]
2019-05-01 12:58:04 -07:00
Wenkai Du 852651be37 fix build with 1.0 library
[ROCm/rccl-tests commit: 7e80ea9d3a]
2019-04-26 17:06:05 -07:00
Stanley Tsang aac7cfb64f Adding AMD copyright notices
[ROCm/rccl-tests commit: 71e663e62d]
2019-04-10 15:28:40 -07:00
Wenkai Du 3c8cfb2d6e hipify nccl-tests to become rccl-tests
[ROCm/rccl-tests commit: a15f771cb2]
2019-04-10 13:43:58 -07:00
David Addison 18902f40a7 Resync all tests with test code from NCCL 2.4
Major rework to merge most of the changes from the NCCL internal
tests into the public ones

Added "-m <agg_iters>" operation aggregation option.
Data integrity checking is now much more performant at scale.
Startup times at scale are improved.
Test latency units are now displayed in usec.


[ROCm/rccl-tests commit: cbe7f65400]
2019-04-05 13:42:15 -07:00
Sylvain Jeaugey 3958cc347e Print NCCL version at start
[ROCm/rccl-tests commit: 925a70576e]
2017-12-21 15:10:09 -08:00