Gráfico de commits

164 Commits

Autor SHA1 Mensaje Fecha
Wenkai Du bb5e42bac0 Use different unroll numbers for copy and reduce (#81)
* Use different unroll numbers for copy and reduce

* use 4 separate unroll factors
2019-06-19 16:36:16 -07:00
Jeff Daily 754ed213cc do not use internal stream (#79) 2019-06-12 16:26:59 -06:00
Wenkai Du ee14676064 Calculate and print kernel throughput (#78)
* rccl-prim-test: print GPU info and set iterations

* Calculate and print kernel throughput
2019-06-07 10:39:30 -07:00
Wenkai Du 42b488507d rccl-prim-test: print GPU info and set iterations (#77) 2019-06-05 15:16:33 -07:00
Wenkai Du b7a6307371 Implement HDP flush when transfer data over PCIe P2P (#75)
* Implement HDP flush when transfer data over PCIe P2P
* Add some descriptions to HDP flushing
* Fix for review comments
2019-06-03 16:29:55 -07:00
Wenkai Du 8c974f1f50 Merge pull request #76 from ROCmSoftwarePlatform/fix-indirect-call
Make ncclFuncs static
2019-05-29 12:04:58 -07:00
Yaxun Sam Liu 5827a4f616 Make ncclFuncs static
This is necessary to constant propagate the function pointers
to eliminate the indirect function call.
2019-05-29 10:50:13 -04:00
Wenkai Du 9a0ac849fa Merge pull request #72 from wenkaidu/default_rings
Increase number of rings with XGMI connection
2019-05-24 14:42:54 -07:00
Wenkai Du f45566a8bd Increase number of rings with XGMI connection
Improve throughput for about 20%. Also remove P2P over PCIe which was
left enabled at initial release.

Signed-off-by: Wenkai Du <wenkai.du@amd.com>
2019-05-24 20:58:51 +00:00
Yaxun (Sam) Liu b921279a21 Fix build failure for hip-clang (#69) 2019-05-23 16:53:25 -06:00
Wenkai Du 1bb6d2104c Add RCCL primitive testing (#70) 2019-05-23 16:52:17 -06:00
saadrahim 4c4351673b Jenkinsfile (#65)
* Changing Jenkinsfile to support runs without docker
* Updating install file for build options
* Fixing command execution
* Fixing Jenkinsfile
* fixing test execution
* Removing junit search
2019-05-22 15:32:32 -06:00
saadrahim 42c3e4b93d Updating readme for 2.5 release (#67) 2019-05-22 15:31:12 -06:00
gilbertlee-amd ffe2054ed2 Test combined calls (#64)
* Adding test for queueing multiple different collectives, 1 device per thread
2019-05-22 15:30:37 -06:00
Aaron Enye Shi 6e8f40eb22 Update README to note install rocm-cmake (#68) 2019-05-22 15:29:59 -06:00
gilbertlee-amd a115f577dd Adding fix for unsufficient devices / better logging for skipped tests (#63) 2019-05-21 14:34:20 -06:00
Stanley Tsang afa945d6e6 Renaming jenkinsfile 2019-05-21 15:54:41 +00:00
Wenkai Du 4bfa506a6b Remove extra compiler path setting 2019-05-21 00:08:42 +00:00
Wenkai Du e517dbed5c By default will not build test program 2019-05-20 18:37:58 +00:00
gilbertlee-amd c57ab960ff Merge pull request #62 from gilbertlee-amd/AlignmentTests
Adding support for alignment tests via sub-datasets
2019-05-18 10:54:52 -06:00
Gilbert Lee a50c852851 Adding support for alignment tests via sub-datasets
Added sample alignment test for AllGather
Datasets no longer free memory on destruction so Release() must be used
2019-05-18 00:04:03 +00:00
Stanley Tsang 0d6a5a3d25 Update README.md
Adding mention of requirement for chrpath for unit tests.
2019-05-17 11:42:14 -06:00
gilbertlee-amd 28f8dcb7c9 Merge pull request #61 from gilbertlee-amd/master
Reducing scope of linker flags to rccl target to avoid warnings.  
Changing to tagged version of googletests
Checking for chrpath
2019-05-17 11:36:23 -06:00
Gilbert Lee 248e1d61cc Adding check for chrpath for unit tests 2019-05-17 17:13:40 +00:00
Gilbert Lee 08fcce5ec9 Fixing GoogleTest to 1.8.1 and making changes to tests to support older API 2019-05-16 23:13:49 +00:00
Gilbert Lee 11f78df04d Reducing scope of linker flags to rccl target to avoid warnings 2019-05-16 21:39:39 +00:00
Gilbert Lee 55a4b22ad7 Updating RCCL based on NCCL 2.3.7
- Contains modifications to support AMD hardware
- Adds unit tests
2019-05-16 16:16:18 +00:00
Christian Sigg 4861e197fd Fix memory leak in bootstrapRoot() 2019-01-07 14:18:46 -08:00
Sylvain Jeaugey c244b51ae7 Replace CUDA_VERSION by CUDART_VERSION 2018-12-13 15:22:17 -08:00
Christian Sigg 3e6afef473 Qualify nullptr_t with std:: 2018-12-13 14:18:09 -08:00
Christian Sigg 346fc49514 Two temporary workarounds for cuda-clang issues. 2018-12-13 14:17:58 -08:00
Christian Sigg d08e9b5279 Change __CUDACC_VER_*__ preprocessor directives to CUDA_VERSION because clang doesn't define the former. 2018-12-13 14:17:46 -08:00
Sylvain Jeaugey 469b69a5d0 Fix #163 : remove warnings 2018-12-11 09:19:16 -08:00
Ke Wen 8606cdb8b2 Fix dummy plugin 2018-12-05 17:25:23 -08:00
Sylvain Jeaugey 57368189e1 Remove error logging from a normal path
When initNet fails, we should not print the backtrace as it is
supposed to be normal operation (falling back to sockets)
2018-12-04 14:47:41 -08:00
Sylvain Jeaugey 4b39a4cf91 Fix GPU Direct RDMA detection.
Whether the network supported GPU Direct RDMA or not was ignored,
causing sockets to break when cards were local enough that NCCL
tried to use it.
2018-12-04 14:42:28 -08:00
Sylvain Jeaugey b8a9a32ccb Add NCCL_NET flag to many debug lines. 2018-12-04 13:10:19 -08:00
Sylvain Jeaugey cdae05b277 Improve INFO message when external network is not found.
Fix #162
2018-12-04 12:10:58 -08:00
David Addison 5fe2618c0e Fixed some compilation errors when TRACE=1 set 2018-11-29 14:12:14 -08:00
Sylvain Jeaugey eed8218e17 Rework shared memory code to use SYSCHECK macros.
This is to handle EINTR/EGAIN properly (issue #137), and also
make the code consistent with the rest.

Unfortunately posix_fallocate and mmap do not follow the classic
return code/errno pattern, so we need to write wrappers around those
functions.
2018-11-29 12:52:13 -08:00
Sylvain Jeaugey 302d538b73 Rework SYSCHECK macros to better handle retries.
SYSCHECKVAL was not retrying when a retry was needed. Since not all
calls are inside a loop, that means we could silently miss an
EINTR/EAGAIN return code.

Also rework the socket connection code and improve error reporting.
2018-11-29 12:52:13 -08:00
Sylvain Jeaugey 61b50a63ef Improve net API description 2018-11-26 16:24:31 -08:00
Sylvain Jeaugey 98adf2fe11 Make network isend/irecv non blocking 2018-11-26 16:24:31 -08:00
Sylvain Jeaugey 0d3a20f96d Add support for external network.
Dynamically load external network from libnccl-net.so.
Add init function in networks.
Move PCI scoring to net.cu, only ask transport to provide a path.
Simplify CUDA PCI path detection.
Add dummy external network
2018-11-26 16:24:31 -08:00
Alex Sergeev d7a58cfa58 Generate host-hash for P2P and SHM based on $(readlink /proc/self/ns/uts) + $(readlink /proc/self/ns/mnt) (#156) 2018-11-19 17:39:44 -08:00
Sylvain Jeaugey 3c6e25210b Generate nccl.h in build instead of src
Generating nccl.h in src makes source directories dirty after builds.
2018-11-09 14:00:41 -08:00
Ke Wen 21d9a877be Add official builds download link 2018-11-08 11:22:28 -08:00
Sylvain Jeaugey f7d31919d7 Add instructions to install packaging toolchain
Address #143 and #150 : debuild not installed.
2018-11-05 11:42:33 -08:00
Sylvain Jeaugey bed43524cc Add install target
Fix issue #145
2018-11-05 09:53:59 -08:00
David Addison b56650c7f5 2.3.7-1
Improved LL tuning for multi-node jobs.
Improved bootstrap for large job scaling.
Fixed a hang during bootstrap due to socket reuse.
Added operation name to the COLL INFO logging.
2018-10-24 14:44:59 -07:00