2
0
Gráfico de cometimentos

568 Cometimentos

Autor(a) SHA1 Mensagem Data
Wenkai Du bcf4ecb0e3 Enable local sendrecv over network if GDR is available on all GPUs (#324)
[ROCm/rccl commit: c018edf0f2]
2021-03-05 19:59:41 -08:00
gilbertlee-amd 8d90821062 Adding pthread_join / pthread_detach to clean up pthreads to avoid leaks (#322)
[ROCm/rccl commit: f4a9b9acba]
2021-02-26 16:29:55 -07:00
Wenkai Du 897cb8d618 Merge pull request #320 from wenkaidu/nbio
Match NBIO only when GPUs and NICs are directly connected to CPU

[ROCm/rccl commit: 7191d0959b]
2021-02-25 17:49:09 -08:00
Stanley Tsang 4c42a55c53 Temporarily disabling multiprocess unit tests
[ROCm/rccl commit: 5d3b1fa4d0]
2021-02-25 23:59:44 +00:00
Eiden Yoshida 310dc0e738 Add ubuntu gfx908 target to CI
[ROCm/rccl commit: 25a7dad765]
2021-02-24 19:01:56 -07:00
Wenkai Du 020ccb6730 Update tuning parameters for XGMI and NET
[ROCm/rccl commit: e820a943e9]
2021-02-23 21:41:26 +00:00
Wenkai Du d24df90882 Match NBIO only when GPUs and NICs are directly connected to CPU
[ROCm/rccl commit: ec8d89b1dd]
2021-02-22 18:52:29 -05:00
Stanley Tsang fb7478e3a2 Do not search for GTest if we're force installing it into build directory (#318)
[ROCm/rccl commit: 61d66c8e18]
2021-02-22 15:22:01 -07:00
Wenkai Du c3296954ea Merge pull request #319 from wenkaidu/2.8.3
Update to 2.8.4

[ROCm/rccl commit: a058d5639e]
2021-02-22 10:17:38 -08:00
Stanley Tsang ce02076d64 Fixing cache deletion for CliqueManager; updating copyright
[ROCm/rccl commit: 45f5255f7c]
2021-02-19 22:22:46 +00:00
Stanley Tsang cc450d0fc5 Make CI only run subset of unit tests.
[ROCm/rccl commit: 6a568a8652]
2021-02-19 21:37:51 +00:00
Cory Bloor 6c28ab176f Add Jenkins docs build (#18)
* Fix typo in copyright

* Minor README improvements

- Prevent underscores from being interpreted as italics in test name format.
- Switch URL to HTTPS.

* Update docs scripts config

- Allow run_doc.sh and run_doxygen.sh to be called from any directory.

* Add docs build to Jenkins

[ROCm/rccl commit: 8aea5edb29]
2021-02-18 16:37:37 -07:00
Wenkai Du 6c3ccc2192 Add support to another Rome model
[ROCm/rccl commit: 95f178324c]
2021-02-18 02:00:31 +00:00
Wenkai Du ab71643c99 Merge remote-tracking branch 'nccl/master' into 2.8.3
[ROCm/rccl commit: c985358e11]
2021-02-15 18:44:47 -05:00
Wenkai Du ea2e665834 Merge remote-tracking branch 'rccl/develop' into 2.8.3
[ROCm/rccl commit: 3a1aebd742]
2021-02-15 13:17:38 -05:00
Wenkai Du 34d7735419 Move HDP flush to CPU
[ROCm/rccl commit: bf8eb40705]
2021-02-12 18:06:19 +00:00
pramenku 7d2074fb31 Update install.sh (#317)
* Update install.sh

Install.sh having hard code like /opt/rocm/bin/hipcc for rocm_path and default_path=/opt/rocm
This will work only when we have standalone rocm installed. If anyone has installed, side-by-side, they will face below error.

Can we keep like ROCM_PATH=$ROCM_PATH  instead of “default_path” as variable name and 
ROCM_BIN_PATH=$ROCM_PATH/bin ,rocm_path can be replaced with ROCM_BIN_PATH.

This way, we will have option to export ROCM_PATH as env variable as per need and use the script. 
I have also tried locally, it’s working.  ROCM_PATH is common variable name, we are having.

If you are ok, I can also submit the PR for the same.


Error when side-by-side install is done for driver.
# ./install.sh -dtr 2>&1 | tee /dockerx/6519_rccl-test.log
CMake Error at /usr/share/cmake/Modules/CMakeDetermineCXXCompiler.cmake:48 (message):
Could not find compiler set in environment variable CXX:
/opt/rocm/bin/hipcc.
Call Stack (most recent call first):
CMakeLists.txt:12 (project)

CMake Error: CMAKE_CXX_COMPILER not set, after EnableLanguage
-- Configuring incomplete, errors occurred!
See also "/root/driver/rccl/build/release/CMakeFiles/CMakeOutput.log".

* Update install.sh

Removed ROCM_PATH=$ROCM_PATH

* Update install.sh

Set default value if external value is not supplied.

[ROCm/rccl commit: e9f7908592]
2021-02-12 08:44:30 -08:00
Stanley Tsang 59f9e92374 Fixed temp file creation/deletion with clique mode (#316)
[ROCm/rccl commit: 6b7b312fb9]
2021-02-12 08:44:10 -08:00
Sylvain Jeaugey fc7bdb38a5 2.8.4-1
Fix hang in corner cases of alltoallv using point to point send/recv.
Harmonize error messages.
Fix missing NVTX section in the license.
Update README.


[ROCm/rccl commit: 911d61f214]
2021-02-09 15:36:48 -08:00
Gilbert Lee b36d93ae91 Using GTEST_SKIP() to skip unit tests that have insufficient devices. Skipping out earlier
[ROCm/rccl commit: f1a9ce3fa5]
2021-02-09 03:54:04 +00:00
Wenkai Du 602fe60428 Fix GDRDMA read and remove unused files
[ROCm/rccl commit: 9cc3b56166]
2021-02-09 01:34:39 +00:00
Stanley Tsang f152c8d160 Update MP UT to support arbitrary # of GPUs; multiple bugfixes (#16)
* Fixing temp file creation/deletion for Clique kernel mode.

* Refactoring of MP unit tests; include bugfixes and general support for any number of GPUs

* GroupCall MP UT properly quits when too many devices specified

* MP UT will programmatically set NCCL_COMM_ID if not specified; updated install script

[ROCm/rccl commit: d00b7d17bd]
2021-02-05 16:49:25 -08:00
Wenkai Du fe8923ebba Add gfx908 Rome 4 NICs model
[ROCm/rccl commit: 6dfdfef98f]
2021-02-06 00:19:47 +00:00
Gilbert Lee b954d85935 [TransferBench] Fixing some merge issues
[ROCm/rccl commit: f372c53d52]
2021-02-05 16:46:20 +00:00
Wenkai Du ae5779702a Merge remote-tracking branch 'origin/develop' into 2.8.3
[ROCm/rccl commit: ab1e7a0318]
2021-02-04 20:02:34 -05:00
Gilbert Lee 1dfb88f554 [topo_expl] Updating for 2.8.3
[ROCm/rccl commit: 2f541508c5]
2021-02-04 19:08:42 +00:00
Gilbert Lee f2d07cb9a6 [ib-test] Update for 2.8.3]
[ROCm/rccl commit: 9aac1ed38f]
2021-02-04 19:05:03 +00:00
Gilbert Lee 1643d05c75 [TransferBench] Updating for 2.8.3
[ROCm/rccl commit: 9ce203dd0a]
2021-02-04 18:58:25 +00:00
gilbertlee-amd 16d625ca27 Tuning some clique-based kernel parameters (#315)
[ROCm/rccl commit: 1990ffd76a]
2021-02-03 20:00:08 -07:00
Wenkai Du 57abf599b2 Enable GPU direct RDMA read from GPU
[ROCm/rccl commit: 5f97122442]
2021-02-03 02:48:30 +00:00
gilbertlee-amd 60c74f63fa [TransferBench] Restore some previous fixes - memory leak, PCIe address (#314)
[ROCm/rccl commit: 62e0447e9a]
2021-02-01 09:48:09 -07:00
Gilbert Lee 6bf9b0d36a Removing in-place tests from Combined calls (no support for send/recv)
[ROCm/rccl commit: 01a998b17c]
2021-01-28 20:09:03 +00:00
gilbertlee-amd c981e76efe Clique kernel support (#295) (#15)
* Adding experimental clique-based kernels (opt-in only)

Co-authored-by: Stanley Tsang <stanley.tsang@amd.com>
Co-authored-by: Gilbert Lee <gilbert.lee@amd.com>
Co-authored-by: Wenkai Du <43822138+wenkaidu@users.noreply.github.com>

Co-authored-by: Stanley Tsang <stanley.tsang@amd.com>
Co-authored-by: Wenkai Du <43822138+wenkaidu@users.noreply.github.com>

[ROCm/rccl commit: 3e62ceddc5]
2021-01-28 09:45:01 -07:00
Wenkai Du 7f9c15b843 Use less unroll for clique kernels (#313)
[ROCm/rccl commit: 41e47a36e7]
2021-01-15 17:48:10 -08:00
Stanley Tsang d7ed44eb9a Adding multiprocess unit tests (#312)
Adding multiprocess unit tests for collectives.  

To run, NCCL_COMM_ID=$HOSTNAME:12345 build/release/test/UnitTestsMultiProcess

[ROCm/rccl commit: d3fa257682]
2021-01-15 16:34:36 -07:00
Wenkai Du d4382de267 Improve collective trace
[ROCm/rccl commit: 2ddbe6646b]
2021-01-14 19:28:01 -05:00
Wenkai Du 560224fe9f gtest: add scatter to combined calls and use loops (#303)
* gtest: add scatter to combined calls and use loops

* gtest: run validation inside loop

* gtest: revert small element count to 2520

* gtest: fix memory leak in validation

(cherry picked from commit 36935cfbee)

* Fix combined call UT

* Fix memory leak

* Fix alltoallv test


[ROCm/rccl commit: b33a2cac8b]
2021-01-14 19:28:01 -05:00
Wenkai Du 2c49121171 Port alltoall[v]
[ROCm/rccl commit: f4d5d3d620]
2021-01-14 19:28:01 -05:00
Wenkai Du 41bead5a4e Do not allow GPU as intermediate
[ROCm/rccl commit: 105db19a11]
2021-01-14 19:28:01 -05:00
Wenkai Du 34c6013299 Revert "Changes to topology based on XGMI (#272)"
This reverts commit 0a9adc16f4.


[ROCm/rccl commit: e055229e56]
2021-01-14 19:28:01 -05:00
Wenkai Du adff98765c Merge remote-tracking branch 'nccl/master' into no-target-id
[ROCm/rccl commit: d469947641]
2021-01-14 19:27:53 -05:00
Jonas Zhou 1db601566f x86: Add CPU detection for Zhaoxin processors
Signed-off-by: Jonas Zhou <JonasZhou@zhaoxin.com>


[ROCm/rccl commit: 3996562690]
2020-12-17 11:15:18 -08:00
Wenkai Du 4ea285c527 Fix Rome PCIe 2 node topology generation (#310)
[ROCm/rccl commit: 373a108516]
2020-12-15 17:16:17 -08:00
gilbertlee-amd c570f09681 [TransferBench] Fixing bug with fine-grained memory allocation (#311)
* Fixing bug with fine-grained memory

[ROCm/rccl commit: 41c35dad48]
2020-12-15 17:37:31 -07:00
gilbertlee-amd 5155abb250 [TransferBench] Adding ability to perform CPU-executed copies, various upgrades (#309)
* Adding CPU based execution, fixing typos, adding Fine-grained mem
* Exposing sampling factor when generating range of data sizes
* Refactoring how Links are launched, now once per thread
* Documentation updates

[ROCm/rccl commit: ae0c4092c7]
2020-12-11 10:21:14 -07:00
gilbertlee-amd 9b48f92d72 [TransferBench] Support multiple of 4 byte sizes, changing default GPU timing mechanism (#307)
* Changing default timing mechanism, adjusting CPU bandwidth calc, adding flag to use combined timing
* Adding support for smaller transfers (byte size must be multiple of 4 instead of 128)

[ROCm/rccl commit: b80ae551b1]
2020-12-04 14:57:13 -07:00
Wenkai Du 9e83df4ad3 Adding backward compatibility for target-id syntax for AMDGPU_TARGETS (#306)
[ROCm/rccl commit: 882d52ad7e]
2020-12-04 13:55:56 -08:00
Wenkai Du b68ff1ebba Add Rome model and improve search (#305)
[ROCm/rccl commit: 975b14dffa]
2020-11-17 14:55:06 -08:00
Sylvain Jeaugey a8908b34ee 2.8.3-1
Optimization for Tree allreduce on A100.
Improve aggregation performance.
Use shared buffers for inter-node send/recv.
Add NVTX profiling hooks.
Accelerate alltoall connections by merging communication for all
channels.
Add support for one hop communication through NVLink, for faster
send/recv communication on cubemesh topologies like DGX-1.
Improve alltoall scheduling to better balance intra/inter node
communication.
Increase send/recv parallelism by 8x, each warp sending or
receiving to a different peer.
Net: move to v4.
Net: make flush operation asynchronous to accelerate alltoall.
Net: define maximum number of requests.
Fix hang when using LL128 protocol after 2^31 steps.
Fix #379 : topology injection failing when using less GPUs than
described in the XML.
Fix #394 : protocol mismatch causing hangs or crashes when using
one GPU per node.


[ROCm/rccl commit: 920dbe5b35]
2020-11-17 11:08:52 -08:00
Wenkai Du 32fdfc93fc Merge remote-tracking branch 'origin/master' into develop
[ROCm/rccl commit: 1943bac646]
2020-11-16 12:16:53 -05:00