b0c3a1790f
[TransferBench] Removing dependency on hip_fp16 header, fixing swapped output CSV header ( #416 )
...
[ROCm/rccl commit: 1ed272e5f0
2021-08-04 10:53:41 -06:00
6e997354e8
Merge branch 'develop' into 2.10.3
...
[ROCm/rccl commit: babbd1047b
2021-08-04 09:45:22 -07:00
de0c586bad
Sort IB devices based on device name ( #413 )
...
[ROCm/rccl commit: 2d0ed8dff6
2021-08-03 15:32:41 -07:00
4b89e98675
Merge remote-tracking branch 'nccl/master' into 2.10.3
...
[ROCm/rccl commit: bf2339f93e
2021-07-30 16:23:14 -07:00
4b082ceb32
XGMI connection is always prioritized over NET regardless of hops ( #412 )
...
[ROCm/rccl commit: 3e27227562
2021-07-29 11:12:42 -07:00
d4bdf8fab7
Add basic rtest.xml ( #411 )
...
[ROCm/rccl commit: 229ca88ee6
2021-07-28 11:53:03 -06:00
faea6ead5c
Query XGMI links from xml and adjust gfx906 channel usage ( #410 )
...
[ROCm/rccl commit: 818cdb16a8
2021-07-27 17:32:41 -07:00
765c46dd89
Update changelog with packaging information ( #409 )
...
[ROCm/rccl commit: e579de7ec2
2021-07-27 10:38:36 -06:00
8fbeb14175
topo_expl: fix build after switching to rocm-smi-lib ( #405 )
...
* topo_expl: fix build after switching to rocm-smi-lib
* Use minimal of 4 channels for gfx908
[ROCm/rccl commit: 135d47d125
2021-07-27 08:30:08 -07:00
3d382b5ba3
Extend test stage timeout to 24 hours ( #408 )
...
[ROCm/rccl commit: 56801656f3
2021-07-26 15:29:21 -06:00
4efbbec091
Setup runtime and development packages ( #407 )
...
* changes to enable devel package
* Update rocm-cmake version & build
[ROCm/rccl commit: 97d9cf40e7
2021-07-26 15:06:17 -06:00
bbfc0c85d2
Skipping unnecessary functions in Doxygen by marking as internal ( #353 ) ( #406 )
...
(cherry picked from commit 198e17608ef40acf6b9515c6831d4a26786aabd6)
Co-authored-by: saadrahim <44449863+saadrahim@users.noreply.github.com >
[ROCm/rccl commit: dfc62d5fbb
2021-07-24 11:04:27 -07:00
2ab26a2ff9
Add more info to RCCL logging for topo-aware optim.
...
[ROCm/rccl commit: bd6dbca8fb
2021-07-22 09:52:39 -07:00
f773636575
Fix unit tests static build ( #403 )
...
[ROCm/rccl commit: 215904ee8e
2021-07-09 09:35:32 -07:00
58a9f19dc3
2.10.3-1
...
Add support for bfloat16.
Add ncclAvg reduction operation.
Improve performance for aggregated operations.
Improve performance for tree.
Improve network error reporting.
Add NCCL_NET parameter to force a specific network.
Add NCCL_IB_QPS_PER_CONNECTION parameter to split IB traffic onto multiple queue pairs.
Fix topology detection error in WSL2.
Fix proxy memory elements affinity (improve alltoall performance).
Fix graph search on cubemesh topologies.
Fix hang in cubemesh during NVB connections.
[ROCm/rccl commit: 7e51592129
2021-07-08 14:30:14 -07:00
71dfc3978e
Use rocm_smi_lib for getting topology information ( #402 )
...
* Use rocm_smi_lib for getting topology information
* Add rocm-smi-lib dependency to RCCL package
[ROCm/rccl commit: 56155ff5b6
2021-07-08 13:23:11 -07:00
66349efb1d
Fix static builds ( #393 )
...
[ROCm/rccl commit: 5c3e7d8b67
2021-06-23 09:19:48 -06:00
f2a72b1e0b
[TransferBench] Fixing a typo in TransferBench usage example ( #401 )
...
[ROCm/rccl commit: 2b0b608270
2021-06-22 17:08:57 -06:00
929d72b3b9
Deduct ROCM_PATH from CXX unless specified ( #400 )
...
[ROCm/rccl commit: e75bc53e06
2021-06-22 13:29:08 -07:00
90ae176437
Fixes for NCCL_MAX_NCHANNELS and topo_expl ( #398 )
...
[ROCm/rccl commit: fa6d7e9a63
2021-06-22 08:41:49 -07:00
0a636f20a3
[TransferBench] Switching from little-endian fill pattern to big-endian ( #399 )
...
[ROCm/rccl commit: 720374a767
2021-06-21 14:28:51 -06:00
1670bddea0
Remove hard coded /opt/rocm from cmake ( #396 )
...
[ROCm/rccl commit: 59d2867b01
2021-06-21 08:29:23 -07:00
01a8efbb76
[TransferBench] Adding ability to specify source data pattern ( #394 )
...
* [TransferBench] Adding ability to specify source data pattern
[ROCm/rccl commit: ff413be933
2021-06-15 08:41:57 -06:00
dbb867942d
Move address-sanitizer build above addition of rccl library in CMakeLists ( #392 )
...
[ROCm/rccl commit: fb267ea333
2021-06-11 14:43:54 -06:00
f82f99f533
Select sendrecv path based on collective data size ( #391 )
...
* Select sendrecv path based on collective data size
* Add comments on packing and unpacking group field
* Toggling RCCL_P2P_NET_DISABLE in combined calls unit tests
[ROCm/rccl commit: 6dcae8a459
2021-06-10 17:51:04 -07:00
dd98f1762a
Fixing bug with ExtractSubDataset function not fully initializing subdataset ( #390 )
...
[ROCm/rccl commit: f6f5e16fe6
2021-06-10 14:35:39 -06:00
a24e180296
Add address sanitizer build option ( #389 )
...
[ROCm/rccl commit: eea7b24058
2021-06-10 09:14:54 -06:00
5bebcb0015
Setup collectives threshold for enabling intranet ( #387 )
...
* Setup collectives threshold for enabling intranet
* Use separate operation counters for coll and p2p
[ROCm/rccl commit: b815a2800f
2021-06-09 13:24:26 -07:00
ab9b9151d2
Add support for another Rome model ( #385 )
...
[ROCm/rccl commit: c2064adcc7
2021-06-08 13:58:20 -07:00
52ffd67cd6
Updating changelog to show install script fix ( #384 )
...
[ROCm/rccl commit: 6842429a14
2021-06-08 13:00:40 -06:00
c8a432dc25
Allow intranode use of network connection ( #383 )
...
* Allow intranode use of network connection
* Checking for graph for null pointer
[ROCm/rccl commit: a3a8c2d56b
2021-06-08 07:37:59 -07:00
b1f41247a2
Fixing install script so that invoking -r alone does not trigger rebuild ( #382 )
...
[ROCm/rccl commit: 820a53287f
2021-06-04 09:46:04 -06:00
4b31e521e9
Add option to enable multiple SAT in SHARP ( #380 )
...
* Add option to enable multiple SAT in SHARP
* Extend number of NICs to 16
[ROCm/rccl commit: 961922ea02
2021-06-03 19:45:18 -07:00
fd94c55afe
ROCm 4.3 changelog update ( #379 )
...
* Update CHANGELOG.md (#378 )
* Updating CHANGELOG.md for ROCm 4.3
[ROCm/rccl commit: 903c84050d
2021-06-03 10:56:02 -06:00
cdf2780687
topo_expl: update to 2.9.9
...
[ROCm/rccl commit: 13dc80ee14
2021-05-26 09:24:34 -07:00
b154b532a2
Merge remote-tracking branch 'nccl/master' into develop
...
[ROCm/rccl commit: e3abf1c2ec
2021-05-25 20:52:15 -07:00
b1a6561fee
Adding support for hipMallocManaged() in unit tests ( #375 )
...
* Adding HMM support for unit tests
* Fixing HMM opt-in check
[ROCm/rccl commit: 256403d4f0
2021-05-25 17:07:12 -06:00
aa95cc6102
Update Rome models matching ( #376 )
...
[ROCm/rccl commit: 4c83adb75c
2021-05-25 10:12:40 -07:00
ea17b05518
Tweak clique channel usage for gfx908 ( #374 )
...
[ROCm/rccl commit: 8e817ecd6d
2021-05-21 15:36:21 -06:00
92bcdcf5b0
Correction on max number of groups ( #373 )
...
[ROCm/rccl commit: 50da1b48af
2021-05-20 08:58:45 -07:00
b27490d38d
Use fixed segment size for sendrecv ( #369 )
...
[ROCm/rccl commit: 8cde34be51
2021-05-19 08:25:26 -07:00
83d309354e
Running only sum for CI quick test ( #370 )
...
[ROCm/rccl commit: 42b080867e
2021-05-19 08:25:13 -07:00
87423792fd
Tune clique-based AllReduce for device type 908 ( #372 )
...
* Changing switch-over point for clique-based AllReduce
[ROCm/rccl commit: ddceadc313
2021-05-18 15:36:07 -06:00
08addb85a2
Disabling env var caching for all unit tests ( #371 )
...
* Disabling env var caching for all unit tests
[ROCm/rccl commit: 2daadcc834
2021-05-18 12:56:30 -06:00
e0edd3d5e4
Merge remote-tracking branch 'nccl/master' into 2.9.8
...
[ROCm/rccl commit: 87727383fe
2021-05-17 10:15:16 -07:00
6bce88058a
Multiprocess unit test various fixes ( #367 )
...
* Re-enabling mp unit tests
* Fixing shared memory leak and other bugs related to shared mem for MP unit tests
* Revert 43bfbfc97bf9edbae1f386d461439091618ff8ed
* Further tightening up unlinks
* Moving test check macros to separate header file
* Tightening up shared memory unlinking for clique kernels, add munmap for host barrier for MP unit tests
* Updating new MP unit test
* Fixing mqueue bug
* Fixing memory leak in MP unit tests
[ROCm/rccl commit: 0b2bfdd6d8
2021-05-14 09:38:49 -06:00
fa690c47a0
Allow user to link layer with RCCL_IB_HCA_SKIP_LINK_LAYER ( #361 )
...
To skip Infiniband, set RCCL_IB_HCA_SKIP_LINK_LAYER=1.
To skip Ethernet, RCCL_IB_HCA_SKIP_LINK_LAYER=2.
[ROCm/rccl commit: caf5c9992a
2021-05-12 14:14:53 -07:00
3dd3a1ca66
2.9.9-1
...
Fix crash when setting NCCL_MAX_P2P_NCHANNELS below nchannels.
Fix hang during sendrecv dynamic NVB connection establishment on
cubemesh topologies.
Add environment variable to only use SHARP on communicators beyond
a given number of ranks.
Add debug subsystem to trace memory allocations.
Fix compilation with TRACE=1. (Issue #505 )
[ROCm/rccl commit: 3fec2fa5ee
2021-05-12 11:09:31 -07:00
129e7f4bfc
Merge pull request #366 from ROCmSoftwarePlatform/2.9.6
...
Sync up to NCCL 2.9.6
[ROCm/rccl commit: abde40197a
2021-05-11 20:20:42 -07:00
778aa5f868
Revert "Sync up to NCCL 2.9.6 ( #363 )" ( #365 )
...
This reverts commit 4f7d5f85ec330b82df3b
2021-05-11 20:18:17 -07:00
gilbertlee-amd
Wenkai Du
Wenkai Du
Eiden Yoshida
Liam Wrubleski
Lu
Ke Wen
Stanley Tsang
Sylvain Jeaugey