Wenkai Du
b587b55c2e
Add more Rome models ( #434 )
...
* Add more Rome models
* Update models and tuning
* Update tuning
[ROCm/rccl commit: 2249a1d9d3 ]
2021-10-12 08:23:20 -07:00
gilbertlee-amd
227848b70f
[TransferBench] Adding ability to specify suffix for numBytes ( #435 )
...
[ROCm/rccl commit: aa917c3fc8 ]
2021-10-08 16:36:19 -06:00
gilbertlee-amd
94c60f772d
Updating licensing / attribution for documentation ( #432 )
...
[ROCm/rccl commit: a6368bac99 ]
2021-10-08 13:17:24 -06:00
gilbertlee-amd
fef14c1b73
[TransferBench] Fixing advanced config, adding new all-1-hop sample test ( #433 )
...
* [TransferBench] Fixing advanced config, adding new all-1-hop sample test
[ROCm/rccl commit: e506d14d18 ]
2021-10-07 15:57:21 -06:00
Wenkai Du
d377c4dcc6
Add another Rome model ( #431 )
...
[ROCm/rccl commit: e0053311c0 ]
2021-10-06 08:17:12 -07:00
Wenkai Du
91eca0d7d2
Trim NICs when all GPUs are connected by XGMI ( #430 )
...
* Trim NICs when all GPUs are connected by XGMI
* Only enable clique with maximum of 2 hops
[ROCm/rccl commit: 29c729d8b6 ]
2021-10-05 18:27:43 -07:00
Wenkai Du
55fa23a613
Merge pull request #428 from ROCmSoftwarePlatform/2.10.3
...
Sync up with NCCL 2.10.3
[ROCm/rccl commit: 51a1cf428e ]
2021-09-17 08:23:43 -07:00
Wenkai Du
1eaf495391
Remove extra L1 cache invalidate and restore __ATOMIC_SEQ_CST atomics ( #426 )
...
[ROCm/rccl commit: 5ae3f3f954 ]
2021-09-14 18:30:16 -07:00
Wenkai Du
f4387b2954
Use relaxed atomics and add sleep and wakeup in barrier loop ( #425 )
...
* Use relaxed atomics and add sleep and wakeup in barrier loop
* atomicAdd in ROCm 4.3 only support unsigned long long
* Switch to atomicAdd and atomicExch in more places
* Restore LOAD/STORE define to __ATOMIC_SEQ_CST
* Restore atomic for sizes FIFO
[ROCm/rccl commit: 020484bf40 ]
2021-09-13 17:03:49 -07:00
Wenkai Du
9ffeb41fe1
Update tuning table ( #424 )
...
[ROCm/rccl commit: ef432e48e1 ]
2021-09-13 08:39:01 -07:00
Wenkai Du
934885526d
Merge pull request #423 from wenkaidu/prim-test
...
rccl-prim-test: support 8p1h and 16p1h testing
[ROCm/rccl commit: a2421f8b4a ]
2021-09-08 17:01:19 -07:00
Wenkai Du
d2580c8cf5
Improve barrier implementation
...
[ROCm/rccl commit: adb8d63352 ]
2021-09-08 16:14:32 -05:00
Wenkai Du
d75504e9dc
Remove atomic from profiling
...
[ROCm/rccl commit: 31bd4236f1 ]
2021-09-08 14:20:32 -05:00
Wenkai Du
310d51056f
rccl-prim-test: enable 8p1h and 16p1h test
...
[ROCm/rccl commit: 7558b5e2bf ]
2021-09-08 11:51:26 -05:00
Wenkai Du
4f610a2239
Revert "rccl-prim-test: add all-to-all benchmark ( #185 )"
...
This reverts commit e3e1c6b29c .
[ROCm/rccl commit: b22d097524 ]
2021-09-07 16:41:46 -05:00
gilbertlee-amd
06b0e1c4e2
[TransferBench] ConfigFile parsing fixes, adding additional info ( #422 )
...
* [TransferBench] Adding GPU to NUMA distance detection, parsing fixes, config file generation fix
* [TransferBench] Fixing up NUMA node detection by filtering pools
[ROCm/rccl commit: 51d64894ff ]
2021-09-07 15:28:16 -06:00
Wenkai Du
b9508a6aba
Implement NIC identification and remapping ( #420 )
...
* Add 1H16P GPU model
* Implement NIC identification and remapping
* Revert "Sort IB devices based on device name (#413 )"
This reverts commit de0c586bad .
* Fix permute and check order
* Correction on IB speed reporting
* Revert "Allow user to link layer with RCCL_IB_HCA_SKIP_LINK_LAYER (#361 )"
This reverts commit fa690c47a0 .
[ROCm/rccl commit: 5c8380ff5b ]
2021-08-24 09:42:04 -07:00
Wenkai Du
57518da006
Add gfx908 VM model ( #418 )
...
[ROCm/rccl commit: 5f15ed6e3e ]
2021-08-10 08:55:11 -07:00
gilbertlee-amd
b0c3a1790f
[TransferBench] Removing dependency on hip_fp16 header, fixing swapped output CSV header ( #416 )
...
[ROCm/rccl commit: 1ed272e5f0 ]
2021-08-04 10:53:41 -06:00
Wenkai Du
de0c586bad
Sort IB devices based on device name ( #413 )
...
[ROCm/rccl commit: 2d0ed8dff6 ]
2021-08-03 15:32:41 -07:00
Gilbert Lee
5be5b37e19
[TransferBench] Update to 2.10.3
...
[ROCm/rccl commit: 68ec3f84e6 ]
2021-08-02 05:53:20 -05:00
Wenkai Du
a44ed86b46
Merge remote-tracking branch 'origin/develop' into 2.10.3
...
[ROCm/rccl commit: 5b72727670 ]
2021-09-15 10:33:25 -07:00
Wenkai Du
d6064367f0
Merge remote-tracking branch 'origin/develop' into 2.10.3
...
[ROCm/rccl commit: 3667d308ab ]
2021-09-13 17:32:48 -07:00
Wenkai Du
8acdb77cc0
Merge remote-tracking branch 'origin/develop' into 2.10.3
...
[ROCm/rccl commit: 8ee2b7932a ]
2021-09-13 15:51:53 -07:00
Wenkai Du
95b37d97cf
Merge remote-tracking branch 'nccl/master' into 2.10.3
...
[ROCm/rccl commit: 21969d7f89 ]
2021-09-01 16:34:44 -07:00
John Bachan
04553b802a
Fix to https://github.com/NVIDIA/nccl/issues/560
...
ncclGroup's containing operations of mixed datatype, element, or collective
would induce crash.
[ROCm/rccl commit: 5f2f2f670f ]
2021-08-31 15:50:05 -07:00
Gilbert Lee
e0fd3c6ba3
Modifying ReduceOrCopyMulti to accept number of preOp source to support clique-based kernels
...
[ROCm/rccl commit: ae13d2a354 ]
2021-08-11 11:00:34 -05:00
Wenkai Du
eaf54184bf
Improve clique kernel performance by increasing unroll
...
[ROCm/rccl commit: a4929465c5 ]
2021-08-26 18:06:09 -07:00
Wenkai Du
a5e85a66fd
Fix typo that affects clique kernels
...
[ROCm/rccl commit: 574f0aca53 ]
2021-08-26 11:10:58 -07:00
Wenkai Du
bd03ec2a45
Unit Test: support ncclAvg
...
[ROCm/rccl commit: 1faff323b4 ]
2021-08-25 14:15:54 -07:00
Wenkai Du
da7ac55e6f
Fix kernel data trace
...
[ROCm/rccl commit: 60ca7484c0 ]
2021-08-24 14:02:53 -07:00
Wenkai Du
4fd7a14087
Merge remote-tracking branch 'origin/develop' into 2.10.3
...
[ROCm/rccl commit: d5f93649ff ]
2021-08-24 09:49:47 -07:00
Wenkai Du
51198b536d
Use noinline for kernel functions
...
[ROCm/rccl commit: 707c687090 ]
2021-08-06 09:15:04 -07:00
Wenkai Du
79bc1e3fde
Fix incorrect network proxy received bytes reporting
...
[ROCm/rccl commit: 01d3b20a66 ]
2021-08-05 17:45:48 -07:00
Wenkai Du
6e997354e8
Merge branch 'develop' into 2.10.3
...
[ROCm/rccl commit: babbd1047b ]
2021-08-04 09:45:22 -07:00
Wenkai Du
4b89e98675
Merge remote-tracking branch 'nccl/master' into 2.10.3
...
[ROCm/rccl commit: bf2339f93e ]
2021-07-30 16:23:14 -07:00
Wenkai Du
4b082ceb32
XGMI connection is always prioritized over NET regardless of hops ( #412 )
...
[ROCm/rccl commit: 3e27227562 ]
2021-07-29 11:12:42 -07:00
Eiden Yoshida
d4bdf8fab7
Add basic rtest.xml ( #411 )
...
[ROCm/rccl commit: 229ca88ee6 ]
2021-07-28 11:53:03 -06:00
Wenkai Du
faea6ead5c
Query XGMI links from xml and adjust gfx906 channel usage ( #410 )
...
[ROCm/rccl commit: 818cdb16a8 ]
2021-07-27 17:32:41 -07:00
Liam Wrubleski
765c46dd89
Update changelog with packaging information ( #409 )
...
[ROCm/rccl commit: e579de7ec2 ]
2021-07-27 10:38:36 -06:00
Wenkai Du
8fbeb14175
topo_expl: fix build after switching to rocm-smi-lib ( #405 )
...
* topo_expl: fix build after switching to rocm-smi-lib
* Use minimal of 4 channels for gfx908
[ROCm/rccl commit: 135d47d125 ]
2021-07-27 08:30:08 -07:00
Eiden Yoshida
3d382b5ba3
Extend test stage timeout to 24 hours ( #408 )
...
[ROCm/rccl commit: 56801656f3 ]
2021-07-26 15:29:21 -06:00
Liam Wrubleski
4efbbec091
Setup runtime and development packages ( #407 )
...
* changes to enable devel package
* Update rocm-cmake version & build
[ROCm/rccl commit: 97d9cf40e7 ]
2021-07-26 15:06:17 -06:00
Wenkai Du
bbfc0c85d2
Skipping unnecessary functions in Doxygen by marking as internal ( #353 ) ( #406 )
...
(cherry picked from commit 198e17608ef40acf6b9515c6831d4a26786aabd6)
Co-authored-by: saadrahim <44449863+saadrahim@users.noreply.github.com >
[ROCm/rccl commit: dfc62d5fbb ]
2021-07-24 11:04:27 -07:00
Hubert Lu
d3d312f041
Merge pull request #404 from hubertlu-tw/coll_trace
...
Enhancement of RCCL logging information for topology-aware optimization
[ROCm/rccl commit: c3e2e7cb5d ]
2021-07-22 13:50:28 -07:00
Lu
2ab26a2ff9
Add more info to RCCL logging for topo-aware optim.
...
[ROCm/rccl commit: bd6dbca8fb ]
2021-07-22 09:52:39 -07:00
Wenkai Du
f773636575
Fix unit tests static build ( #403 )
...
[ROCm/rccl commit: 215904ee8e ]
2021-07-09 09:35:32 -07:00
Ke Wen
58a9f19dc3
2.10.3-1
...
Add support for bfloat16.
Add ncclAvg reduction operation.
Improve performance for aggregated operations.
Improve performance for tree.
Improve network error reporting.
Add NCCL_NET parameter to force a specific network.
Add NCCL_IB_QPS_PER_CONNECTION parameter to split IB traffic onto multiple queue pairs.
Fix topology detection error in WSL2.
Fix proxy memory elements affinity (improve alltoall performance).
Fix graph search on cubemesh topologies.
Fix hang in cubemesh during NVB connections.
[ROCm/rccl commit: 7e51592129 ]
2021-07-08 14:30:14 -07:00
Wenkai Du
71dfc3978e
Use rocm_smi_lib for getting topology information ( #402 )
...
* Use rocm_smi_lib for getting topology information
* Add rocm-smi-lib dependency to RCCL package
[ROCm/rccl commit: 56155ff5b6 ]
2021-07-08 13:23:11 -07:00
Eiden Yoshida
66349efb1d
Fix static builds ( #393 )
...
[ROCm/rccl commit: 5c3e7d8b67 ]
2021-06-23 09:19:48 -06:00