AI/rocm-systems
2
0
Rozštěpit 0
Zdrojový kód Úkoly Pull requesty Akce Balíčky Projekty Vydání Wiki Aktivita
717 Commity 3 Větve 0 Značky
f8bd2d0cfa061ceae0e9bca829078f8ffe0feb2e
Graf commitů

717 Commity

Tato větev
Tato větev
Všechny větve
Autor SHA1 Zpráva Datum
Wenkai Du f8bd2d0cfa Merge remote-tracking branch 'nccl/master' into develop 
[ROCm/rccl commit: 3a919c1f49]
 2021-11-11 14:22:12 -08:00
Wenkai Du fc5f692f71 Remove extra work element copy (#465) 
[ROCm/rccl commit: e05de8fd26]
 2021-11-09 13:52:03 -08:00
gilbertlee-amd 096defc1cd [TransferBench] Adding #CUs / RRLW mode to p2p benchmark (#464) 
[ROCm/rccl commit: 1c7ef1b790]
 2021-11-08 14:36:04 -07:00
Wenkai Du 65fe26eb82 Unit Test: use range from 0 to 1 for floating point test data (#459) 
* Unit Test: use range from 0 to 1 for floating point test data

* gtest: Update init data and bfloat16 threshold

[ROCm/rccl commit: bc2932be4e]
 2021-11-08 09:21:09 -08:00
Stanley Tsang bd30ea0dae Fixing cmake_install_prefix search to include /opt/rocm-xxxx (#462) 
[ROCm/rccl commit: 2f87073514]
 2021-11-06 07:58:26 -07:00
Wenkai Du 680660fcf7 Do not use async stream for memory allocation and transport setup without graph (#460) 
[ROCm/rccl commit: 33bdd557c8]
 2021-11-05 13:39:14 -07:00
Wenkai Du fd98ee84b4 Update Rome model matching (#461) 
* Update Rome model matching

* Add another Rome model

* Automatically setup NET GDR level from model

[ROCm/rccl commit: 0331e39f81]
 2021-11-05 08:53:47 -07:00
rachanaramanna 709b3dc85b Update LICENSE.txt (#450) 
[ROCm/rccl commit: 04c10a6025]
 2021-11-05 09:13:53 -06:00
Wenkai Du befaa35e12 profiling: fix incorrect print out in timing profile (#457) 
[ROCm/rccl commit: 26fc6b0919]
 2021-11-03 16:22:21 -07:00
pavahora 93290f6230 Updating googletest to 1.11.0 (#454) 
Co-authored-by: Vahora <pavahora@amd.com>

[ROCm/rccl commit: ee1a11ca7e]
 2021-11-02 15:44:35 -06:00
Wenkai Du df59f64e3f Support different protocols and algorithms in all reduce only build (#455) 
* Support different protocols and algorithms in all reduce only build

* Restore deleted line in error

[ROCm/rccl commit: 29170a8b5f]
 2021-11-02 08:39:08 -07:00
Wenkai Du a11b55a37f Check rocm_smi64Config.h on older ROCm build (#452) 
[ROCm/rccl commit: 4643a17f83]
 2021-10-28 07:26:28 -07:00
Wenkai Du b0b2e27df3 Rework kernel launch code (#449) 
[ROCm/rccl commit: d221fb672a]
 2021-10-28 07:26:11 -07:00
Wenkai Du 747216e2b2 Enable timing profiling mode (#447) 
[ROCm/rccl commit: ec36c4c326]
 2021-10-27 08:21:48 -07:00
Stanley Tsang a6feafd5dc Build AllReduce only mode (#443) 
* Initial commit of all_reduce_only support

* Working AllReduce only build

* Removing printfs and restoring release build

* Restore P2P index

* Updates to build_allreduce_only mode.

* cleaning up macro ifdefs

[ROCm/rccl commit: 7e55b211c5]
 2021-10-26 17:36:46 -06:00
Wenkai Du 15143b1cfb Query XGMI link count through rocm_smi_lib API (#442) 
[ROCm/rccl commit: 14a184eb67]
 2021-10-26 10:30:20 -07:00
Stanley Tsang 0afd607328 Re-enable use of chrpath to manually set rpath for unit tests. (#448) 
* Re-enable use of chrpath to manually set rpath for unit tests.

* Add check for chrpath

[ROCm/rccl commit: d23dfc12c1]
 2021-10-26 11:10:04 -06:00
gilbertlee-amd bf024320e4 [TransferBench] Changing default per block multiple to 256B, adding BLOCK_BYTES env var (#446) 
[ROCm/rccl commit: 18246fc191]
 2021-10-25 11:23:29 -06:00
Saad Rahim 83dc6396a5 Removing unmaintained dockerfiles (#439) 
[ROCm/rccl commit: 31f9e79775]
 2021-10-22 16:11:23 -06:00
Roopa Malavally e381d2d830 Update attributions.rst 
[ROCm/rccl commit: 8486554e4b]
 2021-10-21 21:08:48 -07:00
gilbertlee-amd b795cc090b TransferBench p2p benchmark mode (#444) 
* [TransferBench] Adding a p2p benchmark mode
* [TransferBench] Switching to using single sync mode by default (USE_SINGLE_SYNC=1)

[ROCm/rccl commit: 550d732d6c]
 2021-10-21 15:28:16 -06:00
Wenkai Du aac9d57633 Fix collnet tuning parameters (#441) 
[ROCm/rccl commit: b4cefc05ed]
 2021-10-20 20:45:36 -07:00
Wenkai Du 4d979ce13d Fix PCIe gen detection (#437) 
* Fix PCIe gen detection

* Update profiling support

[ROCm/rccl commit: 2508507d0a]
 2021-10-15 08:23:50 -07:00
gilbertlee-amd fe4285d002 [TransferBench] Adding comment echoing to help distinguish tests (#438) 
[ROCm/rccl commit: f6b7ac693e]
 2021-10-13 14:56:57 -06:00
gilbertlee-amd ad1a620333 [TransferBench] Adding shared memory per threadblock env var. Defaulting to 1 threadblock per CU (#436) 
[ROCm/rccl commit: 269f07fbc3]
 2021-10-12 09:32:54 -06:00
Wenkai Du b587b55c2e Add more Rome models (#434) 
* Add more Rome models

* Update models and tuning

* Update tuning

[ROCm/rccl commit: 2249a1d9d3]
 2021-10-12 08:23:20 -07:00
gilbertlee-amd 227848b70f [TransferBench] Adding ability to specify suffix for numBytes (#435) 
[ROCm/rccl commit: aa917c3fc8]
 2021-10-08 16:36:19 -06:00
gilbertlee-amd 94c60f772d Updating licensing / attribution for documentation (#432) 
[ROCm/rccl commit: a6368bac99]
 2021-10-08 13:17:24 -06:00
gilbertlee-amd fef14c1b73 [TransferBench] Fixing advanced config, adding new all-1-hop sample test (#433) 
* [TransferBench] Fixing advanced config, adding new all-1-hop sample test

[ROCm/rccl commit: e506d14d18]
 2021-10-07 15:57:21 -06:00
Wenkai Du d377c4dcc6 Add another Rome model (#431) 
[ROCm/rccl commit: e0053311c0]
 2021-10-06 08:17:12 -07:00
Wenkai Du 91eca0d7d2 Trim NICs when all GPUs are connected by XGMI (#430) 
* Trim NICs when all GPUs are connected by XGMI

* Only enable clique with maximum of 2 hops

[ROCm/rccl commit: 29c729d8b6]
 2021-10-05 18:27:43 -07:00
John Bachan 389213c7e8 Fix compilation failure in "src/enqueue.cc" on older GCC because of 
missing `#include <cstring>`.


[ROCm/rccl commit: 30ca3fcacf]
 2021-09-23 09:55:16 -07:00
Sylvain Jeaugey 761812841b Fix Collnet when GDR is disabled 
[ROCm/rccl commit: 4ec992fab7]
 2021-09-22 05:19:16 -07:00
Wenkai Du 55fa23a613 Merge pull request #428 from ROCmSoftwarePlatform/2.10.3 
Sync up with NCCL 2.10.3

[ROCm/rccl commit: 51a1cf428e]
 2021-09-17 08:23:43 -07:00
Wenkai Du 1eaf495391 Remove extra L1 cache invalidate and restore __ATOMIC_SEQ_CST atomics (#426) 
[ROCm/rccl commit: 5ae3f3f954]
 2021-09-14 18:30:16 -07:00
Wenkai Du f4387b2954 Use relaxed atomics and add sleep and wakeup in barrier loop (#425) 
* Use relaxed atomics and add sleep and wakeup in barrier loop

* atomicAdd in ROCm 4.3 only support unsigned long long

* Switch to atomicAdd and atomicExch in more places

* Restore LOAD/STORE define to __ATOMIC_SEQ_CST

* Restore atomic for sizes FIFO

[ROCm/rccl commit: 020484bf40]
 2021-09-13 17:03:49 -07:00
Wenkai Du 9ffeb41fe1 Update tuning table (#424) 
[ROCm/rccl commit: ef432e48e1]
 2021-09-13 08:39:01 -07:00
Wenkai Du 934885526d Merge pull request #423 from wenkaidu/prim-test 
rccl-prim-test: support 8p1h and 16p1h testing

[ROCm/rccl commit: a2421f8b4a]
 2021-09-08 17:01:19 -07:00
Ke Wen e51f2a83da 2.11.4-1 
Add new API for creating a reduction operation which multiplies the input by a rank-specific scalar before doing an inter-rank summation (see: ncclRedOpCreatePreMulSum).
Improve CollNet (SHARP) performance of ncclAllReduce when captured in a CUDA Graph via user buffer registration.
Add environment variable NCCL_NET_PLUGIN="<suffix>" to allow user to choose among multiple NCCL net plugins by substituting into "libnccl-net-<suffix>.so".
Fix memory leak of NVB connections.
Fix topology detection of IB Virtual Functions (SR-IOV).


[ROCm/rccl commit: e11238b302]
 2021-09-08 16:06:23 -07:00
Wenkai Du d2580c8cf5 Improve barrier implementation 
[ROCm/rccl commit: adb8d63352]
 2021-09-08 16:14:32 -05:00
Wenkai Du d75504e9dc Remove atomic from profiling 
[ROCm/rccl commit: 31bd4236f1]
 2021-09-08 14:20:32 -05:00
Wenkai Du 310d51056f rccl-prim-test: enable 8p1h and 16p1h test 
[ROCm/rccl commit: 7558b5e2bf]
 2021-09-08 11:51:26 -05:00
Wenkai Du 4f610a2239 Revert "rccl-prim-test: add all-to-all benchmark (#185)" 
This reverts commit e3e1c6b29c.


[ROCm/rccl commit: b22d097524]
 2021-09-07 16:41:46 -05:00
gilbertlee-amd 06b0e1c4e2 [TransferBench] ConfigFile parsing fixes, adding additional info (#422) 
* [TransferBench] Adding GPU to NUMA distance detection, parsing fixes, config file generation fix

* [TransferBench] Fixing up NUMA node detection by filtering pools

[ROCm/rccl commit: 51d64894ff]
 2021-09-07 15:28:16 -06:00
John Bachan 04553b802a Fix to https://github.com/NVIDIA/nccl/issues/560 
ncclGroup's containing operations of mixed datatype, element, or collective
would induce crash.


[ROCm/rccl commit: 5f2f2f670f]
 2021-08-31 15:50:05 -07:00
Wenkai Du b9508a6aba Implement NIC identification and remapping (#420) 
* Add 1H16P GPU model

* Implement NIC identification and remapping

* Revert "Sort IB devices based on device name (#413)"

This reverts commit de0c586bad.

* Fix permute and check order

* Correction on IB speed reporting

* Revert "Allow user to link layer with RCCL_IB_HCA_SKIP_LINK_LAYER (#361)"

This reverts commit fa690c47a0.

[ROCm/rccl commit: 5c8380ff5b]
 2021-08-24 09:42:04 -07:00
Wenkai Du 57518da006 Add gfx908 VM model (#418) 
[ROCm/rccl commit: 5f15ed6e3e]
 2021-08-10 08:55:11 -07:00
gilbertlee-amd b0c3a1790f [TransferBench] Removing dependency on hip_fp16 header, fixing swapped output CSV header (#416) 
[ROCm/rccl commit: 1ed272e5f0]
 2021-08-04 10:53:41 -06:00
Wenkai Du de0c586bad Sort IB devices based on device name (#413) 
[ROCm/rccl commit: 2d0ed8dff6]
 2021-08-03 15:32:41 -07:00
Gilbert Lee 5be5b37e19 [TransferBench] Update to 2.10.3 
[ROCm/rccl commit: 68ec3f84e6]
 2021-08-02 05:53:20 -05:00