Wenkai Du
123de1621f
Use hipGraph instead of cudaGraph ( #487 )
...
[ROCm/rccl commit: 3669e12432 ]
2022-01-10 08:26:01 -08:00
Wenkai Du
3f16835565
Tune collectives for 2.11.4 ( #486 )
...
[ROCm/rccl commit: 565fbeb5e9 ]
2022-01-10 08:25:47 -08:00
gilbertlee-amd
a6a9ba1b78
[TransferBench] Updating for 2.11.4. Decoupling from RCCL kernel ( #485 )
...
[ROCm/rccl commit: 2530a2f084 ]
2022-01-05 16:33:25 -07:00
Wenkai Du
b5bfb7366a
Unit tests: fix number of GPU detection ( #484 )
...
[ROCm/rccl commit: 6268b87c16 ]
2022-01-05 15:06:12 -08:00
Wenkai Du
e5ff692673
Merge pull request #482 from ROCmSoftwarePlatform/2.11.4
...
Sync up with 2.11.4
[ROCm/rccl commit: 4234a638b5 ]
2022-01-05 09:31:51 -08:00
Wenkai Du
93c7526fdc
Add another Rome model ( #483 )
...
[ROCm/rccl commit: f8d0775a6f ]
2022-01-05 09:26:31 -08:00
Wenkai Du
618fbfc644
Merge remote-tracking branch 'origin/develop' into 2.11.4
...
[ROCm/rccl commit: 434ecb0e1f ]
2022-01-03 09:54:16 -08:00
Stanley Tsang
8d6cfcbf58
Fixing setting of GPUs to 2 when 1 or less GPUs on system for unit tests ( #481 )
...
[ROCm/rccl commit: bbbb35ceec ]
2021-12-09 11:04:31 -07:00
Chang Lan
04f51513a6
Build fastsocket plugin from ext-net
...
[ROCm/rccl commit: c5790b3672 ]
2021-12-09 08:41:05 +01:00
Ke Wen
07d9648aec
Add env NCCL_NET_DISABLE_INTRA
...
Disable NET transport for intra-node communication by setting the env to 1
It provides an option to error out instead of falling back to NET when superior intra-node transports (P2P and SHM) are unavailable
[ROCm/rccl commit: c88c9f873f ]
2021-12-08 16:28:19 +01:00
Wenkai Du
7406aed9c9
Update Rome model ( #479 )
...
[ROCm/rccl commit: a94b953bcc ]
2021-12-03 08:24:51 -08:00
Ke Wen
26c275fe16
Improve warning message about truncated messages
...
Display hints of cause so that it would be easier for user to debug.
Also change the error type from InternalError to InvalidUsage as most
of time this is caused by a mismatch in collective size or env settings.
[ROCm/rccl commit: f589932130 ]
2021-12-02 16:13:15 -08:00
Wenkai Du
dd4a53db37
Update tuning parameters ( #478 )
...
[ROCm/rccl commit: 8a08a2f579 ]
2021-11-30 08:51:11 -08:00
gilbertlee-amd
ef1cbb03d2
[TransferBench] Adding more preset benchmarks to filter read mode, cpu vs gpu pairs ( #477 )
...
[ROCm/rccl commit: 1157c2edfe ]
2021-11-24 18:05:37 -07:00
gilbertlee-amd
2da8358a74
Minor cppcheck fixes, adding suppression file ( #475 )
...
* Minor cppcheck fixes, adding suppression file
[ROCm/rccl commit: 539de1216f ]
2021-11-24 10:23:59 -07:00
Wenkai Du
864c6a645e
Determine fine grained memory availability at RCCL bootstrapping ( #471 )
...
[ROCm/rccl commit: e9bf01fb7e ]
2021-11-19 08:12:53 -08:00
Chris Jones
a52ca36a9e
Perform busIdToInt64 on the stack.
...
I noticed when I enabled `NCCL_DEBUG_SUBSYS=ALLOC` that this function is
called thousands of times, making the log output unintelligible.
Fortunately, this function can be implemented without heap allocations.
[ROCm/rccl commit: 8cf7325d69 ]
2021-11-19 09:35:55 +01:00
Stanley Tsang
5b442ffdc1
Set ROCM_PATH CMake variable in install script ( #470 )
...
* Fixing cmake_install_prefix search to include /opt/rocm-xxxx
* Removing all hard references to /opt/rocm with ROCM_PATH
* Setting ROCM_PATH CMake variable in install script
[ROCm/rccl commit: 7b8b54955b ]
2021-11-18 14:44:19 -07:00
Wenkai Du
a14a57ea71
gtest: dynamically generate tests based on test machine's GPU count ( #467 )
...
* gtest: dynamically generate tests based on test machine's GPU count
* Adjust test element size and bfloat16 threshold for up to 16 GPUs
[ROCm/rccl commit: 03a830293c ]
2021-11-16 10:28:26 -08:00
Stanley Tsang
5bc7a6b858
Remove hardcoded references to /opt/rocm when using chrpath ( #469 )
...
* Fixing cmake_install_prefix search to include /opt/rocm-xxxx
* Removing all hard references to /opt/rocm with ROCM_PATH
[ROCm/rccl commit: a6dba6b9dd ]
2021-11-15 15:00:55 -07:00
Wenkai Du
f8bd2d0cfa
Merge remote-tracking branch 'nccl/master' into develop
...
[ROCm/rccl commit: 3a919c1f49 ]
2021-11-11 14:22:12 -08:00
Wenkai Du
fc5f692f71
Remove extra work element copy ( #465 )
...
[ROCm/rccl commit: e05de8fd26 ]
2021-11-09 13:52:03 -08:00
gilbertlee-amd
096defc1cd
[TransferBench] Adding #CUs / RRLW mode to p2p benchmark ( #464 )
...
[ROCm/rccl commit: 1c7ef1b790 ]
2021-11-08 14:36:04 -07:00
Wenkai Du
65fe26eb82
Unit Test: use range from 0 to 1 for floating point test data ( #459 )
...
* Unit Test: use range from 0 to 1 for floating point test data
* gtest: Update init data and bfloat16 threshold
[ROCm/rccl commit: bc2932be4e ]
2021-11-08 09:21:09 -08:00
Stanley Tsang
bd30ea0dae
Fixing cmake_install_prefix search to include /opt/rocm-xxxx ( #462 )
...
[ROCm/rccl commit: 2f87073514 ]
2021-11-06 07:58:26 -07:00
Wenkai Du
680660fcf7
Do not use async stream for memory allocation and transport setup without graph ( #460 )
...
[ROCm/rccl commit: 33bdd557c8 ]
2021-11-05 13:39:14 -07:00
Wenkai Du
fd98ee84b4
Update Rome model matching ( #461 )
...
* Update Rome model matching
* Add another Rome model
* Automatically setup NET GDR level from model
[ROCm/rccl commit: 0331e39f81 ]
2021-11-05 08:53:47 -07:00
rachanaramanna
709b3dc85b
Update LICENSE.txt ( #450 )
...
[ROCm/rccl commit: 04c10a6025 ]
2021-11-05 09:13:53 -06:00
Wenkai Du
befaa35e12
profiling: fix incorrect print out in timing profile ( #457 )
...
[ROCm/rccl commit: 26fc6b0919 ]
2021-11-03 16:22:21 -07:00
pavahora
93290f6230
Updating googletest to 1.11.0 ( #454 )
...
Co-authored-by: Vahora <pavahora@amd.com >
[ROCm/rccl commit: ee1a11ca7e ]
2021-11-02 15:44:35 -06:00
Wenkai Du
df59f64e3f
Support different protocols and algorithms in all reduce only build ( #455 )
...
* Support different protocols and algorithms in all reduce only build
* Restore deleted line in error
[ROCm/rccl commit: 29170a8b5f ]
2021-11-02 08:39:08 -07:00
Wenkai Du
a11b55a37f
Check rocm_smi64Config.h on older ROCm build ( #452 )
...
[ROCm/rccl commit: 4643a17f83 ]
2021-10-28 07:26:28 -07:00
Wenkai Du
b0b2e27df3
Rework kernel launch code ( #449 )
...
[ROCm/rccl commit: d221fb672a ]
2021-10-28 07:26:11 -07:00
Wenkai Du
747216e2b2
Enable timing profiling mode ( #447 )
...
[ROCm/rccl commit: ec36c4c326 ]
2021-10-27 08:21:48 -07:00
Stanley Tsang
a6feafd5dc
Build AllReduce only mode ( #443 )
...
* Initial commit of all_reduce_only support
* Working AllReduce only build
* Removing printfs and restoring release build
* Restore P2P index
* Updates to build_allreduce_only mode.
* cleaning up macro ifdefs
[ROCm/rccl commit: 7e55b211c5 ]
2021-10-26 17:36:46 -06:00
Wenkai Du
15143b1cfb
Query XGMI link count through rocm_smi_lib API ( #442 )
...
[ROCm/rccl commit: 14a184eb67 ]
2021-10-26 10:30:20 -07:00
Stanley Tsang
0afd607328
Re-enable use of chrpath to manually set rpath for unit tests. ( #448 )
...
* Re-enable use of chrpath to manually set rpath for unit tests.
* Add check for chrpath
[ROCm/rccl commit: d23dfc12c1 ]
2021-10-26 11:10:04 -06:00
gilbertlee-amd
bf024320e4
[TransferBench] Changing default per block multiple to 256B, adding BLOCK_BYTES env var ( #446 )
...
[ROCm/rccl commit: 18246fc191 ]
2021-10-25 11:23:29 -06:00
Saad Rahim
83dc6396a5
Removing unmaintained dockerfiles ( #439 )
...
[ROCm/rccl commit: 31f9e79775 ]
2021-10-22 16:11:23 -06:00
Roopa Malavally
e381d2d830
Update attributions.rst
...
[ROCm/rccl commit: 8486554e4b ]
2021-10-21 21:08:48 -07:00
gilbertlee-amd
b795cc090b
TransferBench p2p benchmark mode ( #444 )
...
* [TransferBench] Adding a p2p benchmark mode
* [TransferBench] Switching to using single sync mode by default (USE_SINGLE_SYNC=1)
[ROCm/rccl commit: 550d732d6c ]
2021-10-21 15:28:16 -06:00
Wenkai Du
aac9d57633
Fix collnet tuning parameters ( #441 )
...
[ROCm/rccl commit: b4cefc05ed ]
2021-10-20 20:45:36 -07:00
Wenkai Du
4d979ce13d
Fix PCIe gen detection ( #437 )
...
* Fix PCIe gen detection
* Update profiling support
[ROCm/rccl commit: 2508507d0a ]
2021-10-15 08:23:50 -07:00
gilbertlee-amd
fe4285d002
[TransferBench] Adding comment echoing to help distinguish tests ( #438 )
...
[ROCm/rccl commit: f6b7ac693e ]
2021-10-13 14:56:57 -06:00
gilbertlee-amd
ad1a620333
[TransferBench] Adding shared memory per threadblock env var. Defaulting to 1 threadblock per CU ( #436 )
...
[ROCm/rccl commit: 269f07fbc3 ]
2021-10-12 09:32:54 -06:00
Wenkai Du
b587b55c2e
Add more Rome models ( #434 )
...
* Add more Rome models
* Update models and tuning
* Update tuning
[ROCm/rccl commit: 2249a1d9d3 ]
2021-10-12 08:23:20 -07:00
gilbertlee-amd
227848b70f
[TransferBench] Adding ability to specify suffix for numBytes ( #435 )
...
[ROCm/rccl commit: aa917c3fc8 ]
2021-10-08 16:36:19 -06:00
gilbertlee-amd
94c60f772d
Updating licensing / attribution for documentation ( #432 )
...
[ROCm/rccl commit: a6368bac99 ]
2021-10-08 13:17:24 -06:00
gilbertlee-amd
fef14c1b73
[TransferBench] Fixing advanced config, adding new all-1-hop sample test ( #433 )
...
* [TransferBench] Fixing advanced config, adding new all-1-hop sample test
[ROCm/rccl commit: e506d14d18 ]
2021-10-07 15:57:21 -06:00
Wenkai Du
d377c4dcc6
Add another Rome model ( #431 )
...
[ROCm/rccl commit: e0053311c0 ]
2021-10-06 08:17:12 -07:00