Wenkai Du
02096c9936
Add another Rome model ( #497 )
2022-02-12 10:30:16 -08:00
Ke Wen
fbfb6ac5d7
Split IB parameter sanity check into two parts
...
First part on collective mismatch, second part on internal errors
2022-02-08 15:21:22 -08:00
gilbertlee-amd
f3c2cafd9d
[TransferBench] Fix for cases with subsets of configured numa nodes ( #495 )
2022-02-07 12:16:19 -07:00
gilbertlee-amd
84d5fce7dd
TransferBench: Adding ability to reindex GPUs based on PCIe address ( #494 )
2022-02-02 08:51:41 -07:00
Sylvain Jeaugey
0144073673
Fix ext-net/google-fastsocket build
2022-01-24 07:19:48 -08:00
Sylvain Jeaugey
cc78e9fab8
Revert "remove unused basePath"
...
This reverts commit 445bc19657 .
2022-01-21 12:30:34 +01:00
void-main
445bc19657
remove unused basePath
2022-01-21 12:12:26 +01:00
Wenkai Du
400df49dbe
Generate proper b-tree with non-repeating channels ( #493 )
2022-01-19 15:09:17 -08:00
Wenkai Du
e94720fe3b
Merge pull request #492 from wenkaidu/develop
...
Sync up with NCCL
2022-01-18 12:55:05 -08:00
Stanley Tsang
b002ef1aaf
Search for GTest 1.11; fix detection of GTest after install ( #476 )
2022-01-17 15:18:01 -07:00
Wenkai Du
973d0111db
Merge remote-tracking branch 'nccl/master' into develop
2022-01-17 13:34:36 -08:00
Roopa Malavally
336ff4fe5f
Add files via upload
2022-01-16 22:19:54 -08:00
Roopa Malavally
f467fb57e8
Delete classification-maptest.xml
2022-01-16 22:19:33 -08:00
Roopa Malavally
62ef66b656
Add files via upload
2022-01-16 08:12:03 -08:00
Roopa Malavally
39cf27222c
Add files via upload
2022-01-16 08:11:40 -08:00
Wenkai Du
598c6fdded
Update Rome models ( #491 )
2022-01-14 10:03:30 -08:00
Wenkai Du
369c021992
topo_expl: update for 2.11.4 ( #490 )
...
* topo_expl: update for 2.11.4
* topo_expl: revert a few logging changes
2022-01-13 13:33:07 -08:00
Wenkai Du
6ff7690cb5
Use noinline and a few other fixes ( #489 )
...
* Use noinline and a few other fixes
* Tune collectives
2022-01-11 16:51:06 -08:00
gilbertlee-amd
7add135529
Updating CHANGELOG.md ( #488 )
2022-01-10 11:34:31 -07:00
Wenkai Du
3669e12432
Use hipGraph instead of cudaGraph ( #487 )
2022-01-10 08:26:01 -08:00
Wenkai Du
565fbeb5e9
Tune collectives for 2.11.4 ( #486 )
2022-01-10 08:25:47 -08:00
gilbertlee-amd
2530a2f084
[TransferBench] Updating for 2.11.4. Decoupling from RCCL kernel ( #485 )
2022-01-05 16:33:25 -07:00
Wenkai Du
6268b87c16
Unit tests: fix number of GPU detection ( #484 )
2022-01-05 15:06:12 -08:00
Wenkai Du
4234a638b5
Merge pull request #482 from ROCmSoftwarePlatform/2.11.4
...
Sync up with 2.11.4
2022-01-05 09:31:51 -08:00
Wenkai Du
f8d0775a6f
Add another Rome model ( #483 )
2022-01-05 09:26:31 -08:00
Wenkai Du
434ecb0e1f
Merge remote-tracking branch 'origin/develop' into 2.11.4
2022-01-03 09:54:16 -08:00
Stanley Tsang
bbbb35ceec
Fixing setting of GPUs to 2 when 1 or less GPUs on system for unit tests ( #481 )
2021-12-09 11:04:31 -07:00
Chang Lan
c5790b3672
Build fastsocket plugin from ext-net
2021-12-09 08:41:05 +01:00
Ke Wen
c88c9f873f
Add env NCCL_NET_DISABLE_INTRA
...
Disable NET transport for intra-node communication by setting the env to 1
It provides an option to error out instead of falling back to NET when superior intra-node transports (P2P and SHM) are unavailable
2021-12-08 16:28:19 +01:00
Wenkai Du
a94b953bcc
Update Rome model ( #479 )
2021-12-03 08:24:51 -08:00
Ke Wen
f589932130
Improve warning message about truncated messages
...
Display hints of cause so that it would be easier for user to debug.
Also change the error type from InternalError to InvalidUsage as most
of time this is caused by a mismatch in collective size or env settings.
2021-12-02 16:13:15 -08:00
Wenkai Du
8a08a2f579
Update tuning parameters ( #478 )
2021-11-30 08:51:11 -08:00
gilbertlee-amd
1157c2edfe
[TransferBench] Adding more preset benchmarks to filter read mode, cpu vs gpu pairs ( #477 )
2021-11-24 18:05:37 -07:00
gilbertlee-amd
539de1216f
Minor cppcheck fixes, adding suppression file ( #475 )
...
* Minor cppcheck fixes, adding suppression file
2021-11-24 10:23:59 -07:00
Wenkai Du
e9bf01fb7e
Determine fine grained memory availability at RCCL bootstrapping ( #471 )
2021-11-19 08:12:53 -08:00
Chris Jones
8cf7325d69
Perform busIdToInt64 on the stack.
...
I noticed when I enabled `NCCL_DEBUG_SUBSYS=ALLOC` that this function is
called thousands of times, making the log output unintelligible.
Fortunately, this function can be implemented without heap allocations.
2021-11-19 09:35:55 +01:00
Stanley Tsang
7b8b54955b
Set ROCM_PATH CMake variable in install script ( #470 )
...
* Fixing cmake_install_prefix search to include /opt/rocm-xxxx
* Removing all hard references to /opt/rocm with ROCM_PATH
* Setting ROCM_PATH CMake variable in install script
2021-11-18 14:44:19 -07:00
Wenkai Du
03a830293c
gtest: dynamically generate tests based on test machine's GPU count ( #467 )
...
* gtest: dynamically generate tests based on test machine's GPU count
* Adjust test element size and bfloat16 threshold for up to 16 GPUs
2021-11-16 10:28:26 -08:00
Stanley Tsang
a6dba6b9dd
Remove hardcoded references to /opt/rocm when using chrpath ( #469 )
...
* Fixing cmake_install_prefix search to include /opt/rocm-xxxx
* Removing all hard references to /opt/rocm with ROCM_PATH
2021-11-15 15:00:55 -07:00
Wenkai Du
3a919c1f49
Merge remote-tracking branch 'nccl/master' into develop
2021-11-11 14:22:12 -08:00
Wenkai Du
e05de8fd26
Remove extra work element copy ( #465 )
2021-11-09 13:52:03 -08:00
gilbertlee-amd
1c7ef1b790
[TransferBench] Adding #CUs / RRLW mode to p2p benchmark ( #464 )
2021-11-08 14:36:04 -07:00
Wenkai Du
bc2932be4e
Unit Test: use range from 0 to 1 for floating point test data ( #459 )
...
* Unit Test: use range from 0 to 1 for floating point test data
* gtest: Update init data and bfloat16 threshold
2021-11-08 09:21:09 -08:00
Stanley Tsang
2f87073514
Fixing cmake_install_prefix search to include /opt/rocm-xxxx ( #462 )
2021-11-06 07:58:26 -07:00
Wenkai Du
33bdd557c8
Do not use async stream for memory allocation and transport setup without graph ( #460 )
2021-11-05 13:39:14 -07:00
Wenkai Du
0331e39f81
Update Rome model matching ( #461 )
...
* Update Rome model matching
* Add another Rome model
* Automatically setup NET GDR level from model
2021-11-05 08:53:47 -07:00
rachanaramanna
04c10a6025
Update LICENSE.txt ( #450 )
2021-11-05 09:13:53 -06:00
Wenkai Du
26fc6b0919
profiling: fix incorrect print out in timing profile ( #457 )
2021-11-03 16:22:21 -07:00
pavahora
ee1a11ca7e
Updating googletest to 1.11.0 ( #454 )
...
Co-authored-by: Vahora <pavahora@amd.com >
2021-11-02 15:44:35 -06:00
Wenkai Du
29170a8b5f
Support different protocols and algorithms in all reduce only build ( #455 )
...
* Support different protocols and algorithms in all reduce only build
* Restore deleted line in error
2021-11-02 08:39:08 -07:00