f5c0b243a8
Add XGMI sys type and clean up detection code ( #597 )
2022-08-12 09:52:29 -07:00
f6b9686482
Improve alignment and tuning for Pivot A2A algorithm ( #593 )
...
* Improve alignment and tuning for Pivot A2A algorithm
* enable pivot a2a by default
2022-08-05 19:40:19 -07:00
dae11c2aca
Disable clique AllReduce UnitTest ( #595 )
2022-08-04 18:30:00 -06:00
9ed9cd0e31
Fixing CMake to avoid unnecessary git_version relinking ( #594 )
2022-08-04 18:03:59 -06:00
2cb2f9493a
HIP Path default updated to ROCM_PATH (reorg path) ( #592 )
...
Updated default path for hip to ROCM_PATH (/opt/rocm instead of /opt/rocm/hip) as per new/current structure.
2022-08-04 13:38:41 -04:00
4cecdc9be5
minor latency tuning ( #591 )
...
* minor tuning for tree ll
2022-08-03 15:07:44 -06:00
9089e68a99
Revert "Use nontemporal in slow path and add XGMI sys type ( #575 )" ( #590 )
...
This reverts commit b250c01cbe
2022-08-02 09:31:53 -07:00
e2cb95a390
Add nccl_net.h to librccl-dev package ( #589 )
2022-07-29 13:39:49 -07:00
254208e7dd
Fixed issue with attomicEXCH creating errors on multi node runs ( #587 )
2022-07-22 11:32:49 -06:00
686dbc8bc6
updated alltoallV test to reflect how send counts are done in perf tests ( #586 )
2022-07-21 14:59:34 -06:00
451c287aa6
Removing redundant LOAD and STORE on primitives plus adding some atomics ( #585 )
2022-07-21 13:04:57 -06:00
6dd090917a
Merge pull request #580 from hubertlu-tw/develop
...
Enhancement of RCCL logging information for topology-aware utilities
2022-07-15 15:16:37 -07:00
58437544f8
Merge pull request #584 from edgargabriel/topic/signal-backtrace
...
intercept SIGUSR2 in RCCL
2022-07-15 11:31:19 -05:00
2b1d5d3bc1
intercept SIGUSR2 in RCCL
...
add support for intercepting SIGUSR2 in RCCL. This signal will
not terminate the execution of the application, but print the stacktrace
of the process that the signal was sent to instead.
2022-07-15 16:28:46 +00:00
da31537ec7
Merge pull request #583 from yzygitzh/ziyyang/ll-fix
...
Remove redundant LOAD/STORE usage in LL initialization
2022-07-14 08:51:39 -06:00
77c2bef952
Remove redundant LOAD/STORE usage in LL initialization
2022-07-14 00:40:36 +00:00
873c13b47a
Merge pull request #582 from akolliasAMD/readmeUpdate
...
updated readme to reflect the newer tests
2022-07-13 12:28:30 -06:00
5950942738
updated readme to reflect the newer tests
2022-07-13 16:08:28 +00:00
314da5a485
README.md: add CMAKE_PREFIX_PATH to build steps ( #581 )
2022-07-12 11:32:07 -07:00
a1842df858
Enhancement of RCCL logging information for topology-aware utilities
2022-07-11 19:01:10 +00:00
8c3c8b78c0
Skip HDP cache flush for gfx90a ( #578 )
...
* Skip HDP cache flush for gfx90a
* Remove extra debug print
2022-07-08 10:13:32 -07:00
aa0d7ca882
Add more constraints to enable GDR ( #579 )
...
* Add more constraints to enable GDR
* Revert deleted line
2022-07-08 09:52:27 -07:00
80f53cc171
Reduce AlltoAll port usage in send/recv proxy ( #577 )
...
* Reduce AlltoAll port usage when connecting proxy
Reuse socket ports when connecting proxies in AlltoAll.
Existing port usage in AlltoAll is O(n) for recv and O(n) for send,
reusing socket ports in server or client side will make one of them
O(1), reusing both will reduce the total port usage to O(1) and enables
AlltoAll in >64 MI200 nodes.
* Update changelog accordingly
Update changelog accordingly.
2022-07-07 16:15:52 -07:00
2e65881a79
Revert "Adding the missing roc:: namespace ( #570 )" ( #576 )
...
This reverts commit d5bea2cfaa
2022-07-06 10:07:35 -07:00
b250c01cbe
Use nontemporal in slow path and add XGMI sys type ( #575 )
...
* Use nontemporal in slow path and add XGMI sys type
* Clean up XGMI detection
2022-07-06 07:58:41 -07:00
00af1f64e9
Fix GPU to NIC mapping in tree ( #573 )
...
* Fix GPU to NIC mapping in tree
* Update tuning table
2022-07-03 20:52:52 -07:00
a89a9966aa
Adding git hash info to version output line ( #572 )
2022-06-28 16:42:51 -06:00
d5bea2cfaa
Adding the missing roc:: namespace ( #570 )
...
* Adding the missing roc:: namespace, effectively changing the value of RCCL_LIBRARY from rccl to roc::rccl.
The important difference is that rccl is treated as a symbolic "-lrccl" by linker (and fail the linking
due to a missing library search path), while roc::rccl is a target name, which can resolve into an absolute
library path.
Co-authored-by: Paul Fultz II <pfultz2@yahoo.com >
* Adding a changelog entry
* minor updates to wording
* missing period
Co-authored-by: Paul Fultz II <pfultz2@yahoo.com >
Co-authored-by: Saad Rahim <44449863+saadrahim@users.noreply.github.com >
2022-06-27 11:44:43 -06:00
9a285b5e1d
Do not set NET GDR level automatically ( #571 )
2022-06-23 16:28:28 -07:00
c3bb9e70d0
Use different atomics to check flags in kernel ( #568 )
2022-06-23 09:16:41 -07:00
06f05300fe
Merge pull request #569 from akolliasAMD/disableMultiRankTest
...
moved default number of max ranks per gpu to 1
2022-06-22 15:52:06 -04:00
8b9291eb47
moved default number of max ranks per gpu to 1
2022-06-22 17:37:49 +00:00
6e93fafdc3
Add Feature - Add NPKit Support in RCCL ( #564 )
...
* apply npkit
* fix bug
* add npkit in readme
2022-06-20 14:30:19 -07:00
f274c865c1
Change default nchannels per peer ( #563 )
2022-06-13 06:39:05 -07:00
a1fe1adf1c
[CMake] GNU Install Dir Enhancements ( #557 )
...
* sd321110 (GNUInstall Dir) enhancements
2022-06-10 18:51:51 -04:00
45e611dffd
Merge pull request #561 from edgargabriel/multi-rank-devel
...
Multi rank devel
2022-06-10 11:19:20 -05:00
a87d61db2b
extending the unit-tests for multi-rank support
2022-06-10 14:23:19 +00:00
0336ffdf70
Introduce multi-rank support per device.
...
This is a single commit of the source code changes required to
introduce support for multiple ranks per device.
A new interface (ncclCommRankInitMulti) has to be used to make use of
this new feature.
2022-06-10 14:23:12 +00:00
5cb2aca3d9
Fix P2P scheduling ( #560 )
2022-06-06 13:32:28 -07:00
7a6c6927ae
Enable timing profile option ( #558 )
2022-06-03 07:05:13 -07:00
2f9663379d
Merge pull request #556 from akolliasAMD/ROCmSoftwarePlatform/2.12.12
...
Sync up with NCCL 2.12.12
2022-06-02 12:09:49 -04:00
e0864e7093
Merge remote-tracking branch 'ncclRepo/master' into develop
2022-06-02 15:27:24 +00:00
eef812bed7
Revert chunksteps changes ( #555 )
2022-05-31 14:45:51 -07:00
ef499c4810
Add another Rome model ( #553 )
...
* Add another Rome model
* Add option to force enable intranet on single node
* Limit p2p channels to number of ranks
* Refine p2p channels handling
2022-05-31 11:31:30 -07:00
a0a686e74c
code cleanup ( #554 )
2022-05-31 09:59:36 -04:00
c5b77121f0
Update Rome model ( #552 )
2022-05-26 09:59:23 -07:00
98f0809a39
Added creation of new tree and added switch for using treesplit for specific cases ( #551 )
2022-05-25 18:55:14 -04:00
700b473211
Moving opt-in custom signal handler from UnitTests into RCCL ( #550 )
...
* Enable via RCCL_ENABLE_SIGNALHANDLER=1
2022-05-20 09:56:38 -06:00
6707a270b1
Add switch for pivot alltoall kernel ( #549 )
2022-05-17 18:14:04 -07:00
283dc86a73
Refine and add new Rome models ( #548 )
2022-05-17 08:23:59 -07:00
Wenkai Du
Ziyue Yang
gilbertlee-amd
arvindcheru
akolliasAMD
Hubert Lu
Edgar Gabriel
Edgar Gabriel
akolliasAMD
hubertlu-tw
Yifan Xiong
Dmitry Mikushin
Aristotelis