7148c0aa7b
add binary tree
...
In addition, introduce the ability to have 2 trees at the same time.
Only for allreduce at the moment.
[ROCm/rccl commit: 65e2ae20e5
2022-09-13 20:52:32 +00:00
fe99249cde
Enable LL128 protocol support ( #605 )
...
* Enable LL128 protocol support
* Use shared memory object directly when possible
[ROCm/rccl commit: 7bbce085cc
2022-09-08 14:45:27 -07:00
1d55fe756c
Simple tree changes ( #599 )
...
changed treebase to create basic balanced tree
[ROCm/rccl commit: 3c1b1ec8c8
2022-08-19 13:51:49 -06:00
6c3f1366e8
Add XGMI sys type and clean up detection code ( #597 )
...
[ROCm/rccl commit: f5c0b243a8
2022-08-12 09:52:29 -07:00
f70830d629
Revert "Use nontemporal in slow path and add XGMI sys type ( #575 )" ( #590 )
...
This reverts commit e04bba619a9089e68a99
2022-08-02 09:31:53 -07:00
659cd52d5c
Add more constraints to enable GDR ( #579 )
...
* Add more constraints to enable GDR
* Revert deleted line
[ROCm/rccl commit: aa0d7ca882
2022-07-08 09:52:27 -07:00
e04bba619a
Use nontemporal in slow path and add XGMI sys type ( #575 )
...
* Use nontemporal in slow path and add XGMI sys type
* Clean up XGMI detection
[ROCm/rccl commit: b250c01cbe
2022-07-06 07:58:41 -07:00
2f4aea93e0
Fix GPU to NIC mapping in tree ( #573 )
...
* Fix GPU to NIC mapping in tree
* Update tuning table
[ROCm/rccl commit: 00af1f64e9
2022-07-03 20:52:52 -07:00
915a9d3934
Do not set NET GDR level automatically ( #571 )
...
[ROCm/rccl commit: 9a285b5e1d
2022-06-23 16:28:28 -07:00
0fb000932f
Change default nchannels per peer ( #563 )
...
[ROCm/rccl commit: f274c865c1
2022-06-13 06:39:05 -07:00
8953f5b5ca
Introduce multi-rank support per device.
...
This is a single commit of the source code changes required to
introduce support for multiple ranks per device.
A new interface (ncclCommRankInitMulti) has to be used to make use of
this new feature.
[ROCm/rccl commit: 0336ffdf70
2022-06-10 14:23:12 +00:00
0b55e01ef3
Merge remote-tracking branch 'ncclRepo/master' into develop
...
[ROCm/rccl commit: e0864e7093
2022-06-02 15:27:24 +00:00
5becf1669f
Add another Rome model ( #553 )
...
* Add another Rome model
* Add option to force enable intranet on single node
* Limit p2p channels to number of ranks
* Refine p2p channels handling
[ROCm/rccl commit: ef499c4810
2022-05-31 11:31:30 -07:00
a03ab8e752
code cleanup ( #554 )
...
[ROCm/rccl commit: a0a686e74c
2022-05-31 09:59:36 -04:00
2c125ce6ed
Update Rome model ( #552 )
...
[ROCm/rccl commit: c5b77121f0
2022-05-26 09:59:23 -07:00
22dc8bd246
Added creation of new tree and added switch for using treesplit for specific cases ( #551 )
...
[ROCm/rccl commit: 98f0809a39
2022-05-25 18:55:14 -04:00
b30b8becea
Refine and add new Rome models ( #548 )
...
[ROCm/rccl commit: 283dc86a73
2022-05-17 08:23:59 -07:00
1c5734046d
2.12.12-1
...
Improve allreduce performance when we have more than one network interface per
GPU and we need to use PXN to close rings.
Add support for PCI Gen5 on 5.4 kernels.
Fix crash when setting NCCL_SET_THREAD_NAME.
Fix random crash in init due to uninitialized struct.
Fix hang on cubemesh topologies.
Add P2P_DIRECT_DISABLE parameter to disable direct access to pointers within a
process.
[ROCm/rccl commit: 7aa1c46fd5
2022-05-13 00:26:57 -07:00
347ea354c2
Update tuning parameters
...
[ROCm/rccl commit: 83fd4f70e7
2022-04-18 16:04:04 -07:00
67e7e6507e
Merge remote-tracking branch 'nccl/master' into develop
...
[ROCm/rccl commit: d28e1cb44f
2022-04-18 11:15:25 -07:00
58b2c1ec9c
Fix random segfault ( #537 )
...
[ROCm/rccl commit: fd2f1b3b88
2022-04-15 14:32:11 -07:00
011447e4dc
Add new Rome model ( #536 )
...
[ROCm/rccl commit: 2151c79d14
2022-04-13 11:45:40 -07:00
f8023f2e07
Add new Rome model ( #535 )
...
[ROCm/rccl commit: ba4c165bf3
2022-04-12 13:27:32 -07:00
9884e61367
Add tuning model ( #523 )
...
[ROCm/rccl commit: 5cc0a405c0
2022-04-04 10:19:57 -07:00
3332cdff07
Support multiple tuning tables ( #522 )
...
* Support multiple tuning tables
* [UnitTests] Skip managed memory testing
[ROCm/rccl commit: bbe780ca6c
2022-03-31 17:09:21 -07:00
828f3d11a0
Update tuning parameters ( #518 )
...
* Update tuning parameters
* Respect user algo and topo selections
[ROCm/rccl commit: 7cbbca4da1
2022-03-29 08:15:37 -07:00
db1e628ba3
Update Rome model matching and add new models ( #516 )
...
* Update Rome model matching and add new models
* Add missing file
* Models update
[ROCm/rccl commit: cd17cf6dce
2022-03-21 10:54:40 -07:00
133aed2dfb
Force ring algorithm on single node ( #509 )
...
[ROCm/rccl commit: d6d6af710e
2022-03-04 10:29:02 -08:00
f8886d8687
2.12.7-1
...
Add network communication through another GPU connected with NVLink
(PXN).
Add aggregation of messages coming from different local GPUs through
PXN and going to the same destination.
Add new v5 plugin API with grouped receives and tags.
Add compat for v4 plugins.
Add naming of NCCL threads to help debugging.
Fix NVLink detection and avoid data corruption when some NVLinks are
down.
Add support for Relaxed Ordering for IB.
Add profiling and timing infrastructure.
[ROCm/rccl commit: 3c223c105a
2022-03-02 20:48:56 +01:00
dfa9b9e958
Add Pivot AllToAll algorithm for Rome model ( #503 )
...
* add a2a pivot interface
* remove debug info
* address comments
* fix bug
* remove custom script
* address comments
* fix bug
[ROCm/rccl commit: b569c0a1db
2022-02-20 21:09:47 -08:00
0f0388ba0b
Allow additional options to be passed in through model's definition ( #501 )
...
[ROCm/rccl commit: 94e0dc8bfd
2022-02-17 08:28:58 -08:00
5b697e40db
Add another Rome model ( #497 )
...
[ROCm/rccl commit: 02096c9936
2022-02-12 10:30:16 -08:00
51df47f9b8
Revert "remove unused basePath"
...
This reverts commit d973ddac8bcc78e9fab8
2022-01-21 12:30:34 +01:00
d973ddac8b
remove unused basePath
...
[ROCm/rccl commit: 445bc19657
2022-01-21 12:12:26 +01:00
635c0bcc01
Generate proper b-tree with non-repeating channels ( #493 )
...
[ROCm/rccl commit: 400df49dbe
2022-01-19 15:09:17 -08:00
4d43d9ce22
Update Rome models ( #491 )
...
[ROCm/rccl commit: 598c6fdded
2022-01-14 10:03:30 -08:00
e5ff692673
Merge pull request #482 from ROCmSoftwarePlatform/2.11.4
...
Sync up with 2.11.4
[ROCm/rccl commit: 4234a638b5
2022-01-05 09:31:51 -08:00
93c7526fdc
Add another Rome model ( #483 )
...
[ROCm/rccl commit: f8d0775a6f
2022-01-05 09:26:31 -08:00
618fbfc644
Merge remote-tracking branch 'origin/develop' into 2.11.4
...
[ROCm/rccl commit: 434ecb0e1f
2022-01-03 09:54:16 -08:00
7406aed9c9
Update Rome model ( #479 )
...
[ROCm/rccl commit: a94b953bcc
2021-12-03 08:24:51 -08:00
dd4a53db37
Update tuning parameters ( #478 )
...
[ROCm/rccl commit: 8a08a2f579
2021-11-30 08:51:11 -08:00
f8bd2d0cfa
Merge remote-tracking branch 'nccl/master' into develop
...
[ROCm/rccl commit: 3a919c1f49
2021-11-11 14:22:12 -08:00
fd98ee84b4
Update Rome model matching ( #461 )
...
* Update Rome model matching
* Add another Rome model
* Automatically setup NET GDR level from model
[ROCm/rccl commit: 0331e39f81
2021-11-05 08:53:47 -07:00
15143b1cfb
Query XGMI link count through rocm_smi_lib API ( #442 )
...
[ROCm/rccl commit: 14a184eb67
2021-10-26 10:30:20 -07:00
aac9d57633
Fix collnet tuning parameters ( #441 )
...
[ROCm/rccl commit: b4cefc05ed
2021-10-20 20:45:36 -07:00
4d979ce13d
Fix PCIe gen detection ( #437 )
...
* Fix PCIe gen detection
* Update profiling support
[ROCm/rccl commit: 2508507d0a
2021-10-15 08:23:50 -07:00
b587b55c2e
Add more Rome models ( #434 )
...
* Add more Rome models
* Update models and tuning
* Update tuning
[ROCm/rccl commit: 2249a1d9d3
2021-10-12 08:23:20 -07:00
d377c4dcc6
Add another Rome model ( #431 )
...
[ROCm/rccl commit: e0053311c0
2021-10-06 08:17:12 -07:00
91eca0d7d2
Trim NICs when all GPUs are connected by XGMI ( #430 )
...
* Trim NICs when all GPUs are connected by XGMI
* Only enable clique with maximum of 2 hops
[ROCm/rccl commit: 29c729d8b6
2021-10-05 18:27:43 -07:00
e51f2a83da
2.11.4-1
...
Add new API for creating a reduction operation which multiplies the input by a rank-specific scalar before doing an inter-rank summation (see: ncclRedOpCreatePreMulSum).
Improve CollNet (SHARP) performance of ncclAllReduce when captured in a CUDA Graph via user buffer registration.
Add environment variable NCCL_NET_PLUGIN="<suffix>" to allow user to choose among multiple NCCL net plugins by substituting into "libnccl-net-<suffix>.so".
Fix memory leak of NVB connections.
Fix topology detection of IB Virtual Functions (SR-IOV).
[ROCm/rccl commit: e11238b302
2021-09-08 16:06:23 -07:00
Edgar Gabriel
Wenkai Du
akolliasAMD
Aristotelis
Sylvain Jeaugey
Wenkai Du
Ziyue Yang
void-main
Ke Wen