AI/rocm-systems
2
0
Fork 0
Código Incidencias Pull Requests Acciones Paquetes Proyectos Lanzamientos Wiki Actividad
1.728 Commits 3 Ramas 0 Etiquetas
c81ea25407eb4a79ea30e7828e253cdaaedc1ca9
Gráfico de commits

118 Commits

Autor SHA1 Mensaje Fecha
Wenkai Du 011447e4dc Add new Rome model (#536) 
[ROCm/rccl commit: 2151c79d14]
 2022-04-13 11:45:40 -07:00
Wenkai Du f8023f2e07 Add new Rome model (#535) 
[ROCm/rccl commit: ba4c165bf3]
 2022-04-12 13:27:32 -07:00
Wenkai Du 3332cdff07 Support multiple tuning tables (#522) 
* Support multiple tuning tables

* [UnitTests] Skip managed memory testing

[ROCm/rccl commit: bbe780ca6c]
 2022-03-31 17:09:21 -07:00
Wenkai Du db1e628ba3 Update Rome model matching and add new models (#516) 
* Update Rome model matching and add new models

* Add missing file

* Models update

[ROCm/rccl commit: cd17cf6dce]
 2022-03-21 10:54:40 -07:00
Ziyue Yang dfa9b9e958 Add Pivot AllToAll algorithm for Rome model (#503) 
* add a2a pivot interface

* remove debug info

* address comments

* fix bug

* remove custom script

* address comments

* fix bug

[ROCm/rccl commit: b569c0a1db]
 2022-02-20 21:09:47 -08:00
Wenkai Du 4d43d9ce22 Update Rome models (#491) 
[ROCm/rccl commit: 598c6fdded]
 2022-01-14 10:03:30 -08:00
Wenkai Du 02a94fc552 topo_expl: update for 2.11.4 (#490) 
* topo_expl: update for 2.11.4

* topo_expl: revert a few logging changes

[ROCm/rccl commit: 369c021992]
 2022-01-13 13:33:07 -08:00
Wenkai Du 93c7526fdc Add another Rome model (#483) 
[ROCm/rccl commit: f8d0775a6f]
 2022-01-05 09:26:31 -08:00
Wenkai Du fd98ee84b4 Update Rome model matching (#461) 
* Update Rome model matching

* Add another Rome model

* Automatically setup NET GDR level from model

[ROCm/rccl commit: 0331e39f81]
 2021-11-05 08:53:47 -07:00
Wenkai Du 15143b1cfb Query XGMI link count through rocm_smi_lib API (#442) 
[ROCm/rccl commit: 14a184eb67]
 2021-10-26 10:30:20 -07:00
Wenkai Du b587b55c2e Add more Rome models (#434) 
* Add more Rome models

* Update models and tuning

* Update tuning

[ROCm/rccl commit: 2249a1d9d3]
 2021-10-12 08:23:20 -07:00
Wenkai Du d377c4dcc6 Add another Rome model (#431) 
[ROCm/rccl commit: e0053311c0]
 2021-10-06 08:17:12 -07:00
Wenkai Du 91eca0d7d2 Trim NICs when all GPUs are connected by XGMI (#430) 
* Trim NICs when all GPUs are connected by XGMI

* Only enable clique with maximum of 2 hops

[ROCm/rccl commit: 29c729d8b6]
 2021-10-05 18:27:43 -07:00
Wenkai Du 4fd7a14087 Merge remote-tracking branch 'origin/develop' into 2.10.3 
[ROCm/rccl commit: d5f93649ff]
 2021-08-24 09:49:47 -07:00
Wenkai Du b9508a6aba Implement NIC identification and remapping (#420) 
* Add 1H16P GPU model

* Implement NIC identification and remapping

* Revert "Sort IB devices based on device name (#413)"

This reverts commit de0c586bad.

* Fix permute and check order

* Correction on IB speed reporting

* Revert "Allow user to link layer with RCCL_IB_HCA_SKIP_LINK_LAYER (#361)"

This reverts commit fa690c47a0.

[ROCm/rccl commit: 5c8380ff5b]
 2021-08-24 09:42:04 -07:00
Wenkai Du 57518da006 Add gfx908 VM model (#418) 
[ROCm/rccl commit: 5f15ed6e3e]
 2021-08-10 08:55:11 -07:00
Wenkai Du 4b89e98675 Merge remote-tracking branch 'nccl/master' into 2.10.3 
[ROCm/rccl commit: bf2339f93e]
 2021-07-30 16:23:14 -07:00
Wenkai Du faea6ead5c Query XGMI links from xml and adjust gfx906 channel usage (#410) 
[ROCm/rccl commit: 818cdb16a8]
 2021-07-27 17:32:41 -07:00
Wenkai Du 8fbeb14175 topo_expl: fix build after switching to rocm-smi-lib (#405) 
* topo_expl: fix build after switching to rocm-smi-lib

* Use minimal of 4 channels for gfx908

[ROCm/rccl commit: 135d47d125]
 2021-07-27 08:30:08 -07:00
Wenkai Du 90ae176437 Fixes for NCCL_MAX_NCHANNELS and topo_expl (#398) 
[ROCm/rccl commit: fa6d7e9a63]
 2021-06-22 08:41:49 -07:00
Wenkai Du 5bebcb0015 Setup collectives threshold for enabling intranet (#387) 
* Setup collectives threshold for enabling intranet

* Use separate operation counters for coll and p2p

[ROCm/rccl commit: b815a2800f]
 2021-06-09 13:24:26 -07:00
Wenkai Du c8a432dc25 Allow intranode use of network connection (#383) 
* Allow intranode use of network connection

* Checking for graph for null pointer

[ROCm/rccl commit: a3a8c2d56b]
 2021-06-08 07:37:59 -07:00
Wenkai Du 4b31e521e9 Add option to enable multiple SAT in SHARP (#380) 
* Add option to enable multiple SAT in SHARP

* Extend number of NICs to 16

[ROCm/rccl commit: 961922ea02]
 2021-06-03 19:45:18 -07:00
Wenkai Du cdf2780687 topo_expl: update to 2.9.9 
[ROCm/rccl commit: 13dc80ee14]
 2021-05-26 09:24:34 -07:00
Wenkai Du aa95cc6102 Update Rome models matching (#376) 
[ROCm/rccl commit: 4c83adb75c]
 2021-05-25 10:12:40 -07:00
Wenkai Du a76bebf8b6 Merge remote-tracking branch 'nccl/master' into develop 
[ROCm/rccl commit: a4ea1fed5b]
 2021-05-05 16:01:01 -07:00
Wenkai Du 0f4d497edc Add gfx90a target (#344) 
* Add gfx90a target

* Support gfx90a topology

Co-authored-by: Eiden Yoshida <eiden.yoshida@amd.com>

[ROCm/rccl commit: 1fe031402a]
 2021-04-14 09:29:00 -06:00
Wenkai Du b4a7fa7011 Cleanup number of channels calculation (#340) 
[ROCm/rccl commit: e26ad2995e]
 2021-04-05 17:51:56 -07:00
Wenkai Du 8927d8bf17 Fix incorrect net counting (#339) 
* Fix incorrect net counting

* Add comments

[ROCm/rccl commit: 17491c918e]
 2021-04-05 12:21:57 -07:00
Wenkai Du 018a31877c Rework network port trimming code (#338) 
* Rework network port trimming code

* Move Rome related changes to separate source files

[ROCm/rccl commit: 1d2946ee4b]
 2021-03-31 10:25:59 -07:00
Wenkai Du 065bde98d8 collnet: support multiple NICs (#335) 
[ROCm/rccl commit: d87dc7c2e8]
 2021-03-25 20:59:32 -07:00
Wenkai Du 287ed0f18a Enable collnet in RCCL (#333) 
* Enable CollNet and use different number of channels

* topo_expl: enable collnet

[ROCm/rccl commit: 1d6244b18d]
 2021-03-19 12:58:13 -07:00
Wenkai Du b7253710ca Revert "Port alltoall[v]" (#325) 
This reverts commit 2c49121171.

[ROCm/rccl commit: 8e180cf087]
 2021-03-06 13:59:31 -08:00
Wenkai Du bcf4ecb0e3 Enable local sendrecv over network if GDR is available on all GPUs (#324) 
[ROCm/rccl commit: c018edf0f2]
 2021-03-05 19:59:41 -08:00
Wenkai Du 6c3ccc2192 Add support to another Rome model 
[ROCm/rccl commit: 95f178324c]
 2021-02-18 02:00:31 +00:00
Wenkai Du fe8923ebba Add gfx908 Rome 4 NICs model 
[ROCm/rccl commit: 6dfdfef98f]
 2021-02-06 00:19:47 +00:00
Wenkai Du ae5779702a Merge remote-tracking branch 'origin/develop' into 2.8.3 
[ROCm/rccl commit: ab1e7a0318]
 2021-02-04 20:02:34 -05:00
Gilbert Lee 1dfb88f554 [topo_expl] Updating for 2.8.3 
[ROCm/rccl commit: 2f541508c5]
 2021-02-04 19:08:42 +00:00
Wenkai Du d4382de267 Improve collective trace 
[ROCm/rccl commit: 2ddbe6646b]
 2021-01-14 19:28:01 -05:00
Wenkai Du 2c49121171 Port alltoall[v] 
[ROCm/rccl commit: f4d5d3d620]
 2021-01-14 19:28:01 -05:00
Wenkai Du adff98765c Merge remote-tracking branch 'nccl/master' into no-target-id 
[ROCm/rccl commit: d469947641]
 2021-01-14 19:27:53 -05:00
Wenkai Du 4ea285c527 Fix Rome PCIe 2 node topology generation (#310) 
[ROCm/rccl commit: 373a108516]
 2020-12-15 17:16:17 -08:00
Wenkai Du b68ff1ebba Add Rome model and improve search (#305) 
[ROCm/rccl commit: 975b14dffa]
 2020-11-17 14:55:06 -08:00
Wenkai Du c0c64d970a Add more Rome models (#292) 
[ROCm/rccl commit: dfa3c41ede]
 2020-10-30 21:26:04 -07:00
Wenkai Du 8b120c0508 Update Rome single node models (#277) 
[ROCm/rccl commit: 33babcb5e2]
 2020-10-13 13:33:09 -07:00
Wenkai Du 41260bb948 Rework Rome detection and add multiple network ports models (#274) 
* Rework Rome detection and add multiple network ports models

* Remove unused opCount in p2p transport

[ROCm/rccl commit: ae008fd2db]
 2020-10-07 13:37:36 -07:00
Wenkai Du dbde26e681 Add Alltoallv RCCL kernel implementation (#269) 
* Add alltoallv API and implementation

* Extend Rome P2P channel limit to multinode and alltoall kernels

* topo_expl: fix compilation and sync up with main

* gtest: use RCCL alltoallv API

* Code review changes

[ROCm/rccl commit: b871ea3c0c]
 2020-09-30 16:25:36 -07:00
Wenkai Du 03bb6bcb54 Increase minimal channels for gfx908 (#259) 
[ROCm/rccl commit: c5cbece6d0]
 2020-08-26 11:40:11 -07:00
Wenkai Du 5f49a0e088 Add NPS4 support on some models (#256) 
* Add NPS4 support on some models

* Add XML models

[ROCm/rccl commit: 391bbf3f1e]
 2020-08-19 11:03:20 -07:00
Wenkai Du 3d5fb8142e Add another Rome model (#249) 
* Add another Rome model

* Add gfx908 4P3L models and support

* Revert "Use cached value for detecting GDR support only once"

This reverts commit 0108a1219d.

* Skip using ibverb for GPU direct RDMA detection

* Fine tune one Rome model

[ROCm/rccl commit: a51e4071e3]
 2020-08-17 10:51:02 -07:00