AI/rocm-systems
2
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
663 Commits 3 Branches 0 Tags
9ffeb41fe18faefdeb72e75ce701586113269521
Commit Graph

124 Commits

Author SHA1 Message Date
Wenkai Du 934885526d Merge pull request #423 from wenkaidu/prim-test 
rccl-prim-test: support 8p1h and 16p1h testing

[ROCm/rccl commit: a2421f8b4a]
 2021-09-08 17:01:19 -07:00
Wenkai Du 310d51056f rccl-prim-test: enable 8p1h and 16p1h test 
[ROCm/rccl commit: 7558b5e2bf]
 2021-09-08 11:51:26 -05:00
Wenkai Du 4f610a2239 Revert "rccl-prim-test: add all-to-all benchmark (#185)" 
This reverts commit e3e1c6b29c.


[ROCm/rccl commit: b22d097524]
 2021-09-07 16:41:46 -05:00
gilbertlee-amd 06b0e1c4e2 [TransferBench] ConfigFile parsing fixes, adding additional info (#422) 
* [TransferBench] Adding GPU to NUMA distance detection, parsing fixes, config file generation fix

* [TransferBench] Fixing up NUMA node detection by filtering pools

[ROCm/rccl commit: 51d64894ff]
 2021-09-07 15:28:16 -06:00
Wenkai Du b9508a6aba Implement NIC identification and remapping (#420) 
* Add 1H16P GPU model

* Implement NIC identification and remapping

* Revert "Sort IB devices based on device name (#413)"

This reverts commit de0c586bad.

* Fix permute and check order

* Correction on IB speed reporting

* Revert "Allow user to link layer with RCCL_IB_HCA_SKIP_LINK_LAYER (#361)"

This reverts commit fa690c47a0.

[ROCm/rccl commit: 5c8380ff5b]
 2021-08-24 09:42:04 -07:00
Wenkai Du 57518da006 Add gfx908 VM model (#418) 
[ROCm/rccl commit: 5f15ed6e3e]
 2021-08-10 08:55:11 -07:00
gilbertlee-amd b0c3a1790f [TransferBench] Removing dependency on hip_fp16 header, fixing swapped output CSV header (#416) 
[ROCm/rccl commit: 1ed272e5f0]
 2021-08-04 10:53:41 -06:00
Wenkai Du faea6ead5c Query XGMI links from xml and adjust gfx906 channel usage (#410) 
[ROCm/rccl commit: 818cdb16a8]
 2021-07-27 17:32:41 -07:00
Wenkai Du 8fbeb14175 topo_expl: fix build after switching to rocm-smi-lib (#405) 
* topo_expl: fix build after switching to rocm-smi-lib

* Use minimal of 4 channels for gfx908

[ROCm/rccl commit: 135d47d125]
 2021-07-27 08:30:08 -07:00
gilbertlee-amd f2a72b1e0b [TransferBench] Fixing a typo in TransferBench usage example (#401) 
[ROCm/rccl commit: 2b0b608270]
 2021-06-22 17:08:57 -06:00
Wenkai Du 90ae176437 Fixes for NCCL_MAX_NCHANNELS and topo_expl (#398) 
[ROCm/rccl commit: fa6d7e9a63]
 2021-06-22 08:41:49 -07:00
gilbertlee-amd 0a636f20a3 [TransferBench] Switching from little-endian fill pattern to big-endian (#399) 
[ROCm/rccl commit: 720374a767]
 2021-06-21 14:28:51 -06:00
gilbertlee-amd 01a8efbb76 [TransferBench] Adding ability to specify source data pattern (#394) 
* [TransferBench] Adding ability to specify source data pattern

[ROCm/rccl commit: ff413be933]
 2021-06-15 08:41:57 -06:00
Wenkai Du 5bebcb0015 Setup collectives threshold for enabling intranet (#387) 
* Setup collectives threshold for enabling intranet

* Use separate operation counters for coll and p2p

[ROCm/rccl commit: b815a2800f]
 2021-06-09 13:24:26 -07:00
Wenkai Du c8a432dc25 Allow intranode use of network connection (#383) 
* Allow intranode use of network connection

* Checking for graph for null pointer

[ROCm/rccl commit: a3a8c2d56b]
 2021-06-08 07:37:59 -07:00
Wenkai Du 4b31e521e9 Add option to enable multiple SAT in SHARP (#380) 
* Add option to enable multiple SAT in SHARP

* Extend number of NICs to 16

[ROCm/rccl commit: 961922ea02]
 2021-06-03 19:45:18 -07:00
Wenkai Du cdf2780687 topo_expl: update to 2.9.9 
[ROCm/rccl commit: 13dc80ee14]
 2021-05-26 09:24:34 -07:00
Wenkai Du aa95cc6102 Update Rome models matching (#376) 
[ROCm/rccl commit: 4c83adb75c]
 2021-05-25 10:12:40 -07:00
Wenkai Du a76bebf8b6 Merge remote-tracking branch 'nccl/master' into develop 
[ROCm/rccl commit: a4ea1fed5b]
 2021-05-05 16:01:01 -07:00
Wenkai Du 661b1351a3 Limit max channels for ring graph on single node Rome (#347) 
* Limit max channels for ring graph on single node Rome
* Partially revert "Use non-temporal access for streaming data (#341)"

[ROCm/rccl commit: a79f74082e]
 2021-04-14 10:14:54 -07:00
Wenkai Du 0f4d497edc Add gfx90a target (#344) 
* Add gfx90a target

* Support gfx90a topology

Co-authored-by: Eiden Yoshida <eiden.yoshida@amd.com>

[ROCm/rccl commit: 1fe031402a]
 2021-04-14 09:29:00 -06:00
Wenkai Du 6b3389b790 Use non-temporal access for streaming data (#341) 
* Use non-temporal access for streaming data

* Revert to ulong2 after fixing compiling issue

[ROCm/rccl commit: 9dfc2c183e]
 2021-04-07 17:34:35 -07:00
Wenkai Du b4a7fa7011 Cleanup number of channels calculation (#340) 
[ROCm/rccl commit: e26ad2995e]
 2021-04-05 17:51:56 -07:00
Wenkai Du 8927d8bf17 Fix incorrect net counting (#339) 
* Fix incorrect net counting

* Add comments

[ROCm/rccl commit: 17491c918e]
 2021-04-05 12:21:57 -07:00
Wenkai Du 018a31877c Rework network port trimming code (#338) 
* Rework network port trimming code

* Move Rome related changes to separate source files

[ROCm/rccl commit: 1d2946ee4b]
 2021-03-31 10:25:59 -07:00
Wenkai Du 065bde98d8 collnet: support multiple NICs (#335) 
[ROCm/rccl commit: d87dc7c2e8]
 2021-03-25 20:59:32 -07:00
Wenkai Du 287ed0f18a Enable collnet in RCCL (#333) 
* Enable CollNet and use different number of channels

* topo_expl: enable collnet

[ROCm/rccl commit: 1d6244b18d]
 2021-03-19 12:58:13 -07:00
Wenkai Du b7253710ca Revert "Port alltoall[v]" (#325) 
This reverts commit 2c49121171.

[ROCm/rccl commit: 8e180cf087]
 2021-03-06 13:59:31 -08:00
Wenkai Du bcf4ecb0e3 Enable local sendrecv over network if GDR is available on all GPUs (#324) 
[ROCm/rccl commit: c018edf0f2]
 2021-03-05 19:59:41 -08:00
Wenkai Du 6c3ccc2192 Add support to another Rome model 
[ROCm/rccl commit: 95f178324c]
 2021-02-18 02:00:31 +00:00
Wenkai Du fe8923ebba Add gfx908 Rome 4 NICs model 
[ROCm/rccl commit: 6dfdfef98f]
 2021-02-06 00:19:47 +00:00
Gilbert Lee b954d85935 [TransferBench] Fixing some merge issues 
[ROCm/rccl commit: f372c53d52]
 2021-02-05 16:46:20 +00:00
Wenkai Du ae5779702a Merge remote-tracking branch 'origin/develop' into 2.8.3 
[ROCm/rccl commit: ab1e7a0318]
 2021-02-04 20:02:34 -05:00
Gilbert Lee 1dfb88f554 [topo_expl] Updating for 2.8.3 
[ROCm/rccl commit: 2f541508c5]
 2021-02-04 19:08:42 +00:00
Gilbert Lee f2d07cb9a6 [ib-test] Update for 2.8.3] 
[ROCm/rccl commit: 9aac1ed38f]
 2021-02-04 19:05:03 +00:00
Gilbert Lee 1643d05c75 [TransferBench] Updating for 2.8.3 
[ROCm/rccl commit: 9ce203dd0a]
 2021-02-04 18:58:25 +00:00
gilbertlee-amd 60c74f63fa [TransferBench] Restore some previous fixes - memory leak, PCIe address (#314) 
[ROCm/rccl commit: 62e0447e9a]
 2021-02-01 09:48:09 -07:00
gilbertlee-amd c981e76efe Clique kernel support (#295) (#15) 
* Adding experimental clique-based kernels (opt-in only)

Co-authored-by: Stanley Tsang <stanley.tsang@amd.com>
Co-authored-by: Gilbert Lee <gilbert.lee@amd.com>
Co-authored-by: Wenkai Du <43822138+wenkaidu@users.noreply.github.com>

Co-authored-by: Stanley Tsang <stanley.tsang@amd.com>
Co-authored-by: Wenkai Du <43822138+wenkaidu@users.noreply.github.com>

[ROCm/rccl commit: 3e62ceddc5]
 2021-01-28 09:45:01 -07:00
Wenkai Du d4382de267 Improve collective trace 
[ROCm/rccl commit: 2ddbe6646b]
 2021-01-14 19:28:01 -05:00
Wenkai Du 2c49121171 Port alltoall[v] 
[ROCm/rccl commit: f4d5d3d620]
 2021-01-14 19:28:01 -05:00
Wenkai Du adff98765c Merge remote-tracking branch 'nccl/master' into no-target-id 
[ROCm/rccl commit: d469947641]
 2021-01-14 19:27:53 -05:00
Wenkai Du 4ea285c527 Fix Rome PCIe 2 node topology generation (#310) 
[ROCm/rccl commit: 373a108516]
 2020-12-15 17:16:17 -08:00
gilbertlee-amd c570f09681 [TransferBench] Fixing bug with fine-grained memory allocation (#311) 
* Fixing bug with fine-grained memory

[ROCm/rccl commit: 41c35dad48]
 2020-12-15 17:37:31 -07:00
gilbertlee-amd 5155abb250 [TransferBench] Adding ability to perform CPU-executed copies, various upgrades (#309) 
* Adding CPU based execution, fixing typos, adding Fine-grained mem
* Exposing sampling factor when generating range of data sizes
* Refactoring how Links are launched, now once per thread
* Documentation updates

[ROCm/rccl commit: ae0c4092c7]
 2020-12-11 10:21:14 -07:00
gilbertlee-amd 9b48f92d72 [TransferBench] Support multiple of 4 byte sizes, changing default GPU timing mechanism (#307) 
* Changing default timing mechanism, adjusting CPU bandwidth calc, adding flag to use combined timing
* Adding support for smaller transfers (byte size must be multiple of 4 instead of 128)

[ROCm/rccl commit: b80ae551b1]
 2020-12-04 14:57:13 -07:00
Wenkai Du b68ff1ebba Add Rome model and improve search (#305) 
[ROCm/rccl commit: 975b14dffa]
 2020-11-17 14:55:06 -08:00
gilbertlee-amd a7ef699687 Clique kernel support (#295) 
* Adding experimental clique-based kernels (opt-in only)

Co-authored-by: Stanley Tsang <stanley.tsang@amd.com>
Co-authored-by: Gilbert Lee <gilbert.lee@amd.com>
Co-authored-by: Wenkai Du <43822138+wenkaidu@users.noreply.github.com>

[ROCm/rccl commit: 41bcfb8878]
 2020-11-10 15:44:10 -07:00
Wenkai Du c0c64d970a Add more Rome models (#292) 
[ROCm/rccl commit: dfa3c41ede]
 2020-10-30 21:26:04 -07:00
gilbertlee-amd 2931959e6e Adding output to CSV, removing OpenMP, decreasing default numBytes to 64MB, adding aggregate stats (#290) 
[ROCm/rccl commit: bfab1d3592]
 2020-10-27 09:00:33 -06:00
gilbertlee-amd a062c80298 [TransferBench] Displaying PCIe Bus ID (#288) 
* Adding PCIe BusID per GPU in topology display

[ROCm/rccl commit: 61e1a71d14]
 2020-10-21 16:13:36 -06:00