AI/rocm-systems
2
0
Fork 0
Code Issues Pull-Requests Actions Pakete Projekte Releases Wiki Aktivität
873 Commits 3 Branches 0 Tags
3225ee7cd0e35e2bf538631ea5599afabb2e5ea4
Commit graph

169 Commits

Autor SHA1 Nachricht Datum
gilbertlee-amd 35872115f8 Updating stream caching (#614) 
- Adding non-captured hipStream for use in setup

[ROCm/rccl commit: dd56135a9a]
 2022-09-09 16:30:15 -06:00
gilbertlee-amd af71be44f1 GraphBench (#613) 
Adding simple GraphBench tool for comparing RCCL hipGraph performance

[ROCm/rccl commit: 65d78e9a1d]
 2022-09-09 12:12:25 -06:00
akolliasAMD 2cd63dac42 added stream synch after hipMemset (#609) 
[ROCm/rccl commit: 06bce9d0c9]
 2022-08-30 16:18:37 -06:00
arvindcheru a44be6655d HIP Path default updated to ROCM_PATH (reorg path) (#592) 
Updated default path for hip to ROCM_PATH (/opt/rocm instead of /opt/rocm/hip) as per new/current structure.

[ROCm/rccl commit: 2cb2f9493a]
 2022-08-04 13:38:41 -04:00
Edgar 8953f5b5ca Introduce multi-rank support per device. 
This is a single commit of the source code changes required to
introduce support for multiple ranks per device.
A new interface (ncclCommRankInitMulti) has to be used to make use of
this new feature.


[ROCm/rccl commit: 0336ffdf70]
 2022-06-10 14:23:12 +00:00
Wenkai Du 5becf1669f Add another Rome model (#553) 
* Add another Rome model

* Add option to force enable intranet on single node

* Limit p2p channels to number of ranks

* Refine p2p channels handling

[ROCm/rccl commit: ef499c4810]
 2022-05-31 11:31:30 -07:00
Wenkai Du 2c125ce6ed Update Rome model (#552) 
[ROCm/rccl commit: c5b77121f0]
 2022-05-26 09:59:23 -07:00
akolliasAMD 22dc8bd246 Added creation of new tree and added switch for using treesplit for specific cases (#551) 
[ROCm/rccl commit: 98f0809a39]
 2022-05-25 18:55:14 -04:00
Wenkai Du b30b8becea Refine and add new Rome models (#548) 
[ROCm/rccl commit: 283dc86a73]
 2022-05-17 08:23:59 -07:00
gilbertlee-amd c6804778d1 [TransferBench] Syncing with TransferBench v1.02 (#541) 
[ROCm/rccl commit: 685bcea127]
 2022-04-27 20:43:24 -06:00
Wenkai Du 95b30d9762 topo_expl: fix build and add tuning support (#539) 
[ROCm/rccl commit: 063da25563]
 2022-04-26 15:40:07 -07:00
Wenkai Du 67e7e6507e Merge remote-tracking branch 'nccl/master' into develop 
[ROCm/rccl commit: d28e1cb44f]
 2022-04-18 11:15:25 -07:00
Wenkai Du 011447e4dc Add new Rome model (#536) 
[ROCm/rccl commit: 2151c79d14]
 2022-04-13 11:45:40 -07:00
Wenkai Du f8023f2e07 Add new Rome model (#535) 
[ROCm/rccl commit: ba4c165bf3]
 2022-04-12 13:27:32 -07:00
gilbertlee-amd e61ff3ce37 Transfer bench single stream mode (#531) 
- Adding single stream mode
- Removing some unused env vars
- Adding output to CSV mode for p2p benchmark, topology listing modes

[ROCm/rccl commit: def6832287]
 2022-04-08 15:20:55 -06:00
Wenkai Du 3332cdff07 Support multiple tuning tables (#522) 
* Support multiple tuning tables

* [UnitTests] Skip managed memory testing

[ROCm/rccl commit: bbe780ca6c]
 2022-03-31 17:09:21 -07:00
gilbertlee-amd 4c32c51772 Adding explicit request for coarse-grained host memory due to changes in HipHostMalloc (#517) 
[ROCm/rccl commit: 2d558c9abc]
 2022-03-25 13:05:07 -06:00
Wenkai Du db1e628ba3 Update Rome model matching and add new models (#516) 
* Update Rome model matching and add new models

* Add missing file

* Models update

[ROCm/rccl commit: cd17cf6dce]
 2022-03-21 10:54:40 -07:00
Ziyue Yang dfa9b9e958 Add Pivot AllToAll algorithm for Rome model (#503) 
* add a2a pivot interface

* remove debug info

* address comments

* fix bug

* remove custom script

* address comments

* fix bug

[ROCm/rccl commit: b569c0a1db]
 2022-02-20 21:09:47 -08:00
gilbertlee-amd 9c3189589f [TransferBench] Fix for cases with subsets of configured numa nodes (#495) 
[ROCm/rccl commit: f3c2cafd9d]
 2022-02-07 12:16:19 -07:00
gilbertlee-amd b2deea27f5 TransferBench: Adding ability to reindex GPUs based on PCIe address (#494) 
[ROCm/rccl commit: 84d5fce7dd]
 2022-02-02 08:51:41 -07:00
Wenkai Du 4d43d9ce22 Update Rome models (#491) 
[ROCm/rccl commit: 598c6fdded]
 2022-01-14 10:03:30 -08:00
Wenkai Du 02a94fc552 topo_expl: update for 2.11.4 (#490) 
* topo_expl: update for 2.11.4

* topo_expl: revert a few logging changes

[ROCm/rccl commit: 369c021992]
 2022-01-13 13:33:07 -08:00
gilbertlee-amd a6a9ba1b78 [TransferBench] Updating for 2.11.4. Decoupling from RCCL kernel (#485) 
[ROCm/rccl commit: 2530a2f084]
 2022-01-05 16:33:25 -07:00
Wenkai Du e5ff692673 Merge pull request #482 from ROCmSoftwarePlatform/2.11.4 
Sync up with 2.11.4

[ROCm/rccl commit: 4234a638b5]
 2022-01-05 09:31:51 -08:00
Wenkai Du 93c7526fdc Add another Rome model (#483) 
[ROCm/rccl commit: f8d0775a6f]
 2022-01-05 09:26:31 -08:00
Wenkai Du 618fbfc644 Merge remote-tracking branch 'origin/develop' into 2.11.4 
[ROCm/rccl commit: 434ecb0e1f]
 2022-01-03 09:54:16 -08:00
gilbertlee-amd ef1cbb03d2 [TransferBench] Adding more preset benchmarks to filter read mode, cpu vs gpu pairs (#477) 
[ROCm/rccl commit: 1157c2edfe]
 2021-11-24 18:05:37 -07:00
Wenkai Du f8bd2d0cfa Merge remote-tracking branch 'nccl/master' into develop 
[ROCm/rccl commit: 3a919c1f49]
 2021-11-11 14:22:12 -08:00
gilbertlee-amd 096defc1cd [TransferBench] Adding #CUs / RRLW mode to p2p benchmark (#464) 
[ROCm/rccl commit: 1c7ef1b790]
 2021-11-08 14:36:04 -07:00
Wenkai Du fd98ee84b4 Update Rome model matching (#461) 
* Update Rome model matching

* Add another Rome model

* Automatically setup NET GDR level from model

[ROCm/rccl commit: 0331e39f81]
 2021-11-05 08:53:47 -07:00
Wenkai Du 15143b1cfb Query XGMI link count through rocm_smi_lib API (#442) 
[ROCm/rccl commit: 14a184eb67]
 2021-10-26 10:30:20 -07:00
gilbertlee-amd bf024320e4 [TransferBench] Changing default per block multiple to 256B, adding BLOCK_BYTES env var (#446) 
[ROCm/rccl commit: 18246fc191]
 2021-10-25 11:23:29 -06:00
gilbertlee-amd b795cc090b TransferBench p2p benchmark mode (#444) 
* [TransferBench] Adding a p2p benchmark mode
* [TransferBench] Switching to using single sync mode by default (USE_SINGLE_SYNC=1)

[ROCm/rccl commit: 550d732d6c]
 2021-10-21 15:28:16 -06:00
gilbertlee-amd fe4285d002 [TransferBench] Adding comment echoing to help distinguish tests (#438) 
[ROCm/rccl commit: f6b7ac693e]
 2021-10-13 14:56:57 -06:00
gilbertlee-amd ad1a620333 [TransferBench] Adding shared memory per threadblock env var. Defaulting to 1 threadblock per CU (#436) 
[ROCm/rccl commit: 269f07fbc3]
 2021-10-12 09:32:54 -06:00
Wenkai Du b587b55c2e Add more Rome models (#434) 
* Add more Rome models

* Update models and tuning

* Update tuning

[ROCm/rccl commit: 2249a1d9d3]
 2021-10-12 08:23:20 -07:00
gilbertlee-amd 227848b70f [TransferBench] Adding ability to specify suffix for numBytes (#435) 
[ROCm/rccl commit: aa917c3fc8]
 2021-10-08 16:36:19 -06:00
gilbertlee-amd fef14c1b73 [TransferBench] Fixing advanced config, adding new all-1-hop sample test (#433) 
* [TransferBench] Fixing advanced config, adding new all-1-hop sample test

[ROCm/rccl commit: e506d14d18]
 2021-10-07 15:57:21 -06:00
Wenkai Du d377c4dcc6 Add another Rome model (#431) 
[ROCm/rccl commit: e0053311c0]
 2021-10-06 08:17:12 -07:00
Wenkai Du 91eca0d7d2 Trim NICs when all GPUs are connected by XGMI (#430) 
* Trim NICs when all GPUs are connected by XGMI

* Only enable clique with maximum of 2 hops

[ROCm/rccl commit: 29c729d8b6]
 2021-10-05 18:27:43 -07:00
Gilbert Lee 5be5b37e19 [TransferBench] Update to 2.10.3 
[ROCm/rccl commit: 68ec3f84e6]
 2021-08-02 05:53:20 -05:00
Wenkai Du 8acdb77cc0 Merge remote-tracking branch 'origin/develop' into 2.10.3 
[ROCm/rccl commit: 8ee2b7932a]
 2021-09-13 15:51:53 -07:00
Wenkai Du 934885526d Merge pull request #423 from wenkaidu/prim-test 
rccl-prim-test: support 8p1h and 16p1h testing

[ROCm/rccl commit: a2421f8b4a]
 2021-09-08 17:01:19 -07:00
Wenkai Du 310d51056f rccl-prim-test: enable 8p1h and 16p1h test 
[ROCm/rccl commit: 7558b5e2bf]
 2021-09-08 11:51:26 -05:00
Wenkai Du 4f610a2239 Revert "rccl-prim-test: add all-to-all benchmark (#185)" 
This reverts commit e3e1c6b29c.


[ROCm/rccl commit: b22d097524]
 2021-09-07 16:41:46 -05:00
gilbertlee-amd 06b0e1c4e2 [TransferBench] ConfigFile parsing fixes, adding additional info (#422) 
* [TransferBench] Adding GPU to NUMA distance detection, parsing fixes, config file generation fix

* [TransferBench] Fixing up NUMA node detection by filtering pools

[ROCm/rccl commit: 51d64894ff]
 2021-09-07 15:28:16 -06:00
Wenkai Du b9508a6aba Implement NIC identification and remapping (#420) 
* Add 1H16P GPU model

* Implement NIC identification and remapping

* Revert "Sort IB devices based on device name (#413)"

This reverts commit de0c586bad.

* Fix permute and check order

* Correction on IB speed reporting

* Revert "Allow user to link layer with RCCL_IB_HCA_SKIP_LINK_LAYER (#361)"

This reverts commit fa690c47a0.

[ROCm/rccl commit: 5c8380ff5b]
 2021-08-24 09:42:04 -07:00
Wenkai Du 4fd7a14087 Merge remote-tracking branch 'origin/develop' into 2.10.3 
[ROCm/rccl commit: d5f93649ff]
 2021-08-24 09:49:47 -07:00
Wenkai Du 57518da006 Add gfx908 VM model (#418) 
[ROCm/rccl commit: 5f15ed6e3e]
 2021-08-10 08:55:11 -07:00