Commit-Graf

158 Incheckningar

Upphovsman SHA1 Meddelande Datum
Wenkai Du 67e7e6507e Merge remote-tracking branch 'nccl/master' into develop
[ROCm/rccl commit: d28e1cb44f]
2022-04-18 11:15:25 -07:00
Wenkai Du 011447e4dc Add new Rome model (#536)
[ROCm/rccl commit: 2151c79d14]
2022-04-13 11:45:40 -07:00
Wenkai Du f8023f2e07 Add new Rome model (#535)
[ROCm/rccl commit: ba4c165bf3]
2022-04-12 13:27:32 -07:00
gilbertlee-amd e61ff3ce37 Transfer bench single stream mode (#531)
- Adding single stream mode
- Removing some unused env vars
- Adding output to CSV mode for p2p benchmark, topology listing modes

[ROCm/rccl commit: def6832287]
2022-04-08 15:20:55 -06:00
Wenkai Du 3332cdff07 Support multiple tuning tables (#522)
* Support multiple tuning tables

* [UnitTests] Skip managed memory testing

[ROCm/rccl commit: bbe780ca6c]
2022-03-31 17:09:21 -07:00
gilbertlee-amd 4c32c51772 Adding explicit request for coarse-grained host memory due to changes in HipHostMalloc (#517)
[ROCm/rccl commit: 2d558c9abc]
2022-03-25 13:05:07 -06:00
Wenkai Du db1e628ba3 Update Rome model matching and add new models (#516)
* Update Rome model matching and add new models

* Add missing file

* Models update

[ROCm/rccl commit: cd17cf6dce]
2022-03-21 10:54:40 -07:00
Ziyue Yang dfa9b9e958 Add Pivot AllToAll algorithm for Rome model (#503)
* add a2a pivot interface

* remove debug info

* address comments

* fix bug

* remove custom script

* address comments

* fix bug

[ROCm/rccl commit: b569c0a1db]
2022-02-20 21:09:47 -08:00
gilbertlee-amd 9c3189589f [TransferBench] Fix for cases with subsets of configured numa nodes (#495)
[ROCm/rccl commit: f3c2cafd9d]
2022-02-07 12:16:19 -07:00
gilbertlee-amd b2deea27f5 TransferBench: Adding ability to reindex GPUs based on PCIe address (#494)
[ROCm/rccl commit: 84d5fce7dd]
2022-02-02 08:51:41 -07:00
Wenkai Du 4d43d9ce22 Update Rome models (#491)
[ROCm/rccl commit: 598c6fdded]
2022-01-14 10:03:30 -08:00
Wenkai Du 02a94fc552 topo_expl: update for 2.11.4 (#490)
* topo_expl: update for 2.11.4

* topo_expl: revert a few logging changes

[ROCm/rccl commit: 369c021992]
2022-01-13 13:33:07 -08:00
gilbertlee-amd a6a9ba1b78 [TransferBench] Updating for 2.11.4. Decoupling from RCCL kernel (#485)
[ROCm/rccl commit: 2530a2f084]
2022-01-05 16:33:25 -07:00
Wenkai Du e5ff692673 Merge pull request #482 from ROCmSoftwarePlatform/2.11.4
Sync up with 2.11.4

[ROCm/rccl commit: 4234a638b5]
2022-01-05 09:31:51 -08:00
Wenkai Du 93c7526fdc Add another Rome model (#483)
[ROCm/rccl commit: f8d0775a6f]
2022-01-05 09:26:31 -08:00
Wenkai Du 618fbfc644 Merge remote-tracking branch 'origin/develop' into 2.11.4
[ROCm/rccl commit: 434ecb0e1f]
2022-01-03 09:54:16 -08:00
gilbertlee-amd ef1cbb03d2 [TransferBench] Adding more preset benchmarks to filter read mode, cpu vs gpu pairs (#477)
[ROCm/rccl commit: 1157c2edfe]
2021-11-24 18:05:37 -07:00
Wenkai Du f8bd2d0cfa Merge remote-tracking branch 'nccl/master' into develop
[ROCm/rccl commit: 3a919c1f49]
2021-11-11 14:22:12 -08:00
gilbertlee-amd 096defc1cd [TransferBench] Adding #CUs / RRLW mode to p2p benchmark (#464)
[ROCm/rccl commit: 1c7ef1b790]
2021-11-08 14:36:04 -07:00
Wenkai Du fd98ee84b4 Update Rome model matching (#461)
* Update Rome model matching

* Add another Rome model

* Automatically setup NET GDR level from model

[ROCm/rccl commit: 0331e39f81]
2021-11-05 08:53:47 -07:00
Wenkai Du 15143b1cfb Query XGMI link count through rocm_smi_lib API (#442)
[ROCm/rccl commit: 14a184eb67]
2021-10-26 10:30:20 -07:00
gilbertlee-amd bf024320e4 [TransferBench] Changing default per block multiple to 256B, adding BLOCK_BYTES env var (#446)
[ROCm/rccl commit: 18246fc191]
2021-10-25 11:23:29 -06:00
gilbertlee-amd b795cc090b TransferBench p2p benchmark mode (#444)
* [TransferBench] Adding a p2p benchmark mode
* [TransferBench] Switching to using single sync mode by default (USE_SINGLE_SYNC=1)

[ROCm/rccl commit: 550d732d6c]
2021-10-21 15:28:16 -06:00
gilbertlee-amd fe4285d002 [TransferBench] Adding comment echoing to help distinguish tests (#438)
[ROCm/rccl commit: f6b7ac693e]
2021-10-13 14:56:57 -06:00
gilbertlee-amd ad1a620333 [TransferBench] Adding shared memory per threadblock env var. Defaulting to 1 threadblock per CU (#436)
[ROCm/rccl commit: 269f07fbc3]
2021-10-12 09:32:54 -06:00
Wenkai Du b587b55c2e Add more Rome models (#434)
* Add more Rome models

* Update models and tuning

* Update tuning

[ROCm/rccl commit: 2249a1d9d3]
2021-10-12 08:23:20 -07:00
gilbertlee-amd 227848b70f [TransferBench] Adding ability to specify suffix for numBytes (#435)
[ROCm/rccl commit: aa917c3fc8]
2021-10-08 16:36:19 -06:00
gilbertlee-amd fef14c1b73 [TransferBench] Fixing advanced config, adding new all-1-hop sample test (#433)
* [TransferBench] Fixing advanced config, adding new all-1-hop sample test

[ROCm/rccl commit: e506d14d18]
2021-10-07 15:57:21 -06:00
Wenkai Du d377c4dcc6 Add another Rome model (#431)
[ROCm/rccl commit: e0053311c0]
2021-10-06 08:17:12 -07:00
Wenkai Du 91eca0d7d2 Trim NICs when all GPUs are connected by XGMI (#430)
* Trim NICs when all GPUs are connected by XGMI

* Only enable clique with maximum of 2 hops

[ROCm/rccl commit: 29c729d8b6]
2021-10-05 18:27:43 -07:00
Gilbert Lee 5be5b37e19 [TransferBench] Update to 2.10.3
[ROCm/rccl commit: 68ec3f84e6]
2021-08-02 05:53:20 -05:00
Wenkai Du 8acdb77cc0 Merge remote-tracking branch 'origin/develop' into 2.10.3
[ROCm/rccl commit: 8ee2b7932a]
2021-09-13 15:51:53 -07:00
Wenkai Du 934885526d Merge pull request #423 from wenkaidu/prim-test
rccl-prim-test: support 8p1h and 16p1h testing

[ROCm/rccl commit: a2421f8b4a]
2021-09-08 17:01:19 -07:00
Wenkai Du 310d51056f rccl-prim-test: enable 8p1h and 16p1h test
[ROCm/rccl commit: 7558b5e2bf]
2021-09-08 11:51:26 -05:00
Wenkai Du 4f610a2239 Revert "rccl-prim-test: add all-to-all benchmark (#185)"
This reverts commit e3e1c6b29c.


[ROCm/rccl commit: b22d097524]
2021-09-07 16:41:46 -05:00
gilbertlee-amd 06b0e1c4e2 [TransferBench] ConfigFile parsing fixes, adding additional info (#422)
* [TransferBench] Adding GPU to NUMA distance detection, parsing fixes, config file generation fix

* [TransferBench] Fixing up NUMA node detection by filtering pools

[ROCm/rccl commit: 51d64894ff]
2021-09-07 15:28:16 -06:00
Wenkai Du b9508a6aba Implement NIC identification and remapping (#420)
* Add 1H16P GPU model

* Implement NIC identification and remapping

* Revert "Sort IB devices based on device name (#413)"

This reverts commit de0c586bad.

* Fix permute and check order

* Correction on IB speed reporting

* Revert "Allow user to link layer with RCCL_IB_HCA_SKIP_LINK_LAYER (#361)"

This reverts commit fa690c47a0.

[ROCm/rccl commit: 5c8380ff5b]
2021-08-24 09:42:04 -07:00
Wenkai Du 4fd7a14087 Merge remote-tracking branch 'origin/develop' into 2.10.3
[ROCm/rccl commit: d5f93649ff]
2021-08-24 09:49:47 -07:00
Wenkai Du 57518da006 Add gfx908 VM model (#418)
[ROCm/rccl commit: 5f15ed6e3e]
2021-08-10 08:55:11 -07:00
gilbertlee-amd b0c3a1790f [TransferBench] Removing dependency on hip_fp16 header, fixing swapped output CSV header (#416)
[ROCm/rccl commit: 1ed272e5f0]
2021-08-04 10:53:41 -06:00
Wenkai Du 4b89e98675 Merge remote-tracking branch 'nccl/master' into 2.10.3
[ROCm/rccl commit: bf2339f93e]
2021-07-30 16:23:14 -07:00
Wenkai Du faea6ead5c Query XGMI links from xml and adjust gfx906 channel usage (#410)
[ROCm/rccl commit: 818cdb16a8]
2021-07-27 17:32:41 -07:00
Wenkai Du 8fbeb14175 topo_expl: fix build after switching to rocm-smi-lib (#405)
* topo_expl: fix build after switching to rocm-smi-lib

* Use minimal of 4 channels for gfx908

[ROCm/rccl commit: 135d47d125]
2021-07-27 08:30:08 -07:00
gilbertlee-amd f2a72b1e0b [TransferBench] Fixing a typo in TransferBench usage example (#401)
[ROCm/rccl commit: 2b0b608270]
2021-06-22 17:08:57 -06:00
Wenkai Du 90ae176437 Fixes for NCCL_MAX_NCHANNELS and topo_expl (#398)
[ROCm/rccl commit: fa6d7e9a63]
2021-06-22 08:41:49 -07:00
gilbertlee-amd 0a636f20a3 [TransferBench] Switching from little-endian fill pattern to big-endian (#399)
[ROCm/rccl commit: 720374a767]
2021-06-21 14:28:51 -06:00
gilbertlee-amd 01a8efbb76 [TransferBench] Adding ability to specify source data pattern (#394)
* [TransferBench] Adding ability to specify source data pattern

[ROCm/rccl commit: ff413be933]
2021-06-15 08:41:57 -06:00
Wenkai Du 5bebcb0015 Setup collectives threshold for enabling intranet (#387)
* Setup collectives threshold for enabling intranet

* Use separate operation counters for coll and p2p

[ROCm/rccl commit: b815a2800f]
2021-06-09 13:24:26 -07:00
Wenkai Du c8a432dc25 Allow intranode use of network connection (#383)
* Allow intranode use of network connection

* Checking for graph for null pointer

[ROCm/rccl commit: a3a8c2d56b]
2021-06-08 07:37:59 -07:00
Wenkai Du 4b31e521e9 Add option to enable multiple SAT in SHARP (#380)
* Add option to enable multiple SAT in SHARP

* Extend number of NICs to 16

[ROCm/rccl commit: 961922ea02]
2021-06-03 19:45:18 -07:00