Wenkai Du
6f3d035396
rccl-prim-test: minor update ( #718 )
...
[ROCm/rccl commit: addbf4bd90 ]
2023-04-03 07:30:04 -07:00
Ziyue Yang
f7f669e7f0
MSCCL: Improve executor and integrate scheduler ( #694 )
...
* MSCCL: improve executor and add scheduler for testing
* Use external scheduler
* Fix cmake error
* Address comments
* Fix thread safe issue
* Make MSCCL lifecycle APIs thread safe
* Make MSCCL internal scheduler aware of topology hint
* Revise error message
[ROCm/rccl commit: e3b2342f39 ]
2023-03-14 14:34:25 -07:00
Wenkai Du
c76bc214c8
Merge remote-tracking branch 'nccl/master' into HEAD
...
[ROCm/rccl commit: e1cb45ff22 ]
2023-02-04 01:44:43 +00:00
Wenkai Du
7be2c55b32
topo_expl: fix broken build by adding hipify steps ( #670 )
...
[ROCm/rccl commit: a0dd8e0b84 ]
2023-01-06 07:29:40 -08:00
Ziyue Yang
431c7d2cb9
Add MSCCL Support ( #658 )
...
* Add MSCCL support
* Add alignment and message size checking
* Fix nRanks checking, in-place and out-of-place tests and group call handling
* Fix hipGraph unit test
* Change MSCCL init warning to INFO
* Revise license info
[ROCm/rccl commit: adafc0f759 ]
2022-12-12 15:51:04 -08:00
gilbertlee-amd
5871811d34
Graph unit tests ( #656 )
...
* Adding hipGraph unit tests
[ROCm/rccl commit: faed69f9fc ]
2022-12-01 10:28:42 -07:00
Wenkai Du
ffecb74b1e
Update tuning table and fix topo_expl
...
[ROCm/rccl commit: 94ad7f6f51 ]
2022-11-07 18:24:24 +00:00
Wenkai Du
36e5e02e46
Merge remote-tracking branch 'nccl/master' into develop
...
[ROCm/rccl commit: 4f0e223db4 ]
2022-10-20 15:41:29 +00:00
Wenkai Du
7fe0b0161f
topo_expl: fix compilation error ( #639 )
...
[ROCm/rccl commit: fc554a2428 ]
2022-10-19 14:19:50 -07:00
gilbertlee-amd
5459f1c3f6
Fixing formatting for copywrite ( #638 )
...
[ROCm/rccl commit: 10dbd2a452 ]
2022-10-19 13:43:21 -06:00
gilbertlee-amd
0ca30fb88a
Updating files for missing licenses ( #637 )
...
[ROCm/rccl commit: ebb8b5bf63 ]
2022-10-14 13:49:16 -06:00
gilbertlee-amd
9225ea766e
Removing TransferBench from tools ( #632 )
...
Point to new TransferBench repo
[ROCm/rccl commit: bd7d589446 ]
2022-09-30 11:53:32 -06:00
Wen-Heng (Jack) Chung
7cde92deff
Tweak unroll factors.
...
[ROCm/rccl commit: 84054c3b30 ]
2022-09-22 13:03:04 -05:00
Gilbert Lee
1d24c476f4
Merge branch 'develop' into 2.13.4
...
[ROCm/rccl commit: 009e79623f ]
2022-09-09 23:07:04 +00:00
gilbertlee-amd
35872115f8
Updating stream caching ( #614 )
...
- Adding non-captured hipStream for use in setup
[ROCm/rccl commit: dd56135a9a ]
2022-09-09 16:30:15 -06:00
gilbertlee-amd
af71be44f1
GraphBench ( #613 )
...
Adding simple GraphBench tool for comparing RCCL hipGraph performance
[ROCm/rccl commit: 65d78e9a1d ]
2022-09-09 12:12:25 -06:00
Wenkai Du
7874a99c75
Merge remote-tracking branch 'nccl/master' into develop
...
[ROCm/rccl commit: a79d9e3586 ]
2022-09-09 16:05:38 +00:00
akolliasAMD
2cd63dac42
added stream synch after hipMemset ( #609 )
...
[ROCm/rccl commit: 06bce9d0c9 ]
2022-08-30 16:18:37 -06:00
arvindcheru
a44be6655d
HIP Path default updated to ROCM_PATH (reorg path) ( #592 )
...
Updated default path for hip to ROCM_PATH (/opt/rocm instead of /opt/rocm/hip) as per new/current structure.
[ROCm/rccl commit: 2cb2f9493a ]
2022-08-04 13:38:41 -04:00
Edgar
8953f5b5ca
Introduce multi-rank support per device.
...
This is a single commit of the source code changes required to
introduce support for multiple ranks per device.
A new interface (ncclCommRankInitMulti) has to be used to make use of
this new feature.
[ROCm/rccl commit: 0336ffdf70 ]
2022-06-10 14:23:12 +00:00
Wenkai Du
5becf1669f
Add another Rome model ( #553 )
...
* Add another Rome model
* Add option to force enable intranet on single node
* Limit p2p channels to number of ranks
* Refine p2p channels handling
[ROCm/rccl commit: ef499c4810 ]
2022-05-31 11:31:30 -07:00
Wenkai Du
2c125ce6ed
Update Rome model ( #552 )
...
[ROCm/rccl commit: c5b77121f0 ]
2022-05-26 09:59:23 -07:00
akolliasAMD
22dc8bd246
Added creation of new tree and added switch for using treesplit for specific cases ( #551 )
...
[ROCm/rccl commit: 98f0809a39 ]
2022-05-25 18:55:14 -04:00
Wenkai Du
b30b8becea
Refine and add new Rome models ( #548 )
...
[ROCm/rccl commit: 283dc86a73 ]
2022-05-17 08:23:59 -07:00
gilbertlee-amd
c6804778d1
[TransferBench] Syncing with TransferBench v1.02 ( #541 )
...
[ROCm/rccl commit: 685bcea127 ]
2022-04-27 20:43:24 -06:00
Wenkai Du
95b30d9762
topo_expl: fix build and add tuning support ( #539 )
...
[ROCm/rccl commit: 063da25563 ]
2022-04-26 15:40:07 -07:00
Wenkai Du
67e7e6507e
Merge remote-tracking branch 'nccl/master' into develop
...
[ROCm/rccl commit: d28e1cb44f ]
2022-04-18 11:15:25 -07:00
Wenkai Du
011447e4dc
Add new Rome model ( #536 )
...
[ROCm/rccl commit: 2151c79d14 ]
2022-04-13 11:45:40 -07:00
Wenkai Du
f8023f2e07
Add new Rome model ( #535 )
...
[ROCm/rccl commit: ba4c165bf3 ]
2022-04-12 13:27:32 -07:00
gilbertlee-amd
e61ff3ce37
Transfer bench single stream mode ( #531 )
...
- Adding single stream mode
- Removing some unused env vars
- Adding output to CSV mode for p2p benchmark, topology listing modes
[ROCm/rccl commit: def6832287 ]
2022-04-08 15:20:55 -06:00
Wenkai Du
3332cdff07
Support multiple tuning tables ( #522 )
...
* Support multiple tuning tables
* [UnitTests] Skip managed memory testing
[ROCm/rccl commit: bbe780ca6c ]
2022-03-31 17:09:21 -07:00
gilbertlee-amd
4c32c51772
Adding explicit request for coarse-grained host memory due to changes in HipHostMalloc ( #517 )
...
[ROCm/rccl commit: 2d558c9abc ]
2022-03-25 13:05:07 -06:00
Wenkai Du
db1e628ba3
Update Rome model matching and add new models ( #516 )
...
* Update Rome model matching and add new models
* Add missing file
* Models update
[ROCm/rccl commit: cd17cf6dce ]
2022-03-21 10:54:40 -07:00
Ziyue Yang
dfa9b9e958
Add Pivot AllToAll algorithm for Rome model ( #503 )
...
* add a2a pivot interface
* remove debug info
* address comments
* fix bug
* remove custom script
* address comments
* fix bug
[ROCm/rccl commit: b569c0a1db ]
2022-02-20 21:09:47 -08:00
gilbertlee-amd
9c3189589f
[TransferBench] Fix for cases with subsets of configured numa nodes ( #495 )
...
[ROCm/rccl commit: f3c2cafd9d ]
2022-02-07 12:16:19 -07:00
gilbertlee-amd
b2deea27f5
TransferBench: Adding ability to reindex GPUs based on PCIe address ( #494 )
...
[ROCm/rccl commit: 84d5fce7dd ]
2022-02-02 08:51:41 -07:00
Wenkai Du
4d43d9ce22
Update Rome models ( #491 )
...
[ROCm/rccl commit: 598c6fdded ]
2022-01-14 10:03:30 -08:00
Wenkai Du
02a94fc552
topo_expl: update for 2.11.4 ( #490 )
...
* topo_expl: update for 2.11.4
* topo_expl: revert a few logging changes
[ROCm/rccl commit: 369c021992 ]
2022-01-13 13:33:07 -08:00
gilbertlee-amd
a6a9ba1b78
[TransferBench] Updating for 2.11.4. Decoupling from RCCL kernel ( #485 )
...
[ROCm/rccl commit: 2530a2f084 ]
2022-01-05 16:33:25 -07:00
Wenkai Du
e5ff692673
Merge pull request #482 from ROCmSoftwarePlatform/2.11.4
...
Sync up with 2.11.4
[ROCm/rccl commit: 4234a638b5 ]
2022-01-05 09:31:51 -08:00
Wenkai Du
93c7526fdc
Add another Rome model ( #483 )
...
[ROCm/rccl commit: f8d0775a6f ]
2022-01-05 09:26:31 -08:00
Wenkai Du
618fbfc644
Merge remote-tracking branch 'origin/develop' into 2.11.4
...
[ROCm/rccl commit: 434ecb0e1f ]
2022-01-03 09:54:16 -08:00
gilbertlee-amd
ef1cbb03d2
[TransferBench] Adding more preset benchmarks to filter read mode, cpu vs gpu pairs ( #477 )
...
[ROCm/rccl commit: 1157c2edfe ]
2021-11-24 18:05:37 -07:00
Wenkai Du
f8bd2d0cfa
Merge remote-tracking branch 'nccl/master' into develop
...
[ROCm/rccl commit: 3a919c1f49 ]
2021-11-11 14:22:12 -08:00
gilbertlee-amd
096defc1cd
[TransferBench] Adding #CUs / RRLW mode to p2p benchmark ( #464 )
...
[ROCm/rccl commit: 1c7ef1b790 ]
2021-11-08 14:36:04 -07:00
Wenkai Du
fd98ee84b4
Update Rome model matching ( #461 )
...
* Update Rome model matching
* Add another Rome model
* Automatically setup NET GDR level from model
[ROCm/rccl commit: 0331e39f81 ]
2021-11-05 08:53:47 -07:00
Wenkai Du
15143b1cfb
Query XGMI link count through rocm_smi_lib API ( #442 )
...
[ROCm/rccl commit: 14a184eb67 ]
2021-10-26 10:30:20 -07:00
gilbertlee-amd
bf024320e4
[TransferBench] Changing default per block multiple to 256B, adding BLOCK_BYTES env var ( #446 )
...
[ROCm/rccl commit: 18246fc191 ]
2021-10-25 11:23:29 -06:00
gilbertlee-amd
b795cc090b
TransferBench p2p benchmark mode ( #444 )
...
* [TransferBench] Adding a p2p benchmark mode
* [TransferBench] Switching to using single sync mode by default (USE_SINGLE_SYNC=1)
[ROCm/rccl commit: 550d732d6c ]
2021-10-21 15:28:16 -06:00
gilbertlee-amd
fe4285d002
[TransferBench] Adding comment echoing to help distinguish tests ( #438 )
...
[ROCm/rccl commit: f6b7ac693e ]
2021-10-13 14:56:57 -06:00