AI/rocm-systems
2
0
Fork 0
Κώδικας Ζητήματα Pull Requests Δράσεις Πακέτα Έργα Κυκλοφορίες Wiki Δραστηριότητα
76.333 Υποβολές 3 Κλάδοι 0 Ετικέτες
develop
Γράφημα Υποβολών

312 Υποβολές

Συγγραφέας SHA1 Μήνυμα Ημερομηνία
Wen-Heng (Jack) Chung 49e52e7269 Introduce 1pass allreduce. Tailor it for very small message sizes <= 20KB. (#919) 
[ROCm/rccl commit: 341926c60a]
 2023-10-16 16:31:08 -05:00
mberenjk 9a0c9ba3e9 adding cuda support for EmptyKernelTest (#913) 
[ROCm/rccl commit: 7e2d905376]
 2023-10-11 14:11:12 -05:00
gilbertlee-amd c1a7b56b9b Adding a simple EmptyKernelTest to measure launch latency (#910) 
[ROCm/rccl commit: 7dbf47e07b]
 2023-10-04 17:22:48 -06:00
Pedram Alizadeh 279da575be Adding a script that will download/compile/run TransferBench/RCCL/UCX/RCCL-tests/RCCL-Unittests/hip-mpi-testsuite (#895) 
[ROCm/rccl commit: 3f6c2b9b32]
 2023-09-27 12:44:36 -04:00
akolliasAMD 8685535346 Fixed topo_expl (#891) 
[ROCm/rccl commit: 762a42859e]
 2023-09-13 12:05:35 -06:00
Audrey MP 2e3d45a53a Gcn arch name (#886) 
We use CMake to determine if we're compiling against a version of ROCm that supports gcnArchName and handles architecture checking appropriately. It includes a few helper functions as drop ins for the functionality we used gcnArch for before; sometimes to enable flags, and sometimes to set frequencies.

[ROCm/rccl commit: e58ec78d35]
 2023-09-12 15:34:40 -04:00
Wenkai Du be412b848b Update ll_latency_test and add CUDA version (#873) 
[ROCm/rccl commit: c6dd6f6237]
 2023-08-30 16:29:42 -07:00
Wenkai Du 4fefe1ce7d rccl-prim-test: use non-temporal access (#867) 
[ROCm/rccl commit: aa95985867]
 2023-08-28 08:28:05 -07:00
Wenkai Du af04103d72 Add MSCCL xml files (#861) 
[ROCm/rccl commit: aeca1af374]
 2023-08-23 14:12:34 -07:00
akolliasAMD 56129830a6 NCCL_TREES variable and rome model fixes (#856) 
[ROCm/rccl commit: d33cd5a233]
 2023-08-21 10:35:37 -06:00
Wenkai Du 47330a62a6 p2p/ll-latency-test: convert to single thread tests (#857) 
[ROCm/rccl commit: 148e3430f4]
 2023-08-21 07:48:37 -07:00
Wenkai Du 0c31452135 Add new model support (#847) 
* Add new model support

* Update new rings

[ROCm/rccl commit: 7044599575]
 2023-08-10 17:14:51 -07:00
Wenkai Du 56ab1e8771 p2p_latency_test: clean up IPC temp files at exit (#832) 
[ROCm/rccl commit: 0441eec32e]
 2023-07-31 08:11:07 -07:00
Wenkai Du 13922baf76 ll_latency_test: fix time calculation (#825) 
* ll_latency_test: fix time calculation

* Measure time after barrier

* Read time stamp only from thread 0

[ROCm/rccl commit: c424979c14]
 2023-07-27 09:04:35 -07:00
Wenkai Du f069aba363 tools: Add LL latency test (#820) 
* Add LL latency test

* Correct name in usage

[ROCm/rccl commit: 1c1ec096e2]
 2023-07-25 20:08:04 -07:00
Bertan Dogancay 0508fa569a Implement RCCL Replayer (#817) 
* Implement RCCL Replayer


[ROCm/rccl commit: 8bab4f04b7]
 2023-07-24 16:26:22 -06:00
Wenkai Du dfda1d6fab Enable gfx94x (#808) (#816) 
(cherry picked from commit 94da229a7788d74685d1591a4e75a8341de64f41)

[ROCm/rccl commit: a7fcd58a97]
 2023-07-21 07:31:27 -07:00
Ziyue Yang 75671adf82 Add GPU P2P ping-pong latency test tool (#804) 
* Add GPU P2P ping-pong latency test tool

* Address comments

* Fix IPC issue in gfx94x

[ROCm/rccl commit: b1cddcaf9a]
 2023-07-14 07:41:29 -07:00
Wenkai Du d2a1142cf3 rccl-prim-test: calculate iterations' standard deviation (#803) 
* rccl-prim-test: calculate iterations' standard deviation

* Add default ring configuration for gfx940

* Use hipDeviceMallocUncached on gfx94x

[ROCm/rccl commit: f41ea11444]
 2023-07-13 11:05:50 -07:00
Wenkai Du a5feda50b9 rccl-prim-test: calculate throughput standard deviations (#802) 
[ROCm/rccl commit: 43f13cd25a]
 2023-07-12 10:04:40 -07:00
Wenkai Du f98715baea Merge remote-tracking branch 'nccl/master' into develop 
[ROCm/rccl commit: abd0615351]
 2023-06-26 22:51:56 +00:00
Bertan Dogancay d411d52b19 Disable Colltrace for --fast option (#778) 
* Disable Colltrace for --fast option

* Limit nprocs for CI

[ROCm/rccl commit: 0c77c66221]
 2023-06-21 14:16:09 -06:00
Bertan Dogancay 1ae071944e improve compilation time and create timetrace plot (#773) 
* improve compilation time and create time-trace plot

* set default value for nproc

[ROCm/rccl commit: f35777e9b0]
 2023-06-14 09:17:51 -06:00
akolliasAMD 8438fd9e42 Wall clock update and npkit trace script Update (#771) 
* changed builtin clock to wall_clock64
* updated npkit_Trace_generator to the new version of npkit

[ROCm/rccl commit: 9cdac774ea]
 2023-06-07 17:47:10 -06:00
gilbertlee-amd 05b8523a7b Updating NOTICES.txt and LICENSE.txt (#770) 
[ROCm/rccl commit: 20b567caac]
 2023-06-07 09:45:03 -06:00
Wenkai Du 90cbef7042 Add NCCL_NCHANNELS_PER_PEER override (#767) 
Also fix topol_expl build issue

[ROCm/rccl commit: 3af90902c8]
 2023-06-06 08:41:38 -07:00
akolliasAMD fd64cb242d added time results on npkit generator (#749) 
[ROCm/rccl commit: 2b1efa9e9a]
 2023-05-30 12:57:25 -06:00
akolliasAMD a26ca6d766 added modified npkit_trace_generator.py to scripts (#738) 
* added modified npkit_trace_generator.py to scripts

[ROCm/rccl commit: c88475462b]
 2023-05-09 10:11:35 -06:00
Wenkai Du 6f3d035396 rccl-prim-test: minor update (#718) 
[ROCm/rccl commit: addbf4bd90]
 2023-04-03 07:30:04 -07:00
Ziyue Yang f7f669e7f0 MSCCL: Improve executor and integrate scheduler (#694) 
* MSCCL: improve executor and add scheduler for testing

* Use external scheduler

* Fix cmake error

* Address comments

* Fix thread safe issue

* Make MSCCL lifecycle APIs thread safe

* Make MSCCL internal scheduler aware of topology hint

* Revise error message

[ROCm/rccl commit: e3b2342f39]
 2023-03-14 14:34:25 -07:00
Wenkai Du c76bc214c8 Merge remote-tracking branch 'nccl/master' into HEAD 
[ROCm/rccl commit: e1cb45ff22]
 2023-02-04 01:44:43 +00:00
Wenkai Du 7be2c55b32 topo_expl: fix broken build by adding hipify steps (#670) 
[ROCm/rccl commit: a0dd8e0b84]
 2023-01-06 07:29:40 -08:00
Ziyue Yang 431c7d2cb9 Add MSCCL Support (#658) 
* Add MSCCL support

* Add alignment and message size checking

* Fix nRanks checking, in-place and out-of-place tests and group call handling

* Fix hipGraph unit test

* Change MSCCL init warning to INFO

* Revise license info

[ROCm/rccl commit: adafc0f759]
 2022-12-12 15:51:04 -08:00
gilbertlee-amd 5871811d34 Graph unit tests (#656) 
* Adding hipGraph unit tests

[ROCm/rccl commit: faed69f9fc]
 2022-12-01 10:28:42 -07:00
Wenkai Du ffecb74b1e Update tuning table and fix topo_expl 
[ROCm/rccl commit: 94ad7f6f51]
 2022-11-07 18:24:24 +00:00
Wenkai Du 36e5e02e46 Merge remote-tracking branch 'nccl/master' into develop 
[ROCm/rccl commit: 4f0e223db4]
 2022-10-20 15:41:29 +00:00
Wenkai Du 7fe0b0161f topo_expl: fix compilation error (#639) 
[ROCm/rccl commit: fc554a2428]
 2022-10-19 14:19:50 -07:00
gilbertlee-amd 5459f1c3f6 Fixing formatting for copywrite (#638) 
[ROCm/rccl commit: 10dbd2a452]
 2022-10-19 13:43:21 -06:00
gilbertlee-amd 0ca30fb88a Updating files for missing licenses (#637) 
[ROCm/rccl commit: ebb8b5bf63]
 2022-10-14 13:49:16 -06:00
gilbertlee-amd 9225ea766e Removing TransferBench from tools (#632) 
Point to new TransferBench repo

[ROCm/rccl commit: bd7d589446]
 2022-09-30 11:53:32 -06:00
Wen-Heng (Jack) Chung 7cde92deff Tweak unroll factors. 
[ROCm/rccl commit: 84054c3b30]
 2022-09-22 13:03:04 -05:00
Gilbert Lee 1d24c476f4 Merge branch 'develop' into 2.13.4 
[ROCm/rccl commit: 009e79623f]
 2022-09-09 23:07:04 +00:00
gilbertlee-amd 35872115f8 Updating stream caching (#614) 
- Adding non-captured hipStream for use in setup

[ROCm/rccl commit: dd56135a9a]
 2022-09-09 16:30:15 -06:00
gilbertlee-amd af71be44f1 GraphBench (#613) 
Adding simple GraphBench tool for comparing RCCL hipGraph performance

[ROCm/rccl commit: 65d78e9a1d]
 2022-09-09 12:12:25 -06:00
Wenkai Du 7874a99c75 Merge remote-tracking branch 'nccl/master' into develop 
[ROCm/rccl commit: a79d9e3586]
 2022-09-09 16:05:38 +00:00
akolliasAMD 2cd63dac42 added stream synch after hipMemset (#609) 
[ROCm/rccl commit: 06bce9d0c9]
 2022-08-30 16:18:37 -06:00
arvindcheru a44be6655d HIP Path default updated to ROCM_PATH (reorg path) (#592) 
Updated default path for hip to ROCM_PATH (/opt/rocm instead of /opt/rocm/hip) as per new/current structure.

[ROCm/rccl commit: 2cb2f9493a]
 2022-08-04 13:38:41 -04:00
Edgar 8953f5b5ca Introduce multi-rank support per device. 
This is a single commit of the source code changes required to
introduce support for multiple ranks per device.
A new interface (ncclCommRankInitMulti) has to be used to make use of
this new feature.


[ROCm/rccl commit: 0336ffdf70]
 2022-06-10 14:23:12 +00:00
Wenkai Du 5becf1669f Add another Rome model (#553) 
* Add another Rome model

* Add option to force enable intranet on single node

* Limit p2p channels to number of ranks

* Refine p2p channels handling

[ROCm/rccl commit: ef499c4810]
 2022-05-31 11:31:30 -07:00
Wenkai Du 2c125ce6ed Update Rome model (#552) 
[ROCm/rccl commit: c5b77121f0]
 2022-05-26 09:59:23 -07:00