AI/rocm-systems
2
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,342 Commits 3 Branches 0 Tags
d6aba883d41fd45ef67de409937063dd4dbe571e
Commit Graph

1229 Commits

Author SHA1 Message Date
dependabot[bot] 2c5a37a6b1 Bump cryptography from 41.0.3 to 41.0.4 in /docs/sphinx (#897) 
Bumps [cryptography](https://github.com/pyca/cryptography) from 41.0.3 to 41.0.4.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pyca/cryptography/compare/41.0.3...41.0.4)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

[ROCm/rccl commit: 1bbc3742b0]
 2023-09-27 12:45:21 -04:00
Pedram Alizadeh 279da575be Adding a script that will download/compile/run TransferBench/RCCL/UCX/RCCL-tests/RCCL-Unittests/hip-mpi-testsuite (#895) 
[ROCm/rccl commit: 3f6c2b9b32]
 2023-09-27 12:44:36 -04:00
Sylvain Jeaugey 69ee68b6d3 2.19.3-1 
H800/H100 fixes and tuning.
Re-enable intra-process direct pointer buffer access when CUMEM is
enabled.


[ROCm/rccl commit: 8c6c595185]
 2023-09-26 05:57:15 -07:00
Sylvain Jeaugey 216dfe3d55 Merge remote-tracking branch 'origin/master' into v2.19 
[ROCm/rccl commit: 3435178b6c]
 2023-09-26 05:55:56 -07:00
Sylvain Jeaugey 506d6c332c 2.19.1-1 
Add local user buffer registration for NVLink SHARP.
Add tuning plugin support.
Increase net API to v7 to allow for device-side packet reordering;
remove support for v4 plugins.
Add support for RoCE ECE.
Add support for C2C links.
Better detect SHM allocation failures to avoid crash with Bus Error.
Fix missing thread unlocks in bootstrap (Fixes #936).
Disable network flush by default on H100.
Move device code from src/collectives/device to src/device.


[ROCm/rccl commit: f9c3dc251e]
 2023-09-26 05:50:33 -07:00
Kaiming Ouyang d03ae00bac Fix cudaMemcpyAsync bug 
We are trying to use the copy result of first cudaMemcpyAsync in the
second cudaMemcpyAsync without sync in between. This patch fixes it
by allocating a CPU side array to cache device side addr so that we
can avoid this consecutive cuda mem copy.

Fixes #957


[ROCm/rccl commit: 4365458757]
 2023-09-20 05:51:14 -07:00
akolliasAMD 6f7eb65308 changed the form that RCCL_TREE uses (#888) 
* changed the form that RCCL_TREE uses

[ROCm/rccl commit: b85d73c02e]
 2023-09-15 15:01:33 -06:00
Wenkai Du 3cc41809dd Reduce NPKit latency overhead in MSCCL kernel (#893) 
* Reduce NPKit latency overhead in MSCCL kernel

* Fix build error without NPKit enable

[ROCm/rccl commit: 26e982d913]
 2023-09-15 13:28:26 -07:00
Wenkai Du 057e30e705 Remove 2H4P condition from P2P channels adjustment (#890) 
[ROCm/rccl commit: 16dd05a58a]
 2023-09-13 12:54:21 -07:00
Ziyue Yang 6d593761dc Add single-node MI300X topology (#889) 
[ROCm/rccl commit: c1bfd5f0d8]
 2023-09-13 11:07:17 -07:00
akolliasAMD 8685535346 Fixed topo_expl (#891) 
[ROCm/rccl commit: 762a42859e]
 2023-09-13 12:05:35 -06:00
Wenkai Du b0a16d80ff Fix crash when NPKit is enabled (#887) 
[ROCm/rccl commit: 6a4d5ec089]
 2023-09-13 11:00:12 -07:00
Audrey MP 2e3d45a53a Gcn arch name (#886) 
We use CMake to determine if we're compiling against a version of ROCm that supports gcnArchName and handles architecture checking appropriately. It includes a few helper functions as drop ins for the functionality we used gcnArch for before; sometimes to enable flags, and sometimes to set frequencies.

[ROCm/rccl commit: e58ec78d35]
 2023-09-12 15:34:40 -04:00
Andy li 43a9fd00ee enable hip graph on multi-node (#884) 
* initial checkin

* enable msccl when hip graph is on

* remove the commented out code of msccl enable check

* clean up the code

* remove the msccl HighestTransportType check logic

[ROCm/rccl commit: e1dc4d5e42]
 2023-09-11 15:30:04 -07:00
Nusrat Islam e0ddc8f549 Merge pull request #880 from nusislam/msccl-npkit 
msccl: add NPKIT profiling for MSCCL send-recv

[ROCm/rccl commit: e46602e44a]
 2023-09-08 14:13:14 -05:00
Nusrat Islam ffbfe43500 msccl: add NPKIT profiling for MSCCL send-recv 
[ROCm/rccl commit: a283f55f12]
 2023-09-08 13:11:16 -05:00
dependabot[bot] ae27ee7108 Bump rocm-docs-core from 0.22.0 to 0.24.0 in /docs/sphinx (#882) 
* Bump rocm-docs-core from 0.22.0 to 0.24.0 in /docs/sphinx

Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core) from 0.22.0 to 0.24.0.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases)
- [Changelog](https://github.com/RadeonOpenCompute/rocm-docs-core/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v0.22.0...v0.24.0)

---
updated-dependencies:
- dependency-name: rocm-docs-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update requirements.in

* Update requirements.txt

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sam Wu <sam.wu2@amd.com>

[ROCm/rccl commit: a893e8a4ab]
 2023-09-07 11:27:53 -06:00
dependabot[bot] ecd3fb42b0 Bump gitpython from 3.1.32 to 3.1.34 in /docs/sphinx (#879) 
Bumps [gitpython](https://github.com/gitpython-developers/GitPython) from 3.1.32 to 3.1.34.
- [Release notes](https://github.com/gitpython-developers/GitPython/releases)
- [Changelog](https://github.com/gitpython-developers/GitPython/blob/main/CHANGES)
- [Commits](https://github.com/gitpython-developers/GitPython/compare/3.1.32...3.1.34)

---
updated-dependencies:
- dependency-name: gitpython
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

[ROCm/rccl commit: 62a09100a6]
 2023-09-06 14:08:45 -06:00
Bertan Dogancay 2aa31c89df RCCL should use hipPointerAttribute_t.type (#872) 
[ROCm/rccl commit: 6230b5f6b3]
 2023-09-05 09:44:12 -06:00
Wenkai Du 009990efca Remove --hipcc-func-supp with recent compilers (#874) 
* Remove --hipcc-func-supp with recent compilers

* Remove HIP_UNCACHED_MEMORY deetction from header file

[ROCm/rccl commit: 2baca3a55a]
 2023-09-01 07:53:18 -07:00
dependabot[bot] 6ec15d550d Bump rocm-docs-core from 0.21.0 to 0.22.0 in /docs/sphinx (#875) 
Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core) from 0.21.0 to 0.22.0.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases)
- [Changelog](https://github.com/RadeonOpenCompute/rocm-docs-core/blob/v0.22.0/CHANGELOG.md)
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v0.21.0...v0.22.0)

---
updated-dependencies:
- dependency-name: rocm-docs-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

[ROCm/rccl commit: e642681fd3]
 2023-09-01 08:46:43 -06:00
Wenkai Du be412b848b Update ll_latency_test and add CUDA version (#873) 
[ROCm/rccl commit: c6dd6f6237]
 2023-08-30 16:29:42 -07:00
dependabot[bot] 29b01e4b3b Bump rocm-docs-core from 0.20.0 to 0.21.0 in /docs/sphinx (#870) 
* Bump rocm-docs-core from 0.20.0 to 0.21.0 in /docs/sphinx

Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core) from 0.20.0 to 0.21.0.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases)
- [Changelog](https://github.com/RadeonOpenCompute/rocm-docs-core/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v0.20.0...v0.21.0)

---
updated-dependencies:
- dependency-name: rocm-docs-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* replace noCI with ci:docs-only label

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sam Wu <sam.wu2@amd.com>

[ROCm/rccl commit: a433fcc726]
 2023-08-30 08:56:38 -06:00
gilbertlee-amd 5fe857c562 More robust msccl shared directory location discovery (#868) 
[ROCm/rccl commit: 4297315de7]
 2023-08-30 08:10:14 -06:00
Pedram Alizadeh b4f96a23e6 optimizing COLL_UNROLL for MI100 machines (#863) 
[ROCm/rccl commit: e7f27c66e0]
 2023-08-29 12:49:06 -04:00
Bertan Dogancay bcb8075e38 Add 0-byte test for send/recv (#865) 
[ROCm/rccl commit: 0a01dc2f19]
 2023-08-29 09:14:18 -06:00
Wenkai Du 4fefe1ce7d rccl-prim-test: use non-temporal access (#867) 
[ROCm/rccl commit: aa95985867]
 2023-08-28 08:28:05 -07:00
Bertan Dogancay 487391e8bb Add ncclCommSplit test (#852) 
Add ncclSplitCommTest

[ROCm/rccl commit: 9d11cd092f]
 2023-08-25 16:26:45 -06:00
Wenkai Du af04103d72 Add MSCCL xml files (#861) 
[ROCm/rccl commit: aeca1af374]
 2023-08-23 14:12:34 -07:00
gilbertlee-amd 3dd880fe74 Minor fix for some msccl installations (#862) 
[ROCm/rccl commit: 5bcd3768cc]
 2023-08-23 13:48:58 -06:00
Sylvain Jeaugey 26b91b9dbb 2.18.5-1 
Fix NVLS search (issue #931).
Increase max IB NICs to 32.
Fix inconsistent device ordering (issue #820).
Try to use different devices for different GPUs in systems with
more than one NIC per GFU.


[ROCm/rccl commit: 559b70f86c]
 2023-08-23 06:32:36 -07:00
arvindcheru 5e60fb93d5 366827 - Disable file reorg backward compatibility support by default (#849) 
* Disable file reorg backward compatibility support by default

- File Reorg backward compatibility option set to OFF

* Update install.sh

[ROCm/rccl commit: 6ee758382e]
 2023-08-22 09:14:49 -04:00
Wenkai Du 5983f0e371 Use relaxed atomics for LL on GFX11 (#859) 
[ROCm/rccl commit: 6a0a6a37d9]
 2023-08-21 16:28:39 -07:00
David Pagan 75e3927f50 Fix static_assert string literal that contains a "\%". This is no longer (#860) 
valid. They can only be simple escape sequences. Removing '\' fixes
issue. Assert message now compiles and emits the '%' as expected.

[ROCm/rccl commit: 2ec2648247]
 2023-08-21 16:19:59 -07:00
akolliasAMD 56129830a6 NCCL_TREES variable and rome model fixes (#856) 
[ROCm/rccl commit: d33cd5a233]
 2023-08-21 10:35:37 -06:00
Wenkai Du 47330a62a6 p2p/ll-latency-test: convert to single thread tests (#857) 
[ROCm/rccl commit: 148e3430f4]
 2023-08-21 07:48:37 -07:00
Wenkai Du 6fdb4103b7 gfx11: don't use LL for sendrecv (#853) 
* gfx11: don't use LL for sendrecv

* Use builtin instead of inline asm

[ROCm/rccl commit: f70e3e569b]
 2023-08-17 08:50:51 -07:00
dependabot[bot] 84c77f7652 Bump gitpython from 3.1.31 to 3.1.32 in /docs/sphinx (#850) 
Bumps [gitpython](https://github.com/gitpython-developers/GitPython) from 3.1.31 to 3.1.32.
- [Release notes](https://github.com/gitpython-developers/GitPython/releases)
- [Changelog](https://github.com/gitpython-developers/GitPython/blob/main/CHANGES)
- [Commits](https://github.com/gitpython-developers/GitPython/compare/3.1.31...3.1.32)

---
updated-dependencies:
- dependency-name: gitpython
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

[ROCm/rccl commit: 621ccd783b]
 2023-08-11 15:08:00 -06:00
Wenkai Du 0c31452135 Add new model support (#847) 
* Add new model support

* Update new rings

[ROCm/rccl commit: 7044599575]
 2023-08-10 17:14:51 -07:00
Bertan Dogancay f602b16bcb Fix mscclLoadAlgo error (#846) 
[ROCm/rccl commit: da107ff2bc]
 2023-08-09 11:39:21 -06:00
Ziyue Yang 18811f6159 NPKit update (#844) 
* NPKit update

1. Enable NPKit for MSCCL kernels
2. Fix NPKit context index calculation for sendrecv kernels

* Update build script for npkit

[ROCm/rccl commit: d33a70e620]
 2023-08-08 17:30:40 -07:00
Wenkai Du cb291157f4 Detect HIP_UNCACHED_MEMORY support from HIP version (#842) 
[ROCm/rccl commit: d65c0830c6]
 2023-08-04 10:17:04 -07:00
Wenkai Du c328294820 gfx11xx: disable LL protocol to workaround mtype issue (#840) 
[ROCm/rccl commit: 8e58b65873]
 2023-08-04 07:53:07 -07:00
Wenkai Du c419755576 Fix merge error and replace inline asm (#838) 
[ROCm/rccl commit: 60efe26549]
 2023-08-03 13:46:40 -07:00
Wenkai Du c0729f28c8 Improve collective trace (#835) 
[ROCm/rccl commit: c8085eb704]
 2023-08-03 07:16:12 -07:00
Bertan Dogancay 74dd9c4807 Disable MSCCL kernels at compile time (#834) 
* Disable MSCCL kernels at compile time

[ROCm/rccl commit: 64c32d1c5b]
 2023-08-02 09:45:18 -06:00
dependabot[bot] 677f58edf6 Bump cryptography from 41.0.2 to 41.0.3 in /docs/sphinx (#836) 
Bumps [cryptography](https://github.com/pyca/cryptography) from 41.0.2 to 41.0.3.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pyca/cryptography/compare/41.0.2...41.0.3)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

[ROCm/rccl commit: 02ef257d64]
 2023-08-02 08:35:41 -06:00
Sylvain Jeaugey 020800d7b7 Fix inter-node NVLS graph search 
We were passing a net ID instead of a gpu index, which could cause
crashes if those were unrelated (and they usually are).

Issue #931


[ROCm/rccl commit: 8ed014bae9]
 2023-08-02 07:06:35 -07:00
Wenkai Du 56ab1e8771 p2p_latency_test: clean up IPC temp files at exit (#832) 
[ROCm/rccl commit: 0441eec32e]
 2023-07-31 08:11:07 -07:00
dependabot[bot] 9a6209f86a Bump rocm-docs-core from 0.19.0 to 0.20.0 in /docs/sphinx (#833) 
Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core) from 0.19.0 to 0.20.0.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases)
- [Changelog](https://github.com/RadeonOpenCompute/rocm-docs-core/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v0.19.0...v0.20.0)

---
updated-dependencies:
- dependency-name: rocm-docs-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

[ROCm/rccl commit: 898bc1ff37]
 2023-07-31 08:38:52 -06:00