AI/rocm-systems
2
0
Förgrening 0
Kod Ärenden Pull-förfrågningar Actions Packages Projekt Släpp Wiki Aktiviteter
1 476 Incheckningar 3 Grenar 0 Taggar
7c4389ee31ab164bbdecfd7dd7e7bd131cc55c79
Commit-Graf

1359 Incheckningar

Upphovsman SHA1 Meddelande Datum
Nilesh M Negi 7c4389ee31 [BUILD] Enable RCCL build with amdclang++ (#1128) 
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com>

[ROCm/rccl commit: 607e34dd99]
 2024-08-25 13:44:22 -04:00
Edgar Gabriel 5368ea024a Merge pull request #1299 from edgargabriel/topic/remove-multirank-examples 
Remove MultiRank examples

[ROCm/rccl commit: bba3559334]
 2024-08-23 08:32:16 -05:00
Wenkai Du 157cc5f6ba Add new Rome model (#1304) 
* Add another rome model and override

* Fix bug

* Fix typo

* Add ring

* Update ring

* Fix model matching

* Clean up

* Clean up

* Reverse rings for NCCL_RINGS input

* Only reverse NCCL_RINGS for ring graph

* Fix mapping issue when using  NCCL_RINGS

* Add NCCL_RINGS_REMAP to handle inconsistant net names

[ROCm/rccl commit: 532b70afb6]
 2024-08-23 08:45:43 +08:00
mberenjk 886b576722 adding all nccl apis to api_support to enable rccl tracing by rocprofv3 (#1297) 
* adding all nccl apis to api_support to enable rccl tracing by rocprofv3

Co-authored-by: Marzieh Berenjkoub <mberenjk@amd.com>
Co-authored-by: Jonathan R. Madsen <jonathanrmadsen@gmail.com>

[ROCm/rccl commit: db840f024e]
 2024-08-22 12:36:07 -05:00
dependabot[bot] 03e6755cf0 Bump rocm-docs-core from 1.6.2 to 1.7.1 in /docs/sphinx (#1305) 
Bumps [rocm-docs-core](https://github.com/ROCm/rocm-docs-core) from 1.6.2 to 1.7.1.
- [Release notes](https://github.com/ROCm/rocm-docs-core/releases)
- [Changelog](https://github.com/ROCm/rocm-docs-core/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/ROCm/rocm-docs-core/compare/v1.6.2...v1.7.1)

---
updated-dependencies:
- dependency-name: rocm-docs-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

[ROCm/rccl commit: 93b0c7418f]
 2024-08-20 13:04:36 -06:00
Wenkai Du d5a33e7107 Fix gfx940 CPX mode (#1290) 
[ROCm/rccl commit: d3171b51b7]
 2024-08-16 08:46:06 +08:00
Wenkai Du e770054b7f Fix model matching with PXN enable (#1295) 
[ROCm/rccl commit: eff56735b0]
 2024-08-16 06:16:00 +08:00
Edgar Gabriel 3d44929d08 Remove MultiRank examples 
remove the MultiRank examples, the features was never released (because
it didn't work reliably), and it might just cause confusion if somebody
sees it. In additional, the locdation in tools was suboptimal.


[ROCm/rccl commit: 8953a26bcd]
 2024-08-14 14:11:16 -07:00
akolliasAMD 38e189bb1e removed hcc mentions (#1291) 
[ROCm/rccl commit: d6c317d6ae]
 2024-08-14 15:04:13 -06:00
dependabot[bot] 09fe7f9b97 Bump rocm-docs-core from 1.5.0 to 1.6.2 in /docs/sphinx (#1287) 
Bumps [rocm-docs-core](https://github.com/ROCm/rocm-docs-core) from 1.5.0 to 1.6.2.
- [Release notes](https://github.com/ROCm/rocm-docs-core/releases)
- [Changelog](https://github.com/ROCm/rocm-docs-core/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/ROCm/rocm-docs-core/compare/v1.5.0...v1.6.2)

---
updated-dependencies:
- dependency-name: rocm-docs-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

[ROCm/rccl commit: dfd5106a4b]
 2024-08-09 11:04:57 -06:00
Pedram Alizadeh e40a0939f1 adding new tunning table for very large number of nodes (#1288) 
[ROCm/rccl commit: a25ca9bb90]
 2024-08-09 10:47:42 -04:00
Tim 9fdecceefb Adding core binding in info (#1212) 
Signed-off-by: AtlantaPepsi <timhu102@amd.com>

[ROCm/rccl commit: 4200964202]
 2024-08-08 11:36:24 -04:00
Nilesh M Negi 3e52d15ced [README] Tips on using less than 8 MI300 GPUs (#1270) 
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com>

[ROCm/rccl commit: a2474846f5]
 2024-08-06 11:12:09 -05:00
Nilesh M Negi 35f4a405f0 [BUILD] Update gfxTargets for ASAN build (#1242) 
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com>

[ROCm/rccl commit: 4f31ab85ea]
 2024-08-06 10:53:51 -05:00
Ziyue Yang 30e3db969f Fix number of loops in p2p-latency-test (#1286) 
[ROCm/rccl commit: 145a13235a]
 2024-08-05 13:35:56 -07:00
Nilesh M Negi 713ed3341d [BUILD] Disable MSCCLPP build by default (#1283) 
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com>

[ROCm/rccl commit: cb2e0615d7]
 2024-08-02 23:17:51 -05:00
Tim 3261e2a5fd Adding User Buffer Registration support for Unit test (#1199) 
* Adding UBR support for UT SendRecv

Signed-off-by: Tim Hu <timhu102@amd.com>

* Update test/common/TestBedChild.cpp

Co-authored-by: corey-derochie-amd <161367113+corey-derochie-amd@users.noreply.github.com>

---------

Signed-off-by: Tim Hu <timhu102@amd.com>
Co-authored-by: corey-derochie-amd <161367113+corey-derochie-amd@users.noreply.github.com>

[ROCm/rccl commit: a4793286c7]
 2024-07-30 13:39:25 -04:00
Wenkai Du 27b7998d13 Restore number of parallel linking jobs (#1278) 
* Restore number of parallel linking jobs

* Dynamically adjust number of linker jobs with limit of 16 jobs max

* Fix typo

* Add cgroup v1 support

[ROCm/rccl commit: ca5341d419]
 2024-07-30 08:04:14 -07:00
Pedram Alizadeh 562eb08978 Adding tuner plugin example for MI300 (#1274) 
[ROCm/rccl commit: b005c13292]
 2024-07-29 15:43:36 -04:00
Richard Barnes 92d874be50 Remove unused but set variable from all_reduce.h (#1258) 
Allows `-Wunused-but-set-variable` to pass

[ROCm/rccl commit: d09b152aa0]
 2024-07-29 08:11:24 -07:00
Richard Barnes 3d208c8eb9 Remove unused but set variable from prims_ll128.h (#1257) 
Allows `-Wunused-but-set-variable` to pass

[ROCm/rccl commit: 86a4ad6e8b]
 2024-07-29 08:11:01 -07:00
Richard Barnes 780324296c Remove unused but set variable from prims_ll.h (#1256) 
Allows `-Wunused-but-set-variable` to pass

[ROCm/rccl commit: 7ad432ee23]
 2024-07-29 08:10:38 -07:00
akolliasAMD 37c44d531b gfx12 Disable ll protocol (#1268) 
[ROCm/rccl commit: c246e25f8e]
 2024-07-26 08:59:55 -06:00
Sam Wu 0aa81c3194 Double compile timeout for extended ci to 400 min (#1277) 
[ROCm/rccl commit: 05dca6def9]
 2024-07-26 09:59:36 -05:00
Benjamin Kitor d2df042c36 topo_expl: Update channel masks for >64 channels (#1279) 
[ROCm/rccl commit: 4bc118336a]
 2024-07-25 17:27:34 -07:00
Joseph Macaranas 496e98a73f Merge pull request #1262 from ROCm/amd/jmacaran/externalCImainline 
External CI: Add triggers for mainline branch

[ROCm/rccl commit: 00cd4dae1e]
 2024-07-22 20:41:01 -04:00
corey-derochie-amd 94910b8f80 Fix bug where the first collective call was using MSCCL instead of MSCCL++ (#1260) 
[ROCm/rccl commit: 69135976d6]
 2024-07-22 15:46:47 -06:00
saurabhAMD 24e1ed5288 Adding performance collection feature in rccl_replayer, and updating MSCCL logging and replayer parsing (#1265) 
* Adding performance collection feature in rccl_replayer, and updating MSCCL logging and replayer parsing

* Performance collection feature in rccl_replayer, and updating MSCCL logging and replayer parsing

[ROCm/rccl commit: cf311b71ee]
 2024-07-22 10:21:29 -05:00
corey-derochie-amd f2b2372056 Only initialize MSCCL++ when runtime-enabled. (#1266) 
[ROCm/rccl commit: b31b4082dd]
 2024-07-22 00:41:31 -06:00
mberenjk 863b213fd2 adding rocprof and pytorch parser scripts (#1214) 
* adding rocprof parser script

* adding the support for multiple json files

* adding pytorch profiler script

* remove filtering from pytorch log

* adding the addressing the comments and add the feature to parse all kernels

* completing the report for torch profiler

---------

Co-authored-by: Marzieh Berenjkoub <mberenjk@amd.com>

[ROCm/rccl commit: 519843d2cf]
 2024-07-19 14:51:28 -05:00
Nusrat Islam df63c9772f Enable CPX mode for MI300X (#1259) 
* graph: enable cpx mode for MI300X

* graph: tune limits for cpx and cleanup

[ROCm/rccl commit: 6f331b0d43]
 2024-07-19 11:30:37 -05:00
Wenkai Du 54e4899607 Template unroll for RCCL kernels (#1250) 
* Template unroll for RCCL kernels

* Adding unroll template arg during CMake hipification

* Reduce linking parallel jobs to avoid OOM in CI

* Workaround issues with UT tests

SWDEV-469533: register spill fix is needed for mainline build
LWPCOMMLIBS-369: cannot enable 112 channels with 80 CUs
Use -parallel-jobs=8 for linking

* CI: do not use -j 16 when building

* CI: use -j 8 when building

* Only reduce parallel linking job for CI extended

* Restore original jenkins command. Change parallel linking jobs in cmake

* Disable MSCCLPP

---------

Co-authored-by: gilbertlee-amd <gilbert.lee@amd.com>

[ROCm/rccl commit: 89349f2ce4]
 2024-07-19 08:15:59 -07:00
Nilesh M Negi 73e17b3e70 Consistent channel shuffling for MI300X multi-node (#1255) 
* Revert "[GRAPH] Use channel shuffling only for IB systems (#1228)"

This reverts commit 8a7dd0e590.

* Revert "Revert "Changing channel stride for MI300X multinode (#1196)" (#1224)"

This reverts commit bb6fab3d8e.

[ROCm/rccl commit: a1ef217b32]
 2024-07-18 10:18:09 -05:00
amd-jmacaran 1ade35ac64 External CI: Add triggers for mainline branch 
[ROCm/rccl commit: 346fee4c83]
 2024-07-17 23:16:49 -04:00
Nilesh M Negi 13134c6c64 [GRAPH] Disable MSCCL override of no. of channels (#1187) 
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com>

[ROCm/rccl commit: 67e867271f]
 2024-07-15 10:45:21 -05:00
corey-derochie-amd da08e5ed1e Only enable MSCCL++ AllReduce for message sizes that are multiples 32 (#1253) 
* Only enable MSCCL++ AllReduce for message sizes that are multiples of 32. MSCCL++ does not handle these other sizes.

* Sanitized MSCCL++ logging.

[ROCm/rccl commit: 9cbb3da224]
 2024-07-12 17:04:23 -07:00
corey-derochie-amd b8542c2477 Integrated RCCL with MSCCL++ for small message sizes (#1231) 
[ROCm/rccl commit: 6dc47eecd7]
 2024-07-12 15:32:58 -06:00
Rahul Vaidya f60367f1c3 Improved version reporting in NCCL_DEBUG=VERSION (#1232) 
* Improved version reporting in NCCL_DEBUG=VERSION.

Signed-off-by: rahulvaidya20 <ravaidya@amd.com>

* Version reporting changes

Signed-off-by: rahulvaidya20 <ravaidya@amd.com>

* Versioning changes: Initialized char arrays to null and fixed typo.

---------

Signed-off-by: rahulvaidya20 <ravaidya@amd.com>

[ROCm/rccl commit: c755b9cf93]
 2024-07-12 08:14:29 -05:00
akolliasAMD 942555fd21 gfx12 initial enablement (#1219) 
[ROCm/rccl commit: 63e4d76e23]
 2024-07-10 13:32:09 -06:00
akolliasAMD 9644767ead cleaned codeowners file (#1247) 
[ROCm/rccl commit: 7e78641dc1]
 2024-07-09 10:31:23 -06:00
dependabot[bot] 4a75b7efc4 Bump certifi from 2024.2.2 to 2024.7.4 in /docs/sphinx (#1241) 
Bumps [certifi](https://github.com/certifi/python-certifi) from 2024.2.2 to 2024.7.4.
- [Commits](https://github.com/certifi/python-certifi/compare/2024.02.02...2024.07.04)

---
updated-dependencies:
- dependency-name: certifi
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

[ROCm/rccl commit: 71e0f551e7]
 2024-07-08 11:49:35 -06:00
dependabot[bot] e73afaecaa Bump rocm-docs-core from 1.4.1 to 1.5.0 in /docs/sphinx (#1240) 
Bumps [rocm-docs-core](https://github.com/ROCm/rocm-docs-core) from 1.4.1 to 1.5.0.
- [Release notes](https://github.com/ROCm/rocm-docs-core/releases)
- [Changelog](https://github.com/ROCm/rocm-docs-core/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/ROCm/rocm-docs-core/compare/v1.4.1...v1.5.0)

---
updated-dependencies:
- dependency-name: rocm-docs-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

[ROCm/rccl commit: 799a8b5e59]
 2024-07-08 10:59:32 -06:00
corey-derochie-amd 37bf54b8f8 Enable multi-threading for MSCCL (#1203) 
MSCCL can now run in a multi-threaded configuration. To test in the unit tests, added the ENABLE_OPENMP compile definition flag and the --openmp-test-enable flag to the unit test build script. To activate, set the environment variables UT_MULTITHREADED=1 and UT_PROCESS_MASK=1. Set Jenkins to use this mode.

[ROCm/rccl commit: 0c36d571ea]
 2024-07-04 09:34:38 -06:00
Wenkai Du b5bc883f61 Checking kernel header files only when missing sysfs entry (#1239) 
[ROCm/rccl commit: 45f3fbc52f]
 2024-07-03 15:53:15 -07:00
dependabot[bot] a4fba80661 Bump rocm-docs-core from 1.4.0 to 1.4.1 in /docs/sphinx (#1233) 
Bumps [rocm-docs-core](https://github.com/ROCm/rocm-docs-core) from 1.4.0 to 1.4.1.
- [Release notes](https://github.com/ROCm/rocm-docs-core/releases)
- [Changelog](https://github.com/ROCm/rocm-docs-core/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/ROCm/rocm-docs-core/compare/v1.4.0...v1.4.1)

---
updated-dependencies:
- dependency-name: rocm-docs-core
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

[ROCm/rccl commit: aeaaacad26]
 2024-07-03 09:32:49 -06:00
Nilesh M Negi 8a7dd0e590 [GRAPH] Use channel shuffling only for IB systems (#1228) 
* [GRAPH] Use channel shuffling only for IB systems

Signed-off-by: nileshnegi <Nilesh.Negi@amd.com>

* [GRAPH] Define channels=48 for gfx94 RoCE systems

Signed-off-by: nileshnegi <Nilesh.Negi@amd.com>

* [GRAPH] Increase channels for RoCE gfx94 systems

Signed-off-by: nileshnegi <Nilesh.Negi@amd.com>

---------

Signed-off-by: nileshnegi <Nilesh.Negi@amd.com>

[ROCm/rccl commit: 5be3b713ef]
 2024-07-02 12:20:40 -05:00
Wenkai Du b3e9d2d61b NPKit: separate time stamps for GPU access from different blocks (#1229) 
To avoid races in memory access in GPU

[ROCm/rccl commit: 9d8f68b4ee]
 2024-06-28 08:00:22 -07:00
Nusrat Islam c24b1ff14f graph: fix minNchannels for multi-node overwrite (#1230) 
[ROCm/rccl commit: b09ea29d66]
 2024-06-26 16:56:10 -05:00
Wenkai Du bb6fab3d8e Revert "Changing channel stride for MI300X multinode (#1196)" (#1224) 
This reverts channel stride change in commit
a009e43f3c

[ROCm/rccl commit: ad31d93f3d]
 2024-06-25 14:03:30 -07:00
saurabhAMD de7ea612d7 Unit Tests for testing channels (#1222) 
[ROCm/rccl commit: e170f41ddd]
 2024-06-25 10:10:10 -05:00