4e2eeafdf6
Update README.md ( #1321 )
...
update note formatting
2024-09-05 14:23:36 -07:00
d3012d3307
[BUILD] Support clang++ compiler ( #1316 )
...
* [BUILD] Support clang++ compiler
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com >
* [BUILD] Enable check_symbol_exists for BFD and clang++
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com >
* [BUILD] Define default C compiler
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com >
---------
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com >
2024-09-05 09:59:58 -05:00
391c7ea070
what-is-rccl ( #1312 )
...
* what-is-rccl
* create Installation instreuctions from README
* update README link
* Add using-nccl
* Add note about docs
* correct doc path
* sources to source
* correct docs link
2024-09-05 06:54:48 -07:00
e056fe8f7e
Disable MSCCL for the non-multi-process case by default ( #1307 )
...
* Added `RCCL_MSCCL_ENABLE_SINGLE_PROCESS` runtime flag to return to the original MSCCL enablement behaviour except when explicitly enabling for multi-thread.
* Added documentation for the new `RCCL_MSCCL_ENABLE_SINGLE_PROCESS` runtime env var.
2024-09-04 11:11:50 -06:00
1a48e19b18
topo_expl: update sm fields in topo xml files ( #1310 )
2024-08-29 12:03:51 -07:00
833435be18
graph: fix for MI300X 64 GPU case ( #1308 )
...
PR #1290 introduced a failure for 64 GPU case on MI300X. This PR
fixes the failure.
2024-08-26 18:37:58 -05:00
607e34dd99
[BUILD] Enable RCCL build with amdclang++ ( #1128 )
...
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com >
2024-08-25 13:44:22 -04:00
bba3559334
Merge pull request #1299 from edgargabriel/topic/remove-multirank-examples
...
Remove MultiRank examples
2024-08-23 08:32:16 -05:00
532b70afb6
Add new Rome model ( #1304 )
...
* Add another rome model and override
* Fix bug
* Fix typo
* Add ring
* Update ring
* Fix model matching
* Clean up
* Clean up
* Reverse rings for NCCL_RINGS input
* Only reverse NCCL_RINGS for ring graph
* Fix mapping issue when using NCCL_RINGS
* Add NCCL_RINGS_REMAP to handle inconsistant net names
2024-08-23 08:45:43 +08:00
db840f024e
adding all nccl apis to api_support to enable rccl tracing by rocprofv3 ( #1297 )
...
* adding all nccl apis to api_support to enable rccl tracing by rocprofv3
Co-authored-by: Marzieh Berenjkoub <mberenjk@amd.com >
Co-authored-by: Jonathan R. Madsen <jonathanrmadsen@gmail.com >
2024-08-22 12:36:07 -05:00
93b0c7418f
Bump rocm-docs-core from 1.6.2 to 1.7.1 in /docs/sphinx ( #1305 )
...
Bumps [rocm-docs-core](https://github.com/ROCm/rocm-docs-core ) from 1.6.2 to 1.7.1.
- [Release notes](https://github.com/ROCm/rocm-docs-core/releases )
- [Changelog](https://github.com/ROCm/rocm-docs-core/blob/develop/CHANGELOG.md )
- [Commits](https://github.com/ROCm/rocm-docs-core/compare/v1.6.2...v1.7.1 )
---
updated-dependencies:
- dependency-name: rocm-docs-core
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-20 13:04:36 -06:00
d3171b51b7
Fix gfx940 CPX mode ( #1290 )
2024-08-16 08:46:06 +08:00
eff56735b0
Fix model matching with PXN enable ( #1295 )
2024-08-16 06:16:00 +08:00
8953a26bcd
Remove MultiRank examples
...
remove the MultiRank examples, the features was never released (because
it didn't work reliably), and it might just cause confusion if somebody
sees it. In additional, the locdation in tools was suboptimal.
2024-08-14 14:11:16 -07:00
d6c317d6ae
removed hcc mentions ( #1291 )
2024-08-14 15:04:13 -06:00
dfd5106a4b
Bump rocm-docs-core from 1.5.0 to 1.6.2 in /docs/sphinx ( #1287 )
...
Bumps [rocm-docs-core](https://github.com/ROCm/rocm-docs-core ) from 1.5.0 to 1.6.2.
- [Release notes](https://github.com/ROCm/rocm-docs-core/releases )
- [Changelog](https://github.com/ROCm/rocm-docs-core/blob/develop/CHANGELOG.md )
- [Commits](https://github.com/ROCm/rocm-docs-core/compare/v1.5.0...v1.6.2 )
---
updated-dependencies:
- dependency-name: rocm-docs-core
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-09 11:04:57 -06:00
a25ca9bb90
adding new tunning table for very large number of nodes ( #1288 )
2024-08-09 10:47:42 -04:00
4200964202
Adding core binding in info ( #1212 )
...
Signed-off-by: AtlantaPepsi <timhu102@amd.com >
2024-08-08 11:36:24 -04:00
a2474846f5
[README] Tips on using less than 8 MI300 GPUs ( #1270 )
...
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com >
2024-08-06 11:12:09 -05:00
4f31ab85ea
[BUILD] Update gfxTargets for ASAN build ( #1242 )
...
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com >
2024-08-06 10:53:51 -05:00
145a13235a
Fix number of loops in p2p-latency-test ( #1286 )
2024-08-05 13:35:56 -07:00
cb2e0615d7
[BUILD] Disable MSCCLPP build by default ( #1283 )
...
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com >
2024-08-02 23:17:51 -05:00
a4793286c7
Adding User Buffer Registration support for Unit test ( #1199 )
...
* Adding UBR support for UT SendRecv
Signed-off-by: Tim Hu <timhu102@amd.com >
* Update test/common/TestBedChild.cpp
Co-authored-by: corey-derochie-amd <161367113+corey-derochie-amd@users.noreply.github.com >
---------
Signed-off-by: Tim Hu <timhu102@amd.com >
Co-authored-by: corey-derochie-amd <161367113+corey-derochie-amd@users.noreply.github.com >
2024-07-30 13:39:25 -04:00
ca5341d419
Restore number of parallel linking jobs ( #1278 )
...
* Restore number of parallel linking jobs
* Dynamically adjust number of linker jobs with limit of 16 jobs max
* Fix typo
* Add cgroup v1 support
2024-07-30 08:04:14 -07:00
b005c13292
Adding tuner plugin example for MI300 ( #1274 )
2024-07-29 15:43:36 -04:00
d09b152aa0
Remove unused but set variable from all_reduce.h ( #1258 )
...
Allows `-Wunused-but-set-variable` to pass
2024-07-29 08:11:24 -07:00
86a4ad6e8b
Remove unused but set variable from prims_ll128.h ( #1257 )
...
Allows `-Wunused-but-set-variable` to pass
2024-07-29 08:11:01 -07:00
7ad432ee23
Remove unused but set variable from prims_ll.h ( #1256 )
...
Allows `-Wunused-but-set-variable` to pass
2024-07-29 08:10:38 -07:00
c246e25f8e
gfx12 Disable ll protocol ( #1268 )
2024-07-26 08:59:55 -06:00
05dca6def9
Double compile timeout for extended ci to 400 min ( #1277 )
2024-07-26 09:59:36 -05:00
4bc118336a
topo_expl: Update channel masks for >64 channels ( #1279 )
2024-07-25 17:27:34 -07:00
00cd4dae1e
Merge pull request #1262 from ROCm/amd/jmacaran/externalCImainline
...
External CI: Add triggers for mainline branch
2024-07-22 20:41:01 -04:00
69135976d6
Fix bug where the first collective call was using MSCCL instead of MSCCL++ ( #1260 )
2024-07-22 15:46:47 -06:00
cf311b71ee
Adding performance collection feature in rccl_replayer, and updating MSCCL logging and replayer parsing ( #1265 )
...
* Adding performance collection feature in rccl_replayer, and updating MSCCL logging and replayer parsing
* Performance collection feature in rccl_replayer, and updating MSCCL logging and replayer parsing
2024-07-22 10:21:29 -05:00
b31b4082dd
Only initialize MSCCL++ when runtime-enabled. ( #1266 )
2024-07-22 00:41:31 -06:00
519843d2cf
adding rocprof and pytorch parser scripts ( #1214 )
...
* adding rocprof parser script
* adding the support for multiple json files
* adding pytorch profiler script
* remove filtering from pytorch log
* adding the addressing the comments and add the feature to parse all kernels
* completing the report for torch profiler
---------
Co-authored-by: Marzieh Berenjkoub <mberenjk@amd.com >
2024-07-19 14:51:28 -05:00
6f331b0d43
Enable CPX mode for MI300X ( #1259 )
...
* graph: enable cpx mode for MI300X
* graph: tune limits for cpx and cleanup
2024-07-19 11:30:37 -05:00
89349f2ce4
Template unroll for RCCL kernels ( #1250 )
...
* Template unroll for RCCL kernels
* Adding unroll template arg during CMake hipification
* Reduce linking parallel jobs to avoid OOM in CI
* Workaround issues with UT tests
SWDEV-469533: register spill fix is needed for mainline build
LWPCOMMLIBS-369: cannot enable 112 channels with 80 CUs
Use -parallel-jobs=8 for linking
* CI: do not use -j 16 when building
* CI: use -j 8 when building
* Only reduce parallel linking job for CI extended
* Restore original jenkins command. Change parallel linking jobs in cmake
* Disable MSCCLPP
---------
Co-authored-by: gilbertlee-amd <gilbert.lee@amd.com >
2024-07-19 08:15:59 -07:00
a1ef217b32
Consistent channel shuffling for MI300X multi-node ( #1255 )
...
* Revert "[GRAPH] Use channel shuffling only for IB systems (#1228 )"
This reverts commit 5be3b713ef#1196 )" (#1224 )"
This reverts commit ad31d93f3d
2024-07-18 10:18:09 -05:00
346fee4c83
External CI: Add triggers for mainline branch
2024-07-17 23:16:49 -04:00
67e867271f
[GRAPH] Disable MSCCL override of no. of channels ( #1187 )
...
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com >
2024-07-15 10:45:21 -05:00
9cbb3da224
Only enable MSCCL++ AllReduce for message sizes that are multiples 32 ( #1253 )
...
* Only enable MSCCL++ AllReduce for message sizes that are multiples of 32. MSCCL++ does not handle these other sizes.
* Sanitized MSCCL++ logging.
2024-07-12 17:04:23 -07:00
6dc47eecd7
Integrated RCCL with MSCCL++ for small message sizes ( #1231 )
2024-07-12 15:32:58 -06:00
c755b9cf93
Improved version reporting in NCCL_DEBUG=VERSION ( #1232 )
...
* Improved version reporting in NCCL_DEBUG=VERSION.
Signed-off-by: rahulvaidya20 <ravaidya@amd.com >
* Version reporting changes
Signed-off-by: rahulvaidya20 <ravaidya@amd.com >
* Versioning changes: Initialized char arrays to null and fixed typo.
---------
Signed-off-by: rahulvaidya20 <ravaidya@amd.com >
2024-07-12 08:14:29 -05:00
63e4d76e23
gfx12 initial enablement ( #1219 )
2024-07-10 13:32:09 -06:00
7e78641dc1
cleaned codeowners file ( #1247 )
2024-07-09 10:31:23 -06:00
71e0f551e7
Bump certifi from 2024.2.2 to 2024.7.4 in /docs/sphinx ( #1241 )
...
Bumps [certifi](https://github.com/certifi/python-certifi ) from 2024.2.2 to 2024.7.4.
- [Commits](https://github.com/certifi/python-certifi/compare/2024.02.02...2024.07.04 )
---
updated-dependencies:
- dependency-name: certifi
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-08 11:49:35 -06:00
799a8b5e59
Bump rocm-docs-core from 1.4.1 to 1.5.0 in /docs/sphinx ( #1240 )
...
Bumps [rocm-docs-core](https://github.com/ROCm/rocm-docs-core ) from 1.4.1 to 1.5.0.
- [Release notes](https://github.com/ROCm/rocm-docs-core/releases )
- [Changelog](https://github.com/ROCm/rocm-docs-core/blob/develop/CHANGELOG.md )
- [Commits](https://github.com/ROCm/rocm-docs-core/compare/v1.4.1...v1.5.0 )
---
updated-dependencies:
- dependency-name: rocm-docs-core
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-08 10:59:32 -06:00
0c36d571ea
Enable multi-threading for MSCCL ( #1203 )
...
MSCCL can now run in a multi-threaded configuration. To test in the unit tests, added the ENABLE_OPENMP compile definition flag and the --openmp-test-enable flag to the unit test build script. To activate, set the environment variables UT_MULTITHREADED=1 and UT_PROCESS_MASK=1. Set Jenkins to use this mode.
2024-07-04 09:34:38 -06:00
45f3fbc52f
Checking kernel header files only when missing sysfs entry ( #1239 )
2024-07-03 15:53:15 -07:00
randyh62
Nilesh M Negi
corey-derochie-amd
Wenkai Du
Nusrat Islam
Edgar Gabriel
mberenjk
dependabot[bot]
Edgar Gabriel
akolliasAMD
Pedram Alizadeh
Tim
Ziyue Yang
Richard Barnes
Sam Wu
Benjamin Kitor
Joseph Macaranas
saurabhAMD
amd-jmacaran
Rahul Vaidya