123fbe8e54
Bump cryptography from 41.0.0 to 41.0.2 in /docs/sphinx ( #809 )
...
Bumps [cryptography](https://github.com/pyca/cryptography ) from 41.0.0 to 41.0.2.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst )
- [Commits](https://github.com/pyca/cryptography/compare/41.0.0...41.0.2 )
---
updated-dependencies:
- dependency-name: cryptography
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17 08:47:42 -06:00
b1cddcaf9a
Add GPU P2P ping-pong latency test tool ( #804 )
...
* Add GPU P2P ping-pong latency test tool
* Address comments
* Fix IPC issue in gfx94x
2023-07-14 07:41:29 -07:00
f41ea11444
rccl-prim-test: calculate iterations' standard deviation ( #803 )
...
* rccl-prim-test: calculate iterations' standard deviation
* Add default ring configuration for gfx940
* Use hipDeviceMallocUncached on gfx94x
2023-07-13 11:05:50 -07:00
848e60b00c
Fix path finding in msccl internal scheduler ( #794 )
2023-07-12 13:31:28 -07:00
43f13cd25a
rccl-prim-test: calculate throughput standard deviations ( #802 )
2023-07-12 10:04:40 -07:00
d52f19f410
Bump rocm-docs-core from 0.18.4 to 0.19.0 in /docs/sphinx ( #801 )
...
Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core ) from 0.18.4 to 0.19.0.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases )
- [Changelog](https://github.com/RadeonOpenCompute/rocm-docs-core/blob/develop/CHANGELOG.md )
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v0.18.4...v0.19.0 )
---
updated-dependencies:
- dependency-name: rocm-docs-core
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-12 08:57:34 -06:00
0f14e5a640
npkit: separate network timing between send and test ( #798 )
2023-07-10 09:31:49 -07:00
c095424e4d
Merge pull request #797 from nusislam/allgather-mi250-perf
...
device: fine tune MI200/MI250 simple protocol performance
2023-07-10 09:53:03 -05:00
58e53dfd37
device: fine tune MI200/MI250 simple protocol performance
...
With Simple protocol, unroll factor of 4 offers better
performance for most of the collectives (on MI200. MI250, and
MI300) except large message allreduce with Ring algorithm
on MI250 and MI200). This PR changes the default unroll factor
to 4 while adding fine tuning for reduction operations.
2023-07-08 20:21:18 -05:00
6ef70811d2
Bump rocm-docs-core from 0.18.2 to 0.18.4 in /docs/sphinx ( #796 )
...
Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core ) from 0.18.2 to 0.18.4.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases )
- [Changelog](https://github.com/RadeonOpenCompute/rocm-docs-core/blob/develop/CHANGELOG.md )
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v0.18.2...v0.18.4 )
---
updated-dependencies:
- dependency-name: rocm-docs-core
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-06 08:41:28 -06:00
397716c04d
Merge pull request #795 from wenkaidu/nccl_sync
...
Sync latest update from NCCL
2023-07-05 09:51:48 -07:00
e0c70af46b
Merge remote-tracking branch 'nccl/master' into nccl_sync
2023-07-05 07:53:53 -07:00
ce6a2ffac8
Merge pull request #782 from ROCmSoftwarePlatform/2.18.3
...
Sync up with NCCL 2.18.3
2023-06-29 15:04:16 -07:00
9bba4a2f2a
added npkit support into the all_gather run ring algorithm ( #790 )
2023-06-29 13:59:54 -06:00
2e00fa4f09
Bump rocm-docs-core from 0.18.1 to 0.18.2 in /docs/sphinx ( #791 )
...
Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core ) from 0.18.1 to 0.18.2.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases )
- [Changelog](https://github.com/RadeonOpenCompute/rocm-docs-core/blob/develop/CHANGELOG.md )
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v0.18.1...v0.18.2 )
---
updated-dependencies:
- dependency-name: rocm-docs-core
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-29 08:31:25 -06:00
cf8cfa88a8
Re-enabled graph tests ( #736 )
...
* enabled graph tests
* joined multi and single process CI testing
2023-06-29 08:08:17 -06:00
f7c553edad
Report unit test environment variable values as part of output ( #789 )
2023-06-29 07:13:05 -06:00
8de3714152
Bump rocm-docs-core from 0.17.2 to 0.18.1 in /docs/sphinx ( #788 )
...
Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core ) from 0.17.2 to 0.18.1.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases )
- [Changelog](https://github.com/RadeonOpenCompute/rocm-docs-core/blob/develop/CHANGELOG.md )
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v0.17.2...v0.18.1 )
---
updated-dependencies:
- dependency-name: rocm-docs-core
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 08:37:12 -06:00
6e24ef4e1f
Prevent WR index truncation in the InfiniBand transport plugin
2023-06-28 11:39:19 +02:00
e2097e088e
Bump rocm-docs-core from 0.16.0 to 0.17.2 in /docs/sphinx ( #787 )
...
* Bump rocm-docs-core from 0.16.0 to 0.17.2 in /docs/sphinx
Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core ) from 0.16.0 to 0.17.2.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases )
- [Changelog](https://github.com/RadeonOpenCompute/rocm-docs-core/blob/develop/CHANGELOG.md )
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v0.16.0...v0.17.2 )
---
updated-dependencies:
- dependency-name: rocm-docs-core
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
* set external_projects_current_project in conf.py
---------
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sam Wu <sam.wu2@amd.com >
2023-06-27 09:24:44 -06:00
abd0615351
Merge remote-tracking branch 'nccl/master' into develop
2023-06-26 22:51:56 +00:00
bd14ac8b59
ASAN build excluding additional files, Algodir support for share folder
...
* ASAN build excluding additional files, Algodir support for share folder (#786 )
* Algodir support for share folder
2023-06-23 10:57:20 -04:00
bb55848450
Limiting # parallel jobs in install script to 16 by default, and new -j/--jobs flag ( #785 )
2023-06-22 14:30:44 -06:00
4ebf17b15e
Bump rocm-docs-core from 0.15.0 to 0.16.0 in /docs/sphinx ( #784 )
...
Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core ) from 0.15.0 to 0.16.0.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases )
- [Changelog](https://github.com/RadeonOpenCompute/rocm-docs-core/blob/develop/CHANGELOG.md )
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v0.15.0...v0.16.0 )
---
updated-dependencies:
- dependency-name: rocm-docs-core
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-22 08:49:19 -06:00
0c77c66221
Disable Colltrace for --fast option ( #778 )
...
* Disable Colltrace for --fast option
* Limit nprocs for CI
2023-06-21 14:16:09 -06:00
399d31ed40
Bump rocm-docs-core from 0.14.0 to 0.15.0 in /docs/sphinx ( #781 )
...
Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core ) from 0.14.0 to 0.15.0.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases )
- [Changelog](https://github.com/RadeonOpenCompute/rocm-docs-core/blob/develop/CHANGELOG.md )
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v0.14.0...v0.15.0 )
---
updated-dependencies:
- dependency-name: rocm-docs-core
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-21 12:39:02 -06:00
9bdf6797a5
fixed npkit size to never be a negative number ( #779 )
2023-06-21 08:26:40 -06:00
52a28ff2fc
Switching to using atomicAdd_system within kernel for collective trace ( #780 )
2023-06-20 17:49:52 -06:00
8802de7761
Bump rocm-docs-core from 0.13.4 to 0.14.0 in /docs/sphinx ( #777 )
...
Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core ) from 0.13.4 to 0.14.0.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases )
- [Changelog](https://github.com/RadeonOpenCompute/rocm-docs-core/blob/develop/CHANGELOG.md )
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v0.13.4...v0.14.0 )
---
updated-dependencies:
- dependency-name: rocm-docs-core
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-16 08:48:41 -06:00
fd6553bcf8
Merge pull request #775 from nusislam/unroll-1
...
device: use unroll factor based on platforms
2023-06-14 17:42:38 -05:00
3a741787bf
device: use unroll factor based on platforms
2023-06-14 13:36:15 -05:00
f35777e9b0
improve compilation time and create timetrace plot ( #773 )
...
* improve compilation time and create time-trace plot
* set default value for nproc
2023-06-14 09:17:51 -06:00
ea38312273
2.18.3-1
...
Fix data corruption with Tree/LL128 on systems with 1GPU:1NIC.
Fix hang with Collnet on bfloat16 on systems with less than one NIC
per GPU.
Fix long initialization time.
Fix data corruption with Collnet when mixing multi-process and
multi-GPU per process.
Fix crash when shared memory creation fails.
Fix Avg operation with Collnet/Chain.
Fix performance of alltoall at scale with more than one NIC per GPU.
Fix performance for DGX H800.
Fix race condition in connection progress causing a crash.
Fix network flush with Collnet.
Fix performance of aggregated allGather/reduceScatter operations.
Fix PXN operation when CUDA_VISIBLE_DEVICES is set.
Fix NVTX3 compilation issues on Debian 10.
2023-06-14 01:29:17 -07:00
b89c5e0632
Enable --fast ( #774 )
2023-06-13 13:40:40 -06:00
9cdac774ea
Wall clock update and npkit trace script Update ( #771 )
...
* changed builtin clock to wall_clock64
* updated npkit_Trace_generator to the new version of npkit
2023-06-07 17:47:10 -06:00
c3f47853bd
Update Read the Docs, documentation, and dependabot ( #772 )
...
* update documentation
add version number to documentation
rename .sphinx/.doxygen to sphinx/doxygen
enable htmlzip, pdf, epub formats when publishing on Read the Docs
* add noCI label for dependabot PRs
since RTD CI is separate from math lib CI
* update rocm-docs-core to v0.13.4
* update README with link to rocm.docs.amd.com
2023-06-07 15:31:58 -06:00
5f1f0142ac
Bump cryptography from 40.0.2 to 41.0.0 in /docs/.sphinx ( #766 )
...
Bumps [cryptography](https://github.com/pyca/cryptography ) from 40.0.2 to 41.0.0.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst )
- [Commits](https://github.com/pyca/cryptography/compare/40.0.2...41.0.0 )
---
updated-dependencies:
- dependency-name: cryptography
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-07 10:27:56 -06:00
5e8654a0b0
Bump requests from 2.28.2 to 2.31.0 in /docs/.sphinx ( #747 )
...
Bumps [requests](https://github.com/psf/requests ) from 2.28.2 to 2.31.0.
- [Release notes](https://github.com/psf/requests/releases )
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md )
- [Commits](https://github.com/psf/requests/compare/v2.28.2...v2.31.0 )
---
updated-dependencies:
- dependency-name: requests
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-07 10:27:36 -06:00
20b567caac
Updating NOTICES.txt and LICENSE.txt ( #770 )
2023-06-07 09:45:03 -06:00
b1a65afd58
Fix build on additional architectures ( #740 )
...
* Fix build on additional architectures
Instead of directly wrapping a platform-specific operation with a
preprocessor check against a gfx macro, it can be more flexible to
check a macro that can be overriden by the user. The gfx macro can then
just provide the default value for the macro, resulting in the same
default behaviour as if the gfx macro was checked directly but with
more control at build-time.
For example, to build rccl without using buffer_wbinvl1_vol on
gfx902, but still use the default on other archs, a user could
export CXXFLAGS='-Xarch_gfx902 -DRCCL_USE_WBINVL1_VOL=1' before
configuring the build. This flexibility isn't always necessary, but
it's nicer to have it and not need it than to need it and not have it.
* Define WARP_SIZE using warpSize builtin
2023-06-06 16:45:50 -06:00
a029d34628
Bump rocm-docs-core from 0.11.0 to 0.13.3 in /docs/.sphinx ( #765 )
...
Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core ) from 0.11.0 to 0.13.3.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases )
- [Changelog](https://github.com/RadeonOpenCompute/rocm-docs-core/blob/develop/CHANGELOG.md )
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v0.11.0...v0.13.3 )
---
updated-dependencies:
- dependency-name: rocm-docs-core
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-06 16:45:15 -06:00
520f15e61b
resolving the pthread-gtest linking issue for rccl-UnitTests ( #768 )
2023-06-06 14:21:40 -04:00
3af90902c8
Add NCCL_NCHANNELS_PER_PEER override ( #767 )
...
Also fix topol_expl build issue
2023-06-06 08:41:38 -07:00
d52b6c0d24
add DMA_BUF support ( #763 )
...
* add DMA_BUF support
* remove unused libraries in src/init.cc
* change NCCL_ALL to NCCL_INIT
* remove extra pointer functions in transport/net.cc
2023-06-01 12:46:42 -06:00
c62aebe882
Removing init_nvtx.cc from source list ( #762 )
2023-05-31 14:44:55 -06:00
5a38ff192b
Rework barrier and event code ( #761 )
...
* Rework barrier and event code
* Switch to inline asm
2023-05-31 13:36:51 -07:00
7519ecb476
Merge pull request #757 from nusislam/unroll
...
device: change unroll factor
2023-05-30 14:19:32 -05:00
2b1efa9e9a
added time results on npkit generator ( #749 )
2023-05-30 12:57:25 -06:00
777d8747a5
Refactoring CMakeFiles ( #755 )
2023-05-25 16:08:54 -06:00
4d1cfb17c8
device: change unroll factor
...
The default value of unroll factor is 2. Changing the unroll
factor to 4 provides better performance for most of the collectives.
2023-05-25 15:42:35 -05:00
dependabot[bot]
Ziyue Yang
Wenkai Du
Nusrat Islam
Wenkai Du
akolliasAMD
gilbertlee-amd
Dmitrii Gabor
arvindcheru
Bertan Dogancay
Sylvain Jeaugey
Sam Wu
Cory Bloor
Pedram Alizadeh