Sam Wu
1e1be0c808
Fix Docs static analysis ( #708 )
...
* remove ref to old script in static analysis
* update README with doc build instructions
update gitignore with doc artifacts
[ROCm/rccl commit: 8c56e6c892 ]
2023-03-16 13:12:43 -06:00
Ziyue Yang
f7f669e7f0
MSCCL: Improve executor and integrate scheduler ( #694 )
...
* MSCCL: improve executor and add scheduler for testing
* Use external scheduler
* Fix cmake error
* Address comments
* Fix thread safe issue
* Make MSCCL lifecycle APIs thread safe
* Make MSCCL internal scheduler aware of topology hint
* Revise error message
[ROCm/rccl commit: e3b2342f39 ]
2023-03-14 14:34:25 -07:00
Saad Rahim
8fdc4795fd
Standard template implementation ( #703 )
...
[ROCm/rccl commit: 6e48e518d9 ]
2023-03-13 11:00:57 -06:00
Wenkai Du
216c83c39d
Fix XGMI detection ( #699 )
...
* Fix XGMI detection
* Increase stack size
* Temporarily disable signal hangler in CI
[Process: 17281] Inside handler function signal: Segmentation fault (11)
BFD: DWARF error: section .debug_info is larger than its filesize! (0x93ef57 vs 0x530ea0)
BFD: DWARF error: section .debug_info is larger than its filesize! (0x93ef57 vs 0x530ea0)
[ROCm/rccl commit: 22b81fbaae ]
2023-03-08 14:08:07 -08:00
Wenkai Du
62f5e6a82f
Warn user on incorrect system settings ( #696 )
...
* Warn user on incorrect system settings
* Fix typo
* Add possible impact
* Ignore iommu settings in VM
[ROCm/rccl commit: 79a2031951 ]
2023-03-06 08:17:06 -08:00
gilbertlee-amd
0da1d6a6cd
Multi stream unit test ( #693 )
...
* Adding multi-stream support to unit tests
[ROCm/rccl commit: 80ed608a9d ]
2023-02-23 13:28:50 -07:00
Wenkai Du
8aaf6f8e0d
Merge pull request #685 from ROCmSoftwarePlatform/2.16.5
...
Sync up to NCCL 2.16.5
[ROCm/rccl commit: d601c4909c ]
2023-02-22 10:29:02 -08:00
gilbertlee-amd
80ce7507c7
Adding UnitTest timing summary (UT_SHOW_TIMING) ( #692 )
...
[ROCm/rccl commit: f63d3b1978 ]
2023-02-22 08:57:13 -07:00
akolliasAMD
3b6b34705a
UnitTests: made reduceScatter run a smaller amount of tests ( #691 )
...
[ROCm/rccl commit: d119c0886e ]
2023-02-21 16:21:24 -07:00
Wenkai Du
1f42d485f8
Fix P2P scheduling ( #690 )
...
[ROCm/rccl commit: 86e7b71234 ]
2023-02-21 07:49:54 -08:00
gilbertlee-amd
7d860d3642
Unit test fail check ( #689 )
...
* Adding fall-through on unit test failure
* Workaround for hipGraph validity check issue
[ROCm/rccl commit: a640c6983f ]
2023-02-18 08:50:46 -08:00
Wenkai Du
393d0ba7f8
Add back __syncthreads() in barrier and adjust stack size ( #688 )
...
[ROCm/rccl commit: 1c166046a2 ]
2023-02-18 08:50:31 -08:00
Ziyue Yang
7c1290f995
NPKit: improve clock calibration and fix GPU clock API ( #683 )
...
* Improve clock calibration in NPKit
* Improve gfx macro
* Fix macro
[ROCm/rccl commit: f4bf47f325 ]
2023-02-17 12:26:57 -07:00
Wenkai Du
0c7a94c462
Merge remote-tracking branch 'nccl/master' into HEAD
...
[ROCm/rccl commit: aee7b42bb8 ]
2023-02-14 17:14:13 -08:00
Wenkai Du
4fb1ebcf4b
Remove workaround and use indirect function call ( #684 )
...
[ROCm/rccl commit: f7a456122c ]
2023-02-14 13:59:48 -08:00
Wenkai Du
cb7e2e8eeb
Merge pull request #681 from wenkaidu/gfx9
...
Add HIP event optimization and remove special code for gfx90a
[ROCm/rccl commit: 9461a43168 ]
2023-02-13 08:04:59 -08:00
Pedram Alizadeh
29a0f74de1
Adding -pthread flag into CMakeLists.txt ( #682 )
...
Adding -pthread flag for linking issues into CMakeLists.txt
[ROCm/rccl commit: f525b8e1e6 ]
2023-02-10 17:22:30 -05:00
Pedram Alizadeh
93fa62b654
Updated RCCL introduction at docs/source/library.rst ( #680 )
...
* Updated RCCL introduction at docs/source/library.rst
* space after period
---------
Co-authored-by: Saad Rahim <44449863+saadrahim@users.noreply.github.com >
[ROCm/rccl commit: e05560ea82 ]
2023-02-10 17:20:54 -05:00
Wenkai Du
8a0d254c69
Add HIP event optimization and remove special code for gfx90a
...
[ROCm/rccl commit: 39534e8724 ]
2023-02-10 16:46:01 +00:00
gilbertlee-amd
e5795cf101
Switching to relaxed capture for unit tests ( #679 )
...
[ROCm/rccl commit: df46645ff8 ]
2023-02-08 11:28:58 -07:00
Pedram Alizadeh
186aff690d
Update library.rst ( #678 )
...
[ROCm/rccl commit: 0df82bd8a3 ]
2023-02-06 16:28:59 -05:00
Wenkai Du
86d9ab47a3
Merge pull request #671 from ROCmSoftwarePlatform/2.16.2
...
Sync up with NCCL 2.16.2
[ROCm/rccl commit: 11567e5157 ]
2023-02-04 06:54:30 -08:00
Wenkai Du
c76bc214c8
Merge remote-tracking branch 'nccl/master' into HEAD
...
[ROCm/rccl commit: e1cb45ff22 ]
2023-02-04 01:44:43 +00:00
Pedram Alizadeh
f7982e9bed
UnitTest: add test cases for 2.14 API (ncclCommInitRankConfig and ncclCommFinalize for non-blocking communicator) ( #674 )
...
[ROCm/rccl commit: fddb5e6be8 ]
2023-02-03 17:36:30 -05:00
Sylvain Jeaugey
e6e8f2555c
2.16.5-1
...
Add support for 400Gbit NDR network adapters (CX7)
Handle EINTR in socket poll() function
Add NCCL_PROGRESS_APPENDOP_FREQ to control op append overhead
Resource cleanup fixes
Fix double free in case of init failure
Fix crash in ncclCommAbort
Revert AMD speed commit
[ROCm/rccl commit: f3d5166783 ]
2023-02-02 12:52:47 -08:00
Pedram Alizadeh
847899dd7e
removed the wrapper script so that the old name is no longer referenced ( #676 )
...
[ROCm/rccl commit: fbe52b6caa ]
2023-01-31 11:11:02 -05:00
Eiden Yoshida
cc2f0f58dd
CI: decrease precheckin and extended test timeouts ( #675 )
...
[ROCm/rccl commit: 513bc6912a ]
2023-01-21 19:32:21 -07:00
Rashika Kheria
2840ac0139
Fix maximum handle size for NCCL Net v4 API
...
NCCL Net v4 supports a maximum handle size of 64 bytes whereas the
ext-net example header files set it for NCCL Net v3. Since,
`aws-ofi-nccl` plugin plans to follow the example header files, fix it
here.
Signed-off-by: Rashika Kheria <rashika@amazon.com >
[ROCm/rccl commit: 93840e7476 ]
2023-01-18 13:31:57 +01:00
Wenkai Du
7be2c55b32
topo_expl: fix broken build by adding hipify steps ( #670 )
...
[ROCm/rccl commit: a0dd8e0b84 ]
2023-01-06 07:29:40 -08:00
gilbertlee-amd
d78eb0a54c
Updating CHANGELOG ( #669 )
...
[ROCm/rccl commit: 3e8ab4e46e ]
2022-12-19 09:36:57 -07:00
Wenkai Du
d95a71b2ef
Switch to hipLaunchHostFunc for HIP graph ( #667 )
...
[ROCm/rccl commit: 2288e9ae80 ]
2022-12-15 10:16:46 -08:00
akolliasAMD
78fc48f1c8
added a different way for getting device count, by running it in a child process ( #665 )
...
[ROCm/rccl commit: 24aa8bd802 ]
2022-12-14 16:10:14 -07:00
Pedram Alizadeh
a85f71a421
Revert "UnitTest: add test cases for 2.14 API (ncclCommInitRankConfig and ncclCommFinalize for non-blocking communicator) ( #662 )" ( #666 )
...
This reverts commit f29aa66d4f .
[ROCm/rccl commit: 54a3da04eb ]
2022-12-14 11:28:40 -05:00
Pedram Alizadeh
c9ba20d749
Merge pull request #664 from PedramAlizadeh/rccl-UnitTests_name_change
...
Changed the name of UnitTests to rccl-UnitTests (wrapper executable i…
[ROCm/rccl commit: 1a8cd9791e ]
2022-12-13 17:16:22 -05:00
PedramAlizadeh
1fe26823f5
Changed the name of UnitTests to rccl-UnitTests (wrapper executable included).
...
[ROCm/rccl commit: 45872d170f ]
2022-12-13 21:45:57 +00:00
Pedram Alizadeh
f29aa66d4f
UnitTest: add test cases for 2.14 API (ncclCommInitRankConfig and ncclCommFinalize for non-blocking communicator) ( #662 )
...
[ROCm/rccl commit: 8250092367 ]
2022-12-13 16:05:09 -05:00
Ziyue Yang
431c7d2cb9
Add MSCCL Support ( #658 )
...
* Add MSCCL support
* Add alignment and message size checking
* Fix nRanks checking, in-place and out-of-place tests and group call handling
* Fix hipGraph unit test
* Change MSCCL init warning to INFO
* Revise license info
[ROCm/rccl commit: adafc0f759 ]
2022-12-12 15:51:04 -08:00
Wenkai Du
bb27f5c8ba
Fix typo in detecting Intel platforms ( #661 )
...
[ROCm/rccl commit: b953544a59 ]
2022-12-07 13:36:11 -08:00
akolliasAMD
90de5e3a84
decreased warp size for gfx110x ( #655 )
...
[ROCm/rccl commit: eca623df07 ]
2022-12-01 12:19:21 -07:00
gilbertlee-amd
5871811d34
Graph unit tests ( #656 )
...
* Adding hipGraph unit tests
[ROCm/rccl commit: faed69f9fc ]
2022-12-01 10:28:42 -07:00
Wenkai Du
2f1882c75e
Reduce linking time through more parallel jobs ( #657 )
...
[ROCm/rccl commit: aebed537a5 ]
2022-11-30 16:06:03 -08:00
Wenkai Du
416b754b31
Query DMABuf support through HSA runtime API ( #654 )
...
[ROCm/rccl commit: fb9938cffa ]
2022-11-30 08:53:03 -08:00
Sylvain Jeaugey
2ce8946622
2.16.2-1
...
Add support for CUDA 12.0, drop Kepler (sm_35).
Support for H100 features.
Make socket code more robust and protected. Solves #555 .
Improve performance on large CUDA graphs, reducing dependencies.
Reduce inter-socket bandwidth on AMD CPUs to favor better paths.
Various fixes to ncclCommAbort.
Make service thread polling resistant to EINTR.
Compile with profiling API by default.
Extend NVTX instrumentation with call arguments.
[ROCm/rccl commit: 28189e2df8 ]
2022-11-30 02:31:59 -08:00
Wenkai Du
55e1008756
Adjust P2P channels on Intel platform ( #653 )
...
[ROCm/rccl commit: 9594bbee3b ]
2022-11-29 13:57:10 -08:00
akolliasAMD
5b7c400fb3
removed cmake HIP_CLANG_PATCH_LEVEL check ( #652 )
...
* removed HIP_CLANG_PATCH_LEVEL check
[ROCm/rccl commit: 11862f67de ]
2022-11-29 09:48:59 -07:00
Wenkai Du
49353e3eaa
Merge pull request #651 from wenkaidu/nccl_sync
...
Sync up with NCCL
[ROCm/rccl commit: 67d9327f52 ]
2022-11-28 17:33:59 -08:00
Wenkai Du
bba08ef09f
Merge remote-tracking branch 'nccl/master' into HEAD
...
[ROCm/rccl commit: bf03a48289 ]
2022-11-28 09:46:16 -08:00
gilbertlee-amd
09f2d7f242
Update CHANGELOG up to ROCm 5.4 ( #649 )
...
* Update CHANGELOG for ROCm 5.4.0
[ROCm/rccl commit: 36ac8107bd ]
2022-11-23 09:40:19 -07:00
Sylvain Jeaugey
1bcb7a7cb6
Fix google-fastsocket plugin build
...
[ROCm/rccl commit: 614b49f0de ]
2022-11-22 02:13:13 -08:00
Sylvain Jeaugey
06f55215e2
Add documentation for NCCL NET plugins
...
Also repurpose dummy plugin as example, including headers and
compat layers from v6 to v2.
[ROCm/rccl commit: 55b1d8ab98 ]
2022-11-22 02:12:53 -08:00