Commit Graph

982 Commits

Author SHA1 Message Date
Sam Wu 1e1be0c808 Fix Docs static analysis (#708)
* remove ref to old script in static analysis

* update README with doc build instructions

update gitignore with doc artifacts

[ROCm/rccl commit: 8c56e6c892]
2023-03-16 13:12:43 -06:00
Ziyue Yang f7f669e7f0 MSCCL: Improve executor and integrate scheduler (#694)
* MSCCL: improve executor and add scheduler for testing

* Use external scheduler

* Fix cmake error

* Address comments

* Fix thread safe issue

* Make MSCCL lifecycle APIs thread safe

* Make MSCCL internal scheduler aware of topology hint

* Revise error message

[ROCm/rccl commit: e3b2342f39]
2023-03-14 14:34:25 -07:00
Saad Rahim 8fdc4795fd Standard template implementation (#703)
[ROCm/rccl commit: 6e48e518d9]
2023-03-13 11:00:57 -06:00
Wenkai Du 216c83c39d Fix XGMI detection (#699)
* Fix XGMI detection

* Increase stack size

* Temporarily disable signal hangler in CI

[Process: 17281] Inside handler function signal: Segmentation fault (11)
BFD: DWARF error: section .debug_info is larger than its filesize! (0x93ef57 vs 0x530ea0)
BFD: DWARF error: section .debug_info is larger than its filesize! (0x93ef57 vs 0x530ea0)

[ROCm/rccl commit: 22b81fbaae]
2023-03-08 14:08:07 -08:00
Wenkai Du 62f5e6a82f Warn user on incorrect system settings (#696)
* Warn user on incorrect system settings

* Fix typo

* Add possible impact

* Ignore iommu settings in VM

[ROCm/rccl commit: 79a2031951]
2023-03-06 08:17:06 -08:00
gilbertlee-amd 0da1d6a6cd Multi stream unit test (#693)
* Adding multi-stream support to unit tests

[ROCm/rccl commit: 80ed608a9d]
2023-02-23 13:28:50 -07:00
Wenkai Du 8aaf6f8e0d Merge pull request #685 from ROCmSoftwarePlatform/2.16.5
Sync up to NCCL 2.16.5

[ROCm/rccl commit: d601c4909c]
2023-02-22 10:29:02 -08:00
gilbertlee-amd 80ce7507c7 Adding UnitTest timing summary (UT_SHOW_TIMING) (#692)
[ROCm/rccl commit: f63d3b1978]
2023-02-22 08:57:13 -07:00
akolliasAMD 3b6b34705a UnitTests: made reduceScatter run a smaller amount of tests (#691)
[ROCm/rccl commit: d119c0886e]
2023-02-21 16:21:24 -07:00
Wenkai Du 1f42d485f8 Fix P2P scheduling (#690)
[ROCm/rccl commit: 86e7b71234]
2023-02-21 07:49:54 -08:00
gilbertlee-amd 7d860d3642 Unit test fail check (#689)
* Adding fall-through on unit test failure

* Workaround for hipGraph validity check issue

[ROCm/rccl commit: a640c6983f]
2023-02-18 08:50:46 -08:00
Wenkai Du 393d0ba7f8 Add back __syncthreads() in barrier and adjust stack size (#688)
[ROCm/rccl commit: 1c166046a2]
2023-02-18 08:50:31 -08:00
Ziyue Yang 7c1290f995 NPKit: improve clock calibration and fix GPU clock API (#683)
* Improve clock calibration in NPKit

* Improve gfx macro

* Fix macro

[ROCm/rccl commit: f4bf47f325]
2023-02-17 12:26:57 -07:00
Wenkai Du 0c7a94c462 Merge remote-tracking branch 'nccl/master' into HEAD
[ROCm/rccl commit: aee7b42bb8]
2023-02-14 17:14:13 -08:00
Wenkai Du 4fb1ebcf4b Remove workaround and use indirect function call (#684)
[ROCm/rccl commit: f7a456122c]
2023-02-14 13:59:48 -08:00
Wenkai Du cb7e2e8eeb Merge pull request #681 from wenkaidu/gfx9
Add HIP event optimization and remove special code for gfx90a

[ROCm/rccl commit: 9461a43168]
2023-02-13 08:04:59 -08:00
Pedram Alizadeh 29a0f74de1 Adding -pthread flag into CMakeLists.txt (#682)
Adding -pthread flag for linking issues into CMakeLists.txt

[ROCm/rccl commit: f525b8e1e6]
2023-02-10 17:22:30 -05:00
Pedram Alizadeh 93fa62b654 Updated RCCL introduction at docs/source/library.rst (#680)
* Updated RCCL introduction at docs/source/library.rst

* space after period

---------

Co-authored-by: Saad Rahim <44449863+saadrahim@users.noreply.github.com>

[ROCm/rccl commit: e05560ea82]
2023-02-10 17:20:54 -05:00
Wenkai Du 8a0d254c69 Add HIP event optimization and remove special code for gfx90a
[ROCm/rccl commit: 39534e8724]
2023-02-10 16:46:01 +00:00
gilbertlee-amd e5795cf101 Switching to relaxed capture for unit tests (#679)
[ROCm/rccl commit: df46645ff8]
2023-02-08 11:28:58 -07:00
Pedram Alizadeh 186aff690d Update library.rst (#678)
[ROCm/rccl commit: 0df82bd8a3]
2023-02-06 16:28:59 -05:00
Wenkai Du 86d9ab47a3 Merge pull request #671 from ROCmSoftwarePlatform/2.16.2
Sync up with NCCL 2.16.2

[ROCm/rccl commit: 11567e5157]
2023-02-04 06:54:30 -08:00
Wenkai Du c76bc214c8 Merge remote-tracking branch 'nccl/master' into HEAD
[ROCm/rccl commit: e1cb45ff22]
2023-02-04 01:44:43 +00:00
Pedram Alizadeh f7982e9bed UnitTest: add test cases for 2.14 API (ncclCommInitRankConfig and ncclCommFinalize for non-blocking communicator) (#674)
[ROCm/rccl commit: fddb5e6be8]
2023-02-03 17:36:30 -05:00
Sylvain Jeaugey e6e8f2555c 2.16.5-1
Add support for 400Gbit NDR network adapters (CX7)
Handle EINTR in socket poll() function
Add NCCL_PROGRESS_APPENDOP_FREQ to control op append overhead
Resource cleanup fixes
Fix double free in case of init failure
Fix crash in ncclCommAbort
Revert AMD speed commit


[ROCm/rccl commit: f3d5166783]
2023-02-02 12:52:47 -08:00
Pedram Alizadeh 847899dd7e removed the wrapper script so that the old name is no longer referenced (#676)
[ROCm/rccl commit: fbe52b6caa]
2023-01-31 11:11:02 -05:00
Eiden Yoshida cc2f0f58dd CI: decrease precheckin and extended test timeouts (#675)
[ROCm/rccl commit: 513bc6912a]
2023-01-21 19:32:21 -07:00
Rashika Kheria 2840ac0139 Fix maximum handle size for NCCL Net v4 API
NCCL Net v4 supports a maximum handle size of 64 bytes whereas the
ext-net example header files set it for NCCL Net v3. Since,
`aws-ofi-nccl` plugin plans to follow the example header files, fix it
here.

Signed-off-by: Rashika Kheria <rashika@amazon.com>


[ROCm/rccl commit: 93840e7476]
2023-01-18 13:31:57 +01:00
Wenkai Du 7be2c55b32 topo_expl: fix broken build by adding hipify steps (#670)
[ROCm/rccl commit: a0dd8e0b84]
2023-01-06 07:29:40 -08:00
gilbertlee-amd d78eb0a54c Updating CHANGELOG (#669)
[ROCm/rccl commit: 3e8ab4e46e]
2022-12-19 09:36:57 -07:00
Wenkai Du d95a71b2ef Switch to hipLaunchHostFunc for HIP graph (#667)
[ROCm/rccl commit: 2288e9ae80]
2022-12-15 10:16:46 -08:00
akolliasAMD 78fc48f1c8 added a different way for getting device count, by running it in a child process (#665)
[ROCm/rccl commit: 24aa8bd802]
2022-12-14 16:10:14 -07:00
Pedram Alizadeh a85f71a421 Revert "UnitTest: add test cases for 2.14 API (ncclCommInitRankConfig and ncclCommFinalize for non-blocking communicator) (#662)" (#666)
This reverts commit f29aa66d4f.

[ROCm/rccl commit: 54a3da04eb]
2022-12-14 11:28:40 -05:00
Pedram Alizadeh c9ba20d749 Merge pull request #664 from PedramAlizadeh/rccl-UnitTests_name_change
Changed the name of UnitTests to rccl-UnitTests (wrapper executable i…

[ROCm/rccl commit: 1a8cd9791e]
2022-12-13 17:16:22 -05:00
PedramAlizadeh 1fe26823f5 Changed the name of UnitTests to rccl-UnitTests (wrapper executable included).
[ROCm/rccl commit: 45872d170f]
2022-12-13 21:45:57 +00:00
Pedram Alizadeh f29aa66d4f UnitTest: add test cases for 2.14 API (ncclCommInitRankConfig and ncclCommFinalize for non-blocking communicator) (#662)
[ROCm/rccl commit: 8250092367]
2022-12-13 16:05:09 -05:00
Ziyue Yang 431c7d2cb9 Add MSCCL Support (#658)
* Add MSCCL support

* Add alignment and message size checking

* Fix nRanks checking, in-place and out-of-place tests and group call handling

* Fix hipGraph unit test

* Change MSCCL init warning to INFO

* Revise license info

[ROCm/rccl commit: adafc0f759]
2022-12-12 15:51:04 -08:00
Wenkai Du bb27f5c8ba Fix typo in detecting Intel platforms (#661)
[ROCm/rccl commit: b953544a59]
2022-12-07 13:36:11 -08:00
akolliasAMD 90de5e3a84 decreased warp size for gfx110x (#655)
[ROCm/rccl commit: eca623df07]
2022-12-01 12:19:21 -07:00
gilbertlee-amd 5871811d34 Graph unit tests (#656)
* Adding hipGraph unit tests

[ROCm/rccl commit: faed69f9fc]
2022-12-01 10:28:42 -07:00
Wenkai Du 2f1882c75e Reduce linking time through more parallel jobs (#657)
[ROCm/rccl commit: aebed537a5]
2022-11-30 16:06:03 -08:00
Wenkai Du 416b754b31 Query DMABuf support through HSA runtime API (#654)
[ROCm/rccl commit: fb9938cffa]
2022-11-30 08:53:03 -08:00
Sylvain Jeaugey 2ce8946622 2.16.2-1
Add support for CUDA 12.0, drop Kepler (sm_35).
Support for H100 features.
Make socket code more robust and protected. Solves #555.
Improve performance on large CUDA graphs, reducing dependencies.
Reduce inter-socket bandwidth on AMD CPUs to favor better paths.
Various fixes to ncclCommAbort.
Make service thread polling resistant to EINTR.
Compile with profiling API by default.
Extend NVTX instrumentation with call arguments.


[ROCm/rccl commit: 28189e2df8]
2022-11-30 02:31:59 -08:00
Wenkai Du 55e1008756 Adjust P2P channels on Intel platform (#653)
[ROCm/rccl commit: 9594bbee3b]
2022-11-29 13:57:10 -08:00
akolliasAMD 5b7c400fb3 removed cmake HIP_CLANG_PATCH_LEVEL check (#652)
* removed HIP_CLANG_PATCH_LEVEL check

[ROCm/rccl commit: 11862f67de]
2022-11-29 09:48:59 -07:00
Wenkai Du 49353e3eaa Merge pull request #651 from wenkaidu/nccl_sync
Sync up with NCCL

[ROCm/rccl commit: 67d9327f52]
2022-11-28 17:33:59 -08:00
Wenkai Du bba08ef09f Merge remote-tracking branch 'nccl/master' into HEAD
[ROCm/rccl commit: bf03a48289]
2022-11-28 09:46:16 -08:00
gilbertlee-amd 09f2d7f242 Update CHANGELOG up to ROCm 5.4 (#649)
* Update CHANGELOG for ROCm 5.4.0

[ROCm/rccl commit: 36ac8107bd]
2022-11-23 09:40:19 -07:00
Sylvain Jeaugey 1bcb7a7cb6 Fix google-fastsocket plugin build
[ROCm/rccl commit: 614b49f0de]
2022-11-22 02:13:13 -08:00
Sylvain Jeaugey 06f55215e2 Add documentation for NCCL NET plugins
Also repurpose dummy plugin as example, including headers and
compat layers from v6 to v2.


[ROCm/rccl commit: 55b1d8ab98]
2022-11-22 02:12:53 -08:00