AI/rocm-systems
2
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,439 Commits 3 Branches 0 Tags
f60367f1c33bd2fa95306dfa4e66a35fabd06e1e
Commit Graph

48 Commits

Author SHA1 Message Date
corey-derochie-amd 37bf54b8f8 Enable multi-threading for MSCCL (#1203) 
MSCCL can now run in a multi-threaded configuration. To test in the unit tests, added the ENABLE_OPENMP compile definition flag and the --openmp-test-enable flag to the unit test build script. To activate, set the environment variables UT_MULTITHREADED=1 and UT_PROCESS_MASK=1. Set Jenkins to use this mode.

[ROCm/rccl commit: 0c36d571ea]
 2024-07-04 09:34:38 -06:00
BertanDogancay 36f9492cda Merge remote-tracking branch 'nccl/master' into develop 
[ROCm/rccl commit: e1a835910e]
 2024-04-23 13:34:00 -07:00
arvindcheru a285fda3a1 Static Build update - Moved all cmake install() to rocm-cmake APIs, static build update (#1123) 
[ROCm/rccl commit: c0a51dc84b]
 2024-03-26 11:11:09 -04:00
Bertan Dogancay bee47d9e91 Add stack size UT (#1081) 
* Add stack size UT

[ROCm/rccl commit: dc2d486ba0]
 2024-02-12 17:56:15 -07:00
Bertan Dogancay 11674674fc [DEV] Configure functions in RCCL (#986) 
* configure functions in rccl

[ROCm/rccl commit: 28d9b170c9]
 2024-01-18 15:07:16 -07:00
Bertan Dogancay 487391e8bb Add ncclCommSplit test (#852) 
Add ncclSplitCommTest

[ROCm/rccl commit: 9d11cd092f]
 2023-08-25 16:26:45 -06:00
gilbertlee-amd 71ab758d36 Removing unnecessary chrpath check for unit tests (#811) 
[ROCm/rccl commit: a5a25bdff7]
 2023-07-20 10:28:04 -06:00
Pedram Alizadeh a34679b2e6 resolving the pthread-gtest linking issue for rccl-UnitTests (#768) 
[ROCm/rccl commit: 520f15e61b]
 2023-06-06 14:21:40 -04:00
gilbertlee-amd d2c1295f79 Refactoring CMakeFiles (#755) 
[ROCm/rccl commit: 777d8747a5]
 2023-05-25 16:08:54 -06:00
gilbertlee-amd ff2c1c5d0f Unit test performance refactor (#700) 
* Refactoring unit tests to improve performance
* Spawning child processes during InitComms instead of on TestBed construction
* Temporarily disabling graph unit tests

[ROCm/rccl commit: 27e0cb43c2]
 2023-04-06 12:28:53 -06:00
gilbertlee-amd 0da1d6a6cd Multi stream unit test (#693) 
* Adding multi-stream support to unit tests

[ROCm/rccl commit: 80ed608a9d]
 2023-02-23 13:28:50 -07:00
Pedram Alizadeh f7982e9bed UnitTest: add test cases for 2.14 API (ncclCommInitRankConfig and ncclCommFinalize for non-blocking communicator) (#674) 
[ROCm/rccl commit: fddb5e6be8]
 2023-02-03 17:36:30 -05:00
Pedram Alizadeh 847899dd7e removed the wrapper script so that the old name is no longer referenced (#676) 
[ROCm/rccl commit: fbe52b6caa]
 2023-01-31 11:11:02 -05:00
Pedram Alizadeh a85f71a421 Revert "UnitTest: add test cases for 2.14 API (ncclCommInitRankConfig and ncclCommFinalize for non-blocking communicator) (#662)" (#666) 
This reverts commit f29aa66d4f.

[ROCm/rccl commit: 54a3da04eb]
 2022-12-14 11:28:40 -05:00
PedramAlizadeh 1fe26823f5 Changed the name of UnitTests to rccl-UnitTests (wrapper executable included). 
[ROCm/rccl commit: 45872d170f]
 2022-12-13 21:45:57 +00:00
Pedram Alizadeh f29aa66d4f UnitTest: add test cases for 2.14 API (ncclCommInitRankConfig and ncclCommFinalize for non-blocking communicator) (#662) 
[ROCm/rccl commit: 8250092367]
 2022-12-13 16:05:09 -05:00
Ziyue Yang 431c7d2cb9 Add MSCCL Support (#658) 
* Add MSCCL support

* Add alignment and message size checking

* Fix nRanks checking, in-place and out-of-place tests and group call handling

* Fix hipGraph unit test

* Change MSCCL init warning to INFO

* Revise license info

[ROCm/rccl commit: adafc0f759]
 2022-12-12 15:51:04 -08:00
Ranjith Ramakrishnan e3b28a9aec Correct hsa header path for new directory layout 
[ROCm/rccl commit: b397cb16ea]
 2022-11-04 09:52:16 -07:00
Ranjith Ramakrishnan 1cfca9f8e1 Correct include and library path for new directory layout 
Use actual header files and libraries , rather than using wrapper header files and library softlinks


[ROCm/rccl commit: cf4e963aaf]
 2022-10-14 01:32:04 -07:00
gilbertlee-amd a2a4888497 Moving opt-in custom signal handler from UnitTests into RCCL (#550) 
* Enable via RCCL_ENABLE_SIGNALHANDLER=1

[ROCm/rccl commit: 700b473211]
 2022-05-20 09:56:38 -06:00
Edgar 1bfc5d06f8 add a signal handler and backtrace 
Tweak the signal handler and force non-release build
Increase ulimit locked memory value
Update the singal handler to use bfd symbol resolution.
Include configure logic to find bfd functions.
Add optionally c++ function name demangling


[ROCm/rccl commit: 2bf6d254b6]
 2022-04-25 10:48:17 -04:00
Liam Wrubleski 95c6476678 Packages for test and benchmark executables on all supported OSes using CPack. (#512) 
[ROCm/rccl commit: a8f1e61f48]
 2022-03-21 15:04:14 -06:00
akolliasAMD 3493750b6b Added alltoallv test and optional args variable on collective args (#514) 
* Added alltoallv test and optional args variable on collective args

[ROCm/rccl commit: 65ea3d80db]
 2022-03-18 13:55:11 -04:00
akolliasAMD 2419a950fe Added Unit test for nccl send recv (#506) 
Added Send Receive test that tests through all pairs

[ROCm/rccl commit: ff54e79799]
 2022-03-02 15:50:16 -05:00
gilbertlee-amd a182076a0e Unit test refactor (#500) 
Refactoring and consolidating single-process / multi-process unit testing

[ROCm/rccl commit: 29ad0f5fbe]
 2022-02-25 08:59:07 -07:00
Wenkai Du b5bfb7366a Unit tests: fix number of GPU detection (#484) 
[ROCm/rccl commit: 6268b87c16]
 2022-01-05 15:06:12 -08:00
Stanley Tsang 8d6cfcbf58 Fixing setting of GPUs to 2 when 1 or less GPUs on system for unit tests (#481) 
[ROCm/rccl commit: bbbb35ceec]
 2021-12-09 11:04:31 -07:00
Wenkai Du a14a57ea71 gtest: dynamically generate tests based on test machine's GPU count (#467) 
* gtest: dynamically generate tests based on test machine's GPU count

* Adjust test element size and bfloat16 threshold for up to 16 GPUs

[ROCm/rccl commit: 03a830293c]
 2021-11-16 10:28:26 -08:00
Stanley Tsang 5bc7a6b858 Remove hardcoded references to /opt/rocm when using chrpath (#469) 
* Fixing cmake_install_prefix search to include /opt/rocm-xxxx

* Removing all hard references to /opt/rocm with ROCM_PATH

[ROCm/rccl commit: a6dba6b9dd]
 2021-11-15 15:00:55 -07:00
Stanley Tsang bd30ea0dae Fixing cmake_install_prefix search to include /opt/rocm-xxxx (#462) 
[ROCm/rccl commit: 2f87073514]
 2021-11-06 07:58:26 -07:00
Stanley Tsang a6feafd5dc Build AllReduce only mode (#443) 
* Initial commit of all_reduce_only support

* Working AllReduce only build

* Removing printfs and restoring release build

* Restore P2P index

* Updates to build_allreduce_only mode.

* cleaning up macro ifdefs

[ROCm/rccl commit: 7e55b211c5]
 2021-10-26 17:36:46 -06:00
Stanley Tsang 0afd607328 Re-enable use of chrpath to manually set rpath for unit tests. (#448) 
* Re-enable use of chrpath to manually set rpath for unit tests.

* Add check for chrpath

[ROCm/rccl commit: d23dfc12c1]
 2021-10-26 11:10:04 -06:00
Wenkai Du f773636575 Fix unit tests static build (#403) 
[ROCm/rccl commit: 215904ee8e]
 2021-07-09 09:35:32 -07:00
Eiden Yoshida 66349efb1d Fix static builds (#393) 
[ROCm/rccl commit: 5c3e7d8b67]
 2021-06-23 09:19:48 -06:00
Wenkai Du 1670bddea0 Remove hard coded /opt/rocm from cmake (#396) 
[ROCm/rccl commit: 59d2867b01]
 2021-06-21 08:29:23 -07:00
gilbertlee-amd f4a12be69b Clique tuning upgrade (#352) 
* Enabling clique for any XGMI-connected topology, adding tuning
* Updating CHANGELOG for clique tuning
* Re-working clique barrier system to work on multi-process / multi-gpu

[ROCm/rccl commit: 9d7232c091]
 2021-05-06 09:50:07 -06:00
Stanley Tsang d7ed44eb9a Adding multiprocess unit tests (#312) 
Adding multiprocess unit tests for collectives.  

To run, NCCL_COMM_ID=$HOSTNAME:12345 build/release/test/UnitTestsMultiProcess

[ROCm/rccl commit: d3fa257682]
 2021-01-15 16:34:36 -07:00
Wenkai Du a3402d6aeb Merge pull request #262 from wenkaidu/alignment 
Make data alignment requirements matching ISA manual

[ROCm/rccl commit: 60819dcf8d]
 2020-09-08 10:40:42 -07:00
Aaron Enye Shi 0a3a397481 Add RCCL Static Lib Creation with -fgpu-rdc 
RCCL uses -fgpu-rdc to compile its source objects. When linking
the RCCL static library, the link and archive step must do through
hipcc and uses the flag --emit-static-lib. When compiling
UnitTests, the librccl.a must be consumed through -l and -L.


[ROCm/rccl commit: 958b213428]
 2020-09-03 11:25:41 -04:00
Wenkai Du 81bf52ddee gtest: add alltoallv test 
[ROCm/rccl commit: b163a8898f]
 2020-09-02 21:28:32 +00:00
saadrahim e5432857db Download GTest if not found in system (#237) 
Co-authored-by: Stanley Tsang <stanley.tsang@amd.com>

[ROCm/rccl commit: 0dc019e35f]
 2020-08-06 09:36:58 -06:00
saadrahim f80136bbba Changing GTest inclusion in cmake to use find_package (#234) 
* GTest is used via find_package. No longer downloaded in cmake.

* Adding error handling

[ROCm/rccl commit: 99a491273f]
 2020-07-15 20:51:48 -06:00
gilbertlee-amd b83acc8032 Removing UnitTest as install, removing unused env var (#231) 
[ROCm/rccl commit: f87ba17737]
 2020-07-10 09:30:28 -06:00
Wenkai Du d1f8fdc3a8 gtest: add scatter, gather and all to all unit tests 
[ROCm/rccl commit: fee1a20b74]
 2020-06-09 17:44:15 -07:00
Stanley Tsang e5419407c4 Updating copyright notices for 2020. 
[ROCm/rccl commit: 20fa04d9b6]
 2020-01-29 15:28:08 -08:00
gilbertlee-amd 71635198b8 Removing OpenMP from unit tests (#163) 
[ROCm/rccl commit: 000bce6f27]
 2019-12-20 11:41:56 -07:00
Akila Premachandra 94b33a7550 Added hip-clang options to install script, and openmp/pthread options to CMakeLists.txt 
[ROCm/rccl commit: f48ae5c98d]
 2019-08-23 22:02:42 +00:00
Wenkai Du 6047487815 RCCL 2.4 update 
[ROCm/rccl commit: f11c8f60cd]
 2019-08-14 10:42:35 -07:00