Commit Graph

100 Commits

Author SHA1 Message Date
Pedram Alizadeh a34679b2e6 resolving the pthread-gtest linking issue for rccl-UnitTests (#768)
[ROCm/rccl commit: 520f15e61b]
2023-06-06 14:21:40 -04:00
gilbertlee-amd d2c1295f79 Refactoring CMakeFiles (#755)
[ROCm/rccl commit: 777d8747a5]
2023-05-25 16:08:54 -06:00
Pedram Alizadeh aeffdf872b Disabled hipgraph tests! (#725)
[ROCm/rccl commit: 53c1c38f0e]
2023-04-13 17:42:05 -04:00
akolliasAMD af8c2194a7 lessened the amount of child processes to active ones (#720)
[ROCm/rccl commit: 2ce7d971e5]
2023-04-11 08:59:56 -06:00
gilbertlee-amd ff2c1c5d0f Unit test performance refactor (#700)
* Refactoring unit tests to improve performance
* Spawning child processes during InitComms instead of on TestBed construction
* Temporarily disabling graph unit tests

[ROCm/rccl commit: 27e0cb43c2]
2023-04-06 12:28:53 -06:00
gilbertlee-amd b859549866 Adding interactive mode for unit tests (UT_INTERACTIVE) (#715)
[ROCm/rccl commit: 00c3d8d850]
2023-03-21 10:58:24 -06:00
akolliasAMD 9daf0bc3d1 Test Fixes (#710)
* splitting CI tests in running SP first and MP second
* set device before hipStreamSynchronize on tests

[ROCm/rccl commit: 9a0d4a07a6]
2023-03-21 08:48:39 -06:00
Ziyue Yang f7f669e7f0 MSCCL: Improve executor and integrate scheduler (#694)
* MSCCL: improve executor and add scheduler for testing

* Use external scheduler

* Fix cmake error

* Address comments

* Fix thread safe issue

* Make MSCCL lifecycle APIs thread safe

* Make MSCCL internal scheduler aware of topology hint

* Revise error message

[ROCm/rccl commit: e3b2342f39]
2023-03-14 14:34:25 -07:00
gilbertlee-amd 0da1d6a6cd Multi stream unit test (#693)
* Adding multi-stream support to unit tests

[ROCm/rccl commit: 80ed608a9d]
2023-02-23 13:28:50 -07:00
gilbertlee-amd 80ce7507c7 Adding UnitTest timing summary (UT_SHOW_TIMING) (#692)
[ROCm/rccl commit: f63d3b1978]
2023-02-22 08:57:13 -07:00
akolliasAMD 3b6b34705a UnitTests: made reduceScatter run a smaller amount of tests (#691)
[ROCm/rccl commit: d119c0886e]
2023-02-21 16:21:24 -07:00
gilbertlee-amd 7d860d3642 Unit test fail check (#689)
* Adding fall-through on unit test failure

* Workaround for hipGraph validity check issue

[ROCm/rccl commit: a640c6983f]
2023-02-18 08:50:46 -08:00
gilbertlee-amd e5795cf101 Switching to relaxed capture for unit tests (#679)
[ROCm/rccl commit: df46645ff8]
2023-02-08 11:28:58 -07:00
Pedram Alizadeh f7982e9bed UnitTest: add test cases for 2.14 API (ncclCommInitRankConfig and ncclCommFinalize for non-blocking communicator) (#674)
[ROCm/rccl commit: fddb5e6be8]
2023-02-03 17:36:30 -05:00
Pedram Alizadeh 847899dd7e removed the wrapper script so that the old name is no longer referenced (#676)
[ROCm/rccl commit: fbe52b6caa]
2023-01-31 11:11:02 -05:00
akolliasAMD 78fc48f1c8 added a different way for getting device count, by running it in a child process (#665)
[ROCm/rccl commit: 24aa8bd802]
2022-12-14 16:10:14 -07:00
Pedram Alizadeh a85f71a421 Revert "UnitTest: add test cases for 2.14 API (ncclCommInitRankConfig and ncclCommFinalize for non-blocking communicator) (#662)" (#666)
This reverts commit f29aa66d4f.

[ROCm/rccl commit: 54a3da04eb]
2022-12-14 11:28:40 -05:00
PedramAlizadeh 1fe26823f5 Changed the name of UnitTests to rccl-UnitTests (wrapper executable included).
[ROCm/rccl commit: 45872d170f]
2022-12-13 21:45:57 +00:00
Pedram Alizadeh f29aa66d4f UnitTest: add test cases for 2.14 API (ncclCommInitRankConfig and ncclCommFinalize for non-blocking communicator) (#662)
[ROCm/rccl commit: 8250092367]
2022-12-13 16:05:09 -05:00
Ziyue Yang 431c7d2cb9 Add MSCCL Support (#658)
* Add MSCCL support

* Add alignment and message size checking

* Fix nRanks checking, in-place and out-of-place tests and group call handling

* Fix hipGraph unit test

* Change MSCCL init warning to INFO

* Revise license info

[ROCm/rccl commit: adafc0f759]
2022-12-12 15:51:04 -08:00
gilbertlee-amd 5871811d34 Graph unit tests (#656)
* Adding hipGraph unit tests

[ROCm/rccl commit: faed69f9fc]
2022-12-01 10:28:42 -07:00
Ranjith Ramakrishnan e3b28a9aec Correct hsa header path for new directory layout
[ROCm/rccl commit: b397cb16ea]
2022-11-04 09:52:16 -07:00
raramakr 65bd12b94d Merge pull request #635 from raramakr/swdev
Correct include and library path for new directory layout

[ROCm/rccl commit: b32f38126d]
2022-10-14 15:48:44 -07:00
gilbertlee-amd 0ca30fb88a Updating files for missing licenses (#637)
[ROCm/rccl commit: ebb8b5bf63]
2022-10-14 13:49:16 -06:00
Ranjith Ramakrishnan 1cfca9f8e1 Correct include and library path for new directory layout
Use actual header files and libraries , rather than using wrapper header files and library softlinks


[ROCm/rccl commit: cf4e963aaf]
2022-10-14 01:32:04 -07:00
akolliasAMD 2cd63dac42 added stream synch after hipMemset (#609)
[ROCm/rccl commit: 06bce9d0c9]
2022-08-30 16:18:37 -06:00
Edgar Gabriel b32b819151 introduce support for ncclFloat16/half in UT
[ROCm/rccl commit: f6e00dec13]
2022-08-24 15:28:24 +00:00
gilbertlee-amd e3b832f4ce Disable clique AllReduce UnitTest (#595)
[ROCm/rccl commit: dae11c2aca]
2022-08-04 18:30:00 -06:00
akolliasAMD fd99ca19f5 updated alltoallV test to reflect how send counts are done in perf tests (#586)
[ROCm/rccl commit: 686dbc8bc6]
2022-07-21 14:59:34 -06:00
akolliasAMD dcf46e84e0 moved default number of max ranks per gpu to 1
[ROCm/rccl commit: 8b9291eb47]
2022-06-22 17:37:49 +00:00
Edgar f7ef619ba7 extending the unit-tests for multi-rank support
[ROCm/rccl commit: a87d61db2b]
2022-06-10 14:23:19 +00:00
gilbertlee-amd a2a4888497 Moving opt-in custom signal handler from UnitTests into RCCL (#550)
* Enable via RCCL_ENABLE_SIGNALHANDLER=1

[ROCm/rccl commit: 700b473211]
2022-05-20 09:56:38 -06:00
Edgar 1bfc5d06f8 add a signal handler and backtrace
Tweak the signal handler and force non-release build
Increase ulimit locked memory value
Update the singal handler to use bfd symbol resolution.
Include configure logic to find bfd functions.
Add optionally c++ function name demangling


[ROCm/rccl commit: 2bf6d254b6]
2022-04-25 10:48:17 -04:00
Liam Wrubleski 95c6476678 Packages for test and benchmark executables on all supported OSes using CPack. (#512)
[ROCm/rccl commit: a8f1e61f48]
2022-03-21 15:04:14 -06:00
akolliasAMD 3493750b6b Added alltoallv test and optional args variable on collective args (#514)
* Added alltoallv test and optional args variable on collective args

[ROCm/rccl commit: 65ea3d80db]
2022-03-18 13:55:11 -04:00
Nirmal Unnikrishnan 4a4c053a6a File reorganization as per the new defined standard
The header files will in /opt/rocm-xxx/include/rccl
Libraries and cmake will be in /opt/rocm-xxx/lib folder.
Added wrappers for header files using rocm-cmake functions for backward compatibility.


[ROCm/rccl commit: 676a4737c1]
2022-03-08 17:32:02 +00:00
gilbertlee-amd 8f7ec04f37 Changing initialization method for UnitTests (#510)
[ROCm/rccl commit: 0687940b84]
2022-03-07 09:22:55 -07:00
gilbertlee-amd c802f53282 [UnitTests] Check process mask for custom tests (#507)
[ROCm/rccl commit: 699dc30f05]
2022-03-02 17:24:14 -07:00
akolliasAMD 2419a950fe Added Unit test for nccl send recv (#506)
Added Send Receive test that tests through all pairs

[ROCm/rccl commit: ff54e79799]
2022-03-02 15:50:16 -05:00
gilbertlee-amd a182076a0e Unit test refactor (#500)
Refactoring and consolidating single-process / multi-process unit testing

[ROCm/rccl commit: 29ad0f5fbe]
2022-02-25 08:59:07 -07:00
Wenkai Du b5bfb7366a Unit tests: fix number of GPU detection (#484)
[ROCm/rccl commit: 6268b87c16]
2022-01-05 15:06:12 -08:00
Stanley Tsang 8d6cfcbf58 Fixing setting of GPUs to 2 when 1 or less GPUs on system for unit tests (#481)
[ROCm/rccl commit: bbbb35ceec]
2021-12-09 11:04:31 -07:00
Wenkai Du a14a57ea71 gtest: dynamically generate tests based on test machine's GPU count (#467)
* gtest: dynamically generate tests based on test machine's GPU count

* Adjust test element size and bfloat16 threshold for up to 16 GPUs

[ROCm/rccl commit: 03a830293c]
2021-11-16 10:28:26 -08:00
Stanley Tsang 5bc7a6b858 Remove hardcoded references to /opt/rocm when using chrpath (#469)
* Fixing cmake_install_prefix search to include /opt/rocm-xxxx

* Removing all hard references to /opt/rocm with ROCM_PATH

[ROCm/rccl commit: a6dba6b9dd]
2021-11-15 15:00:55 -07:00
Wenkai Du 65fe26eb82 Unit Test: use range from 0 to 1 for floating point test data (#459)
* Unit Test: use range from 0 to 1 for floating point test data

* gtest: Update init data and bfloat16 threshold

[ROCm/rccl commit: bc2932be4e]
2021-11-08 09:21:09 -08:00
Stanley Tsang bd30ea0dae Fixing cmake_install_prefix search to include /opt/rocm-xxxx (#462)
[ROCm/rccl commit: 2f87073514]
2021-11-06 07:58:26 -07:00
Stanley Tsang a6feafd5dc Build AllReduce only mode (#443)
* Initial commit of all_reduce_only support

* Working AllReduce only build

* Removing printfs and restoring release build

* Restore P2P index

* Updates to build_allreduce_only mode.

* cleaning up macro ifdefs

[ROCm/rccl commit: 7e55b211c5]
2021-10-26 17:36:46 -06:00
Stanley Tsang 0afd607328 Re-enable use of chrpath to manually set rpath for unit tests. (#448)
* Re-enable use of chrpath to manually set rpath for unit tests.

* Add check for chrpath

[ROCm/rccl commit: d23dfc12c1]
2021-10-26 11:10:04 -06:00
Wenkai Du bd03ec2a45 Unit Test: support ncclAvg
[ROCm/rccl commit: 1faff323b4]
2021-08-25 14:15:54 -07:00
Wenkai Du f773636575 Fix unit tests static build (#403)
[ROCm/rccl commit: 215904ee8e]
2021-07-09 09:35:32 -07:00