Commit Graph

42 Commits

Author SHA1 Message Date
corey-derochie-amd f2b2372056 Only initialize MSCCL++ when runtime-enabled. (#1266)
[ROCm/rccl commit: b31b4082dd]
2024-07-22 00:41:31 -06:00
Wenkai Du 54e4899607 Template unroll for RCCL kernels (#1250)
* Template unroll for RCCL kernels

* Adding unroll template arg during CMake hipification

* Reduce linking parallel jobs to avoid OOM in CI

* Workaround issues with UT tests

SWDEV-469533: register spill fix is needed for mainline build
LWPCOMMLIBS-369: cannot enable 112 channels with 80 CUs
Use -parallel-jobs=8 for linking

* CI: do not use -j 16 when building

* CI: use -j 8 when building

* Only reduce parallel linking job for CI extended

* Restore original jenkins command. Change parallel linking jobs in cmake

* Disable MSCCLPP

---------

Co-authored-by: gilbertlee-amd <gilbert.lee@amd.com>

[ROCm/rccl commit: 89349f2ce4]
2024-07-19 08:15:59 -07:00
corey-derochie-amd b8542c2477 Integrated RCCL with MSCCL++ for small message sizes (#1231)
[ROCm/rccl commit: 6dc47eecd7]
2024-07-12 15:32:58 -06:00
Wenkai Du 470302a776 Allow multiple parameters during selective function generation (#1201)
* Allow multiple parameters during selective function generation

* Remove debug print

* Add examples into Generator.cmake

[ROCm/rccl commit: 9fcd7b55e1]
2024-06-06 07:07:24 -07:00
Bertan Dogancay 8ddb74e3b1 Add unique files to source list (#1144)
[ROCm/rccl commit: 3caad91f32]
2024-04-15 09:46:53 -06:00
mberenjk da835cff9c replacing rccl_bfloat16 with hip_bfloat16 (#1126)
Co-authored-by: mberenjk <mberenjk@amd.com>

[ROCm/rccl commit: 428837ffe4]
2024-04-11 11:30:37 -05:00
corey-derochie-amd 62a6a07d49 Replaced ROCmSoftwarePlatform and RadeonOpenCompute links with ROCm links. (#1125)
[ROCm/rccl commit: 503a472a25]
2024-03-25 16:29:13 -06:00
Andy li e373bd44bf Enable fp8 support (#1101)
* initial checkin

* resolve cr comments

* resolve the build issue

* fix the data correctless issue

* update fp8 header file and update the unit test for fp8 support

* remove fp16 from fp8 headers

* fix ut issue and catch up the latest code from develop

* udate according to cr comments

* update ut according to cr comments

* update num floats for each SumPostDiv from 4 to 6

* update fp8 header file name

* fix the typo

[ROCm/rccl commit: 6777e65c1d]
2024-03-08 15:17:53 -08:00
Bertan Dogancay 1dfe5cca64 Fix bug when configuring for only LL128 (#1097)
[ROCm/rccl commit: a279e7f32d]
2024-03-01 18:09:39 -07:00
BertanDogancay 7842411fb3 Merge remote-tracking branch 'rccl/develop' into 2.19.4
[ROCm/rccl commit: 76f83f95ab]
2024-02-15 13:37:14 -08:00
Bertan Dogancay bee47d9e91 Add stack size UT (#1081)
* Add stack size UT

[ROCm/rccl commit: dc2d486ba0]
2024-02-12 17:56:15 -07:00
Wenkai Du d5f5091e5d Merge remote-tracking branch 'rccl/develop' into 2.19.4
[ROCm/rccl commit: d999d9ad21]
2024-02-09 11:31:03 -06:00
Bertan Dogancay 45ed3ef4e7 Nvtx support (#1076)
* NVTX support

[ROCm/rccl commit: 8a442faa12]
2024-02-08 14:08:24 -07:00
BertanDogancay ef57c82b60 Clean up
[ROCm/rccl commit: 00fdb1ef51]
2024-01-31 17:27:15 -08:00
Wenkai Du 4f4e52aafe Merge remote-tracking branch 'rccl/develop' into 2.19.4
[ROCm/rccl commit: 1a134b283b]
2024-01-31 11:53:10 -06:00
Bertan Dogancay 2319f3dc54 Do not use LL128 when disabled (#1066)
[ROCm/rccl commit: d75c364864]
2024-01-29 14:08:59 -07:00
BertanDogancay 404d398bac Merge remote-tracking branch 'nccl/v2.19' into develop
[ROCm/rccl commit: 81ddf9de89]
2024-01-24 15:25:33 -08:00
Wenkai Du 17f70df058 Revert "msccl: build same number of kernels as in ROCm 5.7" (#1058)
This reverts commit f960174d03be7e5174baa83b256526d388a38842.

[ROCm/rccl commit: 7987015a19]
2024-01-24 08:43:50 -08:00
Bertan Dogancay 645411f8f4 Use binary search for direct function calls (#1057)
* Use binary search for direct function calls

* fix scratch mem issue on MI300

[ROCm/rccl commit: 5564d65e71]
2024-01-22 17:37:56 -07:00
Bertan Dogancay 56482a8be8 Fix collective trace when rccl is configured (#1056)
* Fix collective trace when rccl is configured

[ROCm/rccl commit: c4dbf8a914]
2024-01-22 09:26:44 -07:00
Bertan Dogancay c91be550bc Disable LL128 for gfx90a (#1054)
[ROCm/rccl commit: 1ac800f9fc]
2024-01-18 18:34:19 -07:00
Bertan Dogancay 11674674fc [DEV] Configure functions in RCCL (#986)
* configure functions in rccl

[ROCm/rccl commit: 28d9b170c9]
2024-01-18 15:07:16 -07:00
Wenkai Du 22730bdc4d msccl: build same number of kernels as in ROCm 5.7 (#1005)
Removed fullOps kernels from build

[ROCm/rccl commit: 12c08fc52a]
2023-12-07 13:36:04 -06:00
akolliasAMD bd982864d5 recreated pr 914 to work with current develop branch (#979)
[ROCm/rccl commit: 56ce9ef05f]
2023-11-28 16:33:47 -07:00
Wenkai Du 297023a7a6 msccl: add templated kernel (#945)
* msccl: add templated kernel

* Use defines to improve code readability

* Fix kernel indexing and review feedback

[ROCm/rccl commit: f484ff17b9]
2023-11-02 17:21:53 -07:00
Bertan Dogancay 1ae071944e improve compilation time and create timetrace plot (#773)
* improve compilation time and create time-trace plot

* set default value for nproc

[ROCm/rccl commit: f35777e9b0]
2023-06-14 09:17:51 -06:00
gilbertlee-amd d2c1295f79 Refactoring CMakeFiles (#755)
[ROCm/rccl commit: 777d8747a5]
2023-05-25 16:08:54 -06:00
gilbertlee-amd 0ca30fb88a Updating files for missing licenses (#637)
[ROCm/rccl commit: ebb8b5bf63]
2022-10-14 13:49:16 -06:00
Wenkai Du 7874a99c75 Merge remote-tracking branch 'nccl/master' into develop
[ROCm/rccl commit: a79d9e3586]
2022-09-09 16:05:38 +00:00
akolliasAMD 151a8ef56a git_version cmake consistency changes (#604)
* git_version cmake variable consistency changes

[ROCm/rccl commit: 6670dc95ab]
2022-08-25 15:11:28 -06:00
gilbertlee-amd b350916a6e Fixing CMake to avoid unnecessary git_version relinking (#594)
[ROCm/rccl commit: 9ed9cd0e31]
2022-08-04 18:03:59 -06:00
gilbertlee-amd cb5ae7224e Adding git hash info to version output line (#572)
[ROCm/rccl commit: a89a9966aa]
2022-06-28 16:42:51 -06:00
Liam Wrubleski 95c6476678 Packages for test and benchmark executables on all supported OSes using CPack. (#512)
[ROCm/rccl commit: a8f1e61f48]
2022-03-21 15:04:14 -06:00
Nirmal Unnikrishnan 4a4c053a6a File reorganization as per the new defined standard
The header files will in /opt/rocm-xxx/include/rccl
Libraries and cmake will be in /opt/rocm-xxx/lib folder.
Added wrappers for header files using rocm-cmake functions for backward compatibility.


[ROCm/rccl commit: 676a4737c1]
2022-03-08 17:32:02 +00:00
Stanley Tsang aaeb206ca2 Search for GTest 1.11; fix detection of GTest after install (#476)
[ROCm/rccl commit: b002ef1aaf]
2022-01-17 15:18:01 -07:00
pavahora 93290f6230 Updating googletest to 1.11.0 (#454)
Co-authored-by: Vahora <pavahora@amd.com>

[ROCm/rccl commit: ee1a11ca7e]
2021-11-02 15:44:35 -06:00
Liam Wrubleski 4efbbec091 Setup runtime and development packages (#407)
* changes to enable devel package

* Update rocm-cmake version & build

[ROCm/rccl commit: 97d9cf40e7]
2021-07-26 15:06:17 -06:00
Wenkai Du 0f4d497edc Add gfx90a target (#344)
* Add gfx90a target

* Support gfx90a topology

Co-authored-by: Eiden Yoshida <eiden.yoshida@amd.com>

[ROCm/rccl commit: 1fe031402a]
2021-04-14 09:29:00 -06:00
Stanley Tsang fb7478e3a2 Do not search for GTest if we're force installing it into build directory (#318)
[ROCm/rccl commit: 61d66c8e18]
2021-02-22 15:22:01 -07:00
Wenkai Du e12db6f2ab Don't download GTest unless building unit test (#275)
[ROCm/rccl commit: 88a062342b]
2020-10-02 15:25:40 -07:00
Stanley Tsang 209133fadf Adding the ability to force install dependencies (namely gtest); gtest library installation fix for centos (#265)
* Adding the ability to force install dependencies (namely gtest); gtest library installation fix for centos

* Removing potentially unneccessary dependencies from install script

[ROCm/rccl commit: 8c90aefb6d]
2020-09-10 17:27:22 -06:00
saadrahim e5432857db Download GTest if not found in system (#237)
Co-authored-by: Stanley Tsang <stanley.tsang@amd.com>

[ROCm/rccl commit: 0dc019e35f]
2020-08-06 09:36:58 -06:00