Wenkai Du
36e5e02e46
Merge remote-tracking branch 'nccl/master' into develop
...
[ROCm/rccl commit: 4f0e223db4 ]
2022-10-20 15:41:29 +00:00
Wenkai Du
cf1d4a62e8
Fix missing initialization due to merge error ( #640 )
...
[ROCm/rccl commit: bc8ef779df ]
2022-10-19 21:20:11 -07:00
Wenkai Du
7fe0b0161f
topo_expl: fix compilation error ( #639 )
...
[ROCm/rccl commit: fc554a2428 ]
2022-10-19 14:19:50 -07:00
gilbertlee-amd
5459f1c3f6
Fixing formatting for copywrite ( #638 )
...
[ROCm/rccl commit: 10dbd2a452 ]
2022-10-19 13:43:21 -06:00
Wenkai Du
76414d3230
Support P2P with invisible devices ( #636 )
...
* Support P2P with invisible devices
* Update copyright year
[ROCm/rccl commit: 9ddf0e0649 ]
2022-10-17 10:24:59 -07:00
Wenkai Du
7cb9d872ab
Merge pull request #634 from yzygitzh/ziyyang/npkit-fix
...
Apply several fixes to NPKit
[ROCm/rccl commit: 9916a09818 ]
2022-10-17 08:01:24 -07:00
raramakr
65bd12b94d
Merge pull request #635 from raramakr/swdev
...
Correct include and library path for new directory layout
[ROCm/rccl commit: b32f38126d ]
2022-10-14 15:48:44 -07:00
gilbertlee-amd
0ca30fb88a
Updating files for missing licenses ( #637 )
...
[ROCm/rccl commit: ebb8b5bf63 ]
2022-10-14 13:49:16 -06:00
Ranjith Ramakrishnan
1cfca9f8e1
Correct include and library path for new directory layout
...
Use actual header files and libraries , rather than using wrapper header files and library softlinks
[ROCm/rccl commit: cf4e963aaf ]
2022-10-14 01:32:04 -07:00
Ziyue Yang
d54574b0eb
apply npkit
...
[ROCm/rccl commit: 7d6bbc19d4 ]
2022-10-14 01:28:17 +00:00
Edgar Gabriel
3fd090c5ba
Merge pull request #633 from edgargabriel/topic/topo-binary-tree
...
introduce a hw topology aware bintree
[ROCm/rccl commit: 4972c129e3 ]
2022-10-05 17:06:54 -05:00
Edgar Gabriel
f2736a4fb3
introduce a hw topology aware bintree
...
for hayabusa architecture.
[ROCm/rccl commit: e645b02cd8 ]
2022-10-03 15:26:21 +00:00
gilbertlee-amd
9225ea766e
Removing TransferBench from tools ( #632 )
...
Point to new TransferBench repo
[ROCm/rccl commit: bd7d589446 ]
2022-09-30 11:53:32 -06:00
akolliasAMD
dbbdf65020
Added new gpu targets ( #631 )
...
[ROCm/rccl commit: ef71550738 ]
2022-09-29 14:53:55 -06:00
Wenkai Du
07a0adf1d6
Another threadfence and flags rework ( #629 )
...
[ROCm/rccl commit: a523b37ac7 ]
2022-09-28 16:49:29 -07:00
Wenkai Du
f6da79844a
Add LL128 tuning ( #630 )
...
[ROCm/rccl commit: 021932b3c8 ]
2022-09-27 09:39:09 -07:00
Sylvain Jeaugey
8761a6c2fc
Merge remote-tracking branch 'origin/master'
...
[ROCm/rccl commit: 99c28f2e75 ]
2022-09-27 02:24:41 -07:00
Cliff Woolley
37ccaf1f82
Use compatibility shim only with static cudart
...
Closes issue 658
[ROCm/rccl commit: 78313a6d21 ]
2022-09-27 02:22:48 -07:00
Wen-Heng (Jack) Chung
27d27e971b
Merge pull request #619 from whchung/exp_reduce_code_size
...
Only use split tree algorithm to reduce kernel code size.
[ROCm/rccl commit: e8af0716c4 ]
2022-09-26 10:06:27 -05:00
Sylvain Jeaugey
fda4362c9e
Fix potential deadlock during init in multi-thread mode.
...
Make sure all calls calling cudaMalloc (including devCommSetup) are
called before the last bootstrapBarrier. That way, we avoid calls to
cudaMalloc be blocked by a NCCL kernel launched on another GPU by
another thread which completed init faster.
Resolve #623 .
[ROCm/rccl commit: ecab28a7c9 ]
2022-09-26 02:13:10 -07:00
Wen-Heng (Jack) Chung
bd19566413
Merge pull request #621 from whchung/exp_reduce_sleep_cycles
...
Reduce s_sleep cycles
[ROCm/rccl commit: 35f1fe3434 ]
2022-09-23 15:31:16 -05:00
Wen-Heng (Jack) Chung
183f1e6b32
Merge pull request #624 from whchung/exp_tweak_unroll_factors
...
Tweak unroll factors.
[ROCm/rccl commit: a80cc7e6e1 ]
2022-09-23 11:30:05 -05:00
Wen-Heng (Jack) Chung
7cde92deff
Tweak unroll factors.
...
[ROCm/rccl commit: 84054c3b30 ]
2022-09-22 13:03:04 -05:00
Wenkai Du
abdc365a05
Only use split tree algorithm to reduce kernel code size.
...
[ROCm/rccl commit: 02929cffb6 ]
2022-09-22 12:01:53 -05:00
Wenkai Du
0b56e397cc
Reduce s_sleep cycles
...
[ROCm/rccl commit: a3c8ef8c03 ]
2022-09-22 12:01:12 -05:00
Wen-Heng (Jack) Chung
975642e7ee
Abolish syncthreads and only wait on LDS traffic.
...
[ROCm/rccl commit: b9ae02d4ad ]
2022-09-22 12:00:37 -05:00
Wenkai Du
e4d46a0f64
Rework threadfence and flag setting ( #627 )
...
[ROCm/rccl commit: 49c811ecf9 ]
2022-09-22 08:35:42 -07:00
Wenkai Du
81c71aeb67
Revert changes to gfx1030 ( #622 )
...
[ROCm/rccl commit: d9216af48b ]
2022-09-20 20:06:17 -07:00
Wenkai Du
98609a7b92
Define ncclShmem as global shared ( #618 )
...
* Use global defined shared memory
* Add --hipcc-func-supp to compile option
* Force inline some device functions
* Add back threadfence
[ROCm/rccl commit: 9e6c87a2bf ]
2022-09-20 09:00:20 -07:00
Jane Xu
554b03bed1
address review comments
...
[ROCm/rccl commit: f89fd4777d ]
2022-09-20 11:58:33 +02:00
Jane Xu
e742734b82
Fix intermittent 11.6 builds: generate unique .cu file for each object file
...
[ROCm/rccl commit: 79fb0326ac ]
2022-09-20 11:58:33 +02:00
Edgar Gabriel
95d6ed2154
make binary tree work on 2.13.4
...
[ROCm/rccl commit: 8f3219dbd4 ]
2022-09-15 00:01:54 +00:00
Wenkai Du
ba6e2db70d
Misc fixes and disable binTree
...
[ROCm/rccl commit: a06e14e39b ]
2022-09-14 00:26:19 +00:00
Edgar Gabriel
4a86adcaba
Update init.cc
...
[ROCm/rccl commit: e5d2dfed34 ]
2022-09-13 17:29:32 -05:00
Edgar Gabriel
4c17f4dcc1
Merge branch 'develop' into 2.13.4
...
[ROCm/rccl commit: be935d7ce7 ]
2022-09-13 17:19:04 -05:00
Edgar Gabriel
7148c0aa7b
add binary tree
...
In addition, introduce the ability to have 2 trees at the same time.
Only for allreduce at the moment.
[ROCm/rccl commit: 65e2ae20e5 ]
2022-09-13 20:52:32 +00:00
Gilbert Lee
1d24c476f4
Merge branch 'develop' into 2.13.4
...
[ROCm/rccl commit: 009e79623f ]
2022-09-09 23:07:04 +00:00
gilbertlee-amd
35872115f8
Updating stream caching ( #614 )
...
- Adding non-captured hipStream for use in setup
[ROCm/rccl commit: dd56135a9a ]
2022-09-09 16:30:15 -06:00
gilbertlee-amd
af71be44f1
GraphBench ( #613 )
...
Adding simple GraphBench tool for comparing RCCL hipGraph performance
[ROCm/rccl commit: 65d78e9a1d ]
2022-09-09 12:12:25 -06:00
Wenkai Du
7874a99c75
Merge remote-tracking branch 'nccl/master' into develop
...
[ROCm/rccl commit: a79d9e3586 ]
2022-09-09 16:05:38 +00:00
Wenkai Du
fe99249cde
Enable LL128 protocol support ( #605 )
...
* Enable LL128 protocol support
* Use shared memory object directly when possible
[ROCm/rccl commit: 7bbce085cc ]
2022-09-08 14:45:27 -07:00
Lauren Wrubleski
3da06e4704
Update ubuntu18 to ubuntu20 ( #611 )
...
[ROCm/rccl commit: d700a94918 ]
2022-09-07 16:02:37 -06:00
Min Si
25ba51fe83
Fix compilation issues with buck ( #610 )
...
* Fix compilation warning with -Wmisleading-indentation
When compile with -Wmisleading-indentation, it reports warning:
misleading indentation; statement is not part of the previous 'if'
This patch fixes it
* Avoid relative include file path
We don't need relative include file paths for src/graph/*.h
since src/ is already in CMake include_directories
[ROCm/rccl commit: 2b57751abb ]
2022-09-07 09:56:05 -06:00
gilbertlee-amd
616cb39a0b
Adding opt-in hipGraph support for RCCL via RCCL_ENABLE_HIPGRAPH ( #608 )
...
Adding opt-in hipGraph support via RCCL_ENABLE_HIPGRAPH
[ROCm/rccl commit: 47b2fc3a30 ]
2022-09-06 10:29:46 -06:00
akolliasAMD
2cd63dac42
added stream synch after hipMemset ( #609 )
...
[ROCm/rccl commit: 06bce9d0c9 ]
2022-08-30 16:18:37 -06:00
Wenkai Du
f18868f439
Use hipExtLaunchKernel when not using graph and not in group mode ( #606 )
...
[ROCm/rccl commit: c9f2fe1f65 ]
2022-08-26 13:40:37 -07:00
akolliasAMD
151a8ef56a
git_version cmake consistency changes ( #604 )
...
* git_version cmake variable consistency changes
[ROCm/rccl commit: 6670dc95ab ]
2022-08-25 15:11:28 -06:00
Edgar Gabriel
22dcbed61b
Merge pull request #603 from edgargabriel/topic/float16_unit_tests
...
introduce support for ncclFloat16/half in UT
[ROCm/rccl commit: 8a311583e0 ]
2022-08-25 07:40:20 -05:00
Edgar Gabriel
b32b819151
introduce support for ncclFloat16/half in UT
...
[ROCm/rccl commit: f6e00dec13 ]
2022-08-24 15:28:24 +00:00
Edgar Gabriel
6bb871c986
Merge pull request #598 from edgargabriel/topic/tree-multirank
...
Expand ncclTreeBasePostset for multi-rank
[ROCm/rccl commit: e739c62a53 ]
2022-08-24 08:28:34 -05:00