adff98765c
Merge remote-tracking branch 'nccl/master' into no-target-id
...
[ROCm/rccl commit: d469947641
2021-01-14 19:27:53 -05:00
c0c64d970a
Add more Rome models ( #292 )
...
[ROCm/rccl commit: dfa3c41ede
2020-10-30 21:26:04 -07:00
2931959e6e
Adding output to CSV, removing OpenMP, decreasing default numBytes to 64MB, adding aggregate stats ( #290 )
...
[ROCm/rccl commit: bfab1d3592
2020-10-27 09:00:33 -06:00
a062c80298
[TransferBench] Displaying PCIe Bus ID ( #288 )
...
* Adding PCIe BusID per GPU in topology display
[ROCm/rccl commit: 61e1a71d14
2020-10-21 16:13:36 -06:00
0282595de5
TransferBench Typo. Pinned host memory uses C not P ( #286 )
...
[ROCm/rccl commit: 769418c5c7
2020-10-21 12:05:38 -06:00
94437eef28
Revert "Initial support for clique-based kernels ( #276 )" ( #280 )
...
This reverts commit d68a532bc684a2541e01
2020-10-15 11:30:18 -07:00
8b120c0508
Update Rome single node models ( #277 )
...
[ROCm/rccl commit: 33babcb5e2
2020-10-13 13:33:09 -07:00
d68a532bc6
Initial support for clique-based kernels ( #276 )
...
* Initial support for clique-based kernels
[ROCm/rccl commit: 2b8184808d
2020-10-13 11:22:04 -06:00
41260bb948
Rework Rome detection and add multiple network ports models ( #274 )
...
* Rework Rome detection and add multiple network ports models
* Remove unused opCount in p2p transport
[ROCm/rccl commit: ae008fd2db
2020-10-07 13:37:36 -07:00
dbde26e681
Add Alltoallv RCCL kernel implementation ( #269 )
...
* Add alltoallv API and implementation
* Extend Rome P2P channel limit to multinode and alltoall kernels
* topo_expl: fix compilation and sync up with main
* gtest: use RCCL alltoallv API
* Code review changes
[ROCm/rccl commit: b871ea3c0c
2020-09-30 16:25:36 -07:00
5ca117d7cd
New TransferBench features ( #273 )
...
* Upgrading TransferBench to support pinned CPU memory, expanding functionality, cleaning up env vars
[ROCm/rccl commit: ee262819a7
2020-09-25 12:20:48 -06:00
f6b08ca547
Add rccl bw test script in tools ( #255 )
...
[ROCm/rccl commit: bbe233f8c1
2020-09-11 16:59:03 +08:00
03bb6bcb54
Increase minimal channels for gfx908 ( #259 )
...
[ROCm/rccl commit: c5cbece6d0
2020-08-26 11:40:11 -07:00
5f49a0e088
Add NPS4 support on some models ( #256 )
...
* Add NPS4 support on some models
* Add XML models
[ROCm/rccl commit: 391bbf3f1e
2020-08-19 11:03:20 -07:00
3e4ddd065b
Upgrading various TransferBench features ( #257 )
...
[ROCm/rccl commit: ec9af40fcd
2020-08-19 09:47:19 -06:00
3d5fb8142e
Add another Rome model ( #249 )
...
* Add another Rome model
* Add gfx908 4P3L models and support
* Revert "Use cached value for detecting GDR support only once"
This reverts commit 0108a1219da51e4071e3
2020-08-17 10:51:02 -07:00
1a9b00a7fd
Fixes to make TransferBench compile for hipclang ( #254 )
...
[ROCm/rccl commit: c985478133
2020-08-13 12:25:28 -06:00
f242a2f0b0
Collect gcnArch and hipDeviceArch_t in XML ( #252 )
...
[ROCm/rccl commit: 7e3d8a31cc
2020-08-12 15:48:38 -07:00
26c540abb8
Merge pull request #247 from wenkaidu/rome
...
Additional Rome models support
[ROCm/rccl commit: 3c46cb8ad4
2020-08-07 10:56:12 -07:00
f1373612b0
Update rccl_prim_test.cpp ( #246 )
...
Adding doublelocalcopy operation and freeing buffer memory at end.
DoubleLocalCopy Patch Added
[ROCm/rccl commit: 390c63cf0d
2020-08-07 08:20:14 -07:00
c9815aaa36
Add more Rome 4P2H models
...
[ROCm/rccl commit: 09ef75656a
2020-08-06 18:20:02 +00:00
487f93b83f
Topology tuning for 4P2H on Rome ( #242 )
...
* Topology tuning for 4P2H on Rome
* Use ncclTopoIdToIndex
[ROCm/rccl commit: e7a10aa0e4
2020-07-27 11:53:57 -07:00
49c667ac8a
ib-test: support multiple channels ( #241 )
...
[ROCm/rccl commit: 8d5fb920b6
2020-07-27 11:03:12 -07:00
e55a3f20ba
add 4 node 8P6L 1 NIC 2nd Hive model
...
[ROCm/rccl commit: 2475daafee
2020-07-22 16:27:15 +00:00
b3306d1c13
simplify model definitions in topo expl
...
[ROCm/rccl commit: db55afb014
2020-07-22 16:05:53 +00:00
f604fc774e
Add 8P6L multi-node models ( #239 )
...
[ROCm/rccl commit: d5f90e19b5
2020-07-21 14:10:36 -07:00
3e2c9054cd
Change default channels duplication for chordal ring ( #233 )
...
[ROCm/rccl commit: ab787c767e
2020-07-14 15:16:50 -07:00
3dd54437fe
Adding appropriate references in rccl-prim-test ( #227 )
...
Adding appropriate references to rccl-prim-test.
[ROCm/rccl commit: 9bd4c14603
2020-07-06 10:15:03 -06:00
2f99c7bbad
topo_expl: each rank needs to have its own memory for graphs ( #225 )
...
[ROCm/rccl commit: d3548cc474
2020-07-01 15:11:02 -07:00
e8da2a0da6
topo_expl: fix broken build ( #224 )
...
[ROCm/rccl commit: a6be82f5ab
2020-06-30 11:11:23 -07:00
e7d664200f
Use posix_memalign for network buffer allocation on host memory ( #221 )
...
* Use posix_memalign for network buffer allocation on host memory
* ib-test: add ability to specify run iterations
* ib-test: define iterations as multiple of default cycles
* Add checking to posix_memalign return value
[ROCm/rccl commit: 0eb19a563a
2020-06-22 13:06:25 -07:00
2dc0cfcbf5
ib-test: support host memory allocation through posix_memalign ( #220 )
...
* ib-test: support host memory allocation through posix_memalign
* ib-test: add missing CUDACHECK to hip calls
[ROCm/rccl commit: dc739c4e70
2020-06-17 16:16:54 -07:00
9ca3176346
Add IB/RDMA unit test
...
[ROCm/rccl commit: cfa97eccd3
2020-06-16 18:29:17 +00:00
15cd2aff3c
Add gather, scatter and alltoall collectives
...
Introducing 3 new APIs:
ncclResult_t ncclGather(const void* sendbuff, void* recvbuff, size_t sendcount,
ncclDataType_t datatype, int root, ncclComm_t comm, hipStream_t stream);
ncclResult_t ncclScatter(const void* sendbuff, void* recvbuff,
size_t recvcount, ncclDataType_t datatype, int root, ncclComm_t comm,
hipStream_t stream);
ncclResult_t ncclAllToAll(const void* sendbuff, void* recvbuff, size_t count,
ncclDataType_t datatype, ncclComm_t comm, hipStream_t stream);
Only out of place operation is supported.
Preprocessor symbol RCCL_GATHER_SCATTER=1 indicates API availibility.
By default the APIs launche RCCL kernel implementation, which can be disabled by
RCCL_ALLTOALL_KERNEL_DISABLE=1. Then the APIs use wrapper around ncclSend and ncclRecv.
[ROCm/rccl commit: e80e29573c
2020-06-09 17:44:08 -07:00
69eb70ce43
tpol_expl: update to 2.7
...
[ROCm/rccl commit: 71ec3e09df
2020-06-09 17:40:24 -07:00
61a82ff572
Merge pull request #208 from wenkaidu/perf_xgmi
...
Give preference to path with more XGMI connections
[ROCm/rccl commit: 706de76046
2020-05-15 10:07:22 -07:00
27519fd019
Give preference to path with more XGMI connections
...
[ROCm/rccl commit: b3c9852634
2020-05-14 15:33:16 -07:00
ced9958094
rccl-prim-test: add flags when calling hipExtLaunchMultiKernelMultiDevice in hip-clang
...
[ROCm/rccl commit: f1058b6353
2020-05-12 23:54:07 +00:00
65ad48404b
Merge remote-tracking branch 'upstream/master' into develop
...
[ROCm/rccl commit: 33c23fdcda
2020-04-29 16:12:37 -07:00
779ee97ada
topo_expl: fix build error
...
[ROCm/rccl commit: 5743c6b7d2
2020-04-27 17:17:05 +00:00
eebc6f2844
Adding option to re-use streams instead of re-creating per topology
...
[ROCm/rccl commit: 339bf9ff19
2020-04-23 15:53:40 +00:00
2de0b24c30
rccl-prim-test: auto-detect rings in 4P and 8P configurations
...
[ROCm/rccl commit: ef7064ba9b
2020-04-10 18:17:21 +00:00
bfbfe370c3
Fix HIP-Clang build with HSA headers
...
HIP-Clang does not include these HSA headers, and they need to be explicitly added in RCCL.
[ROCm/rccl commit: a95090d981
2020-04-03 17:58:23 -04:00
8852e54181
topo_expl: update to 2.6
...
[ROCm/rccl commit: 6f54b23503
2020-04-01 13:37:08 -07:00
e3e1c6b29c
rccl-prim-test: add all-to-all benchmark ( #185 )
...
For gfx908, support simple detection of ring topology.
Call ReduceOrCopyMulti directly from kernel.
Also simplify code by removing kernel start synchronization option
which has no effect on throughput measurements.
[ROCm/rccl commit: ebc823e603
2020-03-16 10:00:54 -07:00
7882b2f0c5
topo_expl: add a few more single node models
...
[ROCm/rccl commit: 32388d60a9
2020-03-02 11:43:03 -08:00
a36c2ecbc4
Add topology visualizer tool
...
[ROCm/rccl commit: 498d5029ad
2020-02-26 15:23:34 -08:00
3886f9bea8
topo_expl: use bandwidth numbers defined in graph in CPU models
...
[ROCm/rccl commit: 934b6de557
2020-02-26 14:17:36 -08:00
45a7541582
Revise PCI BW numbers on Rome
...
[ROCm/rccl commit: d2adc61bf6
2020-02-26 13:17:49 -08:00
00f421ccbd
Add topology explorer
...
[ROCm/rccl commit: 55f8e2dec7
2020-02-19 14:42:06 -08:00
Wenkai Du
Wenkai Du
gilbertlee-amd
lijietang
MurtadhaAldallal
Sourav Chakraborty
Stanley Tsang
Saad Rahim
Gilbert Lee
Aaron Enye Shi