AI/rocm-systems
2
0
Garpu 0
Kode Masalah Tarik Permintaan Actions Packages Projects Rilis Wiki Kegiatan
480 Melakukan 3 Cabang 0 Tag
2e5e4a6bde021192f4befea40a961e6b9170e2fa
Grafik Komit

67 Melakukan

Penulis SHA1 Pesan Tanggal
lijietang f6b08ca547 Add rccl bw test script in tools (#255) 
[ROCm/rccl commit: bbe233f8c1]
 2020-09-11 16:59:03 +08:00
Wenkai Du 03bb6bcb54 Increase minimal channels for gfx908 (#259) 
[ROCm/rccl commit: c5cbece6d0]
 2020-08-26 11:40:11 -07:00
Wenkai Du 5f49a0e088 Add NPS4 support on some models (#256) 
* Add NPS4 support on some models

* Add XML models

[ROCm/rccl commit: 391bbf3f1e]
 2020-08-19 11:03:20 -07:00
gilbertlee-amd 3e4ddd065b Upgrading various TransferBench features (#257) 
[ROCm/rccl commit: ec9af40fcd]
 2020-08-19 09:47:19 -06:00
Wenkai Du 3d5fb8142e Add another Rome model (#249) 
* Add another Rome model

* Add gfx908 4P3L models and support

* Revert "Use cached value for detecting GDR support only once"

This reverts commit 0108a1219d.

* Skip using ibverb for GPU direct RDMA detection

* Fine tune one Rome model

[ROCm/rccl commit: a51e4071e3]
 2020-08-17 10:51:02 -07:00
gilbertlee-amd 1a9b00a7fd Fixes to make TransferBench compile for hipclang (#254) 
[ROCm/rccl commit: c985478133]
 2020-08-13 12:25:28 -06:00
Wenkai Du f242a2f0b0 Collect gcnArch and hipDeviceArch_t in XML (#252) 
[ROCm/rccl commit: 7e3d8a31cc]
 2020-08-12 15:48:38 -07:00
Wenkai Du 26c540abb8 Merge pull request #247 from wenkaidu/rome 
Additional Rome models support

[ROCm/rccl commit: 3c46cb8ad4]
 2020-08-07 10:56:12 -07:00
MurtadhaAldallal f1373612b0 Update rccl_prim_test.cpp (#246) 
Adding doublelocalcopy operation and freeing buffer memory at end.
DoubleLocalCopy Patch Added

[ROCm/rccl commit: 390c63cf0d]
 2020-08-07 08:20:14 -07:00
Wenkai Du c9815aaa36 Add more Rome 4P2H models 
[ROCm/rccl commit: 09ef75656a]
 2020-08-06 18:20:02 +00:00
Wenkai Du 487f93b83f Topology tuning for 4P2H on Rome (#242) 
* Topology tuning for 4P2H on Rome

* Use ncclTopoIdToIndex

[ROCm/rccl commit: e7a10aa0e4]
 2020-07-27 11:53:57 -07:00
Wenkai Du 49c667ac8a ib-test: support multiple channels (#241) 
[ROCm/rccl commit: 8d5fb920b6]
 2020-07-27 11:03:12 -07:00
Sourav Chakraborty e55a3f20ba add 4 node 8P6L 1 NIC 2nd Hive model 
[ROCm/rccl commit: 2475daafee]
 2020-07-22 16:27:15 +00:00
Sourav Chakraborty b3306d1c13 simplify model definitions in topo expl 
[ROCm/rccl commit: db55afb014]
 2020-07-22 16:05:53 +00:00
Wenkai Du f604fc774e Add 8P6L multi-node models (#239) 
[ROCm/rccl commit: d5f90e19b5]
 2020-07-21 14:10:36 -07:00
Wenkai Du 3e2c9054cd Change default channels duplication for chordal ring (#233) 
[ROCm/rccl commit: ab787c767e]
 2020-07-14 15:16:50 -07:00
Stanley Tsang 3dd54437fe Adding appropriate references in rccl-prim-test (#227) 
Adding appropriate references to rccl-prim-test.

[ROCm/rccl commit: 9bd4c14603]
 2020-07-06 10:15:03 -06:00
Wenkai Du 2f99c7bbad topo_expl: each rank needs to have its own memory for graphs (#225) 
[ROCm/rccl commit: d3548cc474]
 2020-07-01 15:11:02 -07:00
Wenkai Du e8da2a0da6 topo_expl: fix broken build (#224) 
[ROCm/rccl commit: a6be82f5ab]
 2020-06-30 11:11:23 -07:00
Wenkai Du e7d664200f Use posix_memalign for network buffer allocation on host memory (#221) 
* Use posix_memalign for network buffer allocation on host memory

* ib-test: add ability to specify run iterations

* ib-test: define iterations as multiple of default cycles

* Add checking to posix_memalign return value

[ROCm/rccl commit: 0eb19a563a]
 2020-06-22 13:06:25 -07:00
Wenkai Du 2dc0cfcbf5 ib-test: support host memory allocation through posix_memalign (#220) 
* ib-test: support host memory allocation through posix_memalign

* ib-test: add missing CUDACHECK to hip calls

[ROCm/rccl commit: dc739c4e70]
 2020-06-17 16:16:54 -07:00
Wenkai Du 9ca3176346 Add IB/RDMA unit test 
[ROCm/rccl commit: cfa97eccd3]
 2020-06-16 18:29:17 +00:00
Wenkai Du 15cd2aff3c Add gather, scatter and alltoall collectives 
Introducing 3 new APIs:
ncclResult_t  ncclGather(const void* sendbuff, void* recvbuff, size_t sendcount,
    ncclDataType_t datatype, int root, ncclComm_t comm, hipStream_t stream);
ncclResult_t  ncclScatter(const void* sendbuff, void* recvbuff,
    size_t recvcount, ncclDataType_t datatype, int root, ncclComm_t comm,
    hipStream_t stream);
ncclResult_t  ncclAllToAll(const void* sendbuff, void* recvbuff, size_t count,
    ncclDataType_t datatype, ncclComm_t comm, hipStream_t stream);

Only out of place operation is supported.
Preprocessor symbol RCCL_GATHER_SCATTER=1 indicates API availibility.
By default the APIs launche RCCL kernel implementation, which can be disabled by
RCCL_ALLTOALL_KERNEL_DISABLE=1. Then the APIs use wrapper around ncclSend and ncclRecv.


[ROCm/rccl commit: e80e29573c]
 2020-06-09 17:44:08 -07:00
Wenkai Du 69eb70ce43 tpol_expl: update to 2.7 
[ROCm/rccl commit: 71ec3e09df]
 2020-06-09 17:40:24 -07:00
Wenkai Du 61a82ff572 Merge pull request #208 from wenkaidu/perf_xgmi 
Give preference to path with more XGMI connections

[ROCm/rccl commit: 706de76046]
 2020-05-15 10:07:22 -07:00
Wenkai Du 27519fd019 Give preference to path with more XGMI connections 
[ROCm/rccl commit: b3c9852634]
 2020-05-14 15:33:16 -07:00
Wenkai Du ced9958094 rccl-prim-test: add flags when calling hipExtLaunchMultiKernelMultiDevice in hip-clang 
[ROCm/rccl commit: f1058b6353]
 2020-05-12 23:54:07 +00:00
Saad Rahim 65ad48404b Merge remote-tracking branch 'upstream/master' into develop 
[ROCm/rccl commit: 33c23fdcda]
 2020-04-29 16:12:37 -07:00
Wenkai Du 779ee97ada topo_expl: fix build error 
[ROCm/rccl commit: 5743c6b7d2]
 2020-04-27 17:17:05 +00:00
Gilbert Lee eebc6f2844 Adding option to re-use streams instead of re-creating per topology 
[ROCm/rccl commit: 339bf9ff19]
 2020-04-23 15:53:40 +00:00
Wenkai Du 2de0b24c30 rccl-prim-test: auto-detect rings in 4P and 8P configurations 
[ROCm/rccl commit: ef7064ba9b]
 2020-04-10 18:17:21 +00:00
Aaron Enye Shi bfbfe370c3 Fix HIP-Clang build with HSA headers 
HIP-Clang does not include these HSA headers, and they need to be explicitly added in RCCL.


[ROCm/rccl commit: a95090d981]
 2020-04-03 17:58:23 -04:00
Wenkai Du 8852e54181 topo_expl: update to 2.6 
[ROCm/rccl commit: 6f54b23503]
 2020-04-01 13:37:08 -07:00
Wenkai Du e3e1c6b29c rccl-prim-test: add all-to-all benchmark (#185) 
For gfx908, support simple detection of ring topology.
Call ReduceOrCopyMulti directly from kernel.
Also simplify code by removing kernel start synchronization option
which has no effect on throughput measurements.

[ROCm/rccl commit: ebc823e603]
 2020-03-16 10:00:54 -07:00
Wenkai Du 7882b2f0c5 topo_expl: add a few more single node models 
[ROCm/rccl commit: 32388d60a9]
 2020-03-02 11:43:03 -08:00
Wenkai Du a36c2ecbc4 Add topology visualizer tool 
[ROCm/rccl commit: 498d5029ad]
 2020-02-26 15:23:34 -08:00
Wenkai Du 3886f9bea8 topo_expl: use bandwidth numbers defined in graph in CPU models 
[ROCm/rccl commit: 934b6de557]
 2020-02-26 14:17:36 -08:00
Wenkai Du 45a7541582 Revise PCI BW numbers on Rome 
[ROCm/rccl commit: d2adc61bf6]
 2020-02-26 13:17:49 -08:00
Wenkai Du 00f421ccbd Add topology explorer 
[ROCm/rccl commit: 55f8e2dec7]
 2020-02-19 14:42:06 -08:00
Stanley Tsang e5419407c4 Updating copyright notices for 2020. 
[ROCm/rccl commit: 20fa04d9b6]
 2020-01-29 15:28:08 -08:00
Wenkai Du e6b5933d7e Merge remote-tracking branch 'remotes/rccl/master' into rccl_2.5.6_cleanup 
[ROCm/rccl commit: fe6d012eb0]
 2020-01-29 15:28:03 -08:00
Wenkai Du d2fbcfea02 Misc fixes and improvements for 2.5.6 
1. Fix RCCL unit test
2. Add ROME detection and tuning
3. Change default P2P level
4. Fix search algorithm for XGMI
5. Remove explicit channel duplication with implicit by using half of link speed
6. Add collective trace support
7. Correct Intel Skylake CPU detection and bandwidth
8. Fix topo connect function
9. Disable GDR read and remove unreachable code
10. Disable LL128 kernels
11. Add tuning parameters
12. Use original clock64() implementation which returns RTC counter value
13. Print out timestamp of collective trace
14. Do not use struct ncclColl in kernel launch parameter
15. Fix abort handling and add tracing
17. Add __launch_bounds__ to kernel functions
18. Remove unused abortCount
19. Unset default MIN_NRINGS and MIN_NCHANNELS
20. Do not allocate shared memory when not using LL128 kernels
21. Correct time print out in tuning log


[ROCm/rccl commit: 1e55645d97]
 2020-01-29 15:27:05 -08:00
Gilbert Lee 5783917a75 Changing single sync mode to time all iterations instead of just last 
[ROCm/rccl commit: e5074ce94d]
 2019-12-20 17:08:39 -08:00
gilbertlee-amd a461b6d139 Adding new sleep after sync capability for data fabric profiling (#162) 
Fixing missing header include for ROCM 3.0 changes

[ROCm/rccl commit: 2f4269d06d]
 2019-12-12 15:20:54 -07:00
Wenkai Du 25b3175e82 rccl_prim_test: Generalize ring topology and duplications 
Allow user specified ring topology from command line and duplicated
to requested number of workgroups:
./rccl_prim_test -w 12 -p copy -r "0 1 2 3|3 2 1 0|0 2 1 3|3 1 2 0|0 2 3 1|1 3 2 0"


[ROCm/rccl commit: 07bb6fce8f]
 2019-11-11 15:42:24 -08:00
Wenkai Du 66e4337c6e Merge pull request #149 from wenkaidu/rtc 
Correct RTC frequencies for profiling purpose

[ROCm/rccl commit: 277c72a638]
 2019-11-06 08:02:58 -08:00
gilbertlee-amd 22cbbb9004 Adding interactive mode for profiling purposes (#150) 
[ROCm/rccl commit: fd94f4fa25]
 2019-11-05 17:10:16 -07:00
Wenkai Du 62042e47bc Correct RTC frequencies for profiling purpose 
[ROCm/rccl commit: 8995047830]
 2019-11-05 11:36:45 -08:00
Wenkai Du 0d6b476b08 Merge pull request #145 from wenkaidu/prim_test 
rccl-prim-test: use hipExtLaunchMultiKernelMultiDevice and minor cleanup

[ROCm/rccl commit: 90b2921207]
 2019-11-01 13:30:01 -07:00
gilbertlee-amd f9ef1553aa Single Sync Timing mode (#144) 
* Adding single sync timing mode to emulate timing reported by rccl-prim-test / rccl-tests
* Adding duration / overhead info


[ROCm/rccl commit: 2f9edd2432]
 2019-11-01 10:18:25 -06:00