Commit Graph

526 Commits

Author SHA1 Message Date
Wenkai Du 7f9c15b843 Use less unroll for clique kernels (#313)
[ROCm/rccl commit: 41e47a36e7]
2021-01-15 17:48:10 -08:00
Stanley Tsang d7ed44eb9a Adding multiprocess unit tests (#312)
Adding multiprocess unit tests for collectives.  

To run, NCCL_COMM_ID=$HOSTNAME:12345 build/release/test/UnitTestsMultiProcess

[ROCm/rccl commit: d3fa257682]
2021-01-15 16:34:36 -07:00
Wenkai Du 4ea285c527 Fix Rome PCIe 2 node topology generation (#310)
[ROCm/rccl commit: 373a108516]
2020-12-15 17:16:17 -08:00
gilbertlee-amd c570f09681 [TransferBench] Fixing bug with fine-grained memory allocation (#311)
* Fixing bug with fine-grained memory

[ROCm/rccl commit: 41c35dad48]
2020-12-15 17:37:31 -07:00
gilbertlee-amd 5155abb250 [TransferBench] Adding ability to perform CPU-executed copies, various upgrades (#309)
* Adding CPU based execution, fixing typos, adding Fine-grained mem
* Exposing sampling factor when generating range of data sizes
* Refactoring how Links are launched, now once per thread
* Documentation updates

[ROCm/rccl commit: ae0c4092c7]
2020-12-11 10:21:14 -07:00
gilbertlee-amd 9b48f92d72 [TransferBench] Support multiple of 4 byte sizes, changing default GPU timing mechanism (#307)
* Changing default timing mechanism, adjusting CPU bandwidth calc, adding flag to use combined timing
* Adding support for smaller transfers (byte size must be multiple of 4 instead of 128)

[ROCm/rccl commit: b80ae551b1]
2020-12-04 14:57:13 -07:00
Wenkai Du 9e83df4ad3 Adding backward compatibility for target-id syntax for AMDGPU_TARGETS (#306)
[ROCm/rccl commit: 882d52ad7e]
2020-12-04 13:55:56 -08:00
Wenkai Du b68ff1ebba Add Rome model and improve search (#305)
[ROCm/rccl commit: 975b14dffa]
2020-11-17 14:55:06 -08:00
Wenkai Du 32fdfc93fc Merge remote-tracking branch 'origin/master' into develop
[ROCm/rccl commit: 1943bac646]
2020-11-16 12:16:53 -05:00
Wenkai Du f19cbc8e51 Use device's link width and speed if port doesn't report (#304)
[ROCm/rccl commit: 554729079d]
2020-11-13 17:58:04 -08:00
Wenkai Du 36935cfbee gtest: add scatter to combined calls and use loops (#303)
* gtest: add scatter to combined calls and use loops

* gtest: run validation inside loop

* gtest: revert small element count to 2520

* gtest: fix memory leak in validation

[ROCm/rccl commit: b0853ccd51]
2020-11-13 17:57:44 -08:00
Stanley Tsang f373cd2fdc Fixing IPC handle leak (#302)
[ROCm/rccl commit: 2958f7eace]
2020-11-13 10:32:42 -07:00
gilbertlee-amd f66d05193a Adding RCCL_CLIQUE_DEBUG to help debug experimental clique feature (#300)
[ROCm/rccl commit: c8d08a7c2f]
2020-11-13 09:07:11 -07:00
Wenkai Du 62d21047b8 Skip unused peer connection in scatter and gather (#301)
[ROCm/rccl commit: 4e68229c8b]
2020-11-12 15:47:34 -08:00
Colin Smith 1349b382cd Merge pull request #299 from ROCmSoftwarePlatform/develop
Enable target id build

[ROCm/rccl commit: 377b43470b]
2020-11-10 15:47:42 -07:00
gilbertlee-amd a7ef699687 Clique kernel support (#295)
* Adding experimental clique-based kernels (opt-in only)

Co-authored-by: Stanley Tsang <stanley.tsang@amd.com>
Co-authored-by: Gilbert Lee <gilbert.lee@amd.com>
Co-authored-by: Wenkai Du <43822138+wenkaidu@users.noreply.github.com>

[ROCm/rccl commit: 41bcfb8878]
2020-11-10 15:44:10 -07:00
Wenkai Du 273974393e Use target id of xnack off (#298)
[ROCm/rccl commit: 1fdb216f87]
2020-11-10 11:10:48 -08:00
Wenkai Du a0109b2eae Use ncclSend/ncclRecv for alltoall type of collectives as default (#297)
[ROCm/rccl commit: 2e8b3a0857]
2020-11-09 11:23:17 -08:00
gilbertlee-amd 1af4a5c9fa Adding a CHANGELOG (#296)
[ROCm/rccl commit: bdd8adf1ca]
2020-11-05 13:38:30 -07:00
Wenkai Du a4dd1a9548 Improve GPU direct RDMA handling on Rome (#294)
[ROCm/rccl commit: 709b7e4880]
2020-11-03 14:29:08 -08:00
Wenkai Du c0c64d970a Add more Rome models (#292)
[ROCm/rccl commit: dfa3c41ede]
2020-10-30 21:26:04 -07:00
gilbertlee-amd 2931959e6e Adding output to CSV, removing OpenMP, decreasing default numBytes to 64MB, adding aggregate stats (#290)
[ROCm/rccl commit: bfab1d3592]
2020-10-27 09:00:33 -06:00
Wenkai Du e7ea1a585e Fix lintian errors (#287)
[ROCm/rccl commit: 2ecfc62ec8]
2020-10-21 16:20:53 -07:00
gilbertlee-amd a062c80298 [TransferBench] Displaying PCIe Bus ID (#288)
* Adding PCIe BusID per GPU in topology display

[ROCm/rccl commit: 61e1a71d14]
2020-10-21 16:13:36 -06:00
gilbertlee-amd 0282595de5 TransferBench Typo. Pinned host memory uses C not P (#286)
[ROCm/rccl commit: 769418c5c7]
2020-10-21 12:05:38 -06:00
saadrahim 5439649936 Adding sles15, centos7 and centos8 testing (#283)
[ROCm/rccl commit: e8177c9ee7]
2020-10-20 09:39:03 -06:00
Wenkai Du 1aae6b1344 Fix incorrect pointer checking for scatter and gather (#285)
[ROCm/rccl commit: dcad0ef7cb]
2020-10-19 13:27:09 -07:00
gilbertlee-amd f4b9a0d8e5 Removing unnecessary flags from CI (#278)
* Removing unnecessary flags from CI

* Re-adding HSA_FORCE_FINE_GRAIN_PCIE in CI

[ROCm/rccl commit: 9b3f762b68]
2020-10-19 13:08:24 -06:00
saadrahim 0465dffe6f Updating copyright for documentation (#282)
[ROCm/rccl commit: 49aa6d7afe]
2020-10-19 13:07:15 -06:00
Wenkai Du d1781365d6 Merge pull request #279 from wenkaidu/nccl_sync
Sync up with latest NCCL master branch

[ROCm/rccl commit: a7deecb104]
2020-10-16 11:21:35 -07:00
Eiden Yoshida f1dc3f1e86 Update sramecc and xnack to ANY (#284)
Co-authored-by: Tony <Tony.Tye@amd.com>
Co-authored-by: Wenkai Du<Wenkai.Du@amd.com>

[ROCm/rccl commit: 205b5507b4]
2020-10-16 00:25:18 -06:00
Wenkai Du 194135a40c Merge remote-tracking branch 'nccl/master' into nccl_sync
[ROCm/rccl commit: c835d8263a]
2020-10-15 18:42:38 -04:00
gilbertlee-amd 94437eef28 Revert "Initial support for clique-based kernels (#276)" (#280)
This reverts commit d68a532bc6.

[ROCm/rccl commit: 84a2541e01]
2020-10-15 11:30:18 -07:00
Sylvain Jeaugey 591ffd32fe Fix affinity move
[ROCm/rccl commit: 0e14394c5f]
2020-10-13 16:58:05 -07:00
Sylvain Jeaugey 5de6b6681d Make sure proxy threads inherit the CPU affinity.
[ROCm/rccl commit: c6dbdb0084]
2020-10-13 16:37:52 -07:00
Wenkai Du 8b120c0508 Update Rome single node models (#277)
[ROCm/rccl commit: 33babcb5e2]
2020-10-13 13:33:09 -07:00
gilbertlee-amd d68a532bc6 Initial support for clique-based kernels (#276)
* Initial support for clique-based kernels

[ROCm/rccl commit: 2b8184808d]
2020-10-13 11:22:04 -06:00
Wenkai Du 41260bb948 Rework Rome detection and add multiple network ports models (#274)
* Rework Rome detection and add multiple network ports models

* Remove unused opCount in p2p transport

[ROCm/rccl commit: ae008fd2db]
2020-10-07 13:37:36 -07:00
Wenkai Du e12db6f2ab Don't download GTest unless building unit test (#275)
[ROCm/rccl commit: 88a062342b]
2020-10-02 15:25:40 -07:00
Wenkai Du dbde26e681 Add Alltoallv RCCL kernel implementation (#269)
* Add alltoallv API and implementation

* Extend Rome P2P channel limit to multinode and alltoall kernels

* topo_expl: fix compilation and sync up with main

* gtest: use RCCL alltoallv API

* Code review changes

[ROCm/rccl commit: b871ea3c0c]
2020-09-30 16:25:36 -07:00
nunnikri 256de55920 SWDEV-253325 : Chaning amdgpu-target to cuda-gpu-arch (#268)
[ROCm/rccl commit: aa985bfb7e]
2020-09-25 15:44:56 -06:00
Stanley Tsang 67a8d86d78 Updating inline asm to not require explicit L1 cache invalidation (#270)
[ROCm/rccl commit: acca2ae20a]
2020-09-25 13:46:26 -06:00
gilbertlee-amd 5ca117d7cd New TransferBench features (#273)
* Upgrading TransferBench to support pinned CPU memory, expanding functionality, cleaning up env vars

[ROCm/rccl commit: ee262819a7]
2020-09-25 12:20:48 -06:00
gilbertlee-amd 0a9adc16f4 Changes to topology based on XGMI (#272)
* Alterations to topology search to improve XGMI-enabled nodes

[ROCm/rccl commit: 01bd2573db]
2020-09-25 12:20:09 -06:00
Wenkai Du 7ba087e069 Ensure all ranks on same send/receive or alltoall kernel path (#271)
[ROCm/rccl commit: 44fcde7835]
2020-09-24 08:25:04 -07:00
Wenkai Du 37f7eec6b7 Change network plugin name to librccl-net.so (#266)
[ROCm/rccl commit: d871fceb54]
2020-09-18 13:23:30 -07:00
Wenkai Du 2e5e4a6bde Merge pull request #267 from wenkaidu/p2p
Limit P2P channels on Rome

[ROCm/rccl commit: 45a8f09e97]
2020-09-18 11:35:35 -07:00
Wenkai Du f0a303664e Limit P2P channels on Rome
[ROCm/rccl commit: 42955f5f4f]
2020-09-17 17:20:32 -07:00
lijietang f6b08ca547 Add rccl bw test script in tools (#255)
[ROCm/rccl commit: bbe233f8c1]
2020-09-11 16:59:03 +08:00
Stanley Tsang 209133fadf Adding the ability to force install dependencies (namely gtest); gtest library installation fix for centos (#265)
* Adding the ability to force install dependencies (namely gtest); gtest library installation fix for centos

* Removing potentially unneccessary dependencies from install script

[ROCm/rccl commit: 8c90aefb6d]
2020-09-10 17:27:22 -06:00