AI/rocm-systems
2
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
663 Commits 3 Branches 0 Tags
60ca7484c03c8ffff4cc2b24697fd87a31eb6609
Commit Graph

663 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Wenkai Du 60ca7484c0 Fix kernel data trace 2021-08-24 14:02:53 -07:00
Wenkai Du d5f93649ff Merge remote-tracking branch 'origin/develop' into 2.10.3 2021-08-24 09:49:47 -07:00
Wenkai Du 5c8380ff5b Implement NIC identification and remapping (#420) 
* Add 1H16P GPU model

* Implement NIC identification and remapping

* Revert "Sort IB devices based on device name (#413)"

This reverts commit 2d0ed8dff6.

* Fix permute and check order

* Correction on IB speed reporting

* Revert "Allow user to link layer with RCCL_IB_HCA_SKIP_LINK_LAYER (#361)"

This reverts commit caf5c9992a.
 2021-08-24 09:42:04 -07:00
Wenkai Du 5f15ed6e3e Add gfx908 VM model (#418) 2021-08-10 08:55:11 -07:00
Wenkai Du 707c687090 Use noinline for kernel functions 2021-08-06 09:15:04 -07:00
Wenkai Du 01d3b20a66 Fix incorrect network proxy received bytes reporting 2021-08-05 17:45:48 -07:00
gilbertlee-amd 1ed272e5f0 [TransferBench] Removing dependency on hip_fp16 header, fixing swapped output CSV header (#416) 2021-08-04 10:53:41 -06:00
Wenkai Du babbd1047b Merge branch 'develop' into 2.10.3 2021-08-04 09:45:22 -07:00
Wenkai Du 2d0ed8dff6 Sort IB devices based on device name (#413) 2021-08-03 15:32:41 -07:00
Wenkai Du bf2339f93e Merge remote-tracking branch 'nccl/master' into 2.10.3 2021-07-30 16:23:14 -07:00
Wenkai Du 3e27227562 XGMI connection is always prioritized over NET regardless of hops (#412) 2021-07-29 11:12:42 -07:00
Eiden Yoshida 229ca88ee6 Add basic rtest.xml (#411) 2021-07-28 11:53:03 -06:00
Wenkai Du 818cdb16a8 Query XGMI links from xml and adjust gfx906 channel usage (#410) 2021-07-27 17:32:41 -07:00
Liam Wrubleski e579de7ec2 Update changelog with packaging information (#409) 2021-07-27 10:38:36 -06:00
Wenkai Du 135d47d125 topo_expl: fix build after switching to rocm-smi-lib (#405) 
* topo_expl: fix build after switching to rocm-smi-lib

* Use minimal of 4 channels for gfx908
 2021-07-27 08:30:08 -07:00
Eiden Yoshida 56801656f3 Extend test stage timeout to 24 hours (#408) 2021-07-26 15:29:21 -06:00
Liam Wrubleski 97d9cf40e7 Setup runtime and development packages (#407) 
* changes to enable devel package

* Update rocm-cmake version & build
 2021-07-26 15:06:17 -06:00
Wenkai Du dfc62d5fbb Skipping unnecessary functions in Doxygen by marking as internal (#353) (#406) 
(cherry picked from commit 1c982d819d9c7fe0310b80f9a25808e54c71137e)

Co-authored-by: saadrahim <44449863+saadrahim@users.noreply.github.com>
 2021-07-24 11:04:27 -07:00
Hubert Lu c3e2e7cb5d Merge pull request #404 from hubertlu-tw/coll_trace 
Enhancement of RCCL logging information for topology-aware optimization
 2021-07-22 13:50:28 -07:00
Lu bd6dbca8fb Add more info to RCCL logging for topo-aware optim. 2021-07-22 09:52:39 -07:00
Wenkai Du 215904ee8e Fix unit tests static build (#403) 2021-07-09 09:35:32 -07:00
Ke Wen 7e51592129 2.10.3-1 
Add support for bfloat16.
Add ncclAvg reduction operation.
Improve performance for aggregated operations.
Improve performance for tree.
Improve network error reporting.
Add NCCL_NET parameter to force a specific network.
Add NCCL_IB_QPS_PER_CONNECTION parameter to split IB traffic onto multiple queue pairs.
Fix topology detection error in WSL2.
Fix proxy memory elements affinity (improve alltoall performance).
Fix graph search on cubemesh topologies.
Fix hang in cubemesh during NVB connections.
 2021-07-08 14:30:14 -07:00
Wenkai Du 56155ff5b6 Use rocm_smi_lib for getting topology information (#402) 
* Use rocm_smi_lib for getting topology information

* Add rocm-smi-lib dependency to RCCL package
 2021-07-08 13:23:11 -07:00
Eiden Yoshida 5c3e7d8b67 Fix static builds (#393) 2021-06-23 09:19:48 -06:00
gilbertlee-amd 2b0b608270 [TransferBench] Fixing a typo in TransferBench usage example (#401) 2021-06-22 17:08:57 -06:00
Wenkai Du e75bc53e06 Deduct ROCM_PATH from CXX unless specified (#400) 2021-06-22 13:29:08 -07:00
Wenkai Du fa6d7e9a63 Fixes for NCCL_MAX_NCHANNELS and topo_expl (#398) 2021-06-22 08:41:49 -07:00
gilbertlee-amd 720374a767 [TransferBench] Switching from little-endian fill pattern to big-endian (#399) 2021-06-21 14:28:51 -06:00
Wenkai Du 59d2867b01 Remove hard coded /opt/rocm from cmake (#396) 2021-06-21 08:29:23 -07:00
gilbertlee-amd ff413be933 [TransferBench] Adding ability to specify source data pattern (#394) 
* [TransferBench] Adding ability to specify source data pattern
 2021-06-15 08:41:57 -06:00
Eiden Yoshida fb267ea333 Move address-sanitizer build above addition of rccl library in CMakeLists (#392) 2021-06-11 14:43:54 -06:00
Wenkai Du 6dcae8a459 Select sendrecv path based on collective data size (#391) 
* Select sendrecv path based on collective data size

* Add comments on packing and unpacking group field

* Toggling RCCL_P2P_NET_DISABLE in combined calls unit tests
 2021-06-10 17:51:04 -07:00
Stanley Tsang f6f5e16fe6 Fixing bug with ExtractSubDataset function not fully initializing subdataset (#390) 2021-06-10 14:35:39 -06:00
Eiden Yoshida eea7b24058 Add address sanitizer build option (#389) 2021-06-10 09:14:54 -06:00
Wenkai Du b815a2800f Setup collectives threshold for enabling intranet (#387) 
* Setup collectives threshold for enabling intranet

* Use separate operation counters for coll and p2p
 2021-06-09 13:24:26 -07:00
Wenkai Du c2064adcc7 Add support for another Rome model (#385) 2021-06-08 13:58:20 -07:00
Stanley Tsang 6842429a14 Updating changelog to show install script fix (#384) 2021-06-08 13:00:40 -06:00
Wenkai Du a3a8c2d56b Allow intranode use of network connection (#383) 
* Allow intranode use of network connection

* Checking for graph for null pointer
 2021-06-08 07:37:59 -07:00
Stanley Tsang 820a53287f Fixing install script so that invoking -r alone does not trigger rebuild (#382) 2021-06-04 09:46:04 -06:00
Wenkai Du 961922ea02 Add option to enable multiple SAT in SHARP (#380) 
* Add option to enable multiple SAT in SHARP

* Extend number of NICs to 16
 2021-06-03 19:45:18 -07:00
gilbertlee-amd 903c84050d ROCm 4.3 changelog update (#379) 
* Update CHANGELOG.md (#378)

* Updating CHANGELOG.md for ROCm 4.3
 2021-06-03 10:56:02 -06:00
Wenkai Du 03ac898825 Merge pull request #377 from wenkaidu/2.9.9 
Sync up with NCCL 2.9.9
 2021-05-26 11:38:19 -07:00
Wenkai Du 13dc80ee14 topo_expl: update to 2.9.9 2021-05-26 09:24:34 -07:00
Wenkai Du e3abf1c2ec Merge remote-tracking branch 'nccl/master' into develop 2021-05-25 20:52:15 -07:00
Stanley Tsang 256403d4f0 Adding support for hipMallocManaged() in unit tests (#375) 
* Adding HMM support for unit tests

* Fixing HMM opt-in check
 2021-05-25 17:07:12 -06:00
Wenkai Du 4c83adb75c Update Rome models matching (#376) 2021-05-25 10:12:40 -07:00
gilbertlee-amd 8e817ecd6d Tweak clique channel usage for gfx908 (#374) 2021-05-21 15:36:21 -06:00
Wenkai Du 50da1b48af Correction on max number of groups (#373) 2021-05-20 08:58:45 -07:00
Wenkai Du 8cde34be51 Use fixed segment size for sendrecv (#369) 2021-05-19 08:25:26 -07:00
Wenkai Du 42b080867e Running only sum for CI quick test (#370) 2021-05-19 08:25:13 -07:00