Commit Graph

286 Commits

Author SHA1 Message Date
mberenjk 77ae744c18 removing FP8 product from allReduce test cases (#97)
* removing FP8 product from allReduce test cases

---------

Co-authored-by: Marzieh Berenjkoub <mberenjk@amd.com>
2025-01-06 14:05:38 -06:00
John Bachan 29f4114f02 Fixes to all tests that divide buffers by nranks so that they trim buffer sizes to be multiples of 16 bytes.
This ensures non-pow2 ranks have buffer addresses aligned suitably for performance.
2024-12-18 11:20:28 -08:00
Sylvain Jeaugey 8dfeab9eb9 Merge pull request #259 from NVIDIA/fix-ncclstringtotype
Future-proof ncclstringtotype
2024-10-24 10:28:02 -07:00
Kamil Iskra 34d6d53910 Future-proof ncclstringtotype
Ensure that ncclstringtotype iterates only over data types known to
nccl-tests (as indicated by test_typenum), not over a potentially larger
set of all NCCL types.
2024-10-24 09:21:37 -07:00
Tim ae3e6357cb Scaling tests to #ngpus (#81)
* scaling tests to #ngpus

Signed-off-by: AtlantaPepsi <hyj1999110@gmail.com>

* switching to rocminfo

---------

Signed-off-by: AtlantaPepsi <hyj1999110@gmail.com>
2024-09-10 19:05:22 -04:00
Tim 52aee698fa Merge pull request #86 from AtlantaPepsi/UBR_merge
Registered Buffer option from nccl-tests merged
2024-07-31 11:05:49 -04:00
AtlantaPepsi 71355df959 Fixing typo in readme
Signed-off-by: AtlantaPepsi <timhu102@amd.com>
2024-07-31 14:59:47 +00:00
AtlantaPepsi afd5ca10ae Merge -R option for memory allocation
Signed-off-by: AtlantaPepsi <timhu102@amd.com>
2024-07-31 14:57:20 +00:00
David Addison 9d26b8422b Merge pull request #226 from netgroup/master
improve parsing of stepbytes (increment size) argument
2024-07-30 14:58:54 -07:00
David Addison 0d86b5a6e7 Added some missing command line options to README.md
Also updated single and multi-node examples.
2024-07-30 14:50:45 -07:00
David Addison d2d40cc824 Added -N,--run_cycles option 2024-07-25 22:00:23 -07:00
David Addison 3a3f790efd Merge pull request #240 from OrenLeung/patch-1
doc: add all2all factor
2024-07-25 22:00:06 -07:00
Oren c6eb15875f doc: add all2all factor 2024-07-24 22:55:00 -04:00
Nilesh M Negi e635e9c9be [CI] Add static analysis CI (#85)
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com>
2024-07-23 22:21:26 -05:00
Rahul Vaidya c5cae38bb8 Fix --root all issue. (#83)
Signed-off-by: rahulvaidya20 <ravaidya@amd.com>
2024-06-14 11:46:08 -05:00
Stefano Salsano 746549b28d improve parsing of stepbytes (increment size) argument 2024-06-14 11:28:55 +02:00
Kaiming Ouyang d028efcf35 Change ncclCommRegister size to maxBytes in serial comm init 2024-06-06 06:54:48 -07:00
saurabhAMD 073d56f6e2 Merge pull request #79 from saurabhAMD/rotating_tensor
Rotating tensor -R (default:off)
2024-06-04 17:51:26 -05:00
saurabhAMD 36a2c372ac Rotating tensor -R (default:off) 2024-06-04 11:35:39 -05:00
Giuseppe Congiu a1efb427e7 Add -R option to register user buffers 2024-06-03 01:04:58 -07:00
saurabhAMD 6378438c27 Merge pull request #76 from saurabhAMD/develop
Enable cache flush after every -F iteration. Default : 0 (No cache flush)
2024-05-13 10:41:31 -05:00
saurabhAMD 74c4177f58 updating cache flush on functionality 2024-05-10 08:46:13 -07:00
saurabhAMD 699478dadf Enable cache flush after every -F iteration. Default : 0 (No cache flush) 2024-05-07 11:32:30 -05:00
saurabhAMD 3c0728e8eb Cache flush 2024-05-07 11:09:32 -05:00
Wenkai Du 16dfeaf89b Fix incorrect device ordinal with limited device visibility (#74) 2024-05-02 11:14:57 -07:00
corey-derochie-amd 605fa143ad Merge pull request #75 from corey-derochie-amd/develop
Wrapped the warmup iters in captures when doing graph mode to do a proper warmup.
2024-05-02 09:18:52 -06:00
corey-derochie-amd f74c04b686 Fixed spelling 2024-05-02 09:18:25 -06:00
Corey Derochie 0c762d210c Wrapped the warmup iters in captures when doing graph mode to do a proper warmup. 2024-05-01 20:41:12 -05:00
mberenjk eb65dadfc5 replacing rccl_bfloat16 with hip_bfloat16 (#70)
Co-authored-by: Marzieh Berenjkoub <mberenjk@amd.com>
2024-04-23 17:00:20 -05:00
Nilesh M Negi e8650b1844 [DOCS] Update README for performance-oriented runs (#73)
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com>
2024-04-23 14:30:06 -05:00
Nilesh M Negi 990f88cbaa Ammend use of CUSTOM_RCCL_LIB to avoid build error (#71)
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com>
2024-04-12 12:01:32 -05:00
mberenjk 3f7f7859bf adding git version to rccl-tests (#69)
Co-authored-by: mberenjk <mberenjk@amd.com>
2024-03-28 14:03:59 -05:00
akolliasAMD ddac5f30b1 Merge pull request #68 from ROCm/revert-66-mberenjk/adding_git_version2
Revert "adding git version to rccl-test"
2024-03-22 10:23:24 -06:00
akolliasAMD 91609be0ef Revert "adding git version to rccl-test (#66)"
This reverts commit a31679775c.
2024-03-22 10:21:37 -06:00
mberenjk a31679775c adding git version to rccl-test (#66)
* adding git version to rccl-test

---------

Co-authored-by: mberenjk <mberenjk@banff-cyxtera-s74-2.ctr.dcgpu>
2024-03-20 10:04:12 -05:00
Andy li e447c17382 update the fp8 header file name (#65)
* update the fp8 header name
2024-03-08 10:02:40 -08:00
Andy li 21e59fb283 Enable fp8 support (#63)
* initial checkin

* rename the fp8 datatype name

* update based on cr comments

* resolve the build issue

* resolve fp8 campability issue

* fix minior bug and catch up to reflex latest develop branch change

* add fp8 + operatior support

* update fp8 header file

* resolve merge issue from develop branch
2024-03-07 16:54:41 -08:00
Bertan Dogancay 7a7a5969d0 Revert __nv_bfloat16 back to hip_bfloat16 (#64) 2024-03-06 11:11:44 -07:00
Bertan Dogancay 88cf7dbf45 Add hipify steps prior to build (#62)
* Add hipify steps prior to build
2024-03-05 09:47:18 -07:00
Wenkai Du b9b73002da Merge pull request #61 from ROCm/nccl_tests_sync
Nccl tests sync
2024-03-01 11:54:43 -08:00
Wenkai Du 621dde544d Merge remote-tracking branch 'nccl-tests/master' into HEAD 2024-03-01 18:34:44 +00:00
Wenkai Du 7715a0cf1f Fix typo in rank assignment (#59) 2024-02-15 12:04:38 -08:00
David Addison c6afef0b6f Added missing MPI_Comm_free() call before MPI_Finalize() 2024-02-05 08:53:54 -08:00
akolliasAMD 28b05ac4b5 Merge pull request #58 from ROCm/newPotentialMaster
Develop branch merged into master
2024-02-02 14:05:30 -07:00
akolliasAMD 56a5bb0486 Merge branch 'develop' 2024-01-30 12:50:38 -05:00
Nusrat Islam 48f22de5be Merge pull request #57 from nusislam/out-of-place
Add option to disable out-of-place runs
2024-01-04 17:42:12 -06:00
Nusrat Islam a2bec5d2f6 Add option to disable out-of-place 2024-01-04 16:43:50 -06:00
Nilesh M Negi b1f86ea6eb Update default GPUs and build for AMDGPU_TARGETS (#55)
* Update default GPUs and build for AMDGPU_TARGETS
* Make GPU_TARGETS a cache variable
---------
Signed-off-by: nileshnegi <Nilesh.Negi@amd.com>
2023-12-06 17:24:37 -06:00
Lauren Wrubleski e1a816b869 Offload arch linking (#54)
* Update CMakeLists.txt

* Update CMakeLists.txt

* Link rccl_common object against hip::device

Previously the tests were compiled with `--amdgpu-target` to compile for multiple architectures, As rccl_common was not compiled against those architectures, this didn't work. Linking it against hip::device automatically links against all architectures in `AMDGPU_TARGETS`, and so are the test executables.
2023-12-05 19:20:46 -06:00
Bertan Dogancay 8bfb67faf3 Fixing hipcc location for develop CI (#52) 2023-10-19 13:29:42 -06:00