eb65dadfc5
replacing rccl_bfloat16 with hip_bfloat16 ( #70 )
...
Co-authored-by: Marzieh Berenjkoub <mberenjk@amd.com >
2024-04-23 17:00:20 -05:00
3f7f7859bf
adding git version to rccl-tests ( #69 )
...
Co-authored-by: mberenjk <mberenjk@amd.com >
2024-03-28 14:03:59 -05:00
91609be0ef
Revert "adding git version to rccl-test ( #66 )"
...
This reverts commit a31679775c
2024-03-22 10:21:37 -06:00
a31679775c
adding git version to rccl-test ( #66 )
...
* adding git version to rccl-test
---------
Co-authored-by: mberenjk <mberenjk@banff-cyxtera-s74-2.ctr.dcgpu >
2024-03-20 10:04:12 -05:00
e447c17382
update the fp8 header file name ( #65 )
...
* update the fp8 header name
2024-03-08 10:02:40 -08:00
21e59fb283
Enable fp8 support ( #63 )
...
* initial checkin
* rename the fp8 datatype name
* update based on cr comments
* resolve the build issue
* resolve fp8 campability issue
* fix minior bug and catch up to reflex latest develop branch change
* add fp8 + operatior support
* update fp8 header file
* resolve merge issue from develop branch
2024-03-07 16:54:41 -08:00
88cf7dbf45
Add hipify steps prior to build ( #62 )
...
* Add hipify steps prior to build
2024-03-05 09:47:18 -07:00
621dde544d
Merge remote-tracking branch 'nccl-tests/master' into HEAD
2024-03-01 18:34:44 +00:00
7715a0cf1f
Fix typo in rank assignment ( #59 )
2024-02-15 12:04:38 -08:00
c6afef0b6f
Added missing MPI_Comm_free() call before MPI_Finalize()
2024-02-05 08:53:54 -08:00
a2bec5d2f6
Add option to disable out-of-place
2024-01-04 16:43:50 -06:00
5ee7a08994
Warm up both out-of-place and in-place collectives ( #51 )
2023-10-16 12:13:50 -07:00
1292b25553
Added an MPI_Barrier() call after MPI_Bcast() for HCOLL issue
2023-10-12 16:53:32 -07:00
6c46206a47
Make the -c option be a datacheck iteration count parameter
...
Default is 1
2023-09-13 14:03:38 -07:00
652a24d38d
Fix merge error
2023-06-14 20:26:33 +00:00
bb0f15d407
Merge remote-tracking branch 'nccl/master' into develop
2023-06-14 08:21:02 -07:00
469225bcaf
Merge remote-tracking branch 'origin/master' into develop
2023-06-14 08:01:50 -07:00
d16d1fb16b
fixing the error message for mpirun when number of requested GPUs exceeds the limits ( #37 )
2023-04-27 14:06:17 -04:00
e856fa720f
Revert "fixing the error message for mpirun when number of requested GPUs exceeds the limits ( #33 )" ( #36 )
...
This reverts commit e146460810
2023-04-25 13:44:43 -04:00
e146460810
fixing the error message for mpirun when number of requested GPUs exceeds the limits ( #33 )
2023-04-03 11:37:13 -04:00
24fcf64ed1
Call cudaFreeHost() on wrongPerGpu not cudaFree()
2022-11-22 11:18:37 -08:00
3bd2bd292b
Add fflush(stdout) before perf output
2022-11-22 11:16:47 -08:00
9d3a53dfa3
added std::max to avoid buffer overflow in printing ( #25 )
2022-11-01 11:34:55 -06:00
8a754f15ad
fix a messing endif statement
...
error introduced with the web merger-resolution tool :-(
2022-10-25 16:31:57 +00:00
4d7cd871c1
Merge branch 'develop' into topic/v2.13.4-sync
2022-10-21 17:12:45 -05:00
9a89c300b6
Allow more precise measurements of single operation ( #20 )
2022-10-21 22:07:41 +00:00
641e93e99c
make rccl-test compile again.
...
all files compile now.
mpi tests also pass
2022-10-21 22:07:33 +00:00
3ae371cce7
Merge remote-tracking branch 'nccl-tests/master' into topic/v2.13.4-sync
2022-10-14 16:02:54 -05:00
d22281cb3f
Allow more precise measurements of single operation ( #20 )
2022-10-12 17:28:04 -07:00
d313d20a26
Update NCCL tests
2022-09-23 01:13:29 -07:00
afa4c56b6a
Fix an issue with the last commit when data checking is disabled
2022-09-07 11:23:49 -07:00
a0a14911ee
Display N/A for error count in AlltoAll in-place test
...
AlltoAll does not support in-place buffers
2022-09-06 13:17:15 -07:00
51af5572bf
Resync with NCCL 2.13
...
* Added "verifiable", a suite of kernels for generating and verifying reduction
input and output arrays in a bit-precise way.
* Data corruption errors now reported in number of wrong elements instead of max
deviation.
* Use ncclGetLastError.
* Don't run hypercube on non-powers of 2 ranks.
* Fix to hypercube data verification.
* Use "thread local" as the defaut CUDA capture mode.
* Replaced pthread_yield -> sched_yield()
* Bugfix to the cpu-side barrier/allreduce implementations.
2022-08-22 17:51:06 -07:00
45ec598ac4
Fix typo from previous merge
2022-08-12 14:42:17 +00:00
f6f3c44a7a
Enabling hipGraph codepath for future support ( #18 )
2022-08-09 16:45:27 -06:00
9025051bbb
Fix missing error checking for AllocateBuffs due to merge ( #17 )
2022-08-09 11:04:38 -07:00
0500f2f132
implementation of multi-rank support in rccl-tests.
2022-06-10 14:54:10 -04:00
5cd2374edb
create branch up-to-date with rccl-test
2022-06-10 12:41:56 -04:00
6156759a40
Print GPU's full PCI bus ID
2022-04-06 16:46:17 +00:00
602b745ff4
Add missing hipStreamDestroy at test exit
2021-11-16 07:50:18 -08:00
8b35847d36
Use rccl_bfloat16 class
2021-09-23 16:39:11 -07:00
dc1ad4853d
Fix divide by zero error
2021-09-22 08:43:01 -07:00
213abee002
Merge remote-tracking branch 'nccl/master' into develop
2021-09-20 14:01:22 -07:00
f773748b46
Resync with NCCL 2.11
...
New operator: mulsum
New test: gather
2021-09-17 09:02:45 -07:00
2d9be62621
Merge remote-tracking branch 'nccl/master'
2021-07-15 13:54:43 -07:00
1f8f541686
Add CUDA graph support only for CUDA 11.3 and later builds
...
Fixes #90
2021-07-13 10:47:47 -07:00
9f8ddadcdf
Merge remote-tracking branch 'nccl/master' into develop
2021-07-13 08:11:44 -07:00
b9f90d12a9
Removed MPI_SUPPORT conditional compilation of average flag
2021-07-12 11:43:57 -07:00
547e119d35
Fix issues with MPI_Allreduce and multi-threaded tests
2021-07-08 16:42:40 -07:00
f476f4a17a
Merge branch 'bfloat16'
2021-07-06 10:20:32 -07:00
mberenjk
akolliasAMD
Andy li
Bertan Dogancay
Wenkai Du
Wenkai Du
David Addison
Nusrat Islam
Pedram Alizadeh
Edgar Gabriel
Edgar Gabriel
Sylvain Jeaugey
John Bachan
gilbertlee-amd