NPKit: separate time stamps for GPU access from different blocks (#1229)

To avoid races in memory access in GPU

[ROCm/rccl commit: 9d8f68b4ee]
这个提交包含在:
Wenkai Du 编写, GitHub 于 2024-06-28 08:00:22 -07:00 提交
1 父节点 c24b1ff14f
当前提交 b3e9d2d61b
7 个文件已更改
+17 -21

没有与搜索条件相匹配的文件

+2
查看文件
@@ -16,6 +16,8 @@
#include "common.h"
#define NPKIT_GET_GPU_TIMESTAMP wall_clock64
#define NPKIT_GET_CPU_TIMESTAMP_FROM_BLOCK \
__atomic_load_n(reinterpret_cast<uint64_t*>((uint8_t *)ncclShmem.comm.cpuTimestamp + 128*blockIdx.x), __ATOMIC_RELAXED)
class NpKit {