Tune LL threshold for VEGA

Also move abort check after SPINS_BEFORE_CHECK_ABORT as NCCL


[ROCm/rccl commit: 2223cccf15]
Bu işleme şunda yer alıyor:
Wenkai Du committed 2019-08-15 09:16:11 -07:00
1 ebeveyn 9f79f079f7
işleme d4862fa605
3 files changed
+7 -2

No files matched your search

+1
Dosyayı Görüntüle
@@ -15,6 +15,7 @@
#define NCCL_LL_CHANNEL_THRESHOLD 8 // Per thread size before we start increasing nrings
#define NCCL_THREAD_THRESHOLD 256 // Per thread size before we switch to non-LL
#define NCCL_THREAD_THRESHOLD_PREVOLTA 32 // Per thread size before we switch to non-LL for pre-Volta archs
#define NCCL_THREAD_THRESHOLD_VEGA 8 // Per thread size before we switch to non-LL for VEGA
#define NCCL_LL_MIN_NTHREADS 256
ncclResult_t ncclEnqueueCheck(struct ncclInfo* info);