SWDEV-305016 - Improve MGPU scaling in Tensorflow
Add a threshold for ROCR/SDMA P2P transfers. ROCR copy path requires extra barriers in compute for synchronization. That costs extra performance with tiny transfers. Reduce active wait time to 10us. Tensorflow uses extra thread per GPU with constant hipEventQuery() calls. Longer active waits in ROCr affect CPU performance. Change-Id: I9020358438615fa2d4617f862f00a562f0a588e7
Цей коміт міститься в:
1 джерело
587cda0c91
коміт
008133cf41
3 files changed
+7
-4
No files matched your search
@@ -1249,7 +1249,7 @@ void* VirtualGPU::allocKernArg(size_t size, size_t alignment) {
|
||||
|
||||
// ================================================================================================
|
||||
address VirtualGPU::allocKernelArguments(size_t size, size_t alignment) {
|
||||
if (ROCR_SKIP_KERNEL_ARG_COPY) {
|
||||
if (ROC_SKIP_KERNEL_ARG_COPY) {
|
||||
// Make sure VirtualGPU has an exclusive access to the resources
|
||||
amd::ScopedLock lock(execution());
|
||||
return reinterpret_cast<address>(allocKernArg(size, alignment));
|
||||
|
||||
Reference in new issue
Заблокувати користувача