RCCL Multinode DMA Buffer crash fix (#1682)

This commit handles DMABUF initialization and call appropriate handling function. This fixes crash in OS with no peermem support and relying on only DMABUF.

* Initial test commit
* Handling Dmabuf_fd opening and closing
* Cleanup
* Use DMABuff or Peermem as needed
* Using user input for ibDmaBufSupportInitOnce
* Revert all changes to rocmwrap.cc
* Revert all changes to rocmwrap.cc
* Changing to func definition braces
* Reverting line removal in utils.h
* useDmaBuf to calculate  flushEnabled
This commit is contained in:
Avinash
2025-05-08 19:17:39 -05:00
کامیت شده توسط GitHub
والد e70003736e
کامیت 5f6805b4f4
3فایلهای تغییر یافته به همراه69 افزوده شده و 6 حذف شده
+21
مشاهده پرونده
@@ -545,4 +545,25 @@ T* ncclIntruQueueMpscAbandon(ncclIntruQueueMpsc<T,next>* me) {
return head;
}
}
/**
* @brief function to get page size of the system
*/
size_t get_sc_page_size(void);
/**
* @brief function to get system's page size aligned memory address and buffersize
*
* Given a pointer `ptr` to a buffer of size `bufsize`, this function computes:
* 1. A new pointer `aligned_ptr` which points to the start of the page-aligned memory region that includes `ptr`.
* 2. A new size `aligned_size` that is the minimum number of bytes (aligned to page size) needed to cover the original buffer from `aligned_ptr`.
*
* This is useful, for example, when performing operations such as memory mapping or advising memory usage (e.g., with `mmap`, `madvise`, `mlock`, etc.), which often require page-aligned memory ranges.
* This function doesn't dereferece the input pointer
*
* @param[in] ptr Pointer to the start of the original memory buffer.
* @param[in] bufsize Size (in bytes) of the original buffer starting at `ptr`.
* @param[out] aligned_ptr Pointer to a variable that will be set to the aligned base address.
* @param[out] aligned_size Pointer to a variable that will be set to the aligned size.
*/
void get_aligned_ptr_and_size(const void *ptr, const size_t bufsize, void **aligned_ptr, size_t *aligned_size);
#endif