Add Alltoallv RCCL kernel implementation (#269)

* Add alltoallv API and implementation

* Extend Rome P2P channel limit to multinode and alltoall kernels

* topo_expl: fix compilation and sync up with main

* gtest: use RCCL alltoallv API

* Code review changes

[ROCm/rccl commit: b871ea3c0c]
This commit is contained in:
Wenkai Du
2020-09-30 16:25:36 -07:00
committato da GitHub
parent 256de55920
commit dbde26e681
22 ha cambiato i file con 300 aggiunte e 60 eliminazioni
@@ -26,6 +26,7 @@ struct allGather3Data_t{
int fullCudaCompCap;
int nChannels;
int gcn;
int alltoallDisable;
struct ncclGraphInfo tree;
struct ncclGraphInfo ring;
struct ncclGraphInfo collNet;