Add support for inter-node communication using sockets and InfiniBand/RoCE. Improve latency. Add support for aggregation. Improve LL/regular tuning. Remove tests as those are now at github.com/nvidia/nccl-tests . [ROCm/rccl commit: f93fe9bfd9]
f93fe9bfd9
Sylvain Jeaugey