gilbertlee-amd
9d7232c091
* Enabling clique for any XGMI-connected topology, adding tuning * Updating CHANGELOG for clique tuning * Re-working clique barrier system to work on multi-process / multi-gpu
2.3 KiB
2.3 KiB
Change Log for RCCL
Full documentation for RCCL is available at https://rccl.readthedocs.io
[Unreleased]
Optimizations
- Additional tuning for clique-based kernel AllReduce performance (still requires opt in with RCCL_ENABLE_CLIQUE=1)
Changed
- Replaced RCCL_FORCE_ENABLE_CLIQUE to RCCL_CLIQUE_IGNORE_TOPO
- Clique-based kernels can now be enabled on topologies where all active GPUs are XGMI-connected
- Topologies not normally supported by clique-based kernels require RCCL_CLIQUE_IGNORE_TOPO=1
[RCCL-2.7.8 for ROCm 4.1.0]
Added
- Experimental support for clique-based kernels (opt in with RCCL_ENABLE_CLIQUE=1)
- Clique-based kernels may offer better performance for smaller input sizes
- Clique-based kernels are currently only enabled for AllReduce under a certain byte limit (controlled via RCCL_CLIQUE_ALLREDUCE_BYTE_LIMIT)
Optimizations
- Performance improvements for Rome-based systems
Known issues
- Clique-based kernels are currently experimental and have not been fully tested on all topologies. By default, clique-based kernels are disabled if the detected topology is not supported (override with RCCL_FORCE_ENABLE_CLIQUE)
- Clique-based kernels may hang if there are differences between environment variables set across ranks.
- Clique-based kernels may fail if the input / output device pointers are not the base device pointers returned by hipMalloc.
[RCCL-2.7.8 for ROCm 3.9.0]
Added
- Adding support for alltoallv RCCL kernel
Optimizations
- Modifications to topology based on XGMI links
Known issues
- None
[RCCL-2.7.6 for ROCm 3.8.0]
Added
- Support for static library builds
Known issues
- None
[RCCL-2.7.6 for ROCm 3.7.0]
Added
- Updated to RCCL API version of 2.7.6
- Added gather, scatter and all-to-all collectives
[RCCL-2.7.0 for ROCm 3.6.0]
Added
- Updated to RCCL API version of 2.6.4
[RCCL-2.7.0 for ROCm 3.5.0]
Added
- Compatibility with NCCL 2.6
- Network interface improvements with API v3
Optimizations
- Fixing issues and built time improvements for hip-clang
- Network topology detection
- Improved CPU type detection
- Infiniband adaptive routing support
Changed
- Switched to hip-clang as default compiler
Deprecated
- Deprecated hcc build