Kapil S. Pawar
c8da880dc7
* Add functional tests for CSV Tuner Plugin * Updated directory structure * Updated and renamed directories * Updated csv conf files * Updated readme * Updated readme * Updated readme
41 wiersze
2.7 KiB
Plaintext
41 wiersze
2.7 KiB
Plaintext
# AllReduce configurations with specific nodes/ranks values (no wildcards for topology) - 8B-128M
|
|
# But use wildcards for pipeOps/regBuff since they vary at runtime
|
|
# Small allreduce: tree/ll, 2 channels, 1 node, 4 ranks, any pipeOps, any regBuff (8 bytes to 64K)
|
|
allreduce,8,65536,tree,ll,2,1,4,-1,-1
|
|
# Medium allreduce: ring/ll128, 4 channels, 1 node, 4 ranks, any pipeOps, any regBuff (64K to 16M)
|
|
allreduce,65537,16777216,ring,ll128,4,1,4,-1,-1
|
|
# Large allreduce: ring/simple, 6 channels, 1 node, 4 ranks, any pipeOps, any regBuff (16M to 128M)
|
|
allreduce,16777217,134217728,ring,simple,6,1,4,-1,-1
|
|
|
|
# Broadcast configurations with specific nodes/ranks values (no wildcards for topology) - 8B-128M
|
|
# Small broadcast: ring/ll, 2 channels, 1 node, 4 ranks, any pipeOps, any regBuff (8 bytes to 64K)
|
|
broadcast,8,65536,ring,ll,2,1,4,-1,-1
|
|
# Medium broadcast: ring/ll128, 4 channels, 1 node, 4 ranks, any pipeOps, any regBuff (64K to 16M)
|
|
broadcast,65537,16777216,ring,ll128,4,1,4,-1,-1
|
|
# Large broadcast: ring/simple, 6 channels, 1 node, 4 ranks, any pipeOps, any regBuff (16M to 128M)
|
|
broadcast,16777217,134217728,ring,simple,6,1,4,-1,-1
|
|
|
|
# AllGather configurations with specific nodes/ranks values (no wildcards for topology) - 8B-128M
|
|
# Small allgather: ring/ll, 2 channels, 1 node, 4 ranks, any pipeOps, any regBuff (8 bytes to 64K)
|
|
allgather,8,65536,ring,ll,2,1,4,-1,-1
|
|
# Medium allgather: ring/ll128, 4 channels, 1 node, 4 ranks, any pipeOps, any regBuff (64K to 16M)
|
|
allgather,65537,16777216,ring,ll128,4,1,4,-1,-1
|
|
# Large allgather: ring/simple, 6 channels, 1 node, 4 ranks, any pipeOps, any regBuff (16M to 128M)
|
|
allgather,16777217,134217728,ring,simple,6,1,4,-1,-1
|
|
|
|
# Reduce configurations with specific nodes/ranks values (no wildcards for topology) - 8B-128M
|
|
# Small reduce: ring/ll, 2 channels, 1 node, 4 ranks, any pipeOps, any regBuff (8 bytes to 64K)
|
|
reduce,8,65536,ring,ll,2,1,4,-1,-1
|
|
# Medium reduce: ring/ll128, 4 channels, 1 node, 4 ranks, any pipeOps, any regBuff (64K to 16M)
|
|
reduce,65537,16777216,ring,ll128,4,1,4,-1,-1
|
|
# Large reduce: ring/simple, 6 channels, 1 node, 4 ranks, any pipeOps, any regBuff (16M to 128M)
|
|
reduce,16777217,134217728,ring,simple,6,1,4,-1,-1
|
|
|
|
# ReduceScatter configurations with specific nodes/ranks values (no wildcards for topology) - 8B-128M
|
|
# Small reducescatter: ring/ll, 2 channels, 1 node, 4 ranks, any pipeOps, any regBuff (8 bytes to 64K)
|
|
reducescatter,8,65536,ring,ll,2,1,4,-1,-1
|
|
# Medium reducescatter: ring/ll128, 4 channels, 1 node, 4 ranks, any pipeOps, any regBuff (64K to 16M)
|
|
reducescatter,65537,16777216,ring,ll128,4,1,4,-1,-1
|
|
# Large reducescatter: ring/simple, 6 channels, 1 node, 4 ranks, any pipeOps, any regBuff (16M to 128M)
|
|
reducescatter,16777217,134217728,ring,simple,6,1,4,-1,-1
|