Sylvain Jeaugey
5ca1b6c160
Rework core for NVIDIA Trusted Computing
* Compress work structs so that they are shared between channels
* Utilize the full amount of kernel argument space permitted (4k)
before resorting to work fifo.
* Rework the task preprocessing phase.
* Use a separate abortDevFlag which is kept in sync with abortFlag
using cudaMemcpy operations.
* Rename src/include/align.h to src/include/bitops.h
Add lazy connection establishment for collective operations
* Move buffer allocation and connection establishment to the first
collective operation using that algorithm.
* Accelerate init time and reduce memory usage.
* Avoid allocating NVLS buffers if all calls are registered.
* Compute algo/proto in ncclLaunchCollTasksInfo early on.
* Connect peers in ncclCollPreconnectFunc if not connected already.
* Also move shared buffer creation to the first send/recv call.
Accelerate intra-node NVLink detection
* Make each rank only detect NVLinks attached to its GPU.
* Fuse XMLs to reconstruct the full NVLink topology
Add init profiling to report time spend in different init phases.
* Report timings of bootstrap, allgather, search, connect, etc.
* Add new "PROFILE" category for NCCL_DEBUG_SUBSYS.
Add support for PCI p2p on split PCI switches
* Detect split PCI switches through a kernel module exposing
switch information.
* Update the topology XML and graph to add those inter-switch
connections.
Add cost estimation API
* Add a new ncclGroupEndSimulate primitive to return the estimated
time a group would take.
Net/IB: Add separate traffic class for fifo messages
* Add NCCL_IB_FIFO_TC to control the traffic class of fifo messages
independently from NCCL_IB_TC.
Merges PR #1194
Net/IB: Add support for IB router
* Use flid instead of lid if subnets do not match
* Warn if flid is 0
Optimizations and fixes for device network offload (unpack)
* Double the default number of channels
* Cache netDeviceType
* Fix save/increment head logic to enable Tree support.
Support ncclGroupStart/End for ncclCommAbort/Destroy
* Allow Abort/Destroy to be called within a group when managing
multiple GPUs with a single process.
Improve Tuner API
* Provide to the plugin the original cost table so that the plugin
can leave unknown or disabled algo/proto combinations untouched.
* Remove nvlsSupport and collnetSupport.
Do not print version to stdout when using a debug file
* Also print version from all processes with INFO debug level.
Fixes issue #1271
Fix clang warnings in NVTX headers
* Update NVTX headers to the latest version
Fixes issue #1270
Disable port fusion in heterogeneous systems
* Do not fuse ports if a mix of multi-port and single port are detected.
Fix NVLS graphs search for dual NICs.
* Fix NVLS graph search when we have more than one NIC per GPU.
Fix crash with collnetDirect
* Add separate graph search for collnetDirect, testing alltoall paths
and working similarly to the NVLS search.
Fix hang when nodes have different CPU types
* Add the CPU type to the rank peer info.
* Align all ranks on the CPU type after the first allgather.
* Only use the aligned CPU type for all tuning operations.
Fixes issue #1136
Fixes issue #1184
Fix performance of registered send/recv operations
* Allow for single full size operations
* Add INFO to confirm the registration of send/recv buffers.
Move all sync ops to finalize stage
* Ensure ncclCommDestroy is non-blocking if ncclCommFinalize has
been called.
Improve error reporting during SHM segment creation
Improve support of various compilers
Merges PR #1177
Merges PR #1228
Allow net and tuner plugins to be statically linked
* Search for ncclNet or ncclTuner symbols in the main binary.
Merges PR #979
Plugin examples includes cleanup
* Harmonize err.h and common.h usage.
* Add mixed plugin with both net and tuner.
[ROCm/rccl commit: 178b6b7590]
88 lines
2.4 KiB
C
88 lines
2.4 KiB
C
/*
|
|
* Copyright 2024 NVIDIA Corporation. All rights reserved.
|
|
*
|
|
* Licensed under the Apache License v2.0 with LLVM Exceptions.
|
|
* See https://llvm.org/LICENSE.txt for license information.
|
|
* SPDX-License-Identifier: Apache-2.0 WITH LLVM-exception
|
|
*/
|
|
|
|
/**
|
|
* NVTX semantic headers require nvToolsExtPayload.h to be included beforehand.
|
|
*/
|
|
|
|
#ifndef NVTX_SEMANTIC_ID_COUNTERS_V1
|
|
#define NVTX_SEMANTIC_ID_COUNTERS_V1 2
|
|
|
|
/**
|
|
* Flags to extend the semantics of counters.
|
|
*/
|
|
#define NVTX_COUNTERS_FLAGS_NONE 0
|
|
|
|
/**
|
|
* Convert the fixed point value to a normalized floating point value.
|
|
* Unsigned [0f : 1f] or signed [-1f : 1f] is determined by the underlying type
|
|
* this flag is applied to.
|
|
*/
|
|
#define NVTX_COUNTERS_FLAG_NORMALIZE (1 << 1)
|
|
|
|
/**
|
|
* Visual tools should apply scale and limits when graphing.
|
|
*/
|
|
#define NVTX_COUNTERS_FLAG_LIMIT_MIN (1 << 2)
|
|
#define NVTX_COUNTERS_FLAG_LIMIT_MAX (1 << 3)
|
|
#define NVTX_COUNTERS_FLAG_LIMITS \
|
|
(NVTX_COUNTERS_FLAG_LIMIT_MIN | NVTX_COUNTERS_FLAG_LIMIT_MAX)
|
|
|
|
/**
|
|
* Counter time scopes.
|
|
*/
|
|
#define NVTX_COUNTERS_FLAG_TIMESCOPE_POINT (1 << 5)
|
|
#define NVTX_COUNTERS_FLAG_TIMESCOPE_SINCE_LAST (2 << 5)
|
|
#define NVTX_COUNTERS_FLAG_TIMESCOPE_UNTIL_NEXT (3 << 5)
|
|
#define NVTX_COUNTERS_FLAG_TIMESCOPE_SINCE_START (4 << 5)
|
|
|
|
/**
|
|
* Counter value types.
|
|
*/
|
|
#define NVTX_COUNTERS_FLAG_VALUETYPE_ABSOLUTE (1 << 10)
|
|
/** Delta to previous value of same counter type. */
|
|
#define NVTX_COUNTERS_FLAG_VALUETYPE_DELTA (2 << 10)
|
|
|
|
/**
|
|
* Datatypes for the `limits` union.
|
|
*/
|
|
#define NVTX_COUNTERS_LIMIT_I64 0
|
|
#define NVTX_COUNTERS_LIMIT_U64 1
|
|
#define NVTX_COUNTERS_LIMIT_F64 2
|
|
|
|
/**
|
|
*\brief Specify counter semantics.
|
|
*/
|
|
typedef struct nvtxSemanticsCounter_v1 {
|
|
/** Header of the semantic extensions (with identifier, version, etc.). */
|
|
struct nvtxSemanticsHeader_v1 header;
|
|
|
|
/** Flags to provide more context about the counter value. */
|
|
uint64_t flags;
|
|
|
|
/** Unit of the counter value (case-insensitive). */
|
|
const char* unit;
|
|
|
|
/** Should be 1 if not used. */
|
|
uint64_t unitScaleNumerator;
|
|
|
|
/** Should be 1 if not used. */
|
|
uint64_t unitScaleDenominator;
|
|
|
|
/** Determines the used union member. Use defines `NVTX_COUNTER_LIMIT_*`. */
|
|
int64_t limitType;
|
|
|
|
/** Graph limits {minimum, maximum}. */
|
|
union limits_t {
|
|
int64_t i64[2];
|
|
uint64_t u64[2];
|
|
double d[2];
|
|
} limits;
|
|
} nvtxSemanticsCounter_t;
|
|
|
|
#endif /* NVTX_SEMANTIC_ID_COUNTERS_V1 */ |