184fff009a
* Migrate XML counter defs and reader from v1/v2
* Current Working Set
* Modified parser
* Evaluate AST Start
* Update lib/common/xml
- move definitions out of class declaration
* Update lib/rocprofiler/counters/parser
- update build of bison and flex build
- reproducible generation
- add ROCPROFILER_REGENERATE_COUNTERS_PARSER option
- fix namespacing
* Update lib/rocprofiler/counters/xml
- change location of XML files and install them
* Update lib/rocprofiler/counter/tests
- normalize the test names
- improve test failures (more clear about where failure is)
* Update lib/rocprofiler/counters
- fix namespace
- update to new XML metrics directory
* Update lib/rocprofiler/CMakeLists.txt
- link to object library
* Update lib/rocprofiler/hsa/types.hpp
- reorganize includes
* Add metric loading class/printers
* Agent Implementation
* Queue Implementation (#79)
* Queue Implementation
* API Implementation For Counters (part 1) (#80)
* API Implementation For Counters
* Bewelton/counter collection 3 (#84)
* Added counter sample
* More changes
* More changes
* Update samples/counter_collection
- mostly formatting
* Update include/rocprofiler/counters.h
- formatting
* Add lib.common/synchronized.hpp
- Synchronized struct
* Update lib/rocprofiler/counters/xml/basic_counters.xml
- whitespace
* Update scripts/patch-parser.cmake
- tweaks for consistency
* Update lib/rocprofiler/counters/parser/tests/parser_tests.cpp
- formatting
* Update lib/rocprofiler/counters/parser
- improve consistency in rocprofiler-expr-parser-patch
- update parser.{h,cpp} and scanner.cpp
- formatting + regenerated
* Update lib/rocprofiler/aql
- formatting
- clang-tidy fixes
- guard against memory pool access errors
* Update lib/rocprofiler/aql/tests
- formatting
- update use of get_val
- normalize test names
* Update lib/rocprofiler/counters/tests
- formatting
- patch basic_counters and derived_counters
- normalize test names
* Update lib/rocprofiler/aql/tests
- set_tests_properties
* Update test labels
- fix minor issue with gtest labels
* Update lib/rocprofiler/counters
- formatting
- clang-tidy fixes
* Update lib/rocprofiler/hsa
- fix includes
- formatting
- clang-tidy fixes
- tweak to queue_controller_init interface
* Update lib/rocprofiler
- include fixes
- namespace fixes
- clang-tidy fixes
- formatting
* Update scripts/run-ci.py
- exclude counters/parser from code coverage (generated files)
* Update include/rocprofiler/counters.h
- fix doxygen comment
* Update lib/rocprofiler/aql/packet_construct.cpp
- guard against HSA_AMD_MEMORY_POOL_ACCESS_DISALLOWED_BY_DEFAULT and HSA_AMD_MEMORY_POOL_ACCESS_NEVER_ALLOWED
* Update lib/rocprofiler/counters/parser/raw_ast.hpp
- clang-tidy fixes
* Update lib/rocprofiler/counters/evaluate_ast.hpp
- clang-tidy fixes
* Update lib/rocprofiler/aql/tests
- disable packet_generation_single and packet_generation_multi tests
- the entire implementation rocprofiler::get_ext_table() is incorrect
* Minor fixes before cleanup
* More changes
* More fixes
* More fixes
* source formatting (clang-format v11) (#99)
Co-authored-by: bwelton <bwelton@users.noreply.github.com>
* Revert PTL submodule
* Update scripts/run-ci.py
- exclude counters/parser from code coverage (generated files)
* Migrating counters state to context
* Linting
* source formatting (clang-format v11) (#101)
Co-authored-by: bwelton <bwelton@users.noreply.github.com>
* revert run-ci
* Testing fixes
* More test changes
* Fix minor typo
* Small queue change
* Small queue change
* source formatting (clang-format v11) (#102)
Co-authored-by: bwelton <bwelton@users.noreply.github.com>
* source formatting (clang-format v11) (#105)
Co-authored-by: bwelton <bwelton@users.noreply.github.com>
* Documentation Change
* More documentation fixes
* source formatting (clang-format v11) (#106)
Co-authored-by: bwelton <bwelton@users.noreply.github.com>
* Threading fixes
* Threading fixes
* source formatting (clang-format v11) (#107)
Co-authored-by: bwelton <bwelton@users.noreply.github.com>
* Threading fixes
* More test fixes
* More agent fixes
* More build fixes
* source formatting (clang-format v11) (#109)
Co-authored-by: bwelton <bwelton@users.noreply.github.com>
* changed test timeouts
* Build fix
* Build fix
* Updates to agent
* source formatting (clang-format v11) (#114)
Co-authored-by: bwelton <bwelton@users.noreply.github.com>
* cmake formatting (cmake-format) (#113)
Co-authored-by: bwelton <bwelton@users.noreply.github.com>
* remove git worktree folder
* Doc update
* testing fix
* Another test fix
* More test changes
* Rebase
* source formatting (clang-format v11) (#116)
Co-authored-by: bwelton <bwelton@users.noreply.github.com>
* Documentation
* source formatting (clang-format v11) (#119)
Co-authored-by: bwelton <bwelton@users.noreply.github.com>
* PTL Changes
* Minor agent fix for empty labels
* source formatting (clang-format v11) (#120)
Co-authored-by: bwelton <bwelton@users.noreply.github.com>
* Minor agent fix for empty labels
* Refactor read_map
* source formatting (clang-format v11) (#121)
Co-authored-by: bwelton <bwelton@users.noreply.github.com>
* Refactor read_map
* Cache fixes
* source formatting (clang-format v11) (#122)
Co-authored-by: bwelton <bwelton@users.noreply.github.com>
---------
Co-authored-by: Jonathan R. Madsen <jonathanrmadsen@gmail.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: bwelton <bwelton@users.noreply.github.com>
[ROCm/rocprofiler-sdk commit: 010693b795]
183 linhas
5.5 KiB
C++
183 linhas
5.5 KiB
C++
/******************************************************************************
|
|
Copyright (c) 2023 Advanced Micro Devices, Inc. All rights reserved.
|
|
|
|
Permission is hereby granted, free of charge, to any person obtaining a copy
|
|
of this software and associated documentation files (the "Software"), to deal
|
|
in the Software without restriction, including without limitation the rights
|
|
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
|
copies of the Software, and to permit persons to whom the Software is
|
|
furnished to do so, subject to the following conditions:
|
|
|
|
The above copyright notice and this permission notice shall be included in
|
|
all copies or substantial portions of the Software.
|
|
|
|
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
|
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
|
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
|
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
|
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
|
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
|
|
THE SOFTWARE.
|
|
*******************************************************************************/
|
|
|
|
#include "metrics.hpp"
|
|
|
|
#include <rocprofiler/rocprofiler.h>
|
|
|
|
#include "lib/common/synchronized.hpp"
|
|
#include "lib/common/utility.hpp"
|
|
#include "lib/common/xml.hpp"
|
|
|
|
#include "glog/logging.h"
|
|
|
|
#include <dlfcn.h> // for dladdr
|
|
#include <atomic>
|
|
#include <cstdlib>
|
|
#include <filesystem>
|
|
#include <optional>
|
|
|
|
namespace rocprofiler
|
|
{
|
|
namespace counters
|
|
{
|
|
namespace
|
|
{
|
|
MetricMap
|
|
loadXml(const std::string& filename)
|
|
{
|
|
static std::atomic<uint64_t> id = 0;
|
|
MetricMap ret;
|
|
DLOG(INFO) << "Loading Counter Config: " << filename;
|
|
// todo: return unique_ptr....
|
|
auto xml = common::Xml::Create(filename);
|
|
LOG_IF(FATAL, !xml)
|
|
<< "Could not open XML Counter Config File (set env ROCPROFILER_METRICS_PATH)";
|
|
|
|
for(const auto& [gfx_name, nodes] : xml->GetAllNodes())
|
|
{
|
|
/**
|
|
* "top." is used to designate the root encapsulation of all contained XML subroots (in our
|
|
* case "gfxX"). This is inserted by the parser so it will always be present. .metric
|
|
* denotes XML tags that are contained in the subroots. This will not change unless we
|
|
* respec the XML (which we should...).
|
|
*/
|
|
if(gfx_name.find("metric") == std::string::npos ||
|
|
gfx_name.find("top.") == std::string::npos)
|
|
continue;
|
|
|
|
auto& metricVec =
|
|
ret.emplace(gfx_name.substr(strlen("top."),
|
|
gfx_name.size() - strlen("top.") - strlen(".metric")),
|
|
std::vector<Metric>())
|
|
.first->second;
|
|
for(const auto& node : nodes)
|
|
{
|
|
metricVec.emplace_back(node->opts["name"],
|
|
node->opts["block"],
|
|
node->opts["event"],
|
|
node->opts["descr"],
|
|
node->opts["expr"],
|
|
node->opts["special"],
|
|
id);
|
|
id++;
|
|
}
|
|
}
|
|
|
|
return ret;
|
|
}
|
|
|
|
std::string
|
|
findViaInstallPath(const std::string& filename)
|
|
{
|
|
Dl_info dl_info = {};
|
|
DLOG(INFO) << filename << " is being looked up via install path";
|
|
if(dladdr(reinterpret_cast<const void*>(rocprofiler_query_available_agents), &dl_info) != 0)
|
|
{
|
|
return std::filesystem::path{dl_info.dli_fname}.parent_path().parent_path() /
|
|
fmt::format("share/rocprofiler/{}", filename);
|
|
}
|
|
return filename;
|
|
}
|
|
|
|
std::string
|
|
findViaEnvironment(const std::string& filename)
|
|
{
|
|
if(const char* metrics_path = nullptr; (metrics_path = getenv("ROCPROFILER_METRICS_PATH")))
|
|
{
|
|
DLOG(INFO) << filename << " is being looked up via env variable ROCPROFILER_METRICS_PATH";
|
|
return std::filesystem::path{std::string{metrics_path}} / filename;
|
|
}
|
|
// No environment variable, lookup via install path
|
|
return findViaInstallPath(filename);
|
|
}
|
|
|
|
} // namespace
|
|
|
|
MetricMap
|
|
getDerivedHardwareMetrics()
|
|
{
|
|
return loadXml(findViaEnvironment("derived_counters.xml"));
|
|
}
|
|
|
|
MetricMap
|
|
getBaseHardwareMetrics()
|
|
{
|
|
return loadXml(findViaEnvironment("basic_counters.xml"));
|
|
}
|
|
|
|
const MetricIdMap&
|
|
getMetricIdMap()
|
|
{
|
|
static MetricIdMap id_map = []() {
|
|
MetricIdMap map;
|
|
for(const auto& [_, val] : getMetricMap())
|
|
{
|
|
for(const auto& metric : val)
|
|
{
|
|
map.emplace(metric.id(), metric);
|
|
}
|
|
}
|
|
return map;
|
|
}();
|
|
return id_map;
|
|
}
|
|
|
|
const MetricMap&
|
|
getMetricMap()
|
|
{
|
|
static MetricMap map = []() {
|
|
MetricMap ret = getBaseHardwareMetrics();
|
|
for(auto& [key, val] : getDerivedHardwareMetrics())
|
|
{
|
|
auto [iter, inserted] = ret.emplace(key, val);
|
|
if(!inserted)
|
|
{
|
|
iter->second.insert(iter->second.end(), val.begin(), val.end());
|
|
}
|
|
}
|
|
return ret;
|
|
}();
|
|
return map;
|
|
}
|
|
|
|
const std::vector<Metric>&
|
|
getMetricsForAgent(const std::string& agent)
|
|
{
|
|
static const std::vector<Metric> empty;
|
|
const auto& map = getMetricMap();
|
|
if(const auto* metric_ptr = rocprofiler::common::get_val(map, agent))
|
|
{
|
|
return *metric_ptr;
|
|
}
|
|
|
|
return empty;
|
|
}
|
|
|
|
bool
|
|
operator<(Metric const& lhs, Metric const& rhs)
|
|
{
|
|
return lhs.id() < rhs.id();
|
|
}
|
|
} // namespace counters
|
|
} // namespace rocprofiler
|