fe5d074375
* Adding tools support * cmake formatting (cmake-format) (#227) Co-authored-by: SrirakshaNag <SrirakshaNag@users.noreply.github.com> * Checking to do rebase * Adding rocprofv2 script * cmake formatting (cmake-format) (#229) Co-authored-by: bgopesh <bgopesh@users.noreply.github.com> * Fixing build for the tool * Removing the requirement for rocm_version * Update rocprofiler_utilities.cmake * C++ filesystem fixes - added source/lib/common/filesystem.hpp - support older compilers which have <experimental/filesystem> and do not have <filesystem> - added samples/common/filesystem.hpp - samples now depend on "common" library which provides the correct filesystem header - renamed rocprofiler-stdcxxfs interface target to rocprofiler-cxx-filesystem - support old LLVM in addition to GNU - fix bin/rocprof/rocprof.cpp - was using VLA * Fix rocprofiler-drm include directories - OpenSUSE only has include/libdrm/drm.h (no include/drm/drm.h) * Tools fixes * Fix for the tools * Fix rocprofv2 script * Fixing Filesystem Issues * source formatting (clang-format v11) (#234) Co-authored-by: ammarwa <ammarwa@users.noreply.github.com> * Vlaindic/pc sampling api update (#235) * pcs: updating PC sampling API * source formatting (clang-format v11) (#232) Co-authored-by: vlaindic <vlaindic@users.noreply.github.com> --------- Co-authored-by: vlaindic <vladimir.indic@amd.com> Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: vlaindic <vlaindic@users.noreply.github.com> * Vlaindic/pc sampling api update for ammar branch (#244) *Updating the documentation inside pc_sampling.h --------- Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: vlaindic <vlaindic@users.noreply.github.com> * pcs: use @p in front of params * pcs: documenting struct fields updated * Fixing PC Sampling Documentation issues * Fixing PC Sampling Documentation * Relocated tools directory to source/lib/rocprofiler-tool * Fixes/updates to rocprofiler-tool - updated CMake - Fixed miscellaneous issues in the code (VLAs, etc.) - Updated rocprofv2 to reflect some minor env variables changes in rocprofiler-tool - Fixed clang-tidy warnings * Update lib/rocprofiler-tool/CMakeLists.txt - link to atomic library * Add $ORIGIN/.. RUNPATH to rocprofiler-tool * Adding readme file for tools * Renaming the tools readme file * Update ReadMe.md * Update ReadMe.md * Documentation updates - overview and explanation of design and concepts * Fix lib/rocprofiler-tool/README.md - delete ReadMe.md * Hacks for build * Update Filesystem * cmake formatting (cmake-format) (#248) Co-authored-by: ammarwa <ammarwa@users.noreply.github.com> * source formatting (clang-format v11) (#249) Co-authored-by: ammarwa <ammarwa@users.noreply.github.com> * source formatting (clang-format v11) (#250) Co-authored-by: ammarwa <ammarwa@users.noreply.github.com> * Addressing review comments on the tool readme file * Revert "Hacks for build" This reverts commit d6688cb3d1226c46fc97e37ced889a5b0d180940. * Fixes for GCC 7.5 compiler in OpenSUSE 15.4 * Update lib/rocprofiler-tool/CMakeLists.txt - link to AQL profile library * Fix lib/rocprofiler-tool/README.md - fix markdown * Fix lib/rocprofiler-tool - fix usage of hsa_ven_amd_loader_query_host_address * Fix unused variable warnings - byproduct of variables only used in assert statements * Update docs - update about.md - more "Important Changes" section here - update tool_library_overview.md - extend "Tool Library Design" section - write "Tool Initialization" section - write "Tool Finalization" section * Add ghc::filesystem submodule * Implement usage of ghc::filesystem * Add ROCPROFILER_BUILD_GHC_FS option - option to use external/filesystem (ghc) * Update samples/counter-collection - compile flags - common library - fixes for warnings * Update tests/kernel-tracing/CMakeLists.txt - change install location of kernel-tracing-test-tool and install rpath * Update samples/common/CMakeLists.txt - compile features requiring C++17 * Update lib/rocprofiler-tool/tool.cpp - remove include <filesystem> - comment out unused variable - remove unused functions - move some functions into anonymous namespace --------- Co-authored-by: Sriraksha Nagaraj <Sriraksha.Nagaraj@amd.com> Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: SrirakshaNag <SrirakshaNag@users.noreply.github.com> Co-authored-by: gobhardw <gopesh.bhardwaj@amd.com> Co-authored-by: bgopesh <bgopesh@users.noreply.github.com> Co-authored-by: Jonathan R. Madsen <jonathanrmadsen@gmail.com> Co-authored-by: ammarwa <ammarwa@users.noreply.github.com> Co-authored-by: vlaindic <vladimir.indic@amd.com> Co-authored-by: vlaindic <vlaindic@users.noreply.github.com> Co-authored-by: Vladimir Indic <139573562+vlaindic@users.noreply.github.com> Co-authored-by: Benjamin Welton <bewelton@amd.com> Co-authored-by: Jonathan R. Madsen <jrmadsen@users.noreply.github.com>
533 lines
13 KiB
C++
533 lines
13 KiB
C++
// MIT License
|
|
//
|
|
// Copyright (c) 2023 Advanced Micro Devices, Inc.
|
|
//
|
|
// Permission is hereby granted, free of charge, to any person obtaining a copy
|
|
// of this software and associated documentation files (the "Software"), to deal
|
|
// in the Software without restriction, including without limitation the rights
|
|
// to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
|
// copies of the Software, and to permit persons to whom the Software is
|
|
// furnished to do so, subject to the following conditions:
|
|
//
|
|
// The above copyright notice and this permission notice shall be included in
|
|
// all copies or substantial portions of the Software.
|
|
//
|
|
// THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
|
// IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
|
// FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
|
// AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
|
// LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
|
// OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
|
|
// THE SOFTWARE.
|
|
|
|
#include "lib/common/xml.hpp"
|
|
|
|
#include <glog/logging.h>
|
|
|
|
namespace rocprofiler
|
|
{
|
|
namespace common
|
|
{
|
|
Xml::Xml(std::string file_name, const Xml* obj)
|
|
: file_name_(std::move(file_name))
|
|
, state_(BODY_STATE)
|
|
{
|
|
if(obj != nullptr)
|
|
{
|
|
map_ = obj->map_;
|
|
level_ = obj->level_;
|
|
included_ = true;
|
|
}
|
|
}
|
|
|
|
Xml::~Xml()
|
|
{
|
|
for(auto& x : stack_)
|
|
{
|
|
x->nodes.clear();
|
|
x->copy.reset();
|
|
}
|
|
if(!map_) return;
|
|
for(auto& [_, nodes] : *map_)
|
|
{
|
|
(void) _;
|
|
for(auto& node : nodes)
|
|
{
|
|
node->nodes.clear();
|
|
node->copy.reset();
|
|
}
|
|
}
|
|
}
|
|
|
|
std::shared_ptr<Xml>
|
|
Xml::Create(const std::string& file_name, const Xml* obj)
|
|
{
|
|
auto xml = std::make_shared<Xml>(file_name, obj);
|
|
if(xml != nullptr)
|
|
{
|
|
if(xml->Init() != false)
|
|
{
|
|
const std::size_t pos = file_name.rfind('/');
|
|
const std::string path = (pos != std::string::npos) ? file_name.substr(0, pos + 1) : "";
|
|
|
|
xml->PreProcess();
|
|
nodes_t incl_nodes;
|
|
for(const auto& node : xml->GetNodes("top.include"))
|
|
{
|
|
if(node->opts.find("touch") == node->opts.end())
|
|
{
|
|
node->opts["touch"] = "";
|
|
incl_nodes.push_back(node);
|
|
}
|
|
}
|
|
for(const auto& incl : incl_nodes)
|
|
{
|
|
const std::string& incl_name = path + incl->opts["file"];
|
|
auto ixml = Create(incl_name, xml.get());
|
|
if(!ixml)
|
|
{
|
|
xml.reset();
|
|
break;
|
|
}
|
|
}
|
|
if(xml)
|
|
{
|
|
xml->Process();
|
|
}
|
|
}
|
|
}
|
|
|
|
return xml;
|
|
}
|
|
|
|
void
|
|
Xml::AddExpr(const std::string& full_tag, const std::string& name, const std::string& expr)
|
|
{
|
|
const std::size_t pos = full_tag.rfind('.');
|
|
const std::size_t pos1 = (pos == std::string::npos) ? 0 : pos + 1;
|
|
const std::string level_tag = full_tag.substr(pos1);
|
|
auto level = std::make_shared<level_t>();
|
|
(*map_)[full_tag].push_back(level);
|
|
level->tag = level_tag;
|
|
level->opts["name"] = name;
|
|
level->opts["expr"] = expr;
|
|
}
|
|
|
|
void
|
|
Xml::AddConst(const std::string& full_tag, const std::string& name, const uint64_t& val)
|
|
{
|
|
std::ostringstream oss;
|
|
oss << val;
|
|
AddExpr(full_tag, name, oss.str());
|
|
}
|
|
|
|
bool
|
|
Xml::print_func::operator()(const std::string& global_tag, const std::shared_ptr<level_t>& node)
|
|
{
|
|
std::cout << global_tag << ":\n";
|
|
for(auto& opt : node->opts)
|
|
{
|
|
std::cout << global_tag << "." << opt.first << " = " << opt.second << "\n";
|
|
}
|
|
return true;
|
|
}
|
|
|
|
void
|
|
Xml::Print() const
|
|
{
|
|
std::cout << "XML file '" << file_name_ << "':\n";
|
|
ForEach(print_func{});
|
|
}
|
|
|
|
bool
|
|
Xml::Init()
|
|
{
|
|
fd_ = open(file_name_.c_str(), O_RDONLY);
|
|
if(fd_ == -1)
|
|
{
|
|
// perror((std::string("open XML file ") + file_name_).c_str());
|
|
return false;
|
|
}
|
|
|
|
if(map_ == nullptr)
|
|
{
|
|
map_ = std::make_unique<map_t>();
|
|
AddLevel("top");
|
|
}
|
|
|
|
return true;
|
|
}
|
|
|
|
void
|
|
Xml::PreProcess()
|
|
{
|
|
uint32_t ind = 0;
|
|
char buf[kBufSize];
|
|
bool error = false;
|
|
|
|
while(true)
|
|
{
|
|
const uint32_t pos = lseek(fd_, 0, SEEK_CUR);
|
|
uint32_t size = read(fd_, buf, kBufSize);
|
|
if(size <= 0) break;
|
|
buf[size - 1] = '\0';
|
|
|
|
if(strncmp(buf, "#include \"", 10) == 0)
|
|
{
|
|
for(ind = 0; (ind < size) && (buf[ind] != '\n'); ++ind)
|
|
{}
|
|
if(ind < size)
|
|
{
|
|
buf[ind] = '\0';
|
|
size = ind;
|
|
lseek(fd_, pos + ind + 1, SEEK_SET);
|
|
}
|
|
|
|
for(ind = 10; (ind < size) && (buf[ind] != '"'); ++ind)
|
|
{}
|
|
if(ind == size)
|
|
{
|
|
error = true;
|
|
break;
|
|
}
|
|
buf[ind] = '\0';
|
|
|
|
AddLevel("include");
|
|
AddOption("file", &buf[10]);
|
|
UpLevel();
|
|
}
|
|
}
|
|
|
|
if(error)
|
|
{
|
|
fprintf(stderr, "XML PreProcess failed, line '%s'\n", buf);
|
|
abort();
|
|
}
|
|
|
|
lseek(fd_, 0, SEEK_SET);
|
|
}
|
|
|
|
void
|
|
Xml::Process()
|
|
{
|
|
token_t remainder;
|
|
|
|
while(true)
|
|
{
|
|
token_t token = (!remainder.empty()) ? remainder : NextToken();
|
|
remainder.clear();
|
|
|
|
// token_t token1 = token;
|
|
// token1.push_back('\0');
|
|
// std::cout << ">>> " << &token1[0] << std::endl;
|
|
|
|
// End of file
|
|
if(token.empty()) break;
|
|
|
|
switch(state_)
|
|
{
|
|
case BODY_STATE:
|
|
if(token[0] == '<')
|
|
{
|
|
bool node_begin = true;
|
|
unsigned ind = 1;
|
|
if(token[1] == '/')
|
|
{
|
|
node_begin = false;
|
|
++ind;
|
|
}
|
|
|
|
unsigned i = ind;
|
|
while(i < token.size())
|
|
{
|
|
if(token[i] == '>') break;
|
|
++i;
|
|
}
|
|
for(unsigned j = i + 1; j < token.size(); ++j)
|
|
remainder.push_back(token[j]);
|
|
|
|
if(i == token.size())
|
|
{
|
|
if(node_begin)
|
|
state_ = DECL_STATE;
|
|
else
|
|
BadFormat(token);
|
|
token.push_back('\0');
|
|
}
|
|
else
|
|
{
|
|
token[i] = '\0';
|
|
}
|
|
|
|
const char* tag = &token[ind];
|
|
if(node_begin)
|
|
{
|
|
AddLevel(tag);
|
|
}
|
|
else
|
|
{
|
|
Inherit(GetOption("base"));
|
|
|
|
if(strncmp(CurrentLevel().c_str(), tag, strlen(tag)) != 0)
|
|
{
|
|
token.back() = '>';
|
|
BadFormat(token);
|
|
}
|
|
UpLevel();
|
|
}
|
|
}
|
|
else
|
|
{
|
|
BadFormat(token);
|
|
}
|
|
break;
|
|
case DECL_STATE:
|
|
if(token[0] == '>')
|
|
{
|
|
state_ = BODY_STATE;
|
|
for(unsigned j = 1; j < token.size(); ++j)
|
|
remainder.push_back(token[j]);
|
|
continue;
|
|
}
|
|
else
|
|
{
|
|
token.push_back('\0');
|
|
unsigned j = 0;
|
|
for(j = 0; j < token.size(); ++j)
|
|
if(token[j] == '=') break;
|
|
if(j == token.size()) BadFormat(token);
|
|
token[j] = '\0';
|
|
const std::string key = token.data();
|
|
const std::string value = &token[j + 1];
|
|
AddOption(key, value);
|
|
}
|
|
break;
|
|
default:
|
|
{
|
|
LOG(ERROR) << "XML parser error: wrong state: " << state_;
|
|
abort();
|
|
}
|
|
}
|
|
}
|
|
}
|
|
|
|
bool
|
|
Xml::SpaceCheck() const
|
|
{
|
|
bool cond = ((buffer_[index_] == ' ') || (buffer_[index_] == '\t'));
|
|
return cond;
|
|
}
|
|
|
|
bool
|
|
Xml::LineEndCheck()
|
|
{
|
|
bool found = false;
|
|
if(buffer_[index_] == '\n')
|
|
{
|
|
buffer_[index_] = ' ';
|
|
++file_line_;
|
|
found = true;
|
|
comment_ = false;
|
|
}
|
|
else if(comment_ || (buffer_[index_] == '#'))
|
|
{
|
|
found = true;
|
|
comment_ = true;
|
|
}
|
|
return found;
|
|
}
|
|
|
|
Xml::token_t
|
|
Xml::NextToken()
|
|
{
|
|
token_t token;
|
|
bool in_string = false;
|
|
bool special_symb = false;
|
|
|
|
while(true)
|
|
{
|
|
if(data_size_ == 0)
|
|
{
|
|
data_size_ = read(fd_, buffer_, kBufSize);
|
|
if(data_size_ <= 0) break;
|
|
}
|
|
|
|
if(token.empty())
|
|
{
|
|
while((index_ < data_size_) && (SpaceCheck() || LineEndCheck()))
|
|
{
|
|
++index_;
|
|
}
|
|
}
|
|
while((index_ < data_size_) && (in_string || !(SpaceCheck() || LineEndCheck())))
|
|
{
|
|
const char symb = buffer_[index_];
|
|
bool skip_symb = false;
|
|
|
|
switch(symb)
|
|
{
|
|
case '\\':
|
|
if(special_symb)
|
|
{
|
|
special_symb = false;
|
|
}
|
|
else
|
|
{
|
|
special_symb = true;
|
|
skip_symb = true;
|
|
}
|
|
break;
|
|
case '"':
|
|
if(special_symb)
|
|
{
|
|
special_symb = false;
|
|
}
|
|
else
|
|
{
|
|
in_string = !in_string;
|
|
if(!in_string)
|
|
{
|
|
buffer_[index_] = ' ';
|
|
--index_;
|
|
}
|
|
skip_symb = true;
|
|
}
|
|
break;
|
|
}
|
|
|
|
if(!skip_symb) token.push_back(symb);
|
|
++index_;
|
|
}
|
|
|
|
if(index_ == data_size_)
|
|
{
|
|
index_ = 0;
|
|
data_size_ = 0;
|
|
}
|
|
else
|
|
{
|
|
if(special_symb || in_string) BadFormat(token);
|
|
break;
|
|
}
|
|
}
|
|
|
|
return token;
|
|
}
|
|
|
|
void
|
|
Xml::BadFormat(token_t token)
|
|
{
|
|
token.push_back('\0');
|
|
LOG(ERROR) << "Error: " << file_name_ << ", line " << file_line_ << ", bad XML token '"
|
|
<< token.data() << "'";
|
|
abort();
|
|
}
|
|
|
|
void
|
|
Xml::AddLevel(const std::string& tag)
|
|
{
|
|
auto level = std::make_shared<level_t>();
|
|
level->tag = tag;
|
|
if(level_)
|
|
{
|
|
level_->nodes.push_back(level);
|
|
stack_.push_back(level_);
|
|
}
|
|
level_ = level;
|
|
|
|
std::string global_tag = GlobalTag(tag);
|
|
(*map_)[global_tag].push_back(level_);
|
|
}
|
|
|
|
void
|
|
Xml::UpLevel()
|
|
{
|
|
level_ = stack_.back();
|
|
stack_.pop_back();
|
|
}
|
|
|
|
void
|
|
Xml::Copy(const std::shared_ptr<level_t>& from, const std::shared_ptr<level_t>& to)
|
|
{
|
|
auto level = to;
|
|
if(level == nullptr)
|
|
{
|
|
AddLevel(from->tag);
|
|
level = level_;
|
|
}
|
|
level->copy = from;
|
|
level->opts = from->opts;
|
|
|
|
for(const auto& node : from->nodes)
|
|
{
|
|
bool found = false;
|
|
const std::string name = GetOption("name", node);
|
|
const std::string global_tag = GlobalTag(level->tag) + "." + node->tag;
|
|
for(const auto& item : (*map_)[global_tag])
|
|
{
|
|
if((name == GetOption("name", item)) || (node == item->copy))
|
|
{
|
|
found = true;
|
|
break;
|
|
}
|
|
}
|
|
if(found == false) Copy(node, nullptr);
|
|
}
|
|
|
|
if(to == nullptr) UpLevel();
|
|
}
|
|
|
|
void
|
|
Xml::Inherit(const std::string& tag)
|
|
{
|
|
if(!tag.empty())
|
|
{
|
|
const std::string global_tag = GlobalTag(tag);
|
|
auto it = map_->find(global_tag);
|
|
if(it == map_->end())
|
|
{
|
|
fprintf(
|
|
stderr, "Node \"%s\": Base not found \"%s\"\n", level_->tag.c_str(), tag.c_str());
|
|
abort();
|
|
}
|
|
for(const auto& node : it->second)
|
|
{
|
|
Copy(node, level_);
|
|
}
|
|
}
|
|
}
|
|
|
|
std::string
|
|
Xml::CurrentLevel() const
|
|
{
|
|
return level_->tag;
|
|
}
|
|
|
|
std::string
|
|
Xml::GlobalTag(const std::string& tag) const
|
|
{
|
|
std::string global_tag;
|
|
for(const auto& level : stack_)
|
|
{
|
|
global_tag += level->tag + ".";
|
|
}
|
|
global_tag += tag;
|
|
return global_tag;
|
|
}
|
|
|
|
void
|
|
Xml::AddOption(const std::string& key, const std::string& value)
|
|
{
|
|
level_->opts[key] = value;
|
|
}
|
|
|
|
std::string
|
|
Xml::GetOption(const std::string& key, std::shared_ptr<const level_t> level)
|
|
{
|
|
level = (level != nullptr) ? level : level_;
|
|
auto it = level->opts.find(key);
|
|
return (it != level->opts.end()) ? it->second : "";
|
|
}
|
|
} // namespace common
|
|
} // namespace rocprofiler
|