9de3a6b0b4
* causal backtrace updates
- fix initial causal sampling period value
* causal delay updates
- tweak handling of sleep_for_overhead
* Fix experiment global scaling for prog pts
- results in drastically improved predictions
* pthread_mutex_gotcha updates
- disable all wrappers during causal profiling
* validate-causal-json.py updates
- support decimal stddev
- fix setting stddev from command-line
* causal perform_experiment_impl update
- handle start failing because finalizing
* deprecate causal::component::sample_rate
- appears to not help at all
* Rework sample info
* Increase causal unwind_depth
- use OMNITRACE_MAX_UNWIND_DEPTH
* validate-causal-json updates
- min experiments
- exclude reporting predictions with less than X experiments at a given speedup
- percent samples
- only print samples within X% of the peak (default: 95%)
* Update timemory submodule
- extensions to sampling for signals delivered via non-timer method
- e.g. via HW counter overflow
* dwarf_entry::operator< updates
- sort via file
* causal profiling docs updates
- info about backends
- info about installing/enabling perf
* config updates: causal backend
- CausalBackend enum
- OMNITRACE_CAUSAL_BACKEND: perf, timer, auto
- omnitrace-causal option: --backend
* debug update
- use spin_mutex instead of std::mutex
* address_range::contains update
- range from 0-100 contains range from 10-100 but was returning false because high was == 100 not < 100
* symbol::operator< update
- handle load address differences
* sampling updates (non-causal)
- update get_timer to get_trigger + dynamic_cast
* container::static_vector updates
- support construction from container::c_array
- update_size private member func for handling atomic m_size
* Move perf files
- moved library/causal/perf.{hpp,cpp} to library/perf.{hpp,cpp}
* causal example update
- created impl.hpp (forward decls)
- renamed {cpu,rng}_func_impl to {cpu,rng}_impl_func
- only create two threads which run N iterations instead of two threads each iteration
* Update timemory submodule
- updates to unwind::processed_entry
- updates to procfs::maps
* Updated causal documentation
- fixed line numbers changed by modifications to causal example
* omnitrace-causal exe updates
- set OMNITRACE_THREAD_POOL_SIZE to zero by default
* core/containers updates
- static_vector: provide data() member function
- c_array pop_front() and pop_back() member functions
* core: config and argparse updates + perf
- core/perf.{hpp,cpp}
- forward decl of enums
- config-related capabilities
- argparse: --sample-overflow
- renamed some config functions
- e.g. get_sampling_cpu_freq -> get_sampling_cputime_freq
- added config settings related to overflow sampling via perf
- added timer_sampling and overflow_sampling categories
* Update timemory submodule
- sampling allocator flushing
* binary updates
- lookup_ipaddr_entry
- use bfd_find_nearest_line instead of bfd_find_nearest_line_discriminator
- discriminators are not used
- explicit instantiations of inlined_symbol::serialize
* Bump VERSION to 1.10.0
* sampling and perf updates
- support overflow sampling via Linux Perf
- update perf namespace
- update perf::perf_event
- update record ctor: pointer instead of const ref
- update open member func: return optional string
- add m_batch_size member variable
- sampling updates
- support overflow sampling
- flush allocators
- increase buffer size from 1024 to 2048
- restructure post-processing in light of perf overflow supports
- improve offload memory usage only load buffers for thread
- load_offload_buffer(tid) uses thread-specific filepos
- component updates
- backtrace_metrics::operator-=
- backtrace_metrics::operator-
- backtrace::sample does not record for overflow signal
- callchain: perf overflow sample
* core updates
- component::sampling_percent does not report self + uses_percent_units
* causal updates
- tweak get_line_info
- overloads for set_current_selection (uint64_t, c_array, std::array)
- delay
- use sampling::pause/sampling::resume
- experiment
- experiment::sample derives from unwind::processed_entry
- experiment::samples is vector instead of set
- fixed samples
- overloads for is_selected (uint64_t, c_array, std::array)
- scaling factor defaults to 100 instead of 50
- serialize updates follow change to experiment::sample
- modify algorithm for increasing/decreasing experiment length
- sample_data
- use map<uintptr, uint64_t> instead of set<sample_data>
- get_samples returns vector<sample_data> instead of set<sample_data>
- sampling
- support overflow via Linux Perf
- update causal_offload_buffer
- flush sampling allocator
- backtrace
- overflow component
* libomnitrace-dl updates
- handle dl::InstrumentMode::PythonProfile
* testing updates (causal)
- causal line 155 -> causal line 100
- causal line 165 -> causal line 110
* formatting
* exit_gotcha updates
- exit_info for abort()
- message about non-zero exit code
* testing updates
- fail regex for causal tests
- validate-causal-json: >= min_experiments instead of > min_experiments
- handle OMNITRACE_DEBUG_SETTINGS in omnitrace_write_test_config
* causal sampling updates
- add new lines where appropriate
* causal data updates
- reorder diagnostic info when experiment fails to start
* binary updates
- symbol address range from address to address + symsize + 1
- add 1 based on debug info
* causal data updates
- sample_selection wait_ns defaults to 1,000 instead of 10,000
- sample_selection wait scaled by iteration number
- save_line_info_impl verbosity
- print latest_eligible_pc when experiment does not start
* causal sampling + component updates
- perf backend disables component::backtrace
- ensure get_sampling_(realtime|cputime|overflow)_signal do not malloc
* causal: remove period stats
* validate-causal-json update
- fix --help
* causal data updates
- improve eligible pc history reporting when experiment fails to start
* causal data updates
- fix compute_eligible_lines_impl
- eligible address ranges returning too many ranges
- occasionally, overwrite all *true* eligible address ranges
* causal data updates
- reduce scoped ranges to symbol ranges
- is_eligible_address() returns true contains (not just coarse)
- revert some sample_selection behavior
* binary address_multirange updates
- make coarse_range private
- fix operator+=(pair<coarse, uintptr_t>)
* causal example update
- fix nsync to default to once per iteration
* binary analysis updates
- tweak header file includes
* causal updates
- remove factoring in sleep_for_overhead
- invoke delay::process() even if experiment is not active
* causal data updates
- update latest_eligible_pc structure
* update omnitrace-install.py.in
- fix support for fedora
- /etc/os-release does not have ID_LIKE
- fallback to RHEL 8.7 if version not specified
* update omnitrace-install.py.in
- fix support for debian
- /etc/os-release does not have ID_LIKE
- version mapping
* Update documentation
- update docs on installation
* causal data and experiment updates
- data: reset_sample_selection
* causal set_current_selection debugging
- debug messages for failed e2e runs
* causal data and backtrace component updates
- data: set_current_selection returns the number of eligible addresses added
- backtrace: if cputime signal has selected zero IPs > 5x, then realtime signal starts contributing call-stacks
* core library updates
- move config::parse_numeric_range to utility namespace
- add core/utility.cpp
- support range:increment, e.g. 5-25:10 expands to '5 15 25' instead of '5 10 15 20 25'
* omnitrace-causal update
- end-to-end expands all speedups
- support range:increment in speedups
* causal backtrace updates
- remove select_ival (realtime signal always contributes when select_count == 0)
* containers: static_vector update
- explicit c_array constructor
- explicit std::array constructor
* causal data updates
- remove set_current_selection(uint64_t)
- remove set_current_selection(std::array)
- sample_selection increase default wait time
- report eligible PC candidates
- move reset_sample_selection to perform_experiment_impl
- decrease latest_eligible_pc array size
- set_current_selection does not guard for experiment::active
* core debug updates
- OMNITRACE_PRINT_COLOR macros
* causal data updates
- tweak to experiment never started message
* causal gotcha updates
- remove unused code
* critical trace updates
- remove unused code
* omnitrace-causal
- OMNITRACE_LAUNCHER
* causal data updates
- don't fail on end-to-end + omnitrace-causal
* causal backtrace updates
- reintroduce select_ival behavior
* causal data updates
- tweak verbose messages about number of PC candidates
* core mproc updates
- utilities for waiting on child PID and diagnosing status
- omnitrace::mproc::wait_pid
- omnitrace::mproc::diagnose_status
* omnitrace-run updates
- support --fork argument for executing via fork in current process + execvpe on child instead of execvpe in current process
* omnitrace-causal updates
- wait_pid and diagnose_status just call equivalent functions in omnitrace::mproc
* ubuntu-focal workflow update
- attempt to launch ubuntu-focal-codecov job with CAP_SYS_ADMIN and use perf backend
* tests reorg and updates
- remove binary-rewrite-sampling and runtime-instrument-sampling tests
- rename *-preload tests (which use omnitrace-sample exe) to *-sampling
- split tests/CMakeLists.txt into several tests/omnitrace-<category>-tests.cmake files
- tweak to causal-both-omni-func test
- add args: -n 2 -b timer
* update validate-causal-json.py
- better reasoning info for adjusting tolerance
- always apply tolerance adjustments in CI mode
* causal e2e tests update
- add label "causal-e2e" label
- tweak params
- old: 80 12 432525 500000000
- new: 80 50 432525 100000000
- disable processor affinity for slow-func/line-100 tests
- artificially inflates some speedups with perf
* unblocking_gotcha updates
- overload operator() according to gotcha function index
* blocking_gotcha updates
- overload operator() according to gotcha function index
- fix bug where potentially post block functors (e.g. pthread_mutex_trylock) throw error if lock is not acquired.
* parse_numeric_range update
- support unordered_set
* config update
- OMNITRACE_DEBUG_{TIDS,PIDS} use parse_numeric_range
368 строки
10 KiB
C++
368 строки
10 KiB
C++
// MIT License
|
|
//
|
|
// Copyright (c) 2022 Advanced Micro Devices, Inc. All Rights Reserved.
|
|
//
|
|
// Permission is hereby granted, free of charge, to any person obtaining a copy
|
|
// of this software and associated documentation files (the "Software"), to deal
|
|
// in the Software without restriction, including without limitation the rights
|
|
// to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
|
// copies of the Software, and to permit persons to whom the Software is
|
|
// furnished to do so, subject to the following conditions:
|
|
//
|
|
// The above copyright notice and this permission notice shall be included in all
|
|
// copies or substantial portions of the Software.
|
|
//
|
|
// THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
|
// IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
|
// FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
|
// AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
|
// LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
|
// OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
|
// SOFTWARE.
|
|
|
|
#include "omnitrace-run.hpp"
|
|
|
|
#include "common/defines.h"
|
|
#include "common/delimit.hpp"
|
|
#include "common/environment.hpp"
|
|
#include "common/join.hpp"
|
|
#include "common/setup.hpp"
|
|
#include "core/argparse.hpp"
|
|
#include "core/config.hpp"
|
|
#include "core/state.hpp"
|
|
#include "core/timemory.hpp"
|
|
|
|
#include <timemory/environment.hpp>
|
|
#include <timemory/environment/types.hpp>
|
|
#include <timemory/log/color.hpp>
|
|
#include <timemory/settings/types.hpp>
|
|
#include <timemory/settings/vsettings.hpp>
|
|
#include <timemory/signals/signal_handlers.hpp>
|
|
#include <timemory/utility/argparse.hpp>
|
|
#include <timemory/utility/console.hpp>
|
|
#include <timemory/utility/filepath.hpp>
|
|
#include <timemory/utility/join.hpp>
|
|
|
|
#include <array>
|
|
#include <cctype>
|
|
#include <chrono>
|
|
#include <cmath>
|
|
#include <cstdint>
|
|
#include <cstdio>
|
|
#include <cstdlib>
|
|
#include <cstring>
|
|
#include <iostream>
|
|
#include <regex>
|
|
#include <stdexcept>
|
|
#include <string>
|
|
#include <string_view>
|
|
#include <sys/wait.h>
|
|
#include <thread>
|
|
#include <unistd.h>
|
|
#include <vector>
|
|
|
|
namespace color = ::tim::log::color;
|
|
namespace filepath = ::tim::filepath; // NOLINT
|
|
namespace console = ::tim::utility::console;
|
|
namespace argparse = ::tim::argparse;
|
|
namespace signals = ::tim::signals;
|
|
using settings = ::omnitrace::settings;
|
|
using namespace ::timemory::join;
|
|
using ::tim::get_env;
|
|
using ::tim::log::stream;
|
|
|
|
namespace std
|
|
{
|
|
std::string
|
|
to_string(bool _v)
|
|
{
|
|
return (_v) ? "true" : "false";
|
|
}
|
|
} // namespace std
|
|
|
|
namespace
|
|
{
|
|
std::string
|
|
get_internal_libpath(const std::string& _lib)
|
|
{
|
|
auto _exe = std::string_view{ realpath("/proc/self/exe", nullptr) };
|
|
auto _pos = _exe.find_last_of('/');
|
|
auto _dir = std::string{ "./" };
|
|
if(_pos != std::string_view::npos) _dir = _exe.substr(0, _pos);
|
|
return omnitrace::common::join("/", _dir, "..", "lib", _lib);
|
|
}
|
|
|
|
parser_data_t&
|
|
get_initial_environment(parser_data_t& _data)
|
|
{
|
|
if(environ != nullptr)
|
|
{
|
|
int idx = 0;
|
|
while(environ[idx] != nullptr)
|
|
{
|
|
auto* _v = environ[idx++];
|
|
_data.initial.emplace(_v);
|
|
_data.current.emplace_back(strdup(_v));
|
|
}
|
|
}
|
|
|
|
return _data;
|
|
}
|
|
|
|
int
|
|
get_verbose(parser_data_t& _data)
|
|
{
|
|
auto& verbose = _data.verbose;
|
|
verbose = get_env("OMNITRACE_CAUSAL_VERBOSE",
|
|
get_env<int>("OMNITRACE_VERBOSE", verbose, false));
|
|
auto _debug =
|
|
get_env("OMNITRACE_CAUSAL_DEBUG", get_env<bool>("OMNITRACE_DEBUG", false, false));
|
|
if(_debug) verbose += 8;
|
|
return verbose;
|
|
}
|
|
|
|
std::string
|
|
get_realpath(const std::string& _v)
|
|
{
|
|
auto* _tmp = realpath(_v.c_str(), nullptr);
|
|
auto _ret = std::string{ _tmp };
|
|
free(_tmp);
|
|
return _ret;
|
|
}
|
|
|
|
auto
|
|
toggle_suppression(std::tuple<bool, bool> _inp)
|
|
{
|
|
auto _out =
|
|
std::make_tuple(settings::suppress_config(), settings::suppress_parsing());
|
|
std::tie(settings::suppress_config(), settings::suppress_parsing()) = _inp;
|
|
return _out;
|
|
}
|
|
|
|
// disable suppression when exe loads but store original values for restoration later
|
|
auto initial_suppression = toggle_suppression({ true, true });
|
|
} // namespace
|
|
|
|
void
|
|
print_command(const parser_data_t& _data, std::string_view _prefix)
|
|
{
|
|
auto verbose = _data.verbose;
|
|
const auto& _argv = _data.command;
|
|
if(verbose >= 1)
|
|
stream(std::cout, color::info())
|
|
<< _prefix << "Executing '" << join(array_config{ " " }, _argv) << "'...\n";
|
|
|
|
std::cerr << color::end() << std::flush;
|
|
}
|
|
|
|
void
|
|
prepare_command_for_run(char* _exe, parser_data_t& _data)
|
|
{
|
|
if(!_data.launcher.empty())
|
|
{
|
|
bool _injected = false;
|
|
auto _new_argv = std::vector<char*>{};
|
|
for(auto* itr : _data.command)
|
|
{
|
|
if(!_injected && std::regex_search(itr, std::regex{ _data.launcher }))
|
|
{
|
|
_new_argv.emplace_back(_exe);
|
|
_new_argv.emplace_back(strdup("--"));
|
|
_injected = true;
|
|
}
|
|
_new_argv.emplace_back(itr);
|
|
}
|
|
|
|
if(!_injected)
|
|
{
|
|
throw std::runtime_error(
|
|
join("", "omnitrace-run was unable to match \"", _data.launcher,
|
|
"\" to any arguments on the command line: \"",
|
|
join(array_config{ " ", "", "" }, _data.command), "\""));
|
|
}
|
|
|
|
std::swap(_data.command, _new_argv);
|
|
}
|
|
}
|
|
|
|
void
|
|
prepare_environment_for_run(parser_data_t& _data)
|
|
{
|
|
if(_data.launcher.empty())
|
|
{
|
|
omnitrace::argparse::add_ld_preload(_data);
|
|
}
|
|
}
|
|
|
|
void
|
|
print_updated_environment(parser_data_t& _data, std::string_view _prefix)
|
|
{
|
|
auto _verbose = get_verbose(_data);
|
|
|
|
if(_verbose < 0) return;
|
|
|
|
auto _env = _data.current;
|
|
const auto& _updated_envs = _data.updated;
|
|
|
|
std::sort(_env.begin(), _env.end(), [](auto* _lhs, auto* _rhs) {
|
|
if(!_lhs) return false;
|
|
if(!_rhs) return true;
|
|
return std::string_view{ _lhs } < std::string_view{ _rhs };
|
|
});
|
|
|
|
std::vector<std::string_view> _updates = {};
|
|
std::vector<std::string_view> _general = {};
|
|
|
|
for(auto* itr : _env)
|
|
{
|
|
if(itr == nullptr) continue;
|
|
|
|
auto _is_omni = (std::string_view{ itr }.find("OMNITRACE") == 0);
|
|
auto _updated = false;
|
|
for(const auto& vitr : _updated_envs)
|
|
{
|
|
if(std::string_view{ itr }.find(vitr) == 0)
|
|
{
|
|
_updated = true;
|
|
break;
|
|
}
|
|
}
|
|
|
|
if(_updated)
|
|
_updates.emplace_back(itr);
|
|
else if(_verbose >= 1 && _is_omni)
|
|
_general.emplace_back(itr);
|
|
}
|
|
|
|
if(_general.size() + _updates.size() == 0 || _verbose < 0) return;
|
|
|
|
std::cerr << std::endl;
|
|
|
|
for(auto& itr : _general)
|
|
stream(std::cerr, color::source()) << _prefix << itr << "\n";
|
|
for(auto& itr : _updates)
|
|
stream(std::cerr, color::source()) << _prefix << itr << "\n";
|
|
|
|
std::cerr << color::end() << std::flush;
|
|
}
|
|
|
|
parser_data_t&
|
|
parse_args(int argc, char** argv, parser_data_t& _parser_data, bool& _fork_exec)
|
|
{
|
|
get_initial_environment(_parser_data);
|
|
|
|
bool _do_parse_args = false;
|
|
for(int i = 1; i < argc; ++i)
|
|
{
|
|
auto _arg = std::string_view{ argv[i] };
|
|
if(_arg == "--" || _arg == "-?" || _arg == "-h" || _arg == "--help" ||
|
|
_arg == "--version")
|
|
_do_parse_args = true;
|
|
}
|
|
|
|
if(!_do_parse_args && argc > 1 && std::string_view{ argv[1] }.find('-') == 0)
|
|
_do_parse_args = true;
|
|
|
|
if(!_do_parse_args) return parse_command(argc, argv, _parser_data);
|
|
|
|
using parser_t = argparse::argument_parser;
|
|
using parser_err_t = typename parser_t::result_type;
|
|
|
|
toggle_suppression(initial_suppression);
|
|
omnitrace::argparse::init_parser(_parser_data);
|
|
|
|
// no need for backtraces
|
|
signals::disable_signal_detection(signals::signal_settings::get_enabled());
|
|
|
|
auto help_check = [](parser_t& p, int _argc, char** _argv) {
|
|
std::set<std::string> help_args = { "-h", "--help", "-?" };
|
|
return (p.exists("help") || _argc == 1 ||
|
|
(_argc > 1 && help_args.find(_argv[1]) != help_args.end()));
|
|
};
|
|
|
|
const auto* _desc = R"desc(
|
|
Command line interface to omnitrace configuration.
|
|
)desc";
|
|
|
|
auto parser = parser_t{ basename(argv[0]), _desc };
|
|
|
|
parser.on_error([](parser_t&, const parser_err_t& _err) {
|
|
stream(std::cerr, color::fatal()) << _err << "\n";
|
|
exit(EXIT_FAILURE);
|
|
});
|
|
|
|
parser.enable_help("", "Usage: omnitrace-run <OPTIONS> -- <COMMAND> <ARGS>");
|
|
parser.enable_version("omnitrace-run", OMNITRACE_ARGPARSE_VERSION_INFO);
|
|
|
|
auto _cols = std::get<0>(console::get_columns());
|
|
if(_cols > parser.get_help_width() + 8)
|
|
parser.set_description_width(
|
|
std::min<int>(_cols - parser.get_help_width() - 8, 120));
|
|
|
|
// disable options related to causal profiling
|
|
_parser_data.processed_groups.emplace("causal");
|
|
|
|
omnitrace::argparse::add_core_arguments(parser, _parser_data);
|
|
omnitrace::argparse::add_extended_arguments(parser, _parser_data);
|
|
|
|
parser.start_group("EXECUTION OPTIONS", "");
|
|
parser.add_argument({ "--fork" }, "Execute via fork + execvpe instead of execvpe")
|
|
.min_count(0)
|
|
.max_count(1)
|
|
.dtype("boolean")
|
|
.action([&](parser_t& p) { _fork_exec = p.get<bool>("fork"); });
|
|
|
|
auto _inpv = std::vector<char*>{};
|
|
auto& _outv = _parser_data.command;
|
|
bool _hash = false;
|
|
for(int i = 0; i < argc; ++i)
|
|
{
|
|
if(argv[i] == nullptr)
|
|
{
|
|
continue;
|
|
}
|
|
else if(_hash)
|
|
{
|
|
_outv.emplace_back(strdup(argv[i]));
|
|
}
|
|
else if(std::string_view{ argv[i] } == "--")
|
|
{
|
|
_hash = true;
|
|
}
|
|
else
|
|
{
|
|
_inpv.emplace_back(strdup(argv[i]));
|
|
}
|
|
}
|
|
|
|
auto _cerr = parser.parse_args(_inpv.size(), _inpv.data());
|
|
if(_cerr)
|
|
{
|
|
std::cerr << _cerr.what() << std::endl;
|
|
exit(EXIT_FAILURE);
|
|
}
|
|
|
|
tim::log::monochrome() = _parser_data.monochrome;
|
|
|
|
return _parser_data;
|
|
}
|
|
|
|
parser_data_t&
|
|
parse_command(int argc, char** argv, parser_data_t& _parser_data)
|
|
{
|
|
toggle_suppression(initial_suppression);
|
|
omnitrace::argparse::init_parser(_parser_data);
|
|
|
|
// no need for backtraces
|
|
signals::disable_signal_detection(signals::signal_settings::get_enabled());
|
|
|
|
auto& _outv = _parser_data.command;
|
|
bool _hash = false;
|
|
for(int i = 1; i < argc; ++i)
|
|
{
|
|
_outv.emplace_back(strdup(argv[i]));
|
|
}
|
|
|
|
return _parser_data;
|
|
}
|