9618ddefba
* Addition of basic structure
* Reworked categories
* More causal integration additions
* Causal implementation
* Update examples
* delete virtual_speedup files
* Update perfetto submodule to v31.0
* Update dyninst submodule
* Update timemory submodule
* ElfUtils build for libdw
* OMNITRACE_LIKELY and OMNITRACE_UNLIKELY
* Update common lib join
* Examples updates for causal profiling
* config updates with causal options
- OMNITRACE_CAUSAL_FIXED_LINE
- OMNITRACE_CAUSAL_FIXED_SPEEDUP
- OMNITRACE_CAUSAL_FILE
- OMNITRACE_CAUSAL_BINARY_SCOPE
- OMNITRACE_CAUSAL_SOURCE_SCOPE
- version info in banner
- support increments in parse_numeric_range
- fix occasional deadlock in first call to get_config
* PTL general task group
* Always include PID in debug/verbose messages
* Add blocking/unblocking gotchas to runtime init bundle
* CausalState
* thread_data updates
- generic component_bundle_cache
* Improve handling of causal in category_region
* components updates
- backtrace_causal component
- backtrace::get_data member func
- decrease ignore_depth in backtrace::sample(int)
- handle "omnitrace_main" in backtrace::filter_and_patch(...)
- tweak internal thread state scope for pthread_mutex_gotcha wrappers
* simplify tracing get_instrumentation_bundles usage
* sampling updates
- include backtrace_causal component
- disable backtrace_metrics if using causal and not using perfetto
- disable backtrace and backtrace_timestamp when using causal
- post_process_causal
* causal updates
- more checks in blocking_gotcha and unblocking_gotcha start/stop
- miscellaneous overhaul of data
- experiment update
* Remove virtual speedup
* libomnitrace code_object
* causal-profiling test
* libomnitrace library.cpp updates
- handle causal profiling
- fini_bundle
* Disable causal profiling by default
* Updated causal code and example
- example: three execution variants: cpu + rng, cpu, rng
- example: three instrumentation variants: none, omni, coz
- fix blocking gotcha credit
- rework perform_experiment_impl
- get_eligible_address_ranges
- compute_eligible_lines
- support fixed lines/speedups/functions
- update selected_entry to support function mode
- fix causal::delay
- experiment updates
* omnitrace_progress / omnitrace_user_progress
- with accompanying omnitrace_annotated_progress / omnitrace_user_annotated_progress
* Update timemory submodule
* CausalMode
- mode indicated whether causal predictions source be at line-level or function-level
* code_object, config, runtime, sampling, thread_data
- code_object: address_range
- code_object: basic::line_info serialize(), name(), hash()
- config updates
- two signals for causal sampling
- thread_data init fixes
* pthread updates
- pthread_create_gotcha processes delays
- pthread_mutex_gotcha does not wrap pthread_join in causal mode
* backtrace_causal update
- dynamic delay period stats
* main wrapper uses basename of argv[0]
* update elfio submodule
* perf support (currently unused)
* Fix experiment JSON serialization
- static_vector.hpp (unused)
* causal executable + config options updates
- omnitrace-causal exe simplifies running multiple causal configs
- changed the causal config option names
* Support both throughput and latency points
* process-causal-json.py script
- will be used later for testing
* stable_vector
* Rework thread_data
* Improve omnitrace-causal exe
- better verbosity handling
- correct diagnosis of status for child process
- execvpe when only one iteration (debugging)
* Update timemory submodule
* exe --version
- omnitrace, omnitrace-avail, and omnitrace-sample all support --version on command-line
* OMNITRACE_INTERNAL_API + OMNITRACE_{LIKELY,UNLIKELY}
* omnitrace-causal cmake format
* omnitrace config update
- OMNITRACE_CAUSAL_FILE_CLOBBER
* custom exception
- wraps STL exception and gets stacktrace during construction
* exit_gotcha supports _Exit
* use global construct_on_init + max threads
- add some safety when exceeding max # of threads
* update code_object binary filter
- exclude dyninst and tbbmalloc library
* containers: c_array, static_vector, stable_vector
- moved utility::c_array to container::c_array
- created static_vector: std::vector bound to std::array
- created stable_vector: vector with stable references
* grow thread_data when new thread created
* causal updates
- data: improve compute_eligible_lines to ignore lambdas
- data: use new thread_data
- delay: use new thread_data
- experiment: properly support latency points
- experiment: support file clobber
- experiment: ensure non-zero experiment time
- progress_point: use new thread_data
- backtrace_causal: use new thread_data
* Update causal-profiling tests
* fix omnitrace-causal backslash escaping
* process-causal-json script
* restructure causal implementation
- update verbose messages for omnitrace-causal diagnose_status
- migrated causal implementation in sampling.cpp to causal/sampling.cpp
- OMNITRACE_USE_CAUSAL does not require OMNITRACE_USE_SAMPLING
- added Mode::Causal
- causal sampling uses same signals as regular sampling
- moved tracing::thread_init to implementation file
- combined tracing::thread_init and tracing::thread_init_sampling
- added causal/components folder
- pthread_create_gotcha::wrapper_config
- omnitrace_preload checks OMNITRACE_USE_CAUSAL
- updates mode accordingly
* update timemory submodule
* update timemory submodule
* causal example updates
- causal for lulesh
* perf code + utility - helpers
- relocated causal perf code
- placement new when generating unique ptr trait for potentially allocating during sampling
- additions to utility header
- removed previously added helpers.hpp
* update timemory submodule
* Default env variables for omnitrace-causal
- activate OMNITRACE_USE_KOKKOSP, etc.
* update stable_vector and static_vector
- static vector can use atomic for size tracking for thread-safe situations
* update causal example header
- CAUSAL_PROGRESS_NAMED
- use CAUSAL_ prefix for some macros
* Tweak lulesh example
- use CAUSAL_PROGRESS instead of CAUSAL_BEGIN and CAUSAL_END
* omnitrace-sample support for causal mode
- set OMNITRACE_USE_SAMPLING to off when OMNITRACE_MODE=causal
* refactor and cleanup code_object
- scope filter
- fixes to address_range
* overhaul causal data + causal config options
- full support for function and line mode
- support static vector of instruction pointers
- improve line info mapping resolution
- remove thread-locality from miscellanous functions where unnecessary
- causal options for {binary,source,function,fileline} exclusion
* causal experiment, sampling, and backtrace updates
- is_selected + unwind address array
- experiment warning about progress points
- increased buffer size for backtrace_casual sampler
- backtrace_causal only stores IP addresses instead of full unwind info
* category_region updates
- minor refactor
- local_category_region::mark
* Update causal tests
* Bump version to 1.8.0
* omnitrace-causal args + CLOBBER -> RESET
- renamed OMNITRACE_CAUSAL_FILE_CLOBBER to OMNITRACE_CAUSAL_FILE_RESET
- updated omnitrace-causal exe to support recently added configuration options
- other miscellaneous tweaks to data.cpp, experiment.cpp, and sampling.cpp
* Refactor causal and code_object
- code_object.hpp and code_object.cpp moved into binary folder
- causal components namespaced into omnitrace::causal::component
- moved sample_data out of backtrace_causal and into own file
- renamed backtrace_causal to causal::component::backtrace
* preload omnitrace_init + OMNITRACE_DEBUG_MARK
- env OMNITRACE_DEBUG_MARK
- fix omnitrace_init call when LD_PRELOAD-ing omnitrace
* Fix fileline support + line-info output names + experiment log
- line-info log files are prefixed with experiment name
- don't print experiment duration when E2E
- account for fileline scope in analysis
* KokkosP: OMNITRACE_KOKKOSP_NAME_LENGTH_MAX
- config option to limit the name of kokkos tool callbacks
- remove [kokkos] from KokkosP names
* Update causal example
- minor tweaks to decrease probability of overlapping regions in binary
* omnitrace-causal update
- prefix N / Ntot in environment printout
* Miscellaneous updates
- causal::finish_experimenting()
- OMNITRACE_CAUSAL_RANDOM_SEED
- KokkosP causal updates
- exclude some callbacks, make some callbacks unique, etc.
- address_range::operator+=(address_range)
- combine contiguous ranges in binary/analysis.cpp when file, func, line is same and address range is contiguous
- bfd_line_info reads inline info
- wait for perform_experiment_impl to complete
- causal::delay updates
- delay::process checks if experiment is active
- uses threading::get_id()
- experiment scales duration up for larger speedup experiments
- line info samples includes excluded lines
- sampler uses CLOCK_REALTIME
- blocking_gotcha updates
- is no longer fully static
- adds audit routine which sets the postblock value to zero if try/timed routine fails
- category::host was added to causal_throughput_categories_t
- pthread_create_gotcha sets new threads local parent delay
- was using internal value, now uses sequent value
* Causal improvements to KokkosP
* Updates to experiment time scaling
- use stats instead of just max
* binary/link_map.{hpp,cpp}
* update process-causal-json.py
* Folded fileline scope into source scope
* Update documentation
- Add documentation for causal profiling
- Replace 'Omnitrace' with 'OmniTrace' everywhere
* Update causal-helpers.cmake + omnitrace-testing.cmake
- split tests/CMakeLists.txt partially into omnitrace-testing.cmake
* omnitrace/causal.h
- OMNITRACE_CAUSAL_PROGRESS
- OMNITRACE_CAUSAL_PROGRESS_NAMED
- OMNITRACE_CAUSAL_BEGIN
- OMNITRACE_CAUSAL_END
* selected_entry + remove default filters for lambdas and operator()
- selected entry stores range and binary load address
* update process-causal-json.py
* format examples/lulesh/CMakeLists.txt
* causal-helpers find_package(Threads)
* OMNITRACE_KOKKOSP_KERNEL_LOGGER
- was OMNITRACE_KOKKOS_KERNEL_LOGGER
* quiet find of coz-profiler
* Fix rocm_smi exception handling
* Update timemory submodule (binutils)
- fix binutls compile error on some systems
- bump binutils to v2.40
* Fix miscellaneous tests
* OMNITRACE_KOKKOSP_PREFIX
* revert rocm_smi handling
* ElfUtils updates
- default to download version 0.188
- add -Wno-error=null-dereference due to GCC 12 compiler error
* Update causal example
* Remove OMNITRACE_VERBOSE from global workflow envs
* Reliable causal test
* disable compilation of causal perf files
* Remove set_current_selection with unwind stack
* update timemory submodule
* fix for segfault on bionic
- locking in TLS dtor was causing segfault
* remove experiment::is_selected(unwind_stack_t)
* update default init of selected_entry
* Fix for when IP is not offset by load address
* Update CMakeLists.txt
* Miscellaneous updates
- OMNITRACE_WARNING_OR_CI_THROW
- OMNITRACE_REQUIRE
- OMNITRACE_PREFER
- fixed issues with no ASLR
- added load address variable and ipaddr() func to basic/bfd line info
- removed get_basic() from dwarf_line_info
- TIMEMORY_PREFER -> OMNITRACE_PREFER
- removed previously added binary_address and range variables from selected_entry
* Removed superfluous CausalState
* Additional causal tests (lulesh + kokkos)
* filter, prefer, analysis ASLR handling
- removed default filter on cold functions
- fixed OMNITRACE_PREFER
- fixed analysis ASLR handling
* Tweak line-info output
* Removed some superfluous code
- causal/delay
- causal/selected_entry
* Exclude main.cold in function mode
* Update validate-perfetto-proto.py
- account for occasional http errors
* Add sampling test disabling tmp files
* argparser for process-causal-json
- support validation
- support filtering
* Avoid pthread_{lock,unlock} in sampling offload
- use homemade atomic_mutex/atomic_lock since contention will be low and using pthread tools might trigger our wrappers
* Rename process-causal-json.py
- validate-causal-json.py
* rework omnitrace_add_causal_test
- capable of performing validation
- added validation tests
* Fix kokkosp_begin_deep_copy + causal
* Tweak address range in bfd_line_info::read_pc
* Tweak analysis and data IP handling
- look for gaps
* Disable scaling experiment time by speedup
* Revert change in max threads during CI
* binary updates
- significant overhaul of binary analysis implementation
- removed "basic_line_info" and "bfd_line_info" in lieu of "symbol" class
- symbol class has basic BFD info + vector of inlines + vector of dwarf info
* Updated causal to use new binary analysis
- Fix symbol.cpp includes
* Updated formatting target
- include *.cmake files
* Updated causal tests
- causal tests should be stable now
* Update timemory and dyninst submodules
- TPLs are stripped + built w/o debug info
* Increase tolerance for causal validation speedups
- higher speedups have more variance (increased to +/- 5 from 3)
* Support causal output for MPI
- i.e. tag with MPI rank
* omnitrace-causal launcher argument
* improve experiment sampling output
* causal data updates
- call compute lines once
- fixed filtered cached binary info
- debugging info when experiment fails to start
* Tweaked causal validation tests
* dwarf_entry ranges
* CI updates
- increase max threads to 64
* Tweak causal E2E validation tests
- more threads
- shorter thread runtime
- more iterations
* Fix shadowed variable
* fix symbol read_bfd last PC calculation
* fix maybe-uninitialized warning
* omnitrace-causal launcher update
- only inject "omnitrace-causal --" once
- throw error if no matches found
* Update causal profiling docs for launcher
* fix address range boundaries
376 řádky
13 KiB
CMake
376 řádky
13 KiB
CMake
# adds a ctest for executable
|
|
function(OMNITRACE_ADD_BIN_TEST)
|
|
cmake_parse_arguments(
|
|
TEST
|
|
"ADD_INVERSE" # options
|
|
"NAME;TARGET;TIMEOUT;WORKING_DIRECTORY" # single value args
|
|
"ARGS;ENVIRONMENT;LABELS;PROPERTIES;PASS_REGEX;FAIL_REGEX;SKIP_REGEX;DEPENDS;COMMAND" # multiple
|
|
# value args
|
|
${ARGN})
|
|
|
|
if(NOT TEST_WORKING_DIRECTORY)
|
|
set(TEST_WORKING_DIRECTORY ${PROJECT_BINARY_DIR})
|
|
endif()
|
|
if(NOT OMNITRACE_DYNINST_API_RT_DIR AND OMNITRACE_DYNINST_API_RT)
|
|
get_filename_component(OMNITRACE_DYNINST_API_RT_DIR "${OMNITRACE_DYNINST_API_RT}"
|
|
DIRECTORY)
|
|
endif()
|
|
|
|
if(OMNITRACE_BUILD_DYNINST)
|
|
set(OMNITRACE_DYNINST_API_RT_DIR
|
|
"${PROJECT_BINARY_DIR}/external/dyninst/dyninstAPI_RT:${PROJECT_BINARY_DIR}/external/dyninst/dyninstAPI"
|
|
)
|
|
endif()
|
|
|
|
if(NOT TEST_ENVIRONMENT)
|
|
set(TEST_ENVIRONMENT
|
|
"OMNITRACE_USE_PERFETTO=ON"
|
|
"OMNITRACE_USE_TIMEMORY=ON"
|
|
"OMNITRACE_USE_SAMPLING=ON"
|
|
"OMNITRACE_TIME_OUTPUT=OFF"
|
|
"LD_LIBRARY_PATH=${PROJECT_BINARY_DIR}/${CMAKE_INSTALL_LIBDIR}:${OMNITRACE_DYNINST_API_RT_DIR}:$ENV{LD_LIBRARY_PATH}"
|
|
)
|
|
endif()
|
|
|
|
# common
|
|
list(APPEND TEST_ENVIRONMENT "OMNITRACE_CI=ON" "OMNITRACE_CONFIG_FILE="
|
|
"OMNITRACE_OUTPUT_PATH=omnitrace-tests-output" "TWD=${TEST_WORKING_DIRECTORY}")
|
|
# copy for inverse
|
|
set(TEST_ENVIRONMENT_INV "${TEST_ENVIRONMENT}")
|
|
|
|
# different for regular test and inverse test
|
|
list(APPEND TEST_ENVIRONMENT "OMNITRACE_OUTPUT_PREFIX=${TEST_NAME}/")
|
|
list(APPEND TEST_ENVIRONMENT_INV "OMNITRACE_OUTPUT_PREFIX=${TEST_NAME}-inverse/")
|
|
|
|
if(TEST_COMMAND)
|
|
add_test(
|
|
NAME ${TEST_NAME}
|
|
COMMAND ${TEST_COMMAND} ${TEST_ARGS}
|
|
WORKING_DIRECTORY ${TEST_WORKING_DIRECTORY})
|
|
|
|
set_tests_properties(
|
|
${TEST_NAME}
|
|
PROPERTIES ENVIRONMENT
|
|
"${TEST_ENVIRONMENT}"
|
|
TIMEOUT
|
|
${TEST_TIMEOUT}
|
|
DEPENDS
|
|
"${TEST_DEPENDS}"
|
|
LABELS
|
|
"omnitrace-bin;${TEST_LABELS}"
|
|
PASS_REGULAR_EXPRESSION
|
|
"${TEST_PASS_REGEX}"
|
|
FAIL_REGULAR_EXPRESSION
|
|
"${TEST_FAIL_REGEX}"
|
|
SKIP_REGULAR_EXPRESSION
|
|
"${TEST_SKIP_REGEX}"
|
|
${TEST_PROPERTIES})
|
|
if(TEST_ADD_INVERSE)
|
|
add_test(
|
|
NAME ${TEST_NAME}-inverse
|
|
COMMAND ${TEST_COMMAND} ${TEST_ARGS}
|
|
WORKING_DIRECTORY ${TEST_WORKING_DIRECTORY})
|
|
|
|
set_tests_properties(
|
|
${TEST_NAME}-inverse
|
|
PROPERTIES ENVIRONMENT
|
|
"${TEST_ENVIRONMENT_INV}"
|
|
TIMEOUT
|
|
${TEST_TIMEOUT}
|
|
DEPENDS
|
|
"${TEST_DEPENDS}"
|
|
LABELS
|
|
"omnitrace-bin;${TEST_LABELS}"
|
|
PASS_REGULAR_EXPRESSION
|
|
"${TEST_FAIL_REGEX}"
|
|
FAIL_REGULAR_EXPRESSION
|
|
"${TEST_PASS_REGEX}"
|
|
SKIP_REGULAR_EXPRESSION
|
|
"${TEST_SKIP_REGEX}"
|
|
WILL_FAIL
|
|
ON
|
|
${TEST_PROPERTIES})
|
|
endif()
|
|
elseif(TARGET ${TEST_TARGET})
|
|
add_test(
|
|
NAME ${TEST_NAME}
|
|
COMMAND $<TARGET_FILE:${TEST_TARGET}> ${TEST_ARGS}
|
|
WORKING_DIRECTORY ${TEST_WORKING_DIRECTORY})
|
|
|
|
set_tests_properties(
|
|
${TEST_NAME}
|
|
PROPERTIES ENVIRONMENT
|
|
"${TEST_ENVIRONMENT}"
|
|
TIMEOUT
|
|
${TEST_TIMEOUT}
|
|
DEPENDS
|
|
"${TEST_DEPENDS}"
|
|
LABELS
|
|
"omnitrace-bin;${TEST_LABELS}"
|
|
PASS_REGULAR_EXPRESSION
|
|
"${TEST_PASS_REGEX}"
|
|
FAIL_REGULAR_EXPRESSION
|
|
"${TEST_FAIL_REGEX}"
|
|
SKIP_REGULAR_EXPRESSION
|
|
"${TEST_SKIP_REGEX}"
|
|
${TEST_PROPERTIES})
|
|
if(TEST_ADD_INVERSE)
|
|
add_test(
|
|
NAME ${TEST_NAME}-inverse
|
|
COMMAND $<TARGET_FILE:${TEST_TARGET}> ${TEST_ARGS}
|
|
WORKING_DIRECTORY ${TEST_WORKING_DIRECTORY})
|
|
|
|
set_tests_properties(
|
|
${TEST_NAME}-inverse
|
|
PROPERTIES ENVIRONMENT
|
|
"${TEST_ENVIRONMENT_INV}"
|
|
TIMEOUT
|
|
${TEST_TIMEOUT}
|
|
DEPENDS
|
|
"${TEST_DEPENDS}"
|
|
LABELS
|
|
"omnitrace-bin;${TEST_LABELS}"
|
|
PASS_REGULAR_EXPRESSION
|
|
"${TEST_FAIL_REGEX}"
|
|
FAIL_REGULAR_EXPRESSION
|
|
"${TEST_PASS_REGEX}"
|
|
SKIP_REGULAR_EXPRESSION
|
|
"${TEST_SKIP_REGEX}"
|
|
WILL_FAIL
|
|
ON
|
|
${TEST_PROPERTIES})
|
|
endif()
|
|
elseif(OMNITRACE_BUILD_TESTING)
|
|
message(FATAL_ERROR "Error! ${TEST_TARGET} does not exist")
|
|
endif()
|
|
endfunction()
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-exe-help
|
|
TARGET omnitrace-exe
|
|
ARGS --help
|
|
LABELS omnitrace-exe
|
|
TIMEOUT 45
|
|
PASS_REGEX
|
|
".*\\\[omnitrace\\\] Usage:.*\\\[DEBUG OPTIONS\\\].*\\\[MODE OPTIONS\\\].*\\\[LIBRARY OPTIONS\\\].*\\\[SYMBOL SELECTION OPTIONS\\\].*\\\[RUNTIME OPTIONS\\\].*\\\[GRANULARITY OPTIONS\\\].*\\\[DYNINST OPTIONS\\\].*"
|
|
)
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-exe-simulate-ls
|
|
TARGET omnitrace-exe
|
|
ARGS --simulate
|
|
--print-format
|
|
json
|
|
txt
|
|
xml
|
|
-v
|
|
2
|
|
--all-functions
|
|
--
|
|
ls
|
|
LABELS "simulate"
|
|
TIMEOUT 120)
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-exe-simulate-ls-check
|
|
DEPENDS omnitrace-exe-simulate-ls
|
|
COMMAND ls omnitrace-tests-output/omnitrace-exe-simulate-ls/instrumentation
|
|
TIMEOUT 60
|
|
PASS_REGEX
|
|
".*available.json.*available.txt.*available.xml.*excluded.json.*excluded.txt.*excluded.xml.*instrumented.json.*instrumented.txt.*instrumented.xml.*overlapping.json.*overlapping.txt.*overlapping.xml.*"
|
|
FAIL_REGEX "No such file or directory|not found")
|
|
|
|
omnitrace_add_bin_test(
|
|
ADD_INVERSE
|
|
NAME omnitrace-exe-simulate-lib
|
|
TARGET omnitrace-exe
|
|
ARGS --print-available functions -v 2 -- $<TARGET_FILE:omnitrace-user-library>
|
|
LABELS "simulate"
|
|
TIMEOUT 120
|
|
PASS_REGEX
|
|
"\\\[omnitrace\\\]\\\[exe\\\] Runtime instrumentation is not possible!(.*)\n(.*)\\\[omnitrace\\\]\\\[exe\\\] Switching to binary rewrite mode and assuming '--simulate --all-functions'"
|
|
)
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-exe-write-log
|
|
TARGET omnitrace-exe
|
|
ARGS --print-instrumented functions -v 1 --log-file user.log -- ls
|
|
LABELS "log"
|
|
TIMEOUT 120
|
|
PASS_REGEX "Opening .*/instrumentation/user.log")
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-exe-write-log-check
|
|
DEPENDS omnitrace-exe-write-log
|
|
COMMAND ls omnitrace-tests-output/omnitrace-exe-write-log/instrumentation/user.log
|
|
LABELS "log"
|
|
TIMEOUT 60
|
|
PASS_REGEX "user.log"
|
|
FAIL_REGEX "No such file or directory|not found")
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-avail-help
|
|
TARGET omnitrace-avail
|
|
ARGS --help
|
|
LABELS "omnitrace-avail"
|
|
TIMEOUT 45
|
|
PASS_REGEX
|
|
".*\\\[omnitrace-avail\\\] Usage:.*\\\[CATEGORIES\\\].*\\\[VIEW OPTIONS\\\].*\\\[COLUMN OPTIONS\\\].*\\\[WIDTH OPTIONS\\\].*\\\[OUTPUT OPTIONS\\\].*"
|
|
)
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-avail-all
|
|
TARGET omnitrace-avail
|
|
ARGS --all
|
|
LABELS "omnitrace-avail"
|
|
TIMEOUT 45)
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-avail-all-expand-keys
|
|
TARGET omnitrace-avail
|
|
ARGS --all --expand-keys
|
|
LABELS "omnitrace-avail"
|
|
TIMEOUT 45
|
|
FAIL_REGEX "%[a-zA-Z_]%")
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-avail-all-only-available-alphabetical
|
|
TARGET omnitrace-avail
|
|
ARGS --all --available --alphabetical --debug --output
|
|
${CMAKE_CURRENT_BINARY_DIR}/omnitrace-avail-all-only-available-alphabetical.log
|
|
LABELS "omnitrace-avail"
|
|
TIMEOUT 45
|
|
PROPERTIES
|
|
ATTACHED_FILES
|
|
${CMAKE_CURRENT_BINARY_DIR}/omnitrace-avail-all-only-available-alphabetical.log)
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-avail-all-csv
|
|
TARGET omnitrace-avail
|
|
ARGS --all --csv --csv-separator "#"
|
|
LABELS "omnitrace-avail"
|
|
TIMEOUT 45
|
|
PASS_REGEX
|
|
"COMPONENT#AVAILABLE#VALUE_TYPE#STRING_IDS#FILENAME#DESCRIPTION#CATEGORY#.*ENVIRONMENT VARIABLE#VALUE#DATA TYPE#DESCRIPTION#CATEGORIES#.*HARDWARE COUNTER#AVAILABLE#DESCRIPTION#"
|
|
)
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-avail-filter-wall-clock-available
|
|
TARGET omnitrace-avail
|
|
ARGS -r wall_clock -C --available
|
|
LABELS "omnitrace-avail"
|
|
TIMEOUT 45
|
|
PASS_REGEX
|
|
"\\\|[-]+\\\|\n\\\|[ ]+COMPONENT[ ]+\\\|\n\\\|[-]+\\\|\n\\\| (wall_clock)[ ]+\\\|\n\\\| (sampling_wall_clock)[ ]+\\\|\n\\\|[-]+\\\|"
|
|
)
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-avail-category-filter-omnitrace
|
|
TARGET omnitrace-avail
|
|
ARGS --categories settings::omnitrace --brief
|
|
LABELS "omnitrace-avail"
|
|
TIMEOUT 45
|
|
PASS_REGEX "OMNITRACE_(SETTINGS_DESC|OUTPUT_FILE|OUTPUT_PREFIX)"
|
|
FAIL_REGEX
|
|
"OMNITRACE_(ADD_SECONDARY|SCIENTIFIC|PRECISION|MEMORY_PRECISION|TIMING_PRECISION)"
|
|
)
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-avail-category-filter-timemory
|
|
TARGET omnitrace-avail
|
|
ARGS --categories settings::timemory --brief --advanced
|
|
LABELS "omnitrace-avail"
|
|
TIMEOUT 45
|
|
PASS_REGEX
|
|
"OMNITRACE_(ADD_SECONDARY|SCIENTIFIC|PRECISION|MEMORY_PRECISION|TIMING_PRECISION)"
|
|
FAIL_REGEX "OMNITRACE_(SETTINGS_DESC|OUTPUT_FILE)")
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-avail-regex-negation
|
|
TARGET omnitrace-avail
|
|
ARGS -R
|
|
omnitrace
|
|
~timemory
|
|
~critical_trace
|
|
-r
|
|
_P
|
|
~PERFETTO
|
|
~PROCESS_SAMPLING
|
|
~KOKKOSP
|
|
--csv
|
|
--brief
|
|
--advanced
|
|
LABELS "omnitrace-avail"
|
|
TIMEOUT 45
|
|
PASS_REGEX
|
|
"ENVIRONMENT VARIABLE,[ \n]+OMNITRACE_THREAD_POOL_SIZE,[ \n]+OMNITRACE_USE_PID,[ \n]+"
|
|
FAIL_REGEX "OMNITRACE_USE_PERFETTO")
|
|
|
|
string(REPLACE "+" "\\\+" _AVAIL_CFG_PATH
|
|
"${PROJECT_BINARY_DIR}/omnitrace-tests-output/omnitrace-avail/omnitrace-")
|
|
# use of TWD == Test Working Directory (added by function)
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-avail-write-config
|
|
TARGET omnitrace-avail
|
|
ARGS -G
|
|
%env{TWD}%/omnitrace-tests-output/omnitrace-avail/omnitrace-test.cfg
|
|
-F
|
|
txt
|
|
json
|
|
xml
|
|
--force
|
|
--all
|
|
-c
|
|
omnitrace
|
|
TIMEOUT 45
|
|
LABELS "omnitrace-avail"
|
|
PASS_REGEX
|
|
"Outputting JSON configuration file '${_AVAIL_CFG_PATH}test\\\.json'(.*)Outputting XML configuration file '${_AVAIL_CFG_PATH}test\\\.xml'(.*)Outputting text configuration file '${_AVAIL_CFG_PATH}test\\\.cfg'(.*)"
|
|
)
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-avail-write-config-tweak
|
|
TARGET omnitrace-avail
|
|
ARGS -G %env{TWD}%/omnitrace-tests-output/omnitrace-avail/omnitrace-tweak.cfg -F txt
|
|
json xml --force
|
|
TIMEOUT 45
|
|
LABELS "omnitrace-avail"
|
|
ENVIRONMENT "OMNITRACE_USE_PERFETTO=OFF;OMNITRACE_USE_TIMEMORY=ON"
|
|
PASS_REGEX
|
|
"Outputting JSON configuration file '${_AVAIL_CFG_PATH}tweak\\\.json'(.*)Outputting XML configuration file '${_AVAIL_CFG_PATH}tweak\\\.xml'(.*)Outputting text configuration file '${_AVAIL_CFG_PATH}tweak\\\.cfg'(.*)"
|
|
)
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-avail-list-keys
|
|
TARGET omnitrace-avail
|
|
ARGS --list-keys --expand-keys
|
|
TIMEOUT 45
|
|
LABELS "omnitrace-avail"
|
|
PASS_REGEX "Output Keys:\n(.*)%argv%(.*)%argv_hash%")
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-avail-list-keys-markdown
|
|
TARGET omnitrace-avail
|
|
ARGS --list-keys --expand-keys --markdown
|
|
TIMEOUT 45
|
|
LABELS "omnitrace-avail;markdown"
|
|
PASS_REGEX "(.*)`%argv%`(.*)`%argv_hash%`")
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-avail-list-categories
|
|
TARGET omnitrace-avail
|
|
ARGS --list-categories
|
|
TIMEOUT 45
|
|
LABELS "omnitrace-avail"
|
|
PASS_REGEX " component::(.*) hw_counters::(.*) settings::")
|
|
|
|
omnitrace_add_bin_test(
|
|
NAME omnitrace-avail-core-categories
|
|
TARGET omnitrace-avail
|
|
ARGS -c core
|
|
TIMEOUT 45
|
|
LABELS "omnitrace-avail"
|
|
PASS_REGEX
|
|
"OMNITRACE_CONFIG_FILE(.*)OMNITRACE_ENABLED(.*)OMNITRACE_SUPPRESS_CONFIG(.*)OMNITRACE_SUPPRESS_PARSING(.*)OMNITRACE_VERBOSE"
|
|
)
|