2 Коммитов

Автор	SHA1	Сообщение	Дата
itrowbri	3bd7773cf7	Memory Allocation Tracking (#1142) ... * Initial commit: Need to implement wrapper function to collect data and test that wrapper function is correctly replacing core HSA functions * Attempted to implement wrapper implementation for hsa memory allocation functions. Need to modify generate record files and test if implementation is working as expected * Debugging and implementing generateCSV function * Memory allocation size and starting address outputted to csv and json file formats * Formatting * Initial setup for OTF2 and Perfetto generation * Collecting agent id for memory_allocation and formatting * Modified memory_allocation.cpp to set up code for AMD_EXT commands * Support for memory_pool_allocate added * Removed accidently added file * Made flag optional and added more OTF2 and Perfetto code. Needs testing to ensure perfetto and OTF2 works * Formatting * Fixed perfetto and otf2 output * Fixed flag issue due to incorrect buffer use * Updated documentation * Small cleaning and comments * Added test for HSA memory allocation tracing * Fixed summary test validation errors due to allocation tracing. Added type to location_base to create unique event ids for allocation due to OTF2 trace error * Decreased lower limit of hip calls for test * Modified summary tests to vary number of allocate requests * Minor fixes to address comments. Still need to address OTF2 comments * Fix docs and changed OTF2 to use enum for type specified in location_base construction * Fixed schema error * Added vmem command tracking. Need to add test * Updated test to work with vmem command and updated generateCSV to output int instead of hex string. * OTF2 enum update and mispelling fix * CI does not support Virtual Memory API. Removed vmem test. Will add back if CI is modifed to suport vmem API * Update CMakeLists.txt for memory allocation test * Updated summary test * Minor fixes to address comments * Moved domain_type.hpp enum to before LAST * Fixed compile errors and formatting * Fixed stats summary domain name error * Added rocprofv3 test * Page migration test fix * Undo page migration test changes. Failures do not appear to have to do with memory allocation	2024-11-18 20:22:14 -06:00
Jonathan R. Madsen	5eb8c2658c	rocprofv3: refactor and reorganize rocprofiler-sdk-tool library (#1138) ... * Add rocprofv3-multi-node.md to source/lib/rocprofiler-sdk-tool * Initial source re-organization - create "output" static library * Update include/rocprofiler-sdk/cxx/serialization.hpp - add GPR count fields to kernel symbol serialization * Add source/scripts/generate-rocpd.py - reads one or more JSON output files from rocprofv3 and writes rocpd SQLite3 database - Note: preliminary implementation * More reorganization b/t lib/rocprofiler-sdk-tool and lib/output * Updates to generate-rocpd.py - add SQL views - option: --absolute-timestamps -> --normalize-timestamps - option: --generic-markers - misc fixes with regards to getting the views working - support marker names * Update generate-rocpd.py - Add --marker-mode option * Update generate-rocpd.py - Improve debugging of bad bulk SQLite statements * Update rocprofv3-multi-node.md - cleanup of proposed SQL schema * lib/output/format_path.{hpp,cpp} - rename format to format_path (in config.hpp and config.cpp) - move format_path functionality to format_path.{hpp,cpp} * Rework lib/output/tmp_file_buffer.{hpp,cpp} * Update output_key.cpp - support %cwd%, %launch_date% * Rework lib/output/buffered_output.hpp * Support csv_output_file constructed via domain_type * Update lib/output/domain_type.{hpp,cpp} - get_domain_trace_file_name - get_domain_stats_file_name * Update lib/rocprofiler-sdk-tool/tool.cpp - tweak headers * Update lib/output/generate*.cpp - remove include of helpers.hpp - CSV uses domain_type for filenames * Update samples/counter_collection/per_dev_serialization.cpp - make wait_on volatile * Remove tool_table from lib/output and lib/rocprofiler-sdk-tool - Also split various structs into their own files - lib/output/agent_info - lib/output/metadata - lib/output/kernel_symbol_info - lib/output/counter_info - Implemented rocprofiler::tool::metadata * Optimize rocprofiler_tool_counter_collection_record_t - reduce the size of the struct from 24784 bytes to 8376 bytes * Introduced output_config - split subset of config (from tools library) into output_config to be able to configure the output generating functions separately from the tool library - this is a significant step towards the output generating functions not relying on static global memory * Stream chunks of data into output instead of loading all info memory * Remove duplicate group_segment_size in rocprofiler_kernel_dispatch_info_t serialization * Adding Q&A to rocprofv3-multi-node.md * Remove all remaining include lib/rocprofiler-sdk-tool from lib/output - migrated a fair amount of code from lib/rocprofiler-sdk-tool/helper.hpp to lib/output * Update Q&A of rocprofv3-multi-node.md * Fix minor compilation errors + minor cleanup * Update hsa/async_copy.cpp - when ROCPROFILER_CI_STRICT_TIMESTAMPS > 0, reduce the active_signal sync wait time * Update profiling_time.hpp - fix log messages for when start/end time is less/greater than enqueue/current CPU time * Fix generate_stats for tool_counter_record_t * Dictionary optimization for generate-rocpd.py --------- Co-authored-by: SrirakshaNag <104580803+SrirakshaNag@users.noreply.github.com>	2024-11-07 01:15:19 -06:00