[rocprofv3] SQLite3 database output (rocpd) support + rocprofiler-sdk-rocpd (#403)

* [rocprofv3] rocpd SQLite3 database output support * Move counters xml and yaml to source/share/rocprofiler-sdk - more representative of install hierarchy * Add share/rocprofiler-sdk/rocpd SQL files * Experimental rocprofiler-sdk SQL API * rocprofv3 default output format is rocpd * Fix rocpd event ids for counter collection w/o kernel dispatch * Remove fktable entries from rocpd_tables.sql * Fix rocpd schema path * Fix install component for roctx python bindings * rocprofiler-sdk-rocpd - create include/rocprofiler-sdk-rocpd - create rocprofiler-sdk-rocpd library, package, etc. - default all "guid" fields to "{{guid}}" in tables - remove "{{view_uuid}}" support (always unused) * Migrate rocprofv3 to use rocprofiler-sdk-rocpd * Fix missing foreign key reference * Revert change * Fix cmake comment * Fix maybe-uninitialized compiler warning * Fix maybe-uninitialized compiler warning * Add logging to rocpd_sql_load_schema * Improve string sanitization when inserting json strings * Initialize rocpd logging on rocprofiler-sdk-rocpd library load * Revert lib/output/generatePerfetto.cpp changes * [temporary] Tweak rocprofv3-test-list-avail-trace-execute test log level * Update get_install_path for lib/rocprofiler-sdk-rocpd/sql.cpp - try to resolve issues on RHEL/SLES for dladdr * Update lib/common/logging.cpp - enable environ overrides * dlsym for rocpd_sql_load_schema * Make dl_info.dli_fname lexically normal * Implement node_info alternatives if /etc/machine-id does not exist * Misc include fixes * SHA256 and UUIDv7 support * Implement UUIDv7 in generateRocpd.cpp * Support push/pop environment variables * Minor tweak * Fix glog segfaults when unsetting glog env * Updated CHANGELOG * Updates tests/pytest-packages - rocpd_reader.py: RocpdReader * Update tests / marker_views.sql - add test_rocpd_data * Update rocpd_tables.sql - Use AUTOINCREMENT - insert "uuid" and "guid" into rocpd_metadata * Minor updates to generateRocpd.cpp - don't quote GUID - use sqlite3_open_v2 - use sqlite3_close_v2 * Update execute_raw_sql_statements_impl - uses sqlite3_last_insert_rowid for autoincrement * Update SQL deferred_transaction - CI check for nullptr to connection * Apply suggestions from code review Co-authored-by: Welton, Benjamin <Benjamin.Welton@amd.com> * Code review updates - formatting - replace if with switch - remove loop for {{uuid}} * Fix pmc_groups handling in rocprofv3 * Address code review feedback - Include rocm_version in rocprofv3 version info - Note `--version` option for `rocprofv3` in CHANGELOG.md - remove commented out code * Fix packaging dependencies * Fix install package step of CI workflow * Fix install package step of CI workflow --------- Co-authored-by: Jonathan R. Madsen <jonathanrmadsen@gmail.com> Co-authored-by: Welton, Benjamin <Benjamin.Welton@amd.com> [ROCm/rocprofiler-sdk commit: 7afedc63be]
2025-05-30 00:13:19 -05:00
@@ -0,0 +1,80 @@
+// MIT License
+//
+// Copyright (c) 2023-2025 Advanced Micro Devices, Inc. All rights reserved.
+//
+// Permission is hereby granted, free of charge, to any person obtaining a copy
+// of this software and associated documentation files (the "Software"), to deal
+// in the Software without restriction, including without limitation the rights
+// to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+// copies of the Software, and to permit persons to whom the Software is
+// furnished to do so, subject to the following conditions:
+//
+// The above copyright notice and this permission notice shall be included in all
+// copies or substantial portions of the Software.
+//
+// THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+// IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+// FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+// AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+// LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+// OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+// SOFTWARE.
+
+#include "lib/common/uuid_v7.hpp"
+#include "lib/common/utility.hpp"
+#include "lib/output/node_info.hpp"
+
+#include <fmt/format.h>
+#include <gtest/gtest.h>
+
+#include <cstddef>
+#include <cstdint>
+#include <sstream>
+#include <string>
+
+TEST(common, uuid_v7)
+{
+    namespace common = ::rocprofiler::common;
+    namespace tool   = ::rocprofiler::tool;
+
+    auto        _node_data = tool::read_node_info();
+    const auto& _mach_id   = _node_data.machine_id;
+    auto        _this_pid  = getpid();
+    auto        _this_ppid = getppid();
+    auto        _init_ns   = common::timestamp_ns();
+    auto        _ticks     = common::get_process_start_ticks_since_boot(_this_pid);
+
+    auto get_uuid_v7 = [&_mach_id, &_this_pid, &_this_ppid, &_ticks](auto _timestamp_ns) {
+        auto _seed = common::compute_system_seed(_mach_id, _this_pid, _this_ppid, _ticks);
+        return common::generate_uuid_v7(_timestamp_ns, _seed);
+    };
+
+    auto reference_uuid_v7 = get_uuid_v7(_init_ns);
+
+    // uuid v7 has millisecond precision
+    std::this_thread::sleep_for(std::chrono::milliseconds{5});
+    for(size_t i = 0; i < 1000; ++i)
+    {
+        auto varying_ns      = common::timestamp_ns();
+        auto varying_uuid_v7 = get_uuid_v7(varying_ns);
+
+        EXPECT_NE(reference_uuid_v7, varying_uuid_v7)
+            << fmt::format("machine-id={}, pid={}, ppid={}, ticks={}, init_ns={}, varying_ns={}",
+                           _mach_id,
+                           _this_pid,
+                           _this_ppid,
+                           _ticks,
+                           _init_ns,
+                           varying_ns);
+
+        // UUIDv7 is supposed to be lexicographically sortable
+        EXPECT_LT(reference_uuid_v7, varying_uuid_v7)
+            << fmt::format("machine-id={}, pid={}, ppid={}, ticks={}, init_ns={}, varying_ns={}",
+                           _mach_id,
+                           _this_pid,
+                           _this_ppid,
+                           _ticks,
+                           _init_ns,
+                           varying_ns);
+    }
+}