User API + reorganized lib folders (#30)

* User API + reorganized lib folders

- omnitrace_user_start_trace
- omnitrace_user_stop_trace
- omnitrace_user_start_thread_trace
- omnitrace_user_stop_thread_trace
- omnitrace_user_push_region
- omnitrace_user_pop_region

* New OpenMP examples/tests

* Fix to KokkosP

* OMPT support

- fixed omnitrace instrumenting reporting
- common invoke improvements
- component::user_region

* exclude kmp_threadprivate_

* Separate omnitrace into multiple files

* PTL and timemory submodule updates

* Active guards + USE_OMPT guards in omnitrace-dl

* Tweak transpose default iterations

* omnitrace-precommit build target

* Omnitrace exe restructuring pt 2

- Never instrument functions with less than 4 instructions
- Never instrument ompt_start_tool or nanosleep
- module_function serializes heuristics
- removed hash stuff from omnitrace
- removed instr_procedures lambda
- WAITPID_DEBUG_MESSAGE

* set_state, "_hidden" fix, CI exceptions, backtrace fix

- set_state function
- fixed "_hidden" from appearing in print macros using __FUNCTION__
- OMNITRACE_CI_THROW
- more CI checks in library
- fixed backtrace init value sample issue being ignored

* Tweaks to OMPT tests

* cmake-formatting

* Removed debug output from backtrace processing

* Fix warnings and verbosity

* omnitrace-dl fix for libomp

* omnitrace-avail fixes

- remove second omnitrace_init_library call
- fix -r option not working

* Additional testing

- source/bin/tests
- tests for omnitrace-exe
- tests for omnitrace-avail

* cmake-format

* Reduce runtime of openmp-lu

* Update openmp-lu and tests timeout

* openmp-lu and CI tweaks

- decrease iterations
- OMP_NUM_THREADS=2
- install clang and libomp-dev in linux-ci
- fix data-files in linux-ci

[ROCm/rocprofiler-systems commit: d80752bc69]

projects/rocprofiler-systems/source/lib/omnitrace/src/library/ptl.cpp

@@ -0,0 +1,98 @@
+// MIT License
+//
+// Copyright (c) 2022 Advanced Micro Devices, Inc. All Rights Reserved.
+//
+// Permission is hereby granted, free of charge, to any person obtaining a copy
+// of this software and associated documentation files (the "Software"), to deal
+// in the Software without restriction, including without limitation the rights
+// to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+// copies of the Software, and to permit persons to whom the Software is
+// furnished to do so, subject to the following conditions:
+//
+// The above copyright notice and this permission notice shall be included in all
+// copies or substantial portions of the Software.
+//
+// THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+// IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+// FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+// AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+// LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+// OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+// SOFTWARE.
+
+#include "library/ptl.hpp"
+#include "library/config.hpp"
+#include "library/debug.hpp"
+#include "library/defines.hpp"
+#include "library/sampling.hpp"
+
+#include <PTL/ThreadPool.hh>
+#include <timemory/utility/declaration.hpp>
+
+namespace omnitrace
+{
+namespace tasking
+{
+namespace
+{
+auto _thread_pool_cfg = []() {
+    PTL::ThreadPool::Config _v{};
+    _v.init         = true;
+    _v.use_affinity = false;
+    _v.use_tbb      = false;
+    _v.initializer  = []() {
+        sampling::block_signals();
+        threading::set_thread_name(
+            TIMEMORY_JOIN('.', "ptl", PTL::Threading::GetThreadId()).c_str());
+    };
+    _v.finalizer = []() {};
+    _v.priority  = 5;
+    _v.pool_size = 1;
+    return _v;
+}();
+}
+
+std::mutex&
+get_roctracer_mutex()
+{
+    static std::mutex _v{};
+    return _v;
+}
+
+PTL::ThreadPool&
+get_roctracer_thread_pool()
+{
+    static auto _v = PTL::ThreadPool{ _thread_pool_cfg };
+    return _v;
+}
+
+PTL::TaskGroup<void>&
+get_roctracer_task_group()
+{
+    static PTL::TaskGroup<void> _v{ &get_roctracer_thread_pool() };
+    return _v;
+}
+
+std::mutex&
+get_critical_trace_mutex()
+{
+    static std::mutex _v{};
+    return _v;
+}
+
+PTL::ThreadPool&
+get_critical_trace_thread_pool()
+{
+    static auto _v = PTL::ThreadPool{ _thread_pool_cfg };
+    return _v;
+}
+
+PTL::TaskGroup<void>&
+get_critical_trace_task_group()
+{
+    static PTL::TaskGroup<void> _v{ &get_critical_trace_thread_pool() };
+    return _v;
+}
+
+}  // namespace tasking
+}  // namespace omnitrace