GPU HW Counters via rocprofiler (#84)

* Initial support for GPU hardware counters

* Update find modules for roctracer and rocprofiler

- /opt/rocm/{rocprofiler,roctracer} path is deprecated so tweak search procedure

* Improve ConfigCPack for MPI

* Update rocprofiler

- rocm_metrics()
- minor cleanup

* Update rocm find modules

* declare rocm_metrics + call in omnitrace-avail

* relocate omnitrace-launch-compiler

* REALPATH and find_modules

* Examples cmake (may drop)

* omnitrace-avail

- hw_counter categories
- init rocm

* setenv updates for rocprofiler in library.cpp and dl.cpp

* get_rocm_events config

* gpu::hip_device_count()

* rocm_metrics returns hardware_counters::info

* - relocated library/components/roctracer_callbacks.* to library/roctracer.*
- relocated library/components/rocprofiler.* to library/rocprofiler.*
- cleaned up rocprofiler.hpp
- added perfetto output of rocprofiler
- added timemory output of rocprofiler
- renamed omni.roctracer thread to roctracer.hip
- added roctracer.hsa thread name
- updated timemory submodule to support std::variant
- updated timemory submodule to support = in config value
- updated timemory submodule to support standalone storage
- updated timemory submodule to support new hw counter apis
- updated timemory submodule to prevent label/description caching in data_tracker

* update omnitrace-avail info_type generation

* Update timemory submodule

* rocprofiler component

* cmake formatting

* omnitrace-avail handle no GPUs

- Add -c command-line option for --categories
- support verbosity

* hsa_rsrc_factory throws exceptions

- throw exceptions to avoid aborting on HSA_STATUS_ERROR_NOT_INITIALIZED when advantageous
- removed duplicate specialization of is_available for component::rocprofiler

* rocprofiler symbols for when disabled

* Fix warning in omnitrace-avail

- std::stringstream from initializer list would use explicit constructor

* Fix finalization after settings are deleted

* Reorganized rocprofiler source

* Updated formatting

* Miscellaneous tweaks

- added using statements from timemory
- tweaked the main and thread bundle names
- fixed timemory header includes

[ROCm/rocprofiler-systems commit: 4208b5654c]

projects/rocprofiler-systems/source/lib/omnitrace/library/gpu.cpp

@@ -24,25 +24,41 @@
 
 #if defined(OMNITRACE_USE_ROCM_SMI) && OMNITRACE_USE_ROCM_SMI > 0
 #    include "library/components/rocm_smi.hpp"
-#elif defined(OMNITRACE_USE_HIP) && OMNITRACE_USE_HIP > 0
+#elif !defined(OMNITRACE_USE_ROCM_SMI)
+#    define OMNITRACE_USE_ROCM_SMI 0
+#endif
+
+#if defined(OMNITRACE_USE_HIP) && OMNITRACE_USE_HIP > 0
 #    if !defined(TIMEMORY_USE_HIP)
 #        define TIMEMORY_USE_HIP 1
 #    endif
 #    include <timemory/components/hip/backends.hpp>
+#elif !defined(OMNITRACE_USE_HIP)
+#    define OMNITRACE_USE_HIP 0
 #endif
 
 namespace omnitrace
 {
 namespace gpu
 {
+int
+hip_device_count()
+{
+#if OMNITRACE_USE_HIP > 0
+    return ::tim::hip::device_count();
+#else
+    return 0;
+#endif
+}
+
 int
 device_count()
 {
-#if defined(OMNITRACE_USE_ROCM_SMI) && OMNITRACE_USE_ROCM_SMI > 0
+#if OMNITRACE_USE_ROCM_SMI > 0
     // store as static since calls after rsmi_shutdown will return zero
     static auto _v = rocm_smi::device_count();
     return _v;
-#elif defined(OMNITRACE_USE_HIP) && OMNITRACE_USE_HIP > 0
+#elif OMNITRACE_USE_HIP > 0
     return ::tim::hip::device_count();
 #else
     return 0;