Update HSA async copy active signals handling (#732)

* Enable INFO logging on retried CI jobs

* Update lib/rocprofiler-sdk/async_copy.cpp

- rework active_signals
  - make hsa_signal_t member variable
  - remove sync from destructor
  - replace _is_set with atomic counter
  - timeout of 30 seconds hsa_signal_wait
  - switch from relaxed to scacquire/screlease memory ordering
- improve logging and error handling
- destroy hsa signal in active_signals in async_fini

* Update lib/rocprofiler-sdk/async_copy.cpp

- active_signals::create
- change initial value of signal to 1 instead of value of completion signal
- change condition trigger of signal callback

* Update tests/counter-collection/validate.py

* Update lib/rocprofiler-sdk/async_copy.cpp

- improved logging
- fix hsa_signal_wait_scacquire_fn check

* Cleanup tests/lib/transpose/transpose.cpp

- remove huge comment block

* Appears to be working on MI200

Dependency Versions:

clr: f7b1398361  - compile mode: release

hsa-runtime: 4cd6c62f25dbbdbaa8580dd4ad8f388c98c508da - compile mode: RelWithDebug

* Update source/lib/rocprofiler-sdk/hsa/async_copy.cpp

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

* Format fix

---------

Co-authored-by: Benjamin Welton <bewelton@amd.com>
Co-authored-by: Ammar ELWazir <ammar.elwazir@amd.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Ammar ELWazir <aelwazir@hpe6u-21.amd.com>

source/scripts/run-ci.py

@@ -388,6 +388,12 @@ def parse_cdash_args(args):
         type=str,
         choices=("clang-tidy",),
     )
+    parser.add_argument(
+        "--run-attempt",
+        help="If > 1, will enable verbose logging of tests",
+        default=1,
+        type=int,
+    )
 
     return parser.parse_args(args)
 
@@ -415,6 +421,10 @@ def parse_args(args=None):
 
     cdash_args = parse_cdash_args(input_args)
 
+    if cdash_args.run_attempt > 1:
+        os.environ["ROCPROFILER_LOG_LEVEL"] = "info"
+        os.environ["ROCPROF_LOG_LEVEL"] = "info"
+
     if cdash_args.coverage:
         cmake_args += ["-DROCPROFILER_BUILD_CODECOV=ON"]
         if cdash_args.coverage == "samples":