[CheckCompatibility] Prevent interleaving of log output

[peternied]

Description

Prevent interleaving of log output and add more detail logging

Example output at standard log level

> Task :checkCompatibility
Checking compatibility for: https://github.com/opensearch-project/sql.git with ref: main
Checking compatibility for: https://github.com/opensearch-project/security.git with ref: main
Finished compatibility check for https://github.com/opensearch-project/security.git
Error output for https://github.com/opensearch-project/security.git build:

Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

Finished compatibility check for https://github.com/opensearch-project/sql.git
Error output for https://github.com/opensearch-project/sql.git build:

Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
/tmp/groovy-generated-tmpdir-6721287947875417197/opensearch/src/main/java/org/opensearch/sql/opensearch/storage/script/core/ExpressionScript.java:64: warning: [removal] AccessController in java.security has been deprecated and marked for removal
    this.fields = AccessController.doPrivileged((PrivilegedAction<Set<ReferenceExpression>>) () ->
                  ^
...

---

Updated status report comment with markdown:

Compatibility status:

Checks if related components are compatible with change fe1e87e

Incompatible components

• https://github.com/opensearch-project/sql.git

Skipped components

• https://github.com/opensearch-project/skippie.git

Compatible components

• https://github.com/opensearch-project/security.git
• https://github.com/opensearch-project/foo.git

Related Issues

• Related [BUG] Compatibility check by OpenSearch Trigger Bot SQL reporting issue #9235

Check List

• New functionality includes testing.
  • All tests pass
• New functionality has been documented.
  • New functionality has javadoc added
• Commits are signed per the DCO using --signoff
• Commit changes are listed out in CHANGELOG.md file (See: Changelog)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[opensearch-trigger-bot]

Compatibility status:

> Task :checkCompatibility
Incompatible components: [https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/performance-analyzer.git]
Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git]

BUILD SUCCESSFUL in 24m 25s

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/22553/
• CommitID: 822c355
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[Yury-Fridlyand]

Is it possible to make output more readable (and with MD)? For example:

## Compatible
* one
* two
* three

## Incompatible ❗ ❗ 
* ...

This message could also include tagging the corresponding teams.

[gaiksaya]

Thanks for the changes. LGTM.

[opensearch-trigger-bot]

Compatibility status:

> Task :checkCompatibility
Incompatible components: [https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/common-utils.git]
Compatible components: [https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/performance-analyzer-rca.git]

BUILD SUCCESSFUL in 25m 37s

[opensearch-trigger-bot]

Compatibility status:

> Task :checkCompatibility
Incompatible components: [https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/security-analytics.git]
Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/performance-analyzer-rca.git]

BUILD SUCCESSFUL in 26m 50s

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/22690/
• CommitID: fe1e87e
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.remotestore.RemoteIndexPrimaryRelocationIT.testPrimaryRelocationWhileIndexing

• URL: https://build.ci.opensearch.org/job/gradle-check/22692/
• CommitID: 8518854
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[codecov]

Codecov Report

Merging #9280 (8518854) into main (3ddff4c) will increase coverage by 0.12%.
Report is 12 commits behind head on main.
The diff coverage is 67.64%.

@@             Coverage Diff              @@
##               main    #9280      +/-   ##
============================================
+ Coverage     71.11%   71.23%   +0.12%     
- Complexity    57351    57517     +166     
============================================
  Files          4771     4774       +3     
  Lines        270587   270664      +77     
  Branches      39564    39570       +6     
============================================
+ Hits         192420   192813     +393     
+ Misses        61950    61708     -242     
+ Partials      16217    16143      -74     

Files Changed	Coverage Δ
...rg/opensearch/gradle/CheckCompatibilityTask.groovy	0.00% <0.00%> (ø)
.../opensearch/telemetry/tracing/noop/NoopTracer.java	66.66% <0.00%> (-13.34%)	⬇️
...nsearch/script/mustache/SearchTemplateRequest.java	78.18% <0.00%> (-2.20%)	⬇️
...opensearch/identity/shiro/ShiroIdentityPlugin.java	88.88% <ø> (ø)
...g/opensearch/extensions/NoopExtensionsManager.java	42.85% <ø> (ø)
...g/opensearch/identity/noop/NoopIdentityPlugin.java	100.00% <ø> (ø)
server/src/main/java/org/opensearch/node/Node.java	86.10% <ø> (ø)
...rch/extensions/rest/RestSendToExtensionAction.java	42.14% <20.00%> (-0.36%)	⬇️
...ensearch/extensions/rest/ExtensionRestRequest.java	71.59% <33.33%> (-1.67%)	⬇️
...g/opensearch/identity/shiro/ShiroTokenManager.java	81.81% <50.00%> (+16.70%)	⬆️
... and 12 more

... and 476 files with indirect coverage changes

[peternied]

@gaiksaya - would you be willing to approve?
@ticheng-aws @dreamer-89 @sachinpkale - I've selected you all at random, could you please help me get this reviewed and merged?

[ticheng-aws]

LGTM. Thanks, @peternied.

[tlfeng]

Thanks for the fix!