Fixed test cases for concurrent search

[e-emoto]

Description

This makes use of the indexRandomForConcurrentSearch function, which creates more segments for concurrent search tests, in several test cases for their concurrent search use-cases. The following test suites are affected by this change:

• DerivativeIT.java
• MovAvgIT.java
• SearchRedStateIndexIT.java
• SearchWhileCreatingIndexIT.java
• TransportTwoNodesSearchIT.java
• RandomScoreFunctionIT.java
• GeoFilterIT.java
• MoreLikeThisIT.java
• FetchSubPhasePluginIT.java

Related Issues

• Resolves [BUG] FetchSubPhasePluginIT.testPlugin for concurrent search is flaky #11112
• Resolves [BUG] RandomScoreFunctionIT.testConsistentHitsWithSameSeed for concurrent search is flaky #11106

Check List

• New functionality includes testing.
  • All tests pass
• New functionality has been documented.
  • New functionality has javadoc added
• Failing checks are inspected and point to the corresponding known issue(s) (See: Troubleshooting Failing Builds)
• Commits are signed per the DCO using --signoff
• Commit changes are listed out in CHANGELOG.md file (See: Changelog)
• Public documentation issue/PR created

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[github-actions]

Compatibility status:

Checks if related components are compatible with change e9ad245

Incompatible components

Incompatible components: [https://github.com/opensearch-project/performance-analyzer.git]

Skipped components

Compatible components

Compatible components: [https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/custom-codecs.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/ml-commons.git]

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/29636/
• CommitID: 287100c
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[neetikasinghal]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/29636/
• CommitID: 287100c
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

org.opensearch.search.basic.TransportTwoNodesSearchIT.testQueryThenFetchWithFrom {p0={"search.concurrent_segment_search.enabled":"true"}} - this test is failing, is this flaky can you take a look at it and confirm if it is flaky or is it always failing?
if it is flaky, lets mute the test and create a corresponding issue.

[e-emoto]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/29636/
• CommitID: 287100c
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

org.opensearch.search.basic.TransportTwoNodesSearchIT.testQueryThenFetchWithFrom {p0={"search.concurrent_segment_search.enabled":"true"}} - this test is failing, is this flaky can you take a look at it and confirm if it is flaky or is it always failing? if it is flaky, lets mute the test and create a corresponding issue.

This test was always failing, I forgot to remove indexRandomForConcurrentSearch from it

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/29640/
• CommitID: 81c61b3
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/29647/
• CommitID: efd0323
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/29648/
• CommitID: 3419d35
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/29686/
• CommitID: 3cb0ac0
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/29687/
• CommitID: 67f0fc3
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[neetikasinghal]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/29687/
• CommitID: 67f0fc3
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

org.opensearch.search.basic.TransportTwoNodesSearchIT.testQueryThenFetchWithFrom {p0={"search.concurrent_segment_search.enabled":"true"}} - is this flaky?

[jed326]

Flaky test

https://build.ci.opensearch.org/job/gradle-check/29687/

• [BUG] Flaky test failure IndexServiceTests.testAsyncTranslogTrimTaskOnClosedIndex #6124

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/29699/
• CommitID: bf71dfd
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.repositories.azure.AzureBlobContainerRetriesTests.testWriteLargeBlob

• URL: https://build.ci.opensearch.org/job/gradle-check/29698/
• CommitID: 60bf49a
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[codecov]

Codecov Report

Merging #11119 (e9ad245) into main (3bbc495) will decrease coverage by 0.12%.
Report is 3 commits behind head on main.
The diff coverage is n/a.

@@             Coverage Diff              @@
##               main   #11119      +/-   ##
============================================
- Coverage     71.25%   71.13%   -0.12%     
+ Complexity    58820    58781      -39     
============================================
  Files          4883     4883              
  Lines        277139   277139              
  Branches      40284    40284              
============================================
- Hits         197484   197155     -329     
- Misses        63204    63536     +332     
+ Partials      16451    16448       -3     

see 474 files with indirect coverage changes

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: SUCCESS ✅
• URL: https://build.ci.opensearch.org/job/gradle-check/29701/
• CommitID: e9ad245