[AUTOCUT] Gradle Check Flaky Test Report for IndicesRequestCacheIT

[prudhvigodithi]

Flaky Test Report for IndicesRequestCacheIT

Noticed the IndicesRequestCacheIT has some flaky, failing tests that failed during post-merge actions.

Details

Git Reference	Merged Pull Request	Build Details	Test Name
194005e	13885	39647	org.opensearch.indices.IndicesRequestCacheIT.classMethod org.opensearch.indices.IndicesRequestCacheIT.testCacheCleanupSkipsWithHighStalenessThreshold {p0={"search.concurrent_segment_search.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
b06d0b9	14062	40165	org.opensearch.indices.IndicesRequestCacheIT.classMethod org.opensearch.indices.IndicesRequestCacheIT.testCacheCleanupOnEqualStalenessAndThreshold {p0={"search.concurrent_segment_search.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testCacheCleanupWithDefaultSettings {p0={"search.concurrent_segment_search.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
2e49743	13869	39454	org.opensearch.indices.IndicesRequestCacheIT.classMethod org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testQueryRewrite {p0={"search.concurrent_segment_search.enabled":"false"}}
05fb780	13864	39402	org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
0ddf4bd	12982	40066	org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
1525a3f	13703	39843	org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
156eca3	13785	39919	org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
306e920	14035	40015	org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
5919409	13945	39654	org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
6ac4e4f	14047	40068	org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
8cf895b	14026	40287	org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
9bc536d	14036	40018	org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
9da6170	13720	40067	org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
a6c86e7	13906	39544	org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
de13aca	13920	39716	org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
e3d7e99	13942	39680	org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}} org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
120678d	14086	41248	org.opensearch.indices.IndicesRequestCacheIT.classMethod org.opensearch.indices.IndicesRequestCacheIT.testCacheClearanceAfterIndexClosure {p0={"search.concurrent_segment_search.enabled":"true"}}
5121409	13304	39858	org.opensearch.indices.IndicesRequestCacheIT.classMethod org.opensearch.indices.IndicesRequestCacheIT.testQueryRewriteDates {p0={"search.concurrent_segment_search.enabled":"true"}}
71dbc22	14274	40946	org.opensearch.indices.IndicesRequestCacheIT.classMethod org.opensearch.indices.IndicesRequestCacheIT.testCacheCleanupSkipsWithHighStalenessThreshold {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}
8599065	14028	40008	org.opensearch.indices.IndicesRequestCacheIT.classMethod org.opensearch.indices.IndicesRequestCacheIT.testStaleKeysCleanupWithMultipleIndices {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}
90ef844	14238	40848	org.opensearch.indices.IndicesRequestCacheIT.classMethod org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}
afeddc2	14037	40910	org.opensearch.indices.IndicesRequestCacheIT.classMethod org.opensearch.indices.IndicesRequestCacheIT.testDynamicStalenessThresholdUpdate {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}
bb013da	13717	39669	org.opensearch.indices.IndicesRequestCacheIT.classMethod org.opensearch.indices.IndicesRequestCacheIT.testQueryRewrite {p0={"search.concurrent_segment_search.enabled":"false"}}
c5c6024	13568	41256	org.opensearch.indices.IndicesRequestCacheIT.classMethod org.opensearch.indices.IndicesRequestCacheIT.testCacheClearAPIRemovesStaleKeysWhenStalenessThresholdIsLow {p0={"search.concurrent_segment_search.enabled":"false"}}
2528067	14400	41155	org.opensearch.indices.IndicesRequestCacheIT.testStaleKeysCleanupWithMultipleIndices {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}
2e13e9c	14107	40782	org.opensearch.indices.IndicesRequestCacheIT.testStaleKeysRemovalWithoutExplicitThreshold {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}
3936671	14050	40310	org.opensearch.indices.IndicesRequestCacheIT.testCacheWithFilteredAlias {p0={"search.concurrent_segment_search.enabled":"true"}}
4035db4	14213	40812	org.opensearch.indices.IndicesRequestCacheIT.testStaleKeysRemovalWithoutExplicitThreshold {p0={"search.concurrent_segment_search.enabled":"false"}}
41cdfa3	13944	39681	org.opensearch.indices.IndicesRequestCacheIT.testCacheCleanupOnZeroStalenessThreshold {p0={"search.concurrent_segment_search.enabled":"true"}}
9c59780	14343	41004	org.opensearch.indices.IndicesRequestCacheIT.testStaleKeysRemovalWithoutExplicitThreshold {p0={"search.concurrent_segment_search.enabled":"true"}}
b01b6e8	13998	40004	org.opensearch.indices.IndicesRequestCacheIT.testStaleKeysRemovalWithoutExplicitThreshold {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}
c49eca4	13721	40576	org.opensearch.indices.IndicesRequestCacheIT.testCacheWithFilteredAlias {p0={"search.concurrent_segment_search.enabled":"true"}}
e9b6a8d	13590	40040	org.opensearch.indices.IndicesRequestCacheIT.testDynamicStalenessThresholdUpdate {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}
f8213b8	14357	41268	org.opensearch.indices.IndicesRequestCacheIT.testCacheCleanupWithDefaultSettings {p0={"search.concurrent_segment_search.enabled":"false"}}

The other pull requests, besides those involved in post-merge actions, that contain failing tests with the IndicesRequestCacheIT class are:

• 13865
• 13772
• 13637
• 13821
• 14369
• 13172
• 13801
• 13934
• 13829
• 13997
• 13577
• 13756
• 13374
• 13461
• 13724
• 13753
• 13778
• 13957
• 13576
• 13988
• 13678
• 13888
• 12016
• 12439
• 13681
• 13810
• 13822
• 14030
• 14043
• 14048
• 14064
• 14069
• 14409
• 13498
• 13777
• 13809
• 13817
• 13994
• 14221
• 13232
• 13901
• 13917
• 14022
• 13474
• 13574
• 13592
• 13767
• 13786
• 13834
• 13887
• 13922
• 14025
• 14093
• 12190
• 12782
• 13324
• 13627
• 13636
• 13655
• 13714
• 13719
• 13748
• 13750
• 13752
• 13762
• 13765
• 13788
• 13793
• 13799
• 13807
• 13814
• 13819
• 13827
• 13843
• 13844
• 13860
• 13866
• 13870
• 13916
• 13930
• 13958
• 13983
• 13986
• 14040
• 14066
• 14131
• 14167
• 14187
• 14264
• 14397
• 13367
• 13632
• 13658
• 13847
• 14206
• 14338
• 13525
• 13573
• 13673
• 13689
• 13802
• 13835
• 13853
• 13933
• 13936
• 13992
• 14004
• 14154
• 14261
• 14341
• 14345
• 14414
• 14415
• 14427
• 14446
• 14448
• 14462
• 13131
• 13315
• 13839
• 13981
• 14110
• 14118
• 14147
• 14230
• 14358
• 14365
• 14385
• 14411
• 14421
• 14453
• 14479
• 14480

For more details on the failed tests refer to OpenSearch Gradle Check Metrics dashboard.

[kiranprakash154]

The fix for this has been merged - opensearch-project#14369
@prudhvigodithi can u help close this ?

[prudhvigodithi]

Hey @kiranprakash154 this issue is part of my fork to test the automation, closing this.
Thanks
@getsaurabh02