[CI] CcsCommonYamlTestSuiteIT test {p0=search/160_exists_query/Test exists query on mapped text field} failing

[benwtrent]

Seems like a weird timeout when running at encryption at rest. I am not 100% sure. looking at the cluster logs, no exceptions were thrown.

Just a timeout and a dump of threads

Build scan:
https://gradle-enterprise.elastic.co/s/ehuer3ubfyxfy/tests/:qa:ccs-common-rest:yamlRestTest/org.elasticsearch.test.rest.yaml.CcsCommonYamlTestSuiteIT/test%20%7Bp0=search%2F160_exists_query%2FTest%20exists%20query%20on%20mapped%20text%20field%7D

Reproduction line:

./gradlew ':qa:ccs-common-rest:yamlRestTest' --tests "org.elasticsearch.test.rest.yaml.CcsCommonYamlTestSuiteIT.test {p0=search/160_exists_query/Test exists query on mapped text field}" -Dtests.seed=FAA796E4A5F0D449 -Dtests.locale=de -Dtests.timezone=Etc/Greenwich -Druntime.java=20

Applicable branches:
8.10

Reproduces locally?:
No

Failure history:
https://gradle-enterprise.elastic.co/scans/tests?tests.container=org.elasticsearch.test.rest.yaml.CcsCommonYamlTestSuiteIT&tests.test=test%20%7Bp0%3Dsearch/160_exists_query/Test%20exists%20query%20on%20mapped%20text%20field%7D

Failure excerpt:

java.lang.Exception: Test abandoned because suite timeout was reached.

  at __randomizedtesting.SeedInfo.seed([FAA796E4A5F0D449]:0)

[elasticsearchmachine]

Pinging @elastic/es-search (Team:Search)

[benwtrent]

Here are the test logs:
ccs-common-rest.zip

Here is the full test failure console output:

gradle-enterprise.elastic.co_s_ehuer3ubfyxfy_console-log_raw_task=_qa_ccs-common-rest_yamlRestTest.txt.zip

Towards the end there is are the massive dump of waiting threads due to a timeout.

[benwtrent]

The test failed quickly due to suite timeout. Suite timeout has been increased to 60m, closing this as the individual test isn't to blame, but instead the entire suite runtime and infra.

Related: #100585