Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fail indexDocs() on rejection #111962

Merged

Conversation

DaveCTurner
Copy link
Contributor

@DaveCTurner DaveCTurner commented Aug 19, 2024

In 9dc59e2 we relaxed the indexDocs() test utility to retry on
rejections caused by exceeding the write queue length limit, but then we
added a limit on concurrency in d88ac0a and then massively relaxed the
queue length limit in #59559. We should not be seeing such rejections
any more, so we can revert this special handling and strengthen the
tests to assert that the indexing process encounters no failures at all.

In 9dc59e2 we relaxed the `indexDocs()` test utility to retry on
rejections caused by exceeding the write queue length limit, but then we
massively relaxed this limit in elastic#59559. We should not be seeing such
rejections any more, so we can revert this special handling and
strengthen the tests to assert that the indexing process encounters no
failures at all.
@DaveCTurner DaveCTurner added >test Issues or PRs that are addressing/adding tests :Distributed Indexing/CRUD A catch all label for issues around indexing, updating and getting a doc by id. Not search. v8.16.0 labels Aug 19, 2024
@DaveCTurner DaveCTurner requested a review from fcofdez August 19, 2024 08:19
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

@elasticsearchmachine elasticsearchmachine added the Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. label Aug 19, 2024
Copy link
Contributor

@fcofdez fcofdez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@DaveCTurner DaveCTurner merged commit ca6d41c into elastic:main Aug 19, 2024
15 checks passed
@DaveCTurner DaveCTurner deleted the 2024/08/19/indexRandom-no-rejections branch August 19, 2024 11:04
weizijun added a commit to weizijun/elasticsearch that referenced this pull request Aug 19, 2024
* upstream/main:
  Fail `indexDocs()` on rejection (elastic#111962)
  Move repo analyzer to its own package (elastic#111963)
  Add generated evaluators for DateNanos conversion functions (elastic#111961)
  Clean the last traces from global retention in templates (elastic#111669)
  Fix known issue docs for elastic#111866 (elastic#111956)
  x-pack/plugin/otel: introduce x-pack-otel plugin (elastic#111091)
  Improve reaction to blob store corruptions (elastic#111954)
  Introduce `StreamingXContentResponse` (elastic#111933)
  Revert "Add 8.15.0 known issue for memory locking in Windows (elastic#111949)"
  Test get-snapshots API with missing details (elastic#111903)
  Add 8.15.0 known issue for memory locking in Windows (elastic#111949)

# Conflicts:
#	server/src/main/java/org/elasticsearch/TransportVersions.java
cbuescher pushed a commit to cbuescher/elasticsearch that referenced this pull request Sep 4, 2024
In 9dc59e2 we relaxed the `indexDocs()` test utility to retry on
rejections caused by exceeding the write queue length limit, but then we
massively relaxed this limit in elastic#59559. We should not be seeing such
rejections any more, so we can revert this special handling and
strengthen the tests to assert that the indexing process encounters no
failures at all.
davidkyle pushed a commit to davidkyle/elasticsearch that referenced this pull request Sep 5, 2024
In 9dc59e2 we relaxed the `indexDocs()` test utility to retry on
rejections caused by exceeding the write queue length limit, but then we
massively relaxed this limit in elastic#59559. We should not be seeing such
rejections any more, so we can revert this special handling and
strengthen the tests to assert that the indexing process encounters no
failures at all.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Distributed Indexing/CRUD A catch all label for issues around indexing, updating and getting a doc by id. Not search. Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. >test Issues or PRs that are addressing/adding tests v8.16.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants