Skip to content

Conversation

@dnhatn
Copy link
Member

@dnhatn dnhatn commented Oct 5, 2020

Today indexing to a shard with 2147483519 documents will fail that shard. We should check the number of documents and reject the write requests instead.

Closes #51136

@dnhatn dnhatn added >enhancement :Distributed Indexing/Engine Anything around managing Lucene and the Translog in an open shard. v8.0.0 v7.10.0 labels Oct 5, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (:Distributed/Engine)

@dnhatn
Copy link
Member Author

dnhatn commented Oct 6, 2020

run elasticsearch-ci/1

Copy link
Contributor

@DaveCTurner DaveCTurner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @dnhatn, this is great. I left a couple of minor questions.

@andreidan andreidan added v7.11.0 and removed v7.10.0 labels Oct 7, 2020
@dnhatn
Copy link
Member Author

dnhatn commented Oct 7, 2020

@DaveCTurner Thanks for looking. I've addressed your comments.

@dnhatn dnhatn requested a review from DaveCTurner October 7, 2020 15:12
Copy link
Contributor

@DaveCTurner DaveCTurner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @dnhatn; implementation looks good now. I left a couple of suggestions for alternative names and an idea for a more general assertion too.

@dnhatn dnhatn requested a review from DaveCTurner October 7, 2020 16:19
Copy link
Contributor

@DaveCTurner DaveCTurner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks @dnhatn

Do we consider this a bug fix? If so, do you think it should go into 7.10?

@dnhatn
Copy link
Member Author

dnhatn commented Oct 8, 2020

@DaveCTurner Thanks so much for the helpful reviews.

Do we consider this a bug fix? If so, do you think it should go into 7.10?

+1. I will backport to 7.10.

@dnhatn dnhatn added the >bug label Oct 8, 2020
@dnhatn dnhatn merged commit 2b5e337 into elastic:master Oct 13, 2020
@dnhatn dnhatn deleted the check-docs-limit-on-primary branch October 13, 2020 14:50
dnhatn added a commit to dnhatn/elasticsearch that referenced this pull request Oct 13, 2020
Today indexing to a shard with 2147483519 documents will fail that
shard. We should check the number of documents and reject the write
requests instead.

Closes elastic#51136
dnhatn added a commit to dnhatn/elasticsearch that referenced this pull request Oct 13, 2020
Today indexing to a shard with 2147483519 documents will fail that
shard. We should check the number of documents and reject the write
requests instead.

Closes elastic#51136
dnhatn added a commit that referenced this pull request Oct 13, 2020
Today indexing to a shard with 2147483519 documents will fail that
shard. We should check the number of documents and reject the write
requests instead.

Closes #51136
dnhatn added a commit that referenced this pull request Oct 13, 2020
Today indexing to a shard with 2147483519 documents will fail that
shard. We should check the number of documents and reject the write
requests instead.

Closes #51136
iverase added a commit to iverase/elasticsearch that referenced this pull request Oct 30, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

>bug :Distributed Indexing/Engine Anything around managing Lucene and the Translog in an open shard. Team:Distributed Meta label for distributed team. v7.10.0 v7.11.0 v8.0.0-alpha1

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Exceeding the maximum doc count of a shard fails the shard

5 participants