[improve][offloaders] Automatically evict Offloaded Ledgers from memory #22
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
14 tasks
|
The pr had no activity for 30 days, mark with Stale label. |
…ding stuck (apache#23004) Co-authored-by: fanjianye <fanjianye@bigo.sg>
…duce memory usage (apache#23006)
…-port is not 4181 (apache#22993)
…ns of a topic have been deleted (apache#22854)
…pache#22994) Co-authored-by: fanjianye <fanjianye@bigo.sg>
…ith a quote pattern (apache#23014)
…edder (apache#22949) Co-authored-by: Kai Wang <kwang@streamnative.io> Co-authored-by: Yunze Xu <xyzinfernity@163.com>
… remote admin fails (apache#23028)
…sters is not the same (apache#22983)
…specific subscription (apache#22902) Co-authored-by: duanlinlin <duanlinllin@xiaohongshu.com>
…nsumer (apache#23013) Co-authored-by: Moises Nessim <moises.nessim@topmanage.com>
…g issues in Key_Shared (PIP-282) (apache#21953)
…ailable (apache#23040) ### Motivation don't do load shedding when metadata service not available. if unload bundle when metadata service not available, these topics which in this bundle can't recover the current ledger and send read again ### Modifications 1. check metadata service state when do load shedding task 2. do not interrupt the task are doing in the same time
…apache#23050) ### Motivation GetPartitionMetadata fail also can produce messages - 'autoUpdatePartitionsInterval' will get partition metadata and will regularly detect partition changes - if GetPartitionMetadata will return ServiceNotReady, client receive ServiceNotReady will close cnx - if close the current cnx, all producers and consumers witch use this cnx will close and reconnect (https://github.com/apache/pulsar/blob/5c6602cbb3660a696bf960f2847aac1a2ae037d2/pulsar-client/src/main/java/org/apache/pulsar/client/impl/ClientCnx.java#L323-L345) - this will influence a lot of producers and consumers and if current time the zk not available and bundle cache not exist the topic's bundle metadata, the client can't send messages to broker because the producer lookup will fail ### Modifications GetPartitionMetadata return MetadataError when throw MetadataStoreException
…ache#23052) Co-authored-by: Zixuan Liu <nodeces@gmail.com>
…ed subscriptions snapshot timeouts (apache#22381) Co-authored-by: Lari Hotari <lhotari@apache.org>
…ensible load manager (apache#23433)
…y if SchemaLedgerForceRecovery flag is enabled (apache#23428)
Signed-off-by: Zixuan Liu <nodeces@gmail.com>
…icated clusters set and caused OOM (apache#23360)
…ng consumer when other leaves (apache#23447)
…pache#23061) Co-authored-by: xiangying <mengxiangying@xiaohongshu.com> Co-authored-by: xiangying <xiangying@apache.org>
…pService (apache#23378) Signed-off-by: Zixuan Liu <nodeces@gmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.