Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replicate the exporter metadata #11235

Closed
saig0 opened this issue Dec 9, 2022 · 0 comments · Fixed by #11425
Closed

Replicate the exporter metadata #11235

saig0 opened this issue Dec 9, 2022 · 0 comments · Fixed by #11425
Assignees
Labels
component/exporter kind/toil Categorizes an issue or PR as general maintenance, i.e. cleanup, refactoring, etc. version:8.2.0-alpha4 Marks an issue as being completely or in parts released in 8.2.0-alpha4 version:8.2.0 Marks an issue as being completely or in parts released in 8.2.0

Comments

@saig0
Copy link
Member

saig0 commented Dec 9, 2022

Description

An exporter can submit metadata. The metadata is stored in the exporter state. The exporter can read the metadata from the state on startup.

In order to handle leader changes gracefully, we need to replicate the exporter metadata. Currently, we already replicate the exporter positions from the leader to the followers. The followers accept the exporter positions and store them in their state. As a result, the exporter can continue from the last position (based on the last update) after a leader change.

We should replicate the exporter metadata next to the exporter position. The followers should write the exporter metadata in their state together with the exporter's position.

This issue is part of #10568.

@saig0 saig0 added the kind/toil Categorizes an issue or PR as general maintenance, i.e. cleanup, refactoring, etc. label Dec 9, 2022
@saig0 saig0 self-assigned this Jan 17, 2023
@ghost ghost closed this as completed in 50cfa2f Jan 18, 2023
@koevskinikola koevskinikola added the version:8.2.0-alpha4 Marks an issue as being completely or in parts released in 8.2.0-alpha4 label Feb 8, 2023
@npepinpe npepinpe added the version:8.2.0 Marks an issue as being completely or in parts released in 8.2.0 label Apr 5, 2023
This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/exporter kind/toil Categorizes an issue or PR as general maintenance, i.e. cleanup, refactoring, etc. version:8.2.0-alpha4 Marks an issue as being completely or in parts released in 8.2.0-alpha4 version:8.2.0 Marks an issue as being completely or in parts released in 8.2.0
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants