Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set Scylla task TTL #4158

Open
Michal-Leszczynski opened this issue Dec 11, 2024 · 0 comments
Open

Set Scylla task TTL #4158

Michal-Leszczynski opened this issue Dec 11, 2024 · 0 comments
Assignees

Comments

@Michal-Leszczynski
Copy link
Collaborator

The information about Scylla tasks (e.g. backup and restore) is stored on Scylla node for a limited amount of time after they are finished.
Querying status of a task which finished over TTL seconds ago results in an error.

For backup:
It's kind of fine if we loose a successful task progress, as we can always start a new one and since SSTables are being removed from the snapshot dir as they are being uploaded, we don't perform any redundant work (although we need to worry about progress calculation).

For restore:
We are unlucky if we loose a successful task progress, as we would basically need to re-restore the whole batch from scratch.

The current Scylla implementation is that the internal tasks and user tasks have different TTL values. Note that setting TTL value means that all tasks started after the change will use the set value, but it's not possible to set per task TTL value directly.

Tasks scheduled by SM are qualified as regular user tasks - the default value for their TTL is 1h.
SM should always set the TTL value even when it's 1h - we can't be sure that the value hasn't been changed from the default.

The question are:

  • what value should we set - is 1h enough?
  • should backup and restore use different values?
  • should those values be configurable?

cc: @karol-kokoszka @VAveryanov8 @regevran

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant