Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DB history table housekeeping option #4608

Open
hjoliver opened this issue Jan 25, 2022 · 1 comment
Open

DB history table housekeeping option #4608

hjoliver opened this issue Jan 25, 2022 · 1 comment
Labels
question Flag this as a question for the next Cylc project meeting.
Milestone

Comments

@hjoliver
Copy link
Member

Currently, the task_events DB table grows without bound.

This is desirable from a provenance perspective, for finite-length science experiments; but probably not desirable for large endlessly-cycling weather prediction workflows (for example).

We should keep all information by default, but should we allow old info to be deleted at some cut-off point behind the active window? (By number of cycle points and/or by cycle point offset and/or by real time offset interval).

@hjoliver hjoliver added the question Flag this as a question for the next Cylc project meeting. label Jan 25, 2022
@hjoliver hjoliver added this to the cylc-8.x milestone Jan 25, 2022
@oliver-sanders
Copy link
Member

Related tickets:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Flag this as a question for the next Cylc project meeting.
Projects
None yet
Development

No branches or pull requests

2 participants