Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clean up MyriaSysTemp tables #847

Open
jortiz16 opened this issue Aug 16, 2016 · 1 comment
Open

Clean up MyriaSysTemp tables #847

jortiz16 opened this issue Aug 16, 2016 · 1 comment
Assignees

Comments

@jortiz16
Copy link
Contributor

Users have reported that MyriaSysTemp tables might stay in Postgres in cases when there is a failed (or canceled?) ingest. Depending on the size of the relation, these tables take up room and there is no direct way to delete or access them.

We need to figure out an automated way to clean up these tables and decide when to do it. @mbalazin suggested calling this clean up operation as a query (through use of the DbExecute operator). That way, the user knows this clean up happened.

If we want to do this automatically, here are some options:

  1. At a Myria restart
  2. After a worker recovers

Any others?

Tagging: @shrjain @senderista @jingjingwang

@senderista
Copy link
Contributor

For now, how about checking for and deleting these tables during worker initialization? Then a global garbage collection is as simple as a restart of the Myria service.

@senderista senderista self-assigned this Aug 16, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants