Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Customisable cluster snapshot with sql and filter fun per table #296

Open
shamis opened this issue Oct 15, 2019 · 0 comments
Open

Customisable cluster snapshot with sql and filter fun per table #296

shamis opened this issue Oct 15, 2019 · 0 comments
Assignees

Comments

@shamis
Copy link
Member

shamis commented Oct 15, 2019

Default cluster snapshot implementation (existing)

  • Takes snapshot of the tables in the configured list [{imem,imem_snap,snapshotClusterTables}]
  • Puts these snapshots a folder and zips the folder
  • executes everyday at [{imem,imem_snap,snapshotClusterHourOfDay}]
  • can be enabled or disabled with [{imem,imem_snap,snapshotCluster}]

New feature : support for custom cluster snapshot

  • list of sqls (instead of table names). gives more control over data
  • filter fun associated with each sql to filter the data after the execution of sql to remove certain rows or modify them
  • configuration flag to enable and disable the custom snapshot
  • configuration for cluster snapshot zip file name
c-bik added a commit that referenced this issue Oct 24, 2019
c-bik added a commit that referenced this issue Oct 24, 2019
stoch pushed a commit that referenced this issue Dec 16, 2019
* WIP

* zipping re-worked

* added eunits #296

* WIP integrated #296

* new tests (failing)

* algo re-implemented

* all passing tests

* fixed ZipFile structure typo

* fixed hasWild recurese early exit

* tuple walk fixed

* code cleanup
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants