Skip to content
This repository was archived by the owner on Aug 23, 2023. It is now read-only.

when writing old data, we hammer cassandra index with metricdef updates #561

Closed
Dieterbe opened this issue Mar 8, 2017 · 2 comments
Closed

Comments

@Dieterbe
Copy link
Contributor

Dieterbe commented Mar 8, 2017

we set the LastUpdate field based on the timestamp of the data, but compare it against wall clock time.
so if a user creates a new series, and starts writing data from a month ago until now, or when writing data just generally lags behind current clock time by more than 2*updateInterval, we will constantly update the index (both in memory and cassandra) with every point that we receive.

maybe something to think about when working on #559

@Dieterbe
Copy link
Contributor Author

Dieterbe commented Mar 8, 2017

some ideas:

  1. we could keep track of the number of points too since we last updated cassandra. and only update if $lastUpdate-time-clause AND update was at least X points ago
  2. compare LastUpdate against timestamp of current point, not against wall clock time.

@woodsaj
Copy link
Member

woodsaj commented Mar 27, 2017

closed by #574

@woodsaj woodsaj closed this as completed Mar 27, 2017
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants