Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Speed up reducing auto_date_histo with a time zone #57933

Merged
merged 1 commit into from
Jun 10, 2020

Conversation

nik9000
Copy link
Member

@nik9000 nik9000 commented Jun 10, 2020

When reducing auto_date_histogram we were using Rounding#round
which is quite a bit more expensive than

Rounding.Prepared prepared = rounding.prepare(min, max);
long result = prepared.round(date);

when rounding to a non-fixed time zone like America/New_York. This
stops using the former and starts using the latter.

Relates to #56124

When reducing `auto_date_histogram` we were using `Rounding#round`
which is quite a bit more expensive than
```
Rounding.Prepared prepared = rounding.prepare(min, max);
long result = prepared.round(date);
```
when rounding to a non-fixed time zone like `America/New_York`. This
stops using the former and starts using the latter.

Relates to elastic#56124
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-analytics-geo (:Analytics/Aggregations)

@elasticmachine elasticmachine added the Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) label Jun 10, 2020
@nik9000
Copy link
Member Author

nik9000 commented Jun 10, 2020

I don't think this is going to amount to a huge speedup, but I'd like to completely remove Rounding.round and this is one of the big users.

Copy link
Member

@not-napoleon not-napoleon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@nik9000 nik9000 merged commit 992ab28 into elastic:master Jun 10, 2020
@nik9000
Copy link
Member Author

nik9000 commented Jun 10, 2020

Thanks @not-napoleon !

nik9000 added a commit to nik9000/elasticsearch that referenced this pull request Jun 10, 2020
When reducing `auto_date_histogram` we were using `Rounding#round`
which is quite a bit more expensive than
```
Rounding.Prepared prepared = rounding.prepare(min, max);
long result = prepared.round(date);
```
when rounding to a non-fixed time zone like `America/New_York`. This
stops using the former and starts using the latter.

Relates to elastic#56124
nik9000 added a commit that referenced this pull request Jun 11, 2020
… (#57958)

When reducing `auto_date_histogram` we were using `Rounding#round`
which is quite a bit more expensive than
```
Rounding.Prepared prepared = rounding.prepare(min, max);
long result = prepared.round(date);
```
when rounding to a non-fixed time zone like `America/New_York`. This
stops using the former and starts using the latter.

Relates to #56124
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Analytics/Aggregations Aggregations >enhancement Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) v7.9.0 v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants