Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pre-aggregated field mappers #48578

Open
iverase opened this issue Oct 28, 2019 · 1 comment
Open

Pre-aggregated field mappers #48578

iverase opened this issue Oct 28, 2019 · 1 comment
Labels
:Analytics/Aggregations Aggregations >feature Meta Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo)

Comments

@iverase
Copy link
Contributor

iverase commented Oct 28, 2019

Meta issue to track the development of new field types which consist in pre-aggregated data. Similar to the hash, geo or completion data types, these would expect input data to adhere to some kind of complex format. Two new mapping fields are targeted:

  • Histograms: aggregation format for numeric fields.

  • HLLplus: cardinality aggregation format for numeric / keyword fields.

Behaviour at indexing time

This complex data structures won't be indexed but stored as a binary doc values. Therefore this fields cannot be using in search (except for exists query) but they can be used for aggregations.

Aggregations

The new field should be able to be used with standard aggregations. In addition they should be able to work with a combination of standard(raw) and pre-aggregated fields. In particular:

  • Histograms: They should be aggregated using percentiles and percentile_ranks aggregations.

  • HLLplus: They should be aggregated using cardinality aggregation,

Relates to #33214

@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-analytics-geo (:Analytics/Aggregations)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Analytics/Aggregations Aggregations >feature Meta Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo)
Projects
None yet
Development

No branches or pull requests

4 participants