Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incremental Aggregation: Optimize the within condition by adding group by elements (and other elements available in persisting tables) #491

Closed
ChariniNana opened this issue Aug 21, 2017 · 0 comments · Fixed by #1310

Comments

@ChariniNana
Copy link
Contributor

When retrieving from an aggregator, we execute the within condition first and then execute the on condition on its results. This could be optimized by including compare conditions which concern group by attributes and other attributes available in the internal aggregate stores as well.
i.e. When there's an avg function in the aggregator, it would be internally stored as sum and count. Hence we can't do above, if the on condition is something similar to "on avgPrice > 100". However, the said optimization is applicable if the on condition is similar to "on symbol == 'WSO2'", where 'symbol' is a group by attribute (since group by attributes are stored internally as well).

@niveathika niveathika changed the title Incremental Processing: Optimize the within condition by adding group by elements (and other elements available in persisting tables) Incremental Aggregation: Optimize the within condition by adding group by elements (and other elements available in persisting tables) May 3, 2019
@mohanvive mohanvive added this to the 5.0.1 milestone Jun 29, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants