Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Format] Incremental query execution #459

Closed
lidavidm opened this issue Feb 15, 2023 · 0 comments · Fixed by #971
Closed

[Format] Incremental query execution #459

lidavidm opened this issue Feb 15, 2023 · 0 comments · Fixed by #971

Comments

@lidavidm
Copy link
Member

Flight RPC/Flight SQL is proposing a way to execute queries and get back results incrementally, instead of waiting for the entire query to finish: https://lists.apache.org/thread/247z3t06mf132nocngc1jkp3oqglz7jp

We should reflect that capability here.

Proposal

Add a new option that can be enabled on statements. When enabled, ExecutePartitions will return whenever new partition(s) are available, instead of blocking and returning only when the query is finished. (Query progress/cancellation are handled by #458.) If no partitions are returned, then the query is finished.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
No open projects
Development

Successfully merging a pull request may close this issue.

1 participant