-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
scan if in memory is too much #38
Labels
enhancement
New feature or request
Comments
Step 1: Make execute funtion lazy from start to finish |
AnatolyBuga
added a commit
that referenced
this issue
Nov 17, 2022
…s only. This is to allow streaming feature on driver. If not cfg streaming then thoe LazyFrame will be collected
When streaming atm UI wouldn't allow to override "prepared" columns such as risk weight. Perhaps add an overridable method to the DataSet trait which would return Vec of added overridable columns. |
AnatolyBuga
added a commit
that referenced
this issue
Jul 5, 2023
…taSet, with new columns hardcoded #38
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
It's possible clients will have too much data to hold it in memory all the time. For such usecases we can try to provide an option for lazy scans, leveraging on with_streaming.
Pros:
Cons:
The text was updated successfully, but these errors were encountered: