Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Ballista] Wait based on available task slots #805

Closed
Dandandan opened this issue Aug 1, 2021 · 0 comments
Closed

[Ballista] Wait based on available task slots #805

Dandandan opened this issue Aug 1, 2021 · 0 comments
Labels
enhancement New feature or request performance Make DataFusion faster

Comments

@Dandandan
Copy link
Contributor

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
We can improve efficiency by avoiding polling and reducing sleep time.

Describe the solution you'd like
Wait some time until we have tasks available based on available_tasks_slots.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.
@Dandandan Dandandan added enhancement New feature or request performance Make DataFusion faster labels Aug 1, 2021
@Dandandan Dandandan mentioned this issue Aug 1, 2021
Closed
andygrove added a commit to andygrove/datafusion that referenced this issue Jan 31, 2025
@andygrove @eejbyfeldt
feat: Implement to_json for subset of types (apache#805)
9d86fa9 
* add skeleton for StructsToJson

* first test passes

* add support for nested structs

* add support for strings and improve test

* clippy

* format

* prepare for review

* remove perf results

* update user guide

* add microbenchmark

* remove comment

* update docs

* reduce size of diff

* add failing test for quotes in field names and values

* test passes

* clippy

* revert a docs change

* Update native/spark-expr/src/to_json.rs

Co-authored-by: Emil Ejbyfeldt <emil.ejbyfeldt@gmail.com>

* address feedback

* support tabs

* newlines

* backspace

* clippy

* fix test regression

* cargo fmt

---------

Co-authored-by: Emil Ejbyfeldt <emil.ejbyfeldt@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request performance Make DataFusion faster
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Ballista] Wait based on available task slots Dandandan/arrow-datafusion
1 participant
@Dandandan