-
Notifications
You must be signed in to change notification settings - Fork 1.7k
Consolidate feature flags into configuration guide #14657
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
| - `compression`: reading files compressed with `xz2`, `bzip2`, `flate2`, and `zstd` | ||
| - `crypto_expressions`: cryptographic functions such as `md5` and `sha256` | ||
| - `datetime_expressions`: date and time functions such as `to_timestamp` | ||
| - `encoding_expressions`: `encode` and `decode` functions |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There were also a few missing items here
| - `crypto_expressions`: cryptographic functions such as `md5` and `sha256` | ||
| - `datetime_expressions`: date and time functions such as `to_timestamp` | ||
| - `encoding_expressions`: `encode` and `decode` functions | ||
| - `math_expressions`: `sqrt` and other math functions |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This doesn't appear to be in the defaults list here:
datafusion/datafusion/core/Cargo.toml
Line 49 in 40bb75f
| default = [ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That was an excellent call. I fixed it in df190ad
However, I think since the subcrates already have their own default features, it is likely not possible to remove these various functon packages 🤔 maybe we should fix that in a following issue
| - `parquet`: support for reading the [Apache Parquet] format | ||
| - `regex_expressions`: regular expression functions, such as `regexp_match` | ||
| - `unicode_expressions`: Include unicode aware functions such as `character_length` | ||
| - `unparser`: enables support to reverse LogicalPlans back into SQL |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This doesn't appear to be in the defaults list here:
datafusion/datafusion/core/Cargo.toml
Line 49 in 40bb75f
| default = [ |
|
|
||
| ### Default features: | ||
|
|
||
| - `nested_expressions`: functions for working with nested type function such as `array_to_string` |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Would this be better in alphabetical order?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Great idea -- done in 6654168
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you @dhegberg for the review
| - `crypto_expressions`: cryptographic functions such as `md5` and `sha256` | ||
| - `datetime_expressions`: date and time functions such as `to_timestamp` | ||
| - `encoding_expressions`: `encode` and `decode` functions | ||
| - `math_expressions`: `sqrt` and other math functions |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That was an excellent call. I fixed it in df190ad
However, I think since the subcrates already have their own default features, it is likely not possible to remove these various functon packages 🤔 maybe we should fix that in a following issue
|
|
||
| ### Default features: | ||
|
|
||
| - `nested_expressions`: functions for working with nested type function such as `array_to_string` |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Great idea -- done in 6654168
|
Thank you for your contribution. Unfortunately, this pull request is stale because it has been open 60 days with no activity. Please remove the stale label or comment or this will be closed in 7 days. |
|
This is a good ticket and shouldn't be autoclosed. |
|
Yeah it just needs a committer to review I think |
Which issue does this PR close?
Rationale for this change
I am trying to improve the docs (inspired by recent PRs)
Let's try and consolidate as much of the documentation into the same set of docs so it isn't spread all over
What changes are included in this PR?
Are these changes tested?
I tested them manually

Are there any user-facing changes?