-
Notifications
You must be signed in to change notification settings - Fork 3.7k
[feat](outfile) support compression type for csv format in outfile and export #55392
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Thank you for your contribution to Apache Doris. Please clearly describe your PR:
|
|
run buildall |
Cloud UT Coverage ReportIncrement line coverage Increment coverage report
|
FE UT Coverage ReportIncrement line coverage |
TPC-H: Total hot run time: 34035 ms |
TPC-DS: Total hot run time: 187301 ms |
ClickBench: Total hot run time: 33.67 s |
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
|
run buildall |
Cloud UT Coverage ReportIncrement line coverage Increment coverage report
|
FE UT Coverage ReportIncrement line coverage |
TPC-H: Total hot run time: 34579 ms |
TPC-DS: Total hot run time: 187294 ms |
ClickBench: Total hot run time: 33.62 s |
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
|
run buildall |
Cloud UT Coverage ReportIncrement line coverage Increment coverage report
|
TPC-H: Total hot run time: 33968 ms |
TPC-DS: Total hot run time: 187601 ms |
ClickBench: Total hot run time: 33.47 s |
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
|
run buildall |
Cloud UT Coverage ReportIncrement line coverage Increment coverage report
|
TPC-H: Total hot run time: 34411 ms |
TPC-DS: Total hot run time: 187416 ms |
ClickBench: Total hot run time: 33.68 s |
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
FE Regression Coverage ReportIncrement line coverage |
wm1581066
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
|
PR approved by anyone and no changes requested. |
|
PR approved by at least one committer and no changes requested. |
…d export (#55392) ### What problem does this PR solve? Outfile: ``` select * from tbl1 into outfile "file:///tmp/my_file_" FORMAT AS CSV PROPERTIES ( "compress_type" = "gzip" ); ``` Export: ``` EXPORT TABLE test_export_csv TO "file:///tmp/test_" PROPERTIES( "label" = "l4", "format" = "csv", "column_separator"=",", "compress_type" = "gzip" ); ``` Now support "plain", "gz", "bz2", "snappyblock", "lz4block", "zstd"
Followup #55392 Change gzip to gz, bzip2 to bz2. So that tools like `gunzip` can recognize it directly
Followup #55392 Change gzip to gz, bzip2 to bz2. So that tools like `gunzip` can recognize it directly
…apache#58090) ### What problem does this PR solve? Related PR: apache#55392 Problem Summary: Support compression when outfile with `csv_with_names` and `cvs_with_names_and_types`
What problem does this PR solve?
Outfile:
Export:
Now support "plain", "gz", "bz2", "snappyblock", "lz4block", "zstd"
Release note
None
Check List (For Author)
Test
Behavior changed:
Does this need documentation?
Check List (For Reviewer who merge this PR)