-
Notifications
You must be signed in to change notification settings - Fork 3.7k
[cherry-pick][feature](load) new ingestion load (#45937) #46092
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
### What problem does this PR solve? Problem Summary: Ingestion Load is used to load pre-processed data into doris. Preprocessing refers to writing the result data to an external storage system after the data is processed according to the partitioning, bucketing and aggregation methods defined by the doris table. The preprocessing is completed by the external system, and then the BE reads the data and converts it into segment files and saves it. The basic flow is as follows:  ### Release note [feature](load) new ingestion load (cherry picked from commit 6580f6b)
|
Thank you for your contribution to Apache Doris. Please clearly describe your PR:
|
|
run buildall |
TPC-H: Total hot run time: 41058 ms |
TPC-DS: Total hot run time: 197853 ms |
ClickBench: Total hot run time: 32.67 s |
|
We're closing this PR because it hasn't been updated in a while. |
Cherry-picked from #45937