Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add batch force commit #4

Draft
wants to merge 168 commits into
base: master
Choose a base branch
from
Draft

Add batch force commit #4

wants to merge 168 commits into from
+13,602 −6,575

Conversation

noob-se7en
Copy link
Owner

Instructions:

  1. The PR has to be tagged with at least one of the following labels (*):
    1. feature
    2. bugfix
    3. performance
    4. ui
    5. backward-incompat
    6. release-notes (**)
  2. Remove these instructions before publishing the PR.

(*) Other labels to consider:

  • testing
  • dependencies
  • docker
  • kubernetes
  • observability
  • security
  • code-style
  • extension-point
  • refactor
  • cleanup

(**) Use release-notes label for scenarios like:

  • New configuration options
  • Deprecation of configurations
  • Signature changes to public methods/interfaces
  • New plugins added or old plugins removed

dependabot bot and others added 30 commits January 6, 2025 18:19
@dependabot
Bump com.nimbusds:nimbus-jose-jwt from 10.0 to 10.0.1 (apache#14759)
c7c4cb1
@dependabot
Bump software.amazon.awssdk:bom from 2.29.44 to 2.29.45 (apache#14760)
cad5cf8
@vvivekiyer
Fix logger class (apache#14763)
88805f2
@abhioncbr
Updated more packages in License-binary (apache#14757)
3ee3dd4
@gortiz
Timestamp in MSE (apache#14690)
6e9a70f
@gortiz
Improve resiliency when executor plugins are loaded (apache#14747)
e5d2417
@tibrewalpratik17
Config for max output segment size in UpsertCompactMerge task (apache…
4588f8c 
…#14742)

* Config for max output segment size in UpsertCompactMerge task

* address comments
@gortiz
[Spool] Actual implementation (apache#14507)
3adcedb
@dependabot
Bump software.amazon.awssdk:bom from 2.29.45 to 2.29.46 (apache#14768)
8558436
@dependabot
Bump com.diffplug.spotless:spotless-maven-plugin from 2.43.0 to 2.44.0 (
5cdfe44 
apache#14769)
@dependabot
Bump commons-codec:commons-codec from 1.17.1 to 1.17.2 (apache#14770)
083d62c
@tibrewalpratik17
Remove default use of outputSegmentMaxSize in UpsertCompactMerge task (…
82bf63c 
…apache#14766)
@dependabot
Bump okio.version from 3.9.1 to 3.10.0 (apache#14767)
edc89a4
@ankitsultana
[perf] Run Inverted Index Before Other Operators (apache#14764)
0600185
@xiangfu0
Add Schema to the PinotTaskGenerator validateTaskConfigs method call (a…
6b1ccc5 
…pache#14683)
@dependabot
Bump commons-beanutils:commons-beanutils from 1.9.4 to 1.10.0 (apache…
55fc3e5 
…#14776)
@dependabot
Bump okio.version from 3.10.0 to 3.10.1 (apache#14777)
070115b
@dependabot
Bump com.diffplug.spotless:spotless-maven-plugin from 2.44.0 to 2.44.1 (
bd7dc48 
apache#14778)
@yashmayya
Allow adding and subtracting timestamp types in the multi-stage engine (
09cce36 
apache#14782)
@dependabot
Bump software.amazon.awssdk:bom from 2.29.46 to 2.29.47 (apache#14775)
2a7322b
@Jackie-Jiang
Allow setting ForwardIndexConfig default settings via cluster config (a…
a8c3107 
…pache#14773)
@gortiz
improve broker selector utils (apache#14733)
6a8bdb5
@mqliang
Enhance SegmentStatusChecker to honor no-queryable servers and instan…
5dd6f8a 
…ce assignment config (apache#14536)
@chrajeshbabu
Make use of move APIs instead of copy segments from staging director…
10de3d0 
…y to output directory in the SparkSegmentGenerationJobRunner apache#14746 (apache#14755)
@lnbest0707-uber
Cleanup and converge V1 and V2 SchemaConformingTransformer (apache#14772
af46700 
)
@dependabot
Bump com.google.re2j:re2j from 1.7 to 1.8 (apache#14793)
92c8348
@dependabot
Bump nl.jqno.equalsverifier:equalsverifier from 3.18 to 3.18.1 (apach…
c3b22b2 
…e#14792)
@dependabot
Bump eclipse.jetty.version from 9.4.56.v20240826 to 9.4.57.v20241219 (a…
d580c45 
…pache#14791)
@dependabot
Bump okio.version from 3.10.1 to 3.10.2 (apache#14790)
5ad39f9
@dependabot
Bump org.apache.httpcomponents.core5:httpcore5 from 5.3.1 to 5.3.2 (a…
e3093c6 
…pache#14789)
dependabot bot and others added 30 commits January 23, 2025 18:56
@dependabot
Bump org.jetbrains:annotations from 26.0.1 to 26.0.2 (apache#14906)
a8f8abe
@dependabot
Bump org.apache.datasketches:datasketches-java from 6.1.1 to 6.2.0 (a…
52f55e8 
…pache#14905)
@noob-se7en
Merge branch 'update_forceCommit_status' of github.com:Harnoor7/pinot…
01604e9 
… into add_batch_force_commit
@xiangfu0
Configure final reduce phase threads for heavy aggreagtion functions (a…
4967780 
…pache#14662)

* Configure final reduce phase threads for heavy aggreagtion functions

* Address comments

* Add tests with numThreadsForFinalReduce
@jasperjiaguo
safe copy in local pinot fs (apache#14883)
e0ec848 
* safe copy in local pinot fs

* make suffix a constant

* fix backup del

* add restoration

* format

* code style

* address comments

* address comments

* add special exception

* add special exception

* copy to tmp file and rename

* use a backup file and delete it

* refactoring

* refactoring

* refactoring

* remove crc

* remove crc

* refactor time stamp
@noob-se7en
Updates forceCommit APIs to handle Pauseless (apache#14828)
c9e08f3
@yashmayya
Rework MSE query throttling to take into account estimated number of …
c239952 
…threads used by a query (apache#14847)
@yashmayya
Upgrade AWS SDK to 2.30; update tests to disable default integrity pr…
dfd8b1b 
…otection (apache#14909)
@noob-se7en
Merge branch 'master' of github.com:apache/pinot into add_batch_force…
bb84ae2 
…_commit
@noob-se7en
Attempts to fix test
71f4ee1
@noob-se7en
attempt to fix test
2408d13
@noob-se7en
Addresses PR comments
ff67929
@noob-se7en
Adds timeout and interval query parameters in API
80dda07
@noob-se7en
nit
11299f4
@noob-se7en
fixes lint
ad7aec0
@noob-se7en
Adds unit test
7ea5535
@noob-se7en
nit
5ea7c3f
@noob-se7en
Addresses PR comments
6907c8f
@noob-se7en
attempts to fix test
2a61ce4
@noob-se7en
speeds up test
445efbc
@noob-se7en
Attempts to fix test
444fc49
@noob-se7en
nit
e7ab323
@noob-se7en
addresses PR comments and attempts to fixe test
5c186d8
@noob-se7en
nit
6110a5a
@noob-se7en
fixes lint
f2fbd4b
@noob-se7en
nit
1d5af84
@noob-se7en
nit
92c771d
@noob-se7en
nit
b14e2af
@Jackie-Jiang
Misc fix and cleanup
de52012
@Jackie-Jiang
Add missing empty line
5b78c1b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.