Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

reverse merge #25

Merged
merged 15 commits into from
Sep 19, 2024
Merged

reverse merge #25

merged 15 commits into from
Sep 19, 2024

Conversation

deepthi912
Copy link
Owner

No description provided.

anandheritage and others added 15 commits September 18, 2024 07:25
Change the way scheam is copied in RealtimeSegmentConverter to keep column base nullability
This commit includes several changes in the code that builds, serializes and deserializes DataBlocks in order to improve the performace.

Changes here should not change the binary format (test included verify that). Instead we've changed how the code to reduce allocation and copies.
With classrealms there will be much more control over the classloaders.
Next to the shaded plugins, a plugin-directory may contain a pinot-plugin.properties (to switch from PluginClassloader to ClassRealms).

if there is no pinot-plugin.properties, the original behavior is used.
if there is a pinot-plugin.properties, a classrealm will be created: every direct file or directory in the plugin-directory will be added to the classrealm.

It is possible to let shaded plugins use a classrealm. In that case the classes in the shaded jar will be loaded before the system classloader (as done by the PluginLoader).

this implementation doesn't unpack plugin-zips as created with the assembly descriptor. Instead is assumes it is unpacked before pinot starts.
This profile is enabled in GHA, but coverage won't be executed by default
Prevent recompilation of code due to fmpp-maven-plugin inefficiencies
* Storage quota imposition on realtime tables

* fix test mock

* Handle IS update failure case

* refactor

* tests

* move quota checker to PinotLLCRealtimeSegmentManager

* test fix

* Add tableStorageQuotaExceeded gauge on controller

* refactor to use PauseState

* revert TABLE_STORAGE_QUOTA_EXCEEDED metric

* cosmetic

* refactors

* check consuming segments only when table is not paused

* refactor
…rt data view (#13992)

* tracking newly added segments on server to handle the race condition when server starts to process a segment ahead of broker adding it to routing table
@deepthi912 deepthi912 merged commit 610a85d into deepthi912:JsonProperty Sep 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants