Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

reverse merge #13

Merged
merged 255 commits into from
Aug 2, 2024
Merged

reverse merge #13

merged 255 commits into from
Aug 2, 2024

Conversation

deepthi912
Copy link
Owner

No description provided.

dependabot bot and others added 30 commits June 7, 2024 11:15
#13342)

* support deleteColumn for compactionTask by extending the record reader

* format
* Refactor ADSS querysubmission stats to avoid missing servers

* Address review comments.
…bles (#13107)

* [Backfill] allow externally partitioned segment uploads for upsert tables

* upload segment with partitionId

* revise uploaded realtime segment name convention
…cord (#13352)

* extend CompactedPinotSegmentRecordReader so that it can skip deleteRecord
yashmayya and others added 29 commits July 19, 2024 19:00
* Checkpoint

* Checkpoint

* Add javadocs for new interfaces.

* Code linting and java docs.

* Add two quick starts for resource tracking.

* Add a javadoc

* Dont serialize thread info

* Add auth to query debug resource
* Fix flaky gauge value issue

* add UTs
* Fix query response time metric

As of PR #13179, the query response time metrics started to get extremely high for
all tables. The root cause tured out to be a missed initialization in which
the query arrival time was set to 0 by default.

The refactor broke the contract that the broker request handler always returns the
time taken to handle the request.

Added code to initialize the arrival time.

Since the refactor attempted to include client pre-processing time, added this code
under the condition that the value is not already set.

Ideally, callers of the method should add on their own pre and post-processing time
to the time returned by the handleRequest() method.

* Changed as per review comments and offline discussion

* Added comments
* Refactor PinotSchemaRestletResource for repetitive code around schema json parsing and access

* Changes as per the PR comment.
* Build profiles for aarch64

* Add license header

* Checkstyle

* Download netty libs using the right OS classifier

* Revert "Download netty libs using the right OS classifier"

This reverts commit d77d166.

* SkipTests on ARM progamatically
* enable parallel background refresh for lucene text index

* lint

* address comments
…3649)

* Use debug logs in case we run into rate limit exceeded exception

* lower kinesis rate limit

* Fix exception

---------

Co-authored-by: Kartik Khare <kharekartik@Kartiks-MacBook-Pro.local>
…able query parser (#13003)

* Support custom Lucene analyzer with arguments and custom query parser

* Add Apache license header to CsvParserTest.java

* Adjusted dependency import order for javax.annotation.Nullable in CsvParser.java

* Applied mvn spotless:apply on CsvParserTest.java

* Correct a spelling mistake in the comments in RealtimeLuceneTextIndex.java

* Adjusted parsing methods naming to improve clarity in TextIndexUtils.java

* Removed redundant reflection logic in TextIndexUtils.java

* Removed redundant string replacement Streaming pipeline in CsvParser.java

* Break up long line over 120 char into two lines in TextIndexUtils.java

* Adjusted the scenarios of when default Analyzers with custom arguments should be used.

* Emit Class.getName() instead of Class.getCanonicalName() in logs within RealtimeLuceneTextIndex.java

* Moved `||` operator in if condition to a new line to resolve style issue.

* Addressed code review concerns from @Bill-hbrhbr

* Fix style error.

* Fix unit test.

* Run maven spotless:apply

* Patched argument parsing bug.

* Updated PR with latest code base.

* Addressed comments from @chenboat

* Fix build issues resulting from merge conflicts

* Removed trailing white-space

* Fix style-check errors

* Fix default Stopwords default initialization values

* Refactored builder code in unit test inside LuceneMutableTextIndexTest.java

Signed-off-by: Jack Luo <jluo14@ext.uber.com>

* Fix style bug

Signed-off-by: Jack Luo <jluo14@ext.uber.com>

---------

Signed-off-by: Jack Luo <jluo14@ext.uber.com>
@deepthi912 deepthi912 merged commit 9cb2bc2 into deepthi912:master Aug 2, 2024
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.