Skip to content

[fix](inverted index) create empty idx file when creating a index on variant-type column (#50937) #51180

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
csun5285 wants to merge 5,131 commits into from
Closed

[fix](inverted index) create empty idx file when creating a index on variant-type column (#50937) #51180

csun5285 wants to merge 5,131 commits into from

Conversation

@csun5285
Copy link
Contributor

@csun5285 csun5285 commented May 23, 2025

pick from master #50937

github-actions bot and others added 30 commits April 22, 2025 10:59
@github-actions @Mryange
branch-3.0: [feature](function) support utf8 input in initcap apache#…
35548b4 
…49846 (apache#49933)

Cherry-picked from apache#49846

Co-authored-by: Mryange <yanxuecheng@selectdb.com>
@linrrzqqq @koi2000
branch-3.0: [Enhancement] Support some spatial functions (apache#48695)…
e7d4b9f 
… (apache#50061)

pick: apache#48695 and
apache#49665

---------

Co-authored-by: koi <koi20000@163.com>
@github-actions @suxiaogang223
branch-3.0: [fix](paimon) Covert Paimon DeletionFile Path to StorageP…
c2976b5 
…ath in fe apache#49645 (apache#49750)

Cherry-picked from apache#49645

Co-authored-by: Socrates <suyiteng@selectdb.com>
@github-actions @morningman
branch-3.0: [fix](meta) do not check replica allocation when replay a…
42d6afa 
…pache#49569 (apache#49603)

Cherry-picked from apache#49569

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
@github-actions @justfortaste
branch-3.0: [bugfix](hive) fix_hive_metastore_client_socket_timeout a…
dfad916 
…pache#47378 (apache#50222)

Cherry-picked from apache#47378

Co-authored-by: zhangyuan <ayuanzhang@tencent.com>
@github-actions @feiniaofeiafei
branch-3.0: [fix](nereids) fix generate column need add cast in strea…
ae32003 
…m load apache#49167 (apache#50029)

Cherry-picked from apache#49167

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
@924060929 @morrySnow
branch-3.0: [fix](Nereids) cse extract wrong expression from lambda e…
962c009 
…xpressions apache#49166 (apache#49941)

cherry pick from apache#49166

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
@bobhan1
branch-3.0-pick: [Fix](cloud-mow) Fix race between `CloudMetaMgr::syn…
750da9f 
…c_tablet_rowsets` and `CloudSchemaChangeJob::_convert_historical_rowsets` (apache#50051) (apache#50081)

pick apache#50051
@Jibing-Li
branch-3.0:[fix](nereids)Use utf-8 when convert string like literal t…
39e26d2 
…o double. (apache#50085) (apache#50153)

backport: apache#50085
@github-actions @airborne12
branch-3.0: [Fix](inverted index) fix rename column build index bug a…
d22a26e 
…pache#50056 (apache#50169)

Cherry-picked from apache#50056

Co-authored-by: airborne12 <jiangkai@selectdb.com>
@bobhan1
branch-3.0-pick: [Fix](cloud-mow) Handle tablet delete bitmap calcula…
a2a87f2 
…tion task's return value unifiedly in CloudEngineCalcDeleteBitmapTask::execute apache#50019 (apache#50045)

pick apache#50019
@eldenmoon
Branch-3.0 Cherry-pick [Fix](Variant) fix variant cast to jsonb into …
415c2fc 
…wrong NULL values (apache#50180) (apache#50234)

cherry-pick from apache#50180
@github-actions @BePPPower
branch-3.0: [fix](Export) fix the lock leak issue of Export apache#50088
328c694 
 (apache#50218)

Cherry-picked from apache#50088

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
@felixwluo
branch-3.0: [fix](agg) prevent core dump in ColumnArray::size_at when…
a461be6 
… handling type mismatch in streaming_agg_serialize_to_column apache#50001 (apache#50098)

Cherry-picked from: apache#50001
@github-actions @morningman
branch-3.0: [fix](hive/iceberg) rectify the fs name if path already c…
4d575fd 
…ontains fs apache#49998 (apache#50197)

Cherry-picked from apache#49998

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
@github-actions @yiguolei
branch-3.0: [enhancement](memoryfailed) throw exception instead of lo…
11fdbb5 
…g fatal during memory allocate failed apache#49876 (apache#49896)

Cherry-picked from apache#49876

Co-authored-by: yiguolei <guolei@selectdb.com>
@github-actions @zclllyybb
branch-3.0: [Fix](function) fix wrong length check of function array_…
45569bb 
…range apache#49993 (apache#49997)

Cherry-picked from apache#49993

Co-authored-by: zclllyybb <zhaochangle@selectdb.com>
@Jibing-Li
branch-3.0:[fix](statistics)No need to forward show table stats comma…
b6de049 
…nd. (apache#50207) (apache#50229)

backport: apache#50207
@zclllyybb
[branch-3.0](lock) Remove SpinLock compeletely (apache#49972)
e450a7d 
### What problem does this PR solve?

Issue Number: close #xxx

Related PR: apache#49872

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [x] No need to test or manual test. Explain why:
- [x] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [x] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [x] No.
- [ ] Yes. <!-- Add document PR link here. eg:
apache/doris-website#1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
@github-actions @feiniaofeiafei
branch-3.0: [fix](nereids) EliminateGroupByConstant should replace ag…
52c31d5 
…g's group by after removing constant group by keys apache#49473 (apache#50043)

Cherry-picked from apache#49473

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
@github-actions @hubgeter
branch-3.0: [fix](parquet)fix when hive_parquet_use_column_names=fals…
1db091a 
…e && read partition tb cause be core. apache#49966 (apache#50007)

Cherry-picked from apache#49966

Co-authored-by: daidai <changyuwei@selectdb.com>
@github-actions @hubgeter
branch-3.0: [fix](mc)Fixed the issue that maxcompute catalog can only…
a8fd878 
… read part of the timestamp data apache#49600 (apache#49705)

Cherry-picked from apache#49600

Co-authored-by: daidai <changyuwei@selectdb.com>
@morningman
branch-3.0: [fix](oss) the write to hive table on oss-hdfs may fail (a…
ebbe891 
…pache#49754) (apache#50284)

bp apache#49754
@github-actions @BePPPower
branch-3.0: [Fix](TrinoConnector) it will return error when query `in…
b2b0dae 
…formation_schema.tables` within `trino-connector` catalog apache#49912 (apache#50006)

Cherry-picked from apache#49912

Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
@github-actions @morningman
branch-3.0: [opt](hive) add option to get schema from table object ap…
8969a6b 
…ache#50038 (apache#50268)

Cherry-picked from apache#50038

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
@github-actions @wuwenchi
branch-3.0: [fix](iceberg) Fix the failure of creating a table in OBS a…
0577ffd 
…pache#49983 (apache#50018)

Cherry-picked from apache#49983

Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
@kaka11chen
branch-3.0: [chore] Updated submodule orc to orc-for-doris-21 branch. (…
ae11bd4 
…apache#50190)

[chore] Updated submodule orc to orc-for-doris-21 branch.
@morningman @hello-stephen
[deps](jindofs) add jindofs for 2.1 (apache#49259)(apache#49371)(apac…
8aff230 
…he#49374)(apache#49502)(apache#49503)(apache#49886)(apache#49903)(apache#49963) (apache#50283)

bp (apache#49259)(apache#49371)(apache#49374)(apache#49502)(apache#49503)(apache#49886)(apache#49903)(apache#49963)

---------

Co-authored-by: Dongyang Li <lidongyang@selectdb.com>
@github-actions @Yukang-Lian
branch-3.0: [Fix](compaction) Only print delete compaction log when t…
a72ce5e 
…here is a delete rowset apache#49953 (apache#50291)

Cherry-picked from apache#49953

Co-authored-by: abmdocrt <lianyukang@selectdb.com>
@github-actions @sollhui
branch-3.0: [fix](load) fix routine load job progress fallback after …
681ac90 
…FE master node restart apache#50221 (apache#50282)

Cherry-picked from apache#50221

Co-authored-by: hui lai <laihui@selectdb.com>
github-actions bot and others added 20 commits May 17, 2025 21:47
@github-actions @xy720
branch-3.0: [bug](cloud) Fix npe when show cluster load statistic apa…
25d7592 
…che#50866 (apache#50992)

Cherry-picked from apache#50866

Co-authored-by: xy720 <22125576+xy720@users.noreply.github.com>
@mrhhsg
[fix](jsonb) Avoid crashing caused by invalid path (apache#50978) (ap…
e06e252 
…ache#50994)

pick apache#50978
@zddr
branch-3.0: [fix](mtmv)before mtmv refresh,check column type if change (
69368b3 
apache#50768)

pick: apache#49041
@MoanasDaddyXu
branch-3.0: [Test](IAMROLE) update IAMROLE export cases (apache#51035)
23a5cd1
@github-actions @deardeng
branch-3.0: [fix](cloud) Add check for cluster_name empty in cloud ap…
8a3626c 
…ache#49775 (apache#50072)

Cherry-picked from apache#49775

Co-authored-by: deardeng <dengxin@selectdb.com>
@deardeng
branch-3.0: [fix](cloud) Some resource APIs should not check if clust…
aa67fd8 
…er_name is empty apache#50148 (apache#51046)

cherry pick from apache#50148
@github-actions @zddr
branch-3.0: [fix](meta) replace partition should not get table versio…
59b6c9e 
…n in cloud mode apache#50888 (apache#51027)

Cherry-picked from apache#50888

Co-authored-by: zhangdong <zhangdong@selectdb.com>
@github-actions @Yukang-Lian
branch-3.0: [Fix](compaction) Failed compaction tablets should sleep …
24c5767 
…before being selected again apache#50672 (apache#51030)

Cherry-picked from apache#50672

Co-authored-by: abmdocrt <lianyukang@selectdb.com>
@zy-kkk
branch-3.0: [hotfix](jdbc catalog) Fix jdbcclient repeated initializa…
ddbc99a 
…tion (apache#51037)

pick apache#51036
@mymeiyi
branch-3.0: [fix](group commit) reduce cpu cost for group_commit get_…
212cd8f 
…block apache#49822 (apache#51079)

pick apache#49822
@github-actions @morrySnow
branch-3.0: [fix](metadata) replace view will break view's metadata a…
53e33c8 
…pache#51058 (apache#51074)

Cherry-picked from apache#51058

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
@BiteTheDDDDt
[Improvement](memory) reduce some memtracker overhead (apache#50063) (a…
8bb8ec1 
…pache#51068)

pick from apache#50063
@xinyiZzz
branch-3.0: [fix](memory) Fix `ThreadMemTrackerMgr::limiter_mem_track…
42a3466 
…er()` performance (apache#50525)

pick apache#50462
@Yukang-Lian @Yoruet
[Cherry-pick](branch-3.0) Pick "[Feature](Compaction)Improve Compacti…
1992e53 
…on Profiling and Logging apache#50950" (apache#51125)

Pick apache#50950 

Co-authored-by: yoruet <1559650411@qq.com>
@github-actions @starocean999
branch-3.0: [fix](planner)comparing partition column name should be c…
819d39f 
…ase insensitive when pruning partition in DeleteJob apache#50674 (apache#51113)

Cherry-picked from apache#50674

Co-authored-by: starocean999 <lichi@selectdb.com>
@github-actions @csun5285
branch-3.0: [fix](case) fix some unstable p2 cases apache#50697 (apac…
1173e26 
…he#51064)

Cherry-picked from apache#50697

Co-authored-by: Sun Chenyang <sunchenyang@selectdb.com>
@github-actions @sollhui
branch-3.0: [improve](load) introduce black list of backend when load…
898fe41 
… job fetch meta to avoid jitter apache#50587 (apache#51043)

Cherry-picked from apache#50587

Co-authored-by: hui lai <laihui@selectdb.com>
@github-actions @924060929
branch-3.0: [fix](nereids) fix subquery unnest can not found aggregat…
566cc51 
…e slot apache#51086 (apache#51137)

Cherry-picked from apache#51086

Co-authored-by: 924060929 <lanhuajian@selectdb.com>
@csun5285
[fix](inverted index) create empty idx file when creating a index on …
b4a08bd 
…variant-type column (apache#50937)

create empty idx file when creating a index on variant-type column
@csun5285
pick fix
f7e6589
@hello-stephen
Copy link
Contributor

hello-stephen commented May 23, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@csun5285 csun5285 closed this May 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@gavinchou gavinchou Awaiting requested review from gavinchou gavinchou is a code owner

@dataroaring dataroaring Awaiting requested review from dataroaring dataroaring is a code owner

@w41ter w41ter Awaiting requested review from w41ter w41ter is a code owner

@morningman morningman Awaiting requested review from morningman morningman is a code owner

@yiguolei yiguolei Awaiting requested review from yiguolei yiguolei is a code owner

@xiaokang xiaokang Awaiting requested review from xiaokang xiaokang is a code owner

@CalvinKirs CalvinKirs Awaiting requested review from CalvinKirs CalvinKirs is a code owner

@BiteTheDDDDt BiteTheDDDDt Awaiting requested review from BiteTheDDDDt BiteTheDDDDt is a code owner

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.