v1.0.0

What's Changed

Accepted RFCs 🛫

• rfc: query result cache. by @RinChanNOWWW in #10014

Exciting New Features ✨

• feat(query): add information_schema for sharding-jdbc by @yufan022 in #9583
• feat(storage): update interpreter and storage support by @zhyass in #9261
• feat(optimizer): Improve cardinality estimation for join based on histogram by @xudong963 in #9594
• feat(storage): read_parquet page index. by @RinChanNOWWW in #9563
• feat(meta/sled): iter() iterate every tree and every records in theses trees by @drmingdrmer in #9621
• feat: improve filter cardinality evaluation by @xudong963 in #9625
• feat(meta/upgrade): meta data upgrade program by @drmingdrmer in #9489
• feat: update statistic during query execution by @xudong963 in #9633
• feat: enhance aggregator cardinality evaluation by @xudong963 in #9654
• feat(query): support named params for table functions. by @RinChanNOWWW in #9630
• feat(planner): Add switch to enable bushy join by @leiysky in #9657
• feat(fuse): add prewhere support in native storage format by @sundy-li in #9600
• feat: Add privilege check for insert/delete/optimize by @zhyass in #9664
• feat: Add oss storage option about presign_endpoint_url by @flaneur2020 in #9532
• feat(query): improve wrapped display by @sundy-li in #9692
• feat(query): enable empty projection by @sundy-li in #9675
• feat(sql): eliminate extra group by scalars by @sundy-li in #9708
• feat(query): add aggregate limit in final aggregate stage by @sundy-li in #9716
• feat(query): Add optional column names to create/alter view statement by @johnhaxx7 in #9715
• feat(pruning): add pruning stats to EXPLAIN by @BohuTANG in #9724
• feat(compression): change the table default compression from lz4 to zstd by @BohuTANG in #9730
• feat(format): fix TSV file format and tests by @BohuTANG in #9732
• feat(query): add topn runtime filter in native storage format by @sundy-li in #9738
• feat(storages): read_parquet uses OpenDAL for all IO operations. by @RinChanNOWWW in #9684
• feat:Feat cache bloom index obj by @dantengsky in #9712
• feat: add syntax about parsing presign options with content type by @flaneur2020 in #9771
• feat: read_parquet supports reading from remote locations. by @RinChanNOWWW in #9769
• feat: http handler not check utf8 when serialize results. by @youngsofun in #9815
• feat(query): enable hashtable state pass from partial to final by @sundy-li in #9809
• feat(query): support array concat by @TCeason in #9804
• feat: http handler always return JSON body. by @youngsofun in #9834
• feat(query): Support array functions prepend and append by @b41sh in #9844
• feat: add column id in TableSchema; use column id instead of index when read and write data by @lichuang in #9623
• feat(query):support array_indexof by @TCeason in #9840
• feat(query): Support view in system.columns by @johnhaxx7 in #9853
• feat(meta): add databend-meta config grpc_api_advertise_host by @drmingdrmer in #9835
• feat(query): support array function array_unique, array_distinct by @b41sh in #9875
• feat: select from stage with files/pattern. by @youngsofun in #9877
• feat: leverage sqllogictest to benchmark tpch by @xudong963 in #9887
• feat(expr): add Decimal128 and Decimal256 type by @andylokandy in #9856
• feat(storage): ParquetTable support topk optimization. by @RinChanNOWWW in #9824
• feat(parser): parse decimal type by @andylokandy in #9894
• feat(query): support array aggregate functions by @b41sh in #9903
• feat: Introduce OpenDAL native retry support by @Xuanwo in #9919
• feat: alter table add/drop column SQL support by @lichuang in #9851
• feat(query): new table function infer_schema. by @youngsofun in #9936
• feat(expr): disallow try_cast between unsupptored types by @andylokandy in #9949
• feat: default file format to Parquet. by @youngsofun in #9956
• feat(query): Support array_any functions by @b41sh in #9953
• feat(query): add privilege check for select by @yufan022 in #9924
• feat(decimal): add operation for decimal by @sundy-li in #9926
• feat(query): improve signed numeric keys by @sundy-li in #9978
• feat(mmap_allocator): change the mmap allocator inner allcator from GlobalAllocator to JEAllocator by @BohuTANG in #9981
• feat: stage table function support option FILE_FORMAT. by @youngsofun in #9983
• feat: Adopt OpenDAL's native scan support by @Xuanwo in #9985
• feat(allocator): print global allocator when server start by @BohuTANG in #9991
• feat(query): support array_sort by @TCeason in #9941
• feat: infer_schema support arg 'file_format'. by @youngsofun in #9997
• feat: bump up strawboat by @sundy-li in #9998
• feat(storagte): Add drop_table_by_id api by @johnhaxx7 in #9990
• feat: support to parse jwt metadata and add multiple identity issuer configuration by @ZhiHanZ in #9971
• feat: derive new filter and push down by @xudong963 in #10021
• feat(planner): Support EXPLAIN ANALYZE statement to profile query execution by @leiysky in #10023
• feat: support create file format. by @youngsofun in #10009
• feat: table data cache for object storage by @dantengsky in #9772
• feat: select from stage support uri with connection options. by @youngsofun in #10066
• feat: create stage, select stage, copy, infer_schema support named file format. by @youngsofun in #10084
• feat(query): type decimal support agg func min/max by @TCeason in #10085
• feat(doc): add decimal docs by @sundy-li in #10095
• feat(query): add sum/avg for decimal types by @sundy-li in #10059
• feat(pipeline): enrich core pipelines processors. by @RinChanNOWWW in #10098
• feat(storage): Use drop_table_by_id api in drop all by @johnhaxx7 in #10054
• feat(storage): native storage format support nested data types by @b41sh in #9798
• feat: add internal_merge_on_read_mutation config option by @dantengsky in #10130
• feat: Iceberg/create-catalog by @ClSlaid in #9017
• feat(query): query result cache by @RinChanNOWWW in #10042
• feat: Adopt OpenDAL's batch delete support by @Xuanwo in #10150
• feat(query): support multi-table query result cache. by @RinChanNOWWW in #10158
• docs(website): Add Baidu verification file by @Chasen-Zhang in #10163
• feat: support insert decimal. by @youngsofun in #10167
• feat: load/unload decimal with CSV/TSV/NDJSON by @youngsofun in #10176
• feat: store result cache as parquet file. by @RinChanNOWWW in #10187
• feat(query): not show SNAPSHOT_LOCATION when show create table by @xinlifoobar in #10164
• feat(query): support desc table with decimal type and support order by decmail type col by @TCeason in #10113
• feat(query): Support query result cache system table and table function by @ariesdevil in #10159
• feat(expression): support map data type by @b41sh in #10152
• feat(website): update website index styles by @Carlosfengv in #10175
• feat(query): add compare op for decimal types by @sundy-li in #10214
• feat(result cache): better the setting name and the desc by @BohuTANG in #10217
• feat: Add support for copying from webhdfs by @ClSlaid in #10156
• feat(website): update website index styles #10175 by @Carlosfengv in #10242
• feat(query): use decimal to store u128 u256 keys and support group by decimal by @sundy-li in #10237
• feat(query): Add rule - Push filter down to aggregate by @johnhaxx7 in #10240
• feat(planner): Introduce bitmap to record applied rules by @dusx1981 in #10024
• feat(query): support aggregate spill to object storage by @zhang2014 in #10273
• feat(query): query cache table function by @ariesdevil in #10256
• feat: Adopt OpenDAL's native write retry support by @Xuanwo in #10284
• feat(query): set returning function unnest. by @RinChanNOWWW in #10229
• feat(website): update blog post styles by @Carlosfengv in #10308
• feat: backend webhdfs by @ClSlaid in #10285
• feat(query): Support Map data type create table and insert values by @b41sh in #10238
• feat(query): support multiple unnest columns. by @RinChanNOWWW in #10312
• feat(planner): Push filter to sort by @johnhaxx7 in #10278
• feat(query): support decimal256 select insert by @TCeason in #10297

Thoughtful Bug Fix 🔧

• fix: sqllogic test hangs (cluster mod + clickhouse handler) by @dantengsky in #9615
• fix: ensure there is page index while using page index to filter pages. by @RinChanNOWWW in #9629
• fix(storage): fix range filter read stat with index by @b41sh in #9619
• fix(query): fix management empty schema by @sundy-li in #9638
• fix(planner): Fix stack overflow when applying RuleFilterPushDownJoin by @leiysky in #9645
• fix: change cost of right semi join by @xudong963 in #9662
• fix(query): fix hang when shutdown with metric api by @zhang2014 in #9666
• fix(query): fix efficiently_memory_final_aggregator result is not stable by @zhang2014 in #9685
• fix(query): fix max_result_rows only limit output results nums by @sandflee in #9661
• fix(hive): may get wrong datablocks if not sorted by output schema by @sandflee in #9470
• fix(tyck): fix missing simple_cast by @andylokandy in #9671
• fix(storage): bloom filter is using wrong cache key by @sundy-li in #9706
• fix(query): fix query hang in two level aggregator by @zhang2014 in #9694
• fix(max_file_size): fix up max_file_size may oom by @BohuTANG in #9740
• fix(query): fix and refactor aggregator by @sundy-li in #9748
• fix(tsv): fix tsv field with whitespace by @ariesdevil in #9752
• fix(metactl): when import data to meta-service dir, the specified "id" has to be one of the "initial_cluster" by @drmingdrmer in #9755
• fix(chore): Fix flaky tests by @leiysky in #9759
• fix(TSV): fix checking num of columns. by @youngsofun in #9758
• fix(query): fix memory leak for data port by @zhang2014 in #9762
• fix: Fix table_meta_cache can't be disabled by @Xuanwo in #9767
• fix(jemalloc): fix not linux and macos jemalloc fallback to std by @BohuTANG in #9786
• fix(query): fix panic when cast jsonb to string by @yufan022 in #9813
• fix: add connection options ACCESS_KEY_SECRET. by @youngsofun in #9838
• fix(procfs): fix on macos by @BohuTANG in #9858
• fix(query): fix slow planner when ndv error backtrace by @zhang2014 in #9876
• fix: order by contains aggregation function by @xudong963 in #9879
• fix(query): remove finished flag for avoid lost block by @zhang2014 in #9883
• fix(copy): fix not return error when copy by @ariesdevil in #9901
• fix: prevent panic when delete with subquery by @xudong963 in #9902
• fix(query): fix insert default value datatype by @sundy-li in #9816
• fix(functions): fix nullable and or domain cal by @sundy-li in #9928
• fix(functions): use and_filters instead of and in predicate by @sundy-li in #9932
• fix: add time travel test for alter table by @lichuang in #9939
• fix: type assertion failed on subquery by @xudong963 in #9937
• fix(shuffle): parts was not distributed evenly. by @youngsofun in #9951
• fix: enable outer join to inner join optimization by @xudong963 in #9943
• fix(write_settings): change compression to TableCompression::default() by @BohuTANG in #9982
• fix: fix sub-column of added-tuple column return default 0 bug by @lichuang in #9973
• fix: Reduce the extra stat API in list operations by @Xuanwo in #10013
• fix(privilege): add privileges on system.one to PUBLIC by default by @flaneur2020 in #10040
• fix: fix limit pushdown outer join by @xudong963 in #10043
• fix: fix add column update bug by @lichuang in #10037
• fix(storage): new bloom filter that bind index with Column Id instead of column name by @zhyass in #10022
• fix: ignore dropped column statistics by column id when reducing block statistics by @lichuang in #10051
• fix(storage): wrong column statistics when contain tuple type by @zhyass in #10068
• fix(cluster): fix limit query hang in cluster mode by @zhang2014 in #10006
• fix: config checking for obsoleted config options table_cache_bloom_index_data_bytes by @dantengsky in #10077
• fix(cluster): fix wrong error message 'abort query' by @zhang2014 in #10083
• fix(storage): compact not work as expected with add column by @zhyass in #10070
• fix: implementation of Default for config::CacheConfig should use values from inner::CacheConfig by @dantengsky in #10089
• fix(expr): no longer return Variant as common super type by @andylokandy in #9961
• fix: fix json parse timestamp when input is an integer by @ariesdevil in #10105
• fix(expr): allow auto cast from string and variant by @andylokandy in #10111
• fix: set tcp keepalive for mysql handler sockets by @dantengsky in #10141
• fix: join build blocks bug by @xudong963 in #10140
• fix: fix add column min\max stat bug by @lichuang in #10137
• fix(cluster): possible distributed deadlock when two nodes close input at same time by @zhang2014 in #10154
• fix: cargo machete by @b41sh in #10190
• fix(meta): when starting up, it should not try to register until leader node to be sync-ed to local store by @drmingdrmer in #10194
• fix: don't push down filter that contains derived column by @xudong963 in #10201
• fix: fix parse timestamp for row based format by @ariesdevil in #10192
• fix(query): fix query result cache system table by @ariesdevil in #10246
• fix: UnaryOp +/- should have high Precedence in PrattParser. by @youngsofun in #10260
• fix(query): fix view query from uri table function by @TCeason in #10241
• fix(rfc): add references. by @RinChanNOWWW in #10267
• fix(storage): optimize purge oom by @zhyass in #10257
• fix: result_scan not set query_id when meta_key is none by @ariesdevil in #10300
• fix(expr): resolve deadloop in #10216 by @andylokandy in #10287
• fix(doc): typo. by @youngsofun in #10320

Code Refactor 🎉

• refactor: Refine on_error mode by @ariesdevil in #9473
• refactor(parser): more strict parser for format_options. by @youngsofun in #9635
• refactor(storage/index): make the storage/index more index by @BohuTANG in #9648
• refactor(planner): remove PhysicalScalar by @andylokandy in #9587
• refactor(geo): Refine geo base functions by @ariesdevil in #9650
• refactor(planner): rename Scalar to ScalarExpr by @andylokandy in #9665
• refactor: move build options table & add unit test by @PsiACE in #9670
• refactor: refactor json path by @b41sh in #9693
• refactor: cache layer by @dantengsky in #9672
• refactor(io): move io constants to common/io by @BohuTANG in #9700
• refactor(pruning):pruner.rs -> fuse_bloom_pruner.rs by @BohuTANG in #9710
• refactor(io/read): refine fuse/io/read by @BohuTANG in #9711
• refactor(fuse/pruning): make pruner hierarchy to chain by @BohuTANG in #9714
• refactor: Avoid register_error_count in MetricsReader by @Xuanwo in #9744
• refactor(ast/expr/planner): unify Span and Result by @andylokandy in #9713
• refactor: remove unnecessary column data copy by @dantengsky in #9779
• refactor(meta): do not remove the last node from a cluster by @drmingdrmer in #9781
• refactor(meta/kvapi): KVApi should have an associated error type by @drmingdrmer in #9783
• refactor(executor): merge simple pipe and resize pipe by @zhang2014 in #9782
• refactor(meta): move kvapi to a standalone crate by @drmingdrmer in #9787
• refactor(meta/kvapi): expose a single "kvapi" as public interface by @drmingdrmer in #9791
• refactor(kvapi): remove dep common-base and common-exception; refine method names by @drmingdrmer in #9792
• refactor: 'select from stage' use ParquetTable. by @youngsofun in #9801
• refactor(kvapi): add KeyBuilder and KeyParser to build/parse str key by @drmingdrmer in #9822
• refactor(kvapi): biuld key with KeyBuilder, instead of with raw "format!" by @drmingdrmer in #9831
• refactor: ParquetTable list file in read_partition. by @youngsofun in #9871
• refactor(cluster): split exchange source to reader and deserializer by @zhang2014 in #9805
• refactor(metactl): when restoring a cluster from backup data, it does not require to specify grpc addresses by @drmingdrmer in #9878
• refactor(query): rename some array functions add array_ prefix by @b41sh in #9886
• refactor: Bump OpenDAL to v0.26 by @Xuanwo in #9897
• refactor(meta): remove obsolete meta service api read_msg() and write_msg() by @drmingdrmer in #9891
• refactor: TableArgs preserve info of positioned and named args by @youngsofun in #9917
• refactor(meta): simplify UserAPI and RoleAPI by introducing a method update_xx_with(id, f: FnOnce) by @drmingdrmer in #9921
• refactor(cluster): split and eliminate the status for exchange transform and sink by @zhang2014 in #9910
• refactor(meta): move application level types such as user/role/storage-config to crate common-meta/app by @drmingdrmer in #9944
• refactor(meta/kvapi): move kv req/reply types from meta-types to meta-kvapi by @drmingdrmer in #9950
• refactor(cluster): use bounded channel for exchange by @zhang2014 in #9930
• refactor: Introduction of FieldIndex and ColumnId types for clear differentiation of use by @lichuang in #10017
• refactor: fix abuse of ErrorCode by @drmingdrmer in #10056
• refactor: use transform_sort_merge use heap to sort blocks. by @RinChanNOWWW in #10047
• refactor: refactor is_nested column node by @lichuang in #10078
• refactor(meta/client): add compatible layer for upgrade by @drmingdrmer in #10082
• refactor: save default values in FuseTable instead of BlockReader by @lichuang in #10099
• refactor: Cmd::IncrSeq is never used, remove it by @drmingdrmer in #10102
• refactor: move AppError from common-meta-types to common-meta-app; move KVAppError from common-meta-types to common-meta-api by @drmingdrmer in #10112
• refactor: remove dependency of common-exceptionn from common-meta-types by @drmingdrmer in #10114
• refactor: remove unused RaftService API: write() by @drmingdrmer in #10115
• refactor(cluster): remove useless code by @zhang2014 in #10122
• refactor(cluster): serde packet without utf-8 in cluster by @zhang2014 in #10124
• refactor(query): use accumulating to impl single state aggregator by @zhang2014 in #10125
• refactor(planner): apply constant folder at physical plan builder by @andylokandy in #9889
• refactor(query): generic for aggregate hash table by @zhang2014 in #10131
• refactor(query): use HashMethodBounds to simplify generics bounds by @zhang2014 in #10134
• refactor(executor): destroy pull sink after pipeline finished by @zhang2014 in #10127
• refactor(cluster): support exchange sorting by @zhang2014 in #10149
• refactor: load and run old test suites when test query-meta compatibility by @drmingdrmer in #10153
• refactor: Adopt OpenDAL query based metadata cache by @Xuanwo in #10162
• refactor(executor): add check processor graph completed by @zhang2014 in #10166
• refactor: Move compress related code into databend by @Xuanwo in #10177
• refactor(cluster): support efficiently memory aggregate for cluster mode by @zhang2014 in #10151
• refactor(meta): upgrade openraft to 0.7.4 by @drmingdrmer in #10221
• refactor(query): refactor block meta and add block meta transform by @zhang2014 in #10234
• refactor(meta): move AppliedState from crate raft-store to meta-types by @drmingdrmer in #10261
• refactor(query): refactor aggregator by @zhang2014 in #10243
• refactor(query): Remove the v2 suffix of structs by @TCeason in #10291
• refactor(query): Drop useless setting by @TCeason in #10307

Build/Testing/CI Infra Changes 🔌

• ci: run sqllogictests with binary by @everpcpc in #9603
• ci: add test_stateful_cluster_linux for production by @xudong963 in #9627
• ci: support setup minio storage & external s3 storage in docker image by @everpcpc in #9676
• ci: fix env mismatch with docs in docker image by @everpcpc in #9689
• ci: force using template when QUERY_CONFIG_FILE is not set for docker image by @everpcpc in #9696
• ci: use IMDSv2 & show stats for sccache by @everpcpc in #9784
• ci: add test for select invalid utf8. by @youngsofun in #9819
• ci: build release in dev ci by @everpcpc in #9788
• ci: comment benchmark result on PR by @everpcpc in #9913
• ci: disable incremental build in CI by @xxchan in #9976
• ci: run benchmark for clickbench result format by @everpcpc in #10019
• ci(benchmark): run benchmark both s3 & fs by @everpcpc in #10050
• ci: release deb repository by @everpcpc in #10080
• ci: Fix log missing while timeout happened by @Xuanwo in #10121
• ci: Create artifacts tar inside target by @Xuanwo in #10123
• ci: Make sure query and meta has been killed before upload by @Xuanwo in #10128
• ci: move iceberg stateful tests by @ClSlaid in #10144
• ci: Install typos for databend CI by @Xuanwo in #10178
• ci: cargo sparse-registry is going to stablize by @Xuanwo in #10179
• ci: Fix typos-cli is not installed correctly by @Xuanwo in #10181
• ci: Fix cargo machete config by @Xuanwo in #10184
• ci: Add typos check in CI by @Xuanwo in #10188
• ci: fix hadoop-hive.env by @ClSlaid in #10250
• ci(benchmark): add benchmark for tpch by @everpcpc in #10264
• ci: Add seperated typos check by @Xuanwo in #10321

Documentation 📔

• docs: fix vague description by @soyeric128 in #9637
• docs: fix usecases by @soyeric128 in #9639
• docs(meta/upgrade): add doc for meta-upgrade by @drmingdrmer in #9641
• docs: update copyinto connection by @soyeric128 in #9649
• docs: reorder contributing docs with minor update by @PsiACE in #9651
• docs: add versioned dropdown by @PsiACE in #9652
• docs(weekly): add databend weekly 77 by @PsiACE in #9686
• docs(weekly): add this week in databend 78 by @PsiACE in #9739
• docs(update): add update by @BohuTANG in #9747
• docs: add note to minio deploy by @soyeric128 in #9756
• docs(readme): add feature rich by @BohuTANG in #9760
• docs: geo functions by @soyeric128 in #9774
• docs: update command by @soyeric128 in #9795
• docs: 0.9 release by @soyeric128 in #9825
• docs(release): add v0.9 changelog by @PsiACE in #9823
• docs: sccache blog by @soyeric128 in #9867
• docs: atomic and idempotency notes by @soyeric128 in #9868
• docs: added note for UPDATE by @soyeric128 in #9870
• docs(weekly): add this week in databend 79 by @PsiACE in #9872
• docs(meta/query): add picture to explain compatibility by @drmingdrmer in #9898
• docs(infer_schmea): add infer_schema to table functions catagory by @BohuTANG in #9942
• docs: change default format to Parquet. by @youngsofun in #9957
• docs(query): Trivial doc fix for to_start_of_week by @johnhaxx7 in #9960
• docs(weekly): add this week in databend 80 by @PsiACE in #9955
• docs(weekly): updated based by comments from eric by @PsiACE in #9979
• docs(unloading data): add unloading data from databend by @BohuTANG in #9996
• docs(array): add docs about array function by @sundy-li in #9999
• docs: unload updates by @soyeric128 in #10002
• docs(EXPLAIN): add EXPLAIN ANALYZE doc by @BohuTANG in #10027
• docs(query): Re-organize numeric functions doc by @johnhaxx7 in #10003
• docs(functions): reorg the functions style by @BohuTANG in #10030
• docs(website): refine the menu by @BohuTANG in #10031
• docs:add tuple data type by @wubx in #10026
• docs(blog): add profile-guided optimization by @PsiACE in #10032
• docs(scalar-functions): work with new expression by @PsiACE in #10046
• docs(functions): Re-organize hash function doc by @johnhaxx7 in #10058
• docs(type): change the order of datatypes by @BohuTANG in #10063
• docs(functions): re-organize conditional function doc by @Big-Wuu in #10064
• docs(agg-functions): work with new expression by @PsiACE in #10045
• docs(scalar-function): polished with eric's comments by @PsiACE in #10072
• docs(cache): add disk cache doc by @BohuTANG in #10076
• docs: changes alter functions example to make the function body reflect the name and match other doc examples by @cameronbraid in #10092
• docs: array function updates by @soyeric128 in #10091
• docs(weekly): add this week in databend 81 by @PsiACE in #10090
• docs(docker): add section how to connect by @everpcpc in #10093
• docs: add alter table add\drop column doc by @lichuang in #10094
• docs: refine the docs, analysis -> analytics by @BohuTANG in #10097
• docs(install): add install document with deb repo by @everpcpc in #10101
• docs: databend overview page by @soyeric128 in #10109
• docs: explain compatibility changes by @drmingdrmer in #10110
• docs(functions): Reorg the uuid functions style by @suyanhanx in #10116
• docs(functions): reorg Context functions style by @suyanhanx in #10117
• docs(website): remove weekly link by @BohuTANG in #10119
• docs(install): fix debian repo format for old version by @everpcpc in #10139
• docs: databend layers by @soyeric128 in #10142
• chore(storage): make native format support compaction/mutation by @sundy-li in #10135
• docs: copyright 2023 and minor update by @PsiACE in #10146
• docs: remove single quotes by @soyeric128 in #10170
• docs(weekly): add this week in databend 82 by @PsiACE in #10198
• docs: simple the index page by @BohuTANG in #10205
• docs(stage): stage table function and user defined file format. by @youngsofun in #10208
• docs(query stage): add more example by @BohuTANG in #10210
• docs: twitter from Datafuse_Labs to DatabendLabs by @BohuTANG in #10211
• docs: Deploying Databend on minio by @wubx in #10206
• docs(copy uri): add tab for URL/URI of COPY by @BohuTANG in #10218
• docs: remove i18n support by @PsiACE in #10219
• docs: reorder the chapter by @BohuTANG in #10231
• docs: fix link and improve some chapter by @BohuTANG in #10232
• docs:Update 15-metasrv-config.md by @wubx in #10224
• docs(develop): work with Databend driver by @PsiACE in #10236
• docs: fix typos by @soyeric128 in #10239
• docs: lift the decimal type under the number type by @BohuTANG in #10245
• docs: remove array and tuple from variant by @BohuTANG in #10247
• docs: Update decimal description by @sundy-li in #10252
• docs(functions):Re-organize conversions function doc by @wangjili8417 in #10255
• docs: update Golang development guide by @soyeric128 in #10258
• docs(functions): Re-organize Geography function doc by @wangjili8417 in #10268
• docs: update developer guides by @soyeric128 in #10270
• docs(IDENTIFIERS): add more example for the SQL IDENTIFIERS by @BohuTANG in #10277
• docs: refactor download instructions by @soyeric128 in #10288
• docs: fix typo by @soyeric128 in #10289
• docs: Update 2023-02-24-Deploy-databend-on-minio.md by @wubx in #10293
• docs: add document for grafana integration by @everpcpc in #10303
• docs: Some styling tweaks for Blog by @Carlosfengv in #10310
• docs: move blog ahead download by @BohuTANG in #10318
• docs: added blog bendsql by @soyeric128 in #10317
• docs: tips for install errors by @soyeric128 in #10316
• docs: Some styling tweaks for docs by @Carlosfengv in #10325
• docs: add performance page by @BohuTANG in #10324
• docs: Add Blog Contact us module by @Carlosfengv in #10330

Others 📒

• chore: move range filter test to right dir by @xudong963 in #9595
• chore(query): make opendal be workspace dep by @sundy-li in #9608
• chore: replace ## to # for comment in test file by @xudong963 in #9610
• chore(query): add DistinctToGroupBy by @sundy-li in #9612
• chore(query): remove extra projection if not need by @sundy-li in #9609
• chore: bump sqllogictest-0.11.1 by @xudong963 in #9602
• chore(query): add bloom filter supported data type by @TCeason in #9614
• chore: fix typo, "Confilct" -> "Conflict" by @dantengsky in #9622
• chore(sqllogictest): add log for http session by @xudong963 in #9643
• chore: regenerate test data by @ariesdevil in #9653
• chore: update tpch 9 by @xudong963 in #9655
• chore: rename ColumnLeaf to ColumnNode by @b41sh in #9660
• chore(planner): unify format of EXPLAIN FRAGMENTS by @leiysky in #9681
• chore: deny creating table with nullable nested type. by @RinChanNOWWW in #9680
• chore(sqllogictest): add sqllogic tests for management mode by @ariesdevil in #9683
• chore(deps): bump git2 from 0.15.0 to 0.16.1 by @dependabot in #9698
• chore(query): fix count distinct rewrite bug by @sundy-li in #9701
• chore: cleanup commented code (gc.rs) by @dantengsky in #9704
• chore(query): refactor hashtable by @sundy-li in #9703
• chore(fuse): add fuse pruning sql logic tests by @BohuTANG in #9719
• chore(fuse/metrics): add fuse pruning metrics by @BohuTANG in #9721
• chore(fuse/metrics): better the metrics name of pruning by @BohuTANG in #9722
• chore(fuse): refine the pruning stats by @BohuTANG in #9727
• chore(cache): fix cache name to lowercase by @BohuTANG in #9742
• chore(copy): make on_error default to abort by @ariesdevil in #9743
• chore(deps): bump ua-parser-js from 0.7.31 to 0.7.33 in /website by @dependabot in #9745
• chore(partitions): refine the context partition related function name by @BohuTANG in #9746
• chore(bumpalo): make bumpalo to workspace and bump to latest 3.12.0 by @BohuTANG in #9753
• chore(sqllogictest): add time cost by @BohuTANG in #9757
• chore(mem_allocator): remove inner allocator for JEAllocator by @BohuTANG in #9770
• chore(jemalloc): background_thread:true,metadata_thp:auto by @BohuTANG in #9776
• chore(meta): rename KVApiKey::to_key/from_key to to_string/from_str by @drmingdrmer in #9785
• chore(test): Add total count to sqllogic test console output by @johnhaxx7 in #9802
• chore: remove table function read_parquet. by @RinChanNOWWW in #9833
• chore(deps): bump http-cache-semantics from 4.1.0 to 4.1.1 in /website by @dependabot in #9845
• chore(query): improve types display by @sundy-li in #9848
• chore(query): add proc io stats by @sundy-li in #9850
• chore(query): fix macos build by @sundy-li in #9854
• chore(query): rename hashmap by @sundy-li in #9855
• chore(pipeline): refatctor the pipeline sink by @BohuTANG in #9862
• chore(pipeline): sources/src/processors/sources -> sources/ by @BohuTANG in #9863
• chore(planner): Cache RelationalProperty for SExpr by @leiysky in #9881
• chore(query): take two number after point for humanize number by @zhang2014 in #9880
• chore(deps): bump tokio from 1.23.1 to 1.24.2 by @dependabot in #9890
• chore(benchmark):add native format storage by @xudong963 in #9896
• chore(query): remove extra clone by @sundy-li in #9899
• chore: fix typo by @flaneur2020 in #9906
• chore: add test for delete with subquery by @xudong963 in #9912
• chore(query): configurable partitioned hashtable by @sundy-li in #9911
• chore(query): validate default value in create table by @sundy-li in #9916
• chore(benchmark):add steps to benchmark databend on s3 by @xudong963 in #9918
• chore(query): introduce TzLUT util by @sundy-li in #9920
• chore: move types, remove obsolete codes by @drmingdrmer in #9922
• chore: improve codes quality. by @RinChanNOWWW in #9915
• chore(benchmark): add analyze table before run benchmark by @xudong963 in #9931
• chore: upgrade bendsql to 0.3.0 for perf by @everpcpc in #9929
• chore(meta): avoid using MatchSeq::Any, use MatchSeq::GE(0) instead by @drmingdrmer in #9952
• chore(processor): add on_start and on_finish for transform by @zhang2014 in #9954
• chore(deps): bump loader-utils from 2.0.2 to 2.0.4 in /website by @dependabot in #9958
• chore(metactl/test): json output map keys in arbitrary order. Do not rely on the key order by @drmingdrmer in #9964
• chore(query): default enable broadcast join by @zhang2014 in #9962
• chore(ci): upload failure artifact when cancelled by @everpcpc in #9966
• chore: Adopt typos-cli and fix typos by @Xuanwo in #9967
• chore(proto-conv): fix panic unsupported type in to_pb by @BohuTANG in #9970
• chore(query): improve filter string kernel by @sundy-li in #9965
• chore(ci): fix check github event name for perf by @everpcpc in #9975
• chore(query): update string_multi_args by @sundy-li in #9984
• chore(query): add default feature jemalloc by @sundy-li in #9987
• chore(ci): make install_protobuf install latest protobuf version by @sundy-li in #9989
• chore(doc): remove the old version performance by @BohuTANG in #9995
• chore(query): make hashtable support TrustedLen trait by @sundy-li in #10001
• chore(ci): try force kill before upload by @everpcpc in #10004
• chore: refactor rule pushdown filter to join by @xudong963 in #10008
• chore(query): remove extra hashtable iter by @sundy-li in #10025
• chore(tpch): simple the TPC-H bench by @BohuTANG in #10028
• chore(ci): add permission to trusted workflow by @everpcpc in #10033
• chore(ci): trigger benchmark on release manually by @everpcpc in #10038
• chore(ci): only setup commit authors for query storage by @everpcpc in #10041
• chore(ci): fix remove redundant arg recursive by @everpcpc in #10044
• chore(ci): select min from more result values by @everpcpc in #10048
• chore(ci): fix download benchmark artifacts by @everpcpc in #10052
• chore(ci): fix checking benchmark source release by @everpcpc in #10053
• chore(ci): add storage type to bench mark system by @everpcpc in #10055
• chore(ci): change benchmark storage to machine instead of system by @everpcpc in #10057
• chore(ci): release deb for gnu with arm64&amd64 by @everpcpc in #10060
• chore(ci): generate report for nightly on release by @everpcpc in #10071
• chore: remove rebundant transform_limit.rs. by @RinChanNOWWW in #10073
• chore(ci): ignore file change error on uploading failure artifact by @everpcpc in #10074
• chore: enable delete tests for crdb suit by @xudong963 in #10075
• chore(ci): upload failure for sqllogic test by @everpcpc in #10086
• chore(cache): remove old cache code by @BohuTANG in #10096
• chore(config): make obsolete check from QueryConfig to Config by @BohuTANG in #10104
• chore(query): check meta set twice for data block by @zhang2014 in #10100
• chore(docs): remove clickhouse-cli in docs by @everpcpc in #10106
• chore(docs): uniformity cases in array-functions && adjust indention by @suyanhanx in #10120
• chore(deps): upgrade Arrow2 to fix nested data types read multiple pages by @b41sh in #10129
• chore(meta): explain meta - query compatibility by @drmingdrmer in #10138
• chore(ci): release with systemd units by @everpcpc in #10145
• chore(ci): fix build linux release flags by @everpcpc in #10157
• chore(ci): fix missing scripts for deb package by @everpcpc in #10160
• chore(ci): notify release build result by @everpcpc in #10161
• chore: Add more detailed panic information about singleton drops by @Xuanwo in #10168
• chore(query): use formatted AST to generate the result cache key. by @RinChanNOWWW in #10165
• chore(storage): remove unused codes and format some codes by @zhyass in #10169
• chore(ci): fix missing checkout for release notify by @everpcpc in #10172
• chore(query): Add prune cache for query by @sundy-li in #10155
• chore(dev): make protoc executable by @everpcpc in #10186
• chore(ci):fix make lint err by @TCeason in #10183
• chore(query): remove extra histogram_from_ndv for unused columns by @sundy-li in #10185
• chore(planner): merge map operator by @sundy-li in #10195
• chore: fix select from system.columns if there is a view from stage. by @RinChanNOWWW in #10200
• chore: make error msg of parquet schema miss match easier to read. by @youngsofun in #10209
• chore: only run subquery rewrite for sql contains subquery by @xudong963 in #10207
• chore: remove unused code. by @youngsofun in #10223
• chore(storage): limit the scan threads if there are small parts by @sundy-li in #10226
• chore(release): show chore label to release note by @BohuTANG in #10228
• chore(fuse): add get_max_page_size function to FuseTable by @BohuTANG in #10230
• chore(query): enable info level log for ci by @zhang2014 in #10235
• chore: reduce clone cost for SExpr by @xudong963 in #10244
• chore: fixup meta-upgrade-90 tests, the version expected is now 30 by @drmingdrmer in #10249
• chore: improve DSqlLogicTestError code by @xudong963 in #10251
• chore: clean tpch test by @xudong963 in #10254
• chore(docs): update docs by @sundy-li in #10274
• chore(query): make tpch queries run on decimal by @sundy-li in #10216
• chore(query): add register_additional_cast_rules for timestamp/date by @sundy-li in #10276
• chore(tool): support navicat for mysql 16 connect to databend by @TCeason in #10279
• chore(query): fix merge Rule, add default transformation to be true by @sundy-li in #10281
• chore: delete useless code by @xudong963 in #10282
• chore(ci): fix sync benchmark report for tpch by @everpcpc in #10283
• chore(ci): fix update results for release benchmark by @everpcpc in #10299
• chore(query): add more error messages of binder by @sundy-li in #10298
• chore(website): Some styling tweaks for Blog by @Carlosfengv in #10309
• chore(planer): correct transrormation to transformation by @sandflee in #10302
• chore(query): refine result_scan error messages by @ariesdevil in #10315
• chore(expr): respect overload order for function factories by @andylokandy in #10313
• chore(query): update avg decimal by @sundy-li in #10319
• chore(ci): fix download release benchmark report by @everpcpc in #10327

New Contributors

• @johnhaxx7 made their first contribution in #9715
• @Big-Wuu made their first contribution in #10064
• @cameronbraid made their first contribution in #10092
• @suyanhanx made their first contribution in #10116
• @xinlifoobar made their first contribution in #10164
• @Carlosfengv made their first contribution in #10175
• @wangjili8417 made their first contribution in #10255
• @dusx1981 made their first contribution in #10024

Full Changelog: v0.9.0-nightly...v1.0.0-nightly