[feat](index) Ann Index #54276
Merged
[feat](index) Ann Index #54276
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Contributor
|
Thank you for your contribution to Apache Doris. Please clearly describe your PR:
|
zhiqiang-hhhh
force-pushed
the
vec-rebase-vslot-ref
branch
from
34f125e to
fdd49ad
Compare
Contributor
Author
|
run buildall |
zhiqiang-hhhh
force-pushed
the
vec-rebase-vslot-ref
branch
from
5fc6332 to
e2c8fb9
Compare
Contributor
Author
|
run buildall |
zhiqiang-hhhh
force-pushed
the
vec-rebase-vslot-ref
branch
from
e2c8fb9 to
babc892
Compare
Contributor
Author
|
run buildall |
zhiqiang-hhhh
force-pushed
the
vec-rebase-vslot-ref
branch
from
babc892 to
dc9091f
Compare
Contributor
Author
|
run buildall |
zhiqiang-hhhh
force-pushed
the
vec-rebase-vslot-ref
branch
from
dc9091f to
c2bf0c2
Compare
Contributor
Author
|
run buildall |
Contributor
Cloud UT Coverage ReportIncrement line coverage Increment coverage report
|
zhiqiang-hhhh
force-pushed
the
vec-rebase-vslot-ref
branch
3 times, most recently
from
11601d9 to
0f3a54c
Compare
Contributor
Author
|
run buildall |
Contributor
Cloud UT Coverage ReportIncrement line coverage Increment coverage report
|
Contributor
FE UT Coverage ReportIncrement line coverage |
zhiqiang-hhhh
force-pushed
the
vec-rebase-vslot-ref
branch
2 times, most recently
from
46d76be to
346b9e5
Compare
Contributor
Author
|
run buildall |
Cloud UT Coverage ReportIncrement line coverage Increment coverage report
|
Contributor
FE UT Coverage ReportIncrement line coverage |
zhiqiang-hhhh
force-pushed
the
vec-rebase-vslot-ref
branch
from
38ee758 to
45ef37d
Compare
Contributor
Author
|
run buildall |
zhiqiang-hhhh
requested review from
dataroaring,
gavinchou and
yiguolei
as code owners
Contributor
FE UT Coverage ReportIncrement line coverage |
Contributor
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
Contributor
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
Contributor
Author
|
run p0 |
Contributor
Author
|
run feut |
Contributor
FE UT Coverage ReportIncrement line coverage |
Contributor
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
Contributor
|
PR approved by at least one committer and no changes requested. |
github-actions
bot
added
the
approved
Contributor
|
PR approved by anyone and no changes requested. |
zzzxl1993
approved these changes
Aug 21, 2025
This was referenced Aug 22, 2025
16 tasks
16 tasks
airborne12
pushed a commit
that referenced
this pull request
Nov 20, 2025
### What problem does this PR solve?
This PR add `CREATE INDEX` and `BUILD INDEX` sql syntax for ANN index
i.e.
```sql
CREATE INDEX [IF NOT EXISTS] <ann_index_name>
ON <table_name> (<column_name>)
USING ANN
[PROPERTIES ("<key>" = "<value>"[ , ...])]
[COMMENT '<index_comment>']
BUILD INDEX <ann_index_name> ON <table_name> [partition_list]
```
Related PR: #54276
airborne12
pushed a commit
to airborne12/apache-doris
that referenced
this pull request
Dec 3, 2025
…#55586) This PR add `CREATE INDEX` and `BUILD INDEX` sql syntax for ANN index i.e. ```sql CREATE INDEX [IF NOT EXISTS] <ann_index_name> ON <table_name> (<column_name>) USING ANN [PROPERTIES ("<key>" = "<value>"[ , ...])] [COMMENT '<index_comment>'] BUILD INDEX <ann_index_name> ON <table_name> [partition_list] ``` Related PR: apache#54276
nagisa-kunhah
pushed a commit
to nagisa-kunhah/doris
that referenced
this pull request
Dec 14, 2025
…#55586) ### What problem does this PR solve? This PR add `CREATE INDEX` and `BUILD INDEX` sql syntax for ANN index i.e. ```sql CREATE INDEX [IF NOT EXISTS] <ann_index_name> ON <table_name> (<column_name>) USING ANN [PROPERTIES ("<key>" = "<value>"[ , ...])] [COMMENT '<index_comment>'] BUILD INDEX <ann_index_name> ON <table_name> [partition_list] ``` Related PR: apache#54276
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
9 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What problem does this PR solve?
Introducing Ann index to doris.
This pull request introduces foundational support for ANN (Approximate Nearest Neighbor) vector index functionality in the storage engine, including new runtime structures, configuration options, and initial integration with the build system. The changes lay the groundwork for ANN-based search and statistics collection, and begin integrating ANN index support into various storage and query execution paths.
The implementation of ann index is based on faiss.
Faiss could return distance directly, so this pr using virtual slot ref to return result from index.
Each data segment of doris will have a faiss index if user creates a table with Ann index, and new segment generated by compaction will have a faiss index automatically.
Currently, create index and build index is not supported, index defination be added to ddl if you want it.
ANN Index Feature Integration:
AnnIndexStats,AnnIndexParam,RangeSearchParams,RangeSearchResult, and others inann_search_params.h, as well asRangeSearchRuntimeInfofor managing ANN range search context. [1] [2] [3]StorageReadOptionsandRowsetReaderContextto includeann_topn_runtimefor passing ANN runtime information through the storage read path. [1] [2] [3]OlapReaderStatisticsfor monitoring ANN index operations.Build System and Dependency Updates:
doris-faissanddoris-openblasas submodules for ANN/vector index support, and integrated the newVectorlibrary into the build process and as a dependency for relevant targets. [1] [2] [3] [4]Index Handling and Schema Integration:
SegmentFlusherto usehas_extra_index()(supporting both inverted and ANN indexes) instead ofhas_inverted_index(). [1] [2] [3] [4]Configuration:
opm_threads_limitto control the maximum number of OpenMP threads used per Doris thread, which is relevant for vectorized/ANN computation. [1] [2]These changes set up the infrastructure required for future development of ANN vector index features, including search, filtering, and statistics collection.
Release note
None
Check List (For Author)
Test
Behavior changed:
Does this need documentation?
Check List (For Reviewer who merge this PR)