[Feature Request]: Performance optimization for full text search if there are many terms #1320
Closed
1 task done
Labels
feature request
New feature or request
Comments
|
Fix by #1342 |
JinHai-CN
pushed a commit
that referenced
this issue
Nov 28, 2024
### What problem does this PR solve? Add BatchOrIterator for fulltext search, which calculates BM25 scores in batch. Issue link:#1320 ### Type of change - [x] New Feature (non-breaking change which adds functionality) - [x] Refactoring
JinHai-CN
pushed a commit
that referenced
this issue
Dec 4, 2024
### What problem does this PR solve? Update fulltext query builder Apply BatchOrIterator when necessary Issue link:#1320 ### Type of change - [x] New Feature (non-breaking change which adds functionality) - [x] Refactoring - [x] Performance Improvement
JinHai-CN
pushed a commit
that referenced
this issue
Dec 6, 2024
### What problem does this PR solve? Update file io for fulltext search Disable log in phrase iterator in release build Issue link:#1320 ### Type of change - [x] Refactoring - [x] Performance Improvement
vsian
pushed a commit
to vsian/infinity
that referenced
this issue
Dec 13, 2024
### What problem does this PR solve? Update fulltext query builder Apply BatchOrIterator when necessary Issue link:infiniflow#1320 ### Type of change - [x] New Feature (non-breaking change which adds functionality) - [x] Refactoring - [x] Performance Improvement
vsian
pushed a commit
to vsian/infinity
that referenced
this issue
Dec 13, 2024
### What problem does this PR solve? Update file io for fulltext search Disable log in phrase iterator in release build Issue link:infiniflow#1320 ### Type of change - [x] Refactoring - [x] Performance Improvement
3 tasks
JinHai-CN
pushed a commit
that referenced
this issue
Dec 13, 2024
### What problem does this PR solve? Now BlockMaxWandIterator can accept both TermDocIterator and PhraseDocIterator as children Issue link:#1320 ### Type of change - [x] New Feature (non-breaking change which adds functionality) - [x] Refactoring - [x] Performance Improvement
3 tasks
JinHai-CN
pushed a commit
that referenced
this issue
Dec 24, 2024
### What problem does this PR solve? Update IDF formula for PhraseDocIterator reference: https://lucene.apache.org/core/10_1_0/core/org/apache/lucene/search/similarities/BM25Similarity.html#idfExplain(org.apache.lucene.search.CollectionStatistics,org.apache.lucene.search.TermStatistics[]) Issue link:#1320 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) - [x] Refactoring - [x] Test cases
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Is there an existing issue for the same feature request?
Is your feature request related to a problem?
No response
Describe the feature you'd like
Either BMW or BMM could not skip efficiently if the query contains too many clauses. Optimizations are required for these scenarios
Describe implementation you've considered
No response
Documentation, adoption, use case
No response
Additional information
No response
The text was updated successfully, but these errors were encountered: