Initial code for plugin based on opensearch-plugin-template-java#3

Merged

msfroh merged 32 commits intoopensearch-project:mainfrom kevinawskendra:main

Nov 4, 2022

+3,600

Commits on Jul 18, 2022

Commits on Oct 7, 2022

Rename files related to semantic-reranker plugin
Mahita Mahesh
committed
Create structure for semantic reranker plugin and add preprocessing step to split document source content into passages
Mahita Mahesh
committed
Implement BM25 util class for scoring passages.

kevinawskendra
authored and
Mahita Mahesh
committed
Implement logic to get top k passages and pass queryText to action listener.

kevinawskendra
authored and
Mahita Mahesh
committed
Implement logic to call external service with top passages and reorder hits based on response, add plugin security policy.

kevinawskendra
authored and
Mahita Mahesh
committed
Add custom plugin setting for enabling/disabling and logic to use that setting.

kevinawskendra
authored and
Mahita Mahesh
committed
Add initial aws sdk integration with credentials.

kevinawskendra
authored and
Mahita Mahesh
committed
Add aws sdk dependencies missed in previous commit.

kevinawskendra
authored and
Mahita Mahesh
committed
Implement basic query extraction logic to extract queryText and bodyField from the OS query.

kevinawskendra
authored and
Mahita Mahesh
committed
Temporarily disable license, third party, logger usage checks
Mahita Mahesh
committed
Add unit tests for text splitter
Mahita Mahesh
committed
Limit maximum number of passages generated by text splitter
Mahita Mahesh
committed
Fetch source for reranking only, if disabled in request
Mahita Mahesh
committed
Handle edge case pagination/scrolling and add new setting for endpointId.

kevinawskendra
authored and
Mahita Mahesh
committed
Implement http call to AWS service.

kevinawskendra
authored and
Mahita Mahesh
committed
Support request-level enable/disable of reranking call overriding index level setting
Mahita Mahesh
committed
Use tokenized passages in request
Mahita Mahesh
committed
Update naming convention to Kendra Intelligent Ranking
Mahita Mahesh
committed

Commits on Oct 10, 2022

Address comments, update licenses and javadoc
Mahita Mahesh
committed

Commits on Oct 11, 2022

Add AssumeRole support when calling Kendra, rename client settings, and remove unused KendraClient.
kevinawskendra
committed

Commits on Oct 12, 2022

Support Kendra body field configuration at index and request level
Mahita Mahesh
committed
Bug fix: Make enabled field in ext Boolean type to support null and not default to false
Mahita Mahesh
committed

Commits on Oct 18, 2022

Update API request structure, call rescore API, fix passage splitting bug.
kevinawskendra
committed

Commits on Oct 20, 2022

Update to use raw HTTP URI for Kendra.
kevinawskendra
committed

Commits on Oct 25, 2022

Remove test file with duplicate of BM25ScorerTests to fix failing build
Mahita Mahesh
committed
Refactor to generic, extensible Transformer interface and rename plugin
Mahita Mahesh
committed
Use rescore execution plan ID in raw HTTP URI for Kendra
Mahita Mahesh
committed

Commits on Oct 27, 2022