Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Action Validation framework and Explain API integration #441

Merged
merged 46 commits into from
Oct 14, 2022
Merged

Action Validation framework and Explain API integration #441

merged 46 commits into from
Oct 14, 2022

Commits on Aug 18, 2022

  1. initial framework 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    8bae0e3 View commit details
    Browse the repository at this point in the history

  2. Removed recursion from Explain Action to avoid stackoverflow in some … 

    …situations (opensearch-project#419)

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
Signed-off-by: Joanne Wang <jowg@amazon.com>
    @petardz @jowg-amazon
    petardz authored and jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    60edc73 View commit details
    Browse the repository at this point in the history

  3. enabled by default integrated 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    0060bf0 View commit details
    Browse the repository at this point in the history

  4. cleaned up comments and logs, created unit test and updated previous … 

    …integration tests

Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    2aa150a View commit details
    Browse the repository at this point in the history

  5. added delete validation logic 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    8add902 View commit details
    Browse the repository at this point in the history

  6. fixed rollover validation unit tests 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    9041646 View commit details
    Browse the repository at this point in the history

  7. added validation info field to ManagedIndexMetaData 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    0cda31a View commit details
    Browse the repository at this point in the history

  8. removed step context as input 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    daa7cdb View commit details
    Browse the repository at this point in the history

  9. added validationmetadata class 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    acec69f View commit details
    Browse the repository at this point in the history

  10. restored old integration tests and changed validation service output 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    78eabc9 View commit details
    Browse the repository at this point in the history

  11. before integrated validation meta data into managed index meta data 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    31d7d45 View commit details
    Browse the repository at this point in the history

  12. integrated validation meta data 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    8515efd View commit details
    Browse the repository at this point in the history

  13. working version 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    3771eca View commit details
    Browse the repository at this point in the history

  14. added validation mapping 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    1492da9 View commit details
    Browse the repository at this point in the history

  15. fixed integ tests 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    2905ddf View commit details
    Browse the repository at this point in the history

  16. renamed some values 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    aceaf52 View commit details
    Browse the repository at this point in the history

  17. before removing from managed index meta data 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    c5cd789 View commit details
    Browse the repository at this point in the history

  18. created validation result object in explain 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    e060642 View commit details
    Browse the repository at this point in the history

  19. testing 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    28e8715 View commit details
    Browse the repository at this point in the history

  20. run fails 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    5e5244c View commit details
    Browse the repository at this point in the history

  21. integration test for delete + added framework for force merge 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    e1ff73a View commit details
    Browse the repository at this point in the history

  22. removed step validation metadata and still testing explain results 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    ace4998 View commit details
    Browse the repository at this point in the history

  23. before removing from managed index runner 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    2a1203e View commit details
    Browse the repository at this point in the history

  24. removed from managed index runner 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    b0fc77c View commit details
    Browse the repository at this point in the history

  25. clean up and tests 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    bfb0c39 View commit details
    Browse the repository at this point in the history

  26. all validation tests pass 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    a3edbe9 View commit details
    Browse the repository at this point in the history

  27. removed validation result from all managed index meta data 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    06cd2fc View commit details
    Browse the repository at this point in the history

  28. restored old IT tests 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    40e5f8e View commit details
    Browse the repository at this point in the history

  29. fixed it tests, set explain validation to false 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    71a2b9f View commit details
    Browse the repository at this point in the history

  30. clean up 

    Signed-off-by: Joanne Wang <jowg@amazon.com>
    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    9169b5b View commit details
    Browse the repository at this point in the history

  31. Merge branch 'error-prevention-dev' into explainIntegration

    @jowg-amazon
    jowg-amazon committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    880a1bc View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2022

  1. Change test page size to avoid index/search TimeInMillis < 1 issue. (o… 

    …pensearch-project#460)

* Change test page size to avoid indexTimeInMillis < 1 issue.

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Change test page size to avoid indexTimeInMillis < 1 issue.

Signed-off-by: Angie Zhang <langelzh@amazon.com>

Signed-off-by: Angie Zhang <langelzh@amazon.com>
    @Angie-Zhang
    Angie-Zhang committed Aug 23, 2022
    Configuration menu
    Copy the full SHA
    307ed55 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2022

  1. Transform maxclauses fix (opensearch-project#477) 

    * transform maxClauses fix

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added bucket log to track processed buckets

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* various renames/changes

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* fixed detekt issues

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added comments to test

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* removed debug logging

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* empty commit to trigger checks

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reduced pageSize to 1 in few ITs to avoid flaky tests; fixed bug where pagesProcessed was calculated incorrectly

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted pagesProcessed change; fixed few ITs

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
    @petardz
    petardz committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    7475cfd View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2022

  1. 483: Updated detekt plugin and snakeyaml dependency. Updated a code t… ( 

    opensearch-project#485)

* 483: Updated detekt plugin and snakeyaml dependency. Updated a code to reduce the number of issues after static analysis

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 483: Updated snakeyaml version to use the latest

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
    @stevanbz
    stevanbz committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    ed6ed10 View commit details
    Browse the repository at this point in the history

  2. Remove HOST_DENY_LIST usage as Notification plugin will own it (opens… 

    …earch-project#471)

(opensearch-project#107)

Signed-off-by: Xuesong Luo <lxuesong@amazon.com>

Signed-off-by: Xuesong Luo <lxuesong@amazon.com>
    @xluo-aws
    xluo-aws committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    39be4e3 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2022

  1. Disable detekt because of the CVE (opensearch-project#497) 

    Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
    @bowenlan-amzn
    bowenlan-amzn committed Sep 8, 2022
    Configuration menu
    Copy the full SHA
    50ac1e9 View commit details
    Browse the repository at this point in the history

  2. Deprecate Master nonmenclature (opensearch-project#501) 

    Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
    @bowenlan-amzn
    bowenlan-amzn committed Sep 8, 2022
    Configuration menu
    Copy the full SHA
    a9d04ec View commit details
    Browse the repository at this point in the history

  3. [AUTO] Increment version to 2.3.0-SNAPSHOT (opensearch-project#484) (o… 

    …pensearch-project#503)
    @opensearch-trigger-bot
    opensearch-trigger-bot[bot] committed Sep 8, 2022
    Configuration menu
    Copy the full SHA
    4275b9f View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2022

  1. fix#921-README-forum-link-index_mgmnt (opensearch-project#499) 

    Signed-off-by: cwillum <cwmmoore@amazon.com>

Signed-off-by: cwillum <cwmmoore@amazon.com>
    @cwillum
    cwillum committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    79214a2 View commit details
    Browse the repository at this point in the history

  2. 64: Added rounding when using aggreagate script for avg metric. Added… ( 

    opensearch-project#490)

* 64: Added rounding when using aggreagate script for avg metric. Added unit tests for checking average aggregations against the target rollup index

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 64: Rollup job renamed

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 64: Removed unrelevant metrics for the avg calculation test

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
    @stevanbz
    stevanbz committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    fadc553 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2022

  1. Revert Disable detekt and force choose snakeyml 1.32 (opensearch-proj… 

    …ect#528)

* Revert Disable detekt: 50ac1e9

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Remove force choosing snakeyml 1.31

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Force snakeyaml 1.32

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Empty commit

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>
    @deshsidd
    deshsidd committed Sep 30, 2022
    Configuration menu
    Copy the full SHA
    943c32b View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2022

  1. Added 2.3 release note (opensearch-project#507) (opensearch-project#515… 

    …) (opensearch-project#517)

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

Signed-off-by: Angie Zhang <langelzh@amazon.com>
(cherry picked from commit d9793ac)
Signed-off-by: Angie Zhang <langelzh@amazon.com>

Signed-off-by: Angie Zhang <langelzh@amazon.com>
(cherry picked from commit 7217b5b)

Co-authored-by: Angie Zhang <langelzh@amazon.com>
    @opensearch-trigger-bot
    opensearch-trigger-bot[bot] and Angie Zhang committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    2e4cf58 View commit details
    Browse the repository at this point in the history

  2. Add 2.2 release note (opensearch-project#450) (opensearch-project#452) ( 

    opensearch-project#516)

* Add 2.2 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Add 2.2 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

Co-authored-by: Angie Zhang <langelzh@amazon.com>
(cherry picked from commit 8eb5da6)
Signed-off-by: Angie Zhang <langelzh@amazon.com>

Signed-off-by: Angie Zhang <langelzh@amazon.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
    @lezzago
    Angie Zhang and lezzago committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    b09ec6a View commit details
    Browse the repository at this point in the history

  3. Adds plugin version sweep background job (opensearch-project#434) 

    * [207]: Added 5 min scheduled job for sweeping ISM plugin version in the case of version discrepancy

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* [207]: Created pluginVersionSweepCoordinator component responsible for scheduling the skip execution task. Annotated tests in order to prevent thread leak error during integrational tests

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* [207]: Increased retry period for background job that sets the skip flag up to 5 mins

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* Empty-Commit

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
Co-authored-by: Stevan Buzejic <buzejic.stevan@gmail.com>
    @downsrob @stevanbz
    downsrob and stevanbz committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    4d844fa View commit details
    Browse the repository at this point in the history

  4. flaky transform test fix attempt (opensearch-project#542) 

    * flaky transform test fix attempt

Signed-off-by: Petar Dzepina <petar.dzepina@vroom.com>

* accidental paste fix

Signed-off-by: Petar Dzepina <petar.dzepina@vroom.com>

Signed-off-by: Petar Dzepina <petar.dzepina@vroom.com>
Co-authored-by: Petar Dzepina <petar.dzepina@vroom.com>
    @petardz
    petardz and Petar Dzepina committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    5217af0 View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2022

  1. Merge branch 'error_prevention_dev' into explainIntegration

    Angie Zhang committed Oct 13, 2022
    Configuration menu
    Copy the full SHA
    6f74e73 View commit details
    Browse the repository at this point in the history