Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert "Support task resource tracking in OpenSearch" #3046

Merged
merged 1 commit into from
Apr 25, 2022

Conversation

dblock
Copy link
Member

@dblock dblock commented Apr 22, 2022

Reverts #2639 given build break failures.

@tushar-kharbanda72

@dblock dblock requested review from a team and reta as code owners April 22, 2022 18:37
@dblock dblock force-pushed the revert-2639-resource-tracker-integration branch from 9d764b6 to a863800 Compare April 22, 2022 18:38
@opensearch-ci-bot
Copy link
Collaborator

❌   Gradle Check failure 9d764b6605ac1c7f22d6021b20d3dc7c9aabbe7d
Log 4725

Reports 4725

@opensearch-ci-bot
Copy link
Collaborator

❌   Gradle Check failure a8638002600db6fa36388e57680d9401513f3c72
Log 4726

Reports 4726

@kotwanikunal
Copy link
Member

Could not determine the dependencies of task ':testCodeCoverageReport'.
> Could not resolve all task dependencies for configuration ':allCodeCoverageReportClassDirectories'.
    > Could not find org.apache.lucene:lucene-core:9.2.0-snapshot-f4f1f70.

@nknize
Copy link
Collaborator

nknize commented Apr 22, 2022

Could not determine the dependencies of task ':testCodeCoverageReport'.

Could not resolve all task dependencies for configuration ':allCodeCoverageReportClassDirectories'.
> Could not find org.apache.lucene:lucene-core:9.2.0-snapshot-f4f1f70.

Depends on #3042

@nknize nknize force-pushed the revert-2639-resource-tracker-integration branch from a863800 to 52e1c57 Compare April 22, 2022 19:25
This reverts commit 6517eec.

Signed-off-by: dblock <dblock@amazon.com>
Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
@nknize nknize force-pushed the revert-2639-resource-tracker-integration branch from 52e1c57 to 156208f Compare April 22, 2022 19:26
@nknize
Copy link
Collaborator

nknize commented Apr 22, 2022

Just rebased. I often forget I have to add my sign-off due to gpg signing. An added layer of security I really like but not that friendly w/ our DCO check. I'd really love to explore gpg sign-off as an added requirement for the project that adds extra security auditing w/o ridiculous overhead for new contributors.

@opensearch-ci-bot
Copy link
Collaborator

✅   Gradle Check success 156208f
Log 4728

Reports 4728

@reta
Copy link
Collaborator

reta commented Apr 22, 2022

Last 2 PRs are successful as well, without a revert:

Let's hold on (if there are no issues right now) till @tushar-kharbanda72 takes a look at the failures?

@nknize nknize self-requested a review April 22, 2022 21:09
Copy link
Collaborator

@nknize nknize left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Holding on revert until @tushar-kharbanda72 takes a look at the failures.

Copy link
Collaborator

@nknize nknize left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Five more PRs have failed. Approving and merging this to unblock cascading failures.

ketanv3 added a commit to ketanv3/OpenSearch that referenced this pull request Jul 31, 2022
Reopens changes from opensearch-project#2639 (reverted in opensearch-project#3046) to add a framework for task resource tracking.
Currently, SearchTask and SearchShardTask support resource tracking but it can be extended to any other task.

Changes since opensearch-project#2639:
* Replaced the usage of AutoQueueAdjustingExecutorBuilder with ResizableExecutorBuilder
* Resolved merge conflicts
* Fixed broken tests

Signed-off-by: Ketan Verma <ketan9495@gmail.com>
Bukhtawar pushed a commit that referenced this pull request Aug 2, 2022
* Support task resource tracking in OpenSearch

* Reopens changes from #2639 (reverted in #3046) to add a framework for task resource tracking. Currently, SearchTask and SearchShardTask support resource tracking but it can be extended to any other task.

* Fixed a race-condition when Task is unregistered before its threads are stopped

* Improved error handling and simplified task resource tracking completion listener

* Avoid registering listeners on already completed tasks

Signed-off-by: Ketan Verma <ketan9495@gmail.com>
ketanv3 added a commit to ketanv3/OpenSearch that referenced this pull request Aug 2, 2022
* Support task resource tracking in OpenSearch

* Reopens changes from opensearch-project#2639 (reverted in opensearch-project#3046) to add a framework for task resource tracking. Currently, SearchTask and SearchShardTask support resource tracking but it can be extended to any other task.

* Fixed a race-condition when Task is unregistered before its threads are stopped

* Improved error handling and simplified task resource tracking completion listener

* Avoid registering listeners on already completed tasks

Signed-off-by: Ketan Verma <ketan9495@gmail.com>
Bukhtawar pushed a commit that referenced this pull request Aug 2, 2022
* [Backport 2.x] Support task resource tracking in OpenSearch

* Reopens changes from #2639 (reverted in #3046) to add a framework for task resource tracking. Currently, SearchTask and SearchShardTask support resource tracking but it can be extended to any other task.

* Fixed a race-condition when Task is unregistered before its threads are stopped

* Improved error handling and simplified task resource tracking completion listener

* Avoid registering listeners on already completed tasks

Signed-off-by: Ketan Verma <ketan9495@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants