Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add idle job preemption #1927

Merged
merged 22 commits into from
Apr 28, 2022
Merged

add idle job preemption #1927

merged 22 commits into from
Apr 28, 2022

Conversation

zubenkoivan
Copy link
Contributor

No description provided.

@codecov
Copy link

codecov bot commented Apr 14, 2022

Codecov Report

Merging #1927 (6d9787a) into master (14a0f54) will increase coverage by 0.05%.
The diff coverage is 92.27%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #1927      +/-   ##
==========================================
+ Coverage   92.54%   92.60%   +0.05%     
==========================================
  Files          40       41       +1     
  Lines        6644     6897     +253     
  Branches     1060     1105      +45     
==========================================
+ Hits         6149     6387     +238     
- Misses        367      376       +9     
- Partials      128      134       +6     
Flag Coverage Δ
integration 84.81% <91.05%> (+0.80%) ⬆️
unit 69.26% <60.16%> (-0.55%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
platform_api/orchestrator/base.py 72.00% <66.66%> (-1.69%) ⬇️
...m_api/orchestrator/kube_orchestrator_preemption.py 91.70% <91.70%> (ø)
platform_api/kube_cluster.py 100.00% <100.00%> (ø)
platform_api/orchestrator/kube_client.py 90.38% <100.00%> (+0.50%) ⬆️
platform_api/orchestrator/kube_orchestrator.py 95.17% <100.00%> (+0.13%) ⬆️
platform_api/handlers/jobs_handler.py 90.34% <0.00%> (-0.52%) ⬇️
platform_api/api.py 91.18% <0.00%> (-0.45%) ⬇️
platform_api/orchestrator/poller_service.py 87.14% <0.00%> (+0.40%) ⬆️
platform_api/orchestrator/jobs_poller.py 95.91% <0.00%> (+1.36%) ⬆️

@zubenkoivan zubenkoivan force-pushed the iz/idle-job-preemption branch 2 times, most recently from 22e7d22 to d8a8239 Compare April 20, 2022 09:30
@zubenkoivan zubenkoivan marked this pull request as ready for review April 20, 2022 14:45
@@ -167,12 +150,13 @@ def orchestrator_config(self) -> OrchestratorConfig:
def kube_config(self) -> KubeConfig:
return self._kube_config

# TODO: remove
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cleanup later to avoid unnecessary changes in pr

@zubenkoivan zubenkoivan marked this pull request as draft April 21, 2022 07:37
@zubenkoivan zubenkoivan marked this pull request as ready for review April 25, 2022 08:29
@@ -875,3 +862,7 @@ async def delete_all_job_resources(self, job_id: str) -> None:
await self._client.delete_all_ingresses(labels=labels)
await self._client.delete_all_services(labels=labels)
await self._client.delete_all_network_policies(labels=labels)

async def preempt_idle_jobs(self, jobs_to_schedule: list[Job]) -> None:
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Currently not used anywhere. Requires K8s upgrade to at least 1.19 of all clusters

@zubenkoivan zubenkoivan merged commit 3e256ea into master Apr 28, 2022
@zubenkoivan zubenkoivan deleted the iz/idle-job-preemption branch April 28, 2022 11:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants