Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Scalability presubmits should use boskos to manager resources #650

Closed
mm4tt opened this issue Jul 17, 2019 · 5 comments · Fixed by kubernetes/test-infra#14954
Closed

Scalability presubmits should use boskos to manager resources #650

mm4tt opened this issue Jul 17, 2019 · 5 comments · Fixed by kubernetes/test-infra#14954

Comments

@mm4tt
Copy link
Contributor

mm4tt commented Jul 17, 2019

See kubernetes/kubernetes#78701 (comment)
@wojtek-t
Copy link
Member

I think that is only about kubemark - gce-100 should already be using boskos (we're using projects from some pool).

kubemark-500 is more tricky, because currently we have one large project with big quota. We would need to split it to N projects with high enough quota to satisfy the requirements of kubemark-500.

@mm4tt
Copy link
Contributor Author

mm4tt commented Jul 17, 2019

gce-100 doesn't seem to be using boskos - https://github.com/kubernetes/test-infra/blob/69c1cc687bb70176421e107d4838bf070dc561ea/config/jobs/kubernetes/sig-scalability/sig-scalability-presubmit-jobs.yaml#L29
Or am I missing something?

@wojtek-t
Copy link
Member

Ohh - interesting. I think we were using, but I must be wrong.

@wojtek-t
Copy link
Member

So basically the effort here would be to split those project into N with high enough quota to run a single test.

@mm4tt mm4tt mentioned this issue Jul 29, 2019
Merged
@oxddr
Copy link
Contributor

oxddr commented Sep 11, 2019 •
edited
Loading

Data point: #784 and #785 both failed pull-perf-tests-clusterloader2 due to lack of CPU quota. At the moment we east all of it (2500 CPUs).

mm4tt added a commit to mm4tt/test-infra that referenced this issue Oct 9, 2019
@mm4tt
Use boskos for k8s.io/perf-tests presubmits
edc776c 
Ref. kubernetes/perf-tests#650
@mm4tt mm4tt mentioned this issue Oct 9, 2019
Merged
mm4tt added a commit to mm4tt/test-infra that referenced this issue Oct 10, 2019
@mm4tt
Revert "Use boskos for k8s.io/perf-tests presubmits"
e4f667a 
This reverts commit edc776c.

Boskos is broken due to kubernetes#14697

Will re-enable once it gets fixed.

Ref. kubernetes/perf-tests#650
@mm4tt mm4tt mentioned this issue Oct 10, 2019
Merged
mm4tt added a commit to mm4tt/test-infra that referenced this issue Oct 11, 2019
@mm4tt
Enable boskos in k8s.io/perf-test presubmits
84ae9e5 
Boskos issues were fixed in
kubernetes#14697.
Let's try re-enabling.

Ref. kubernetes/perf-tests#650
@mm4tt mm4tt mentioned this issue Oct 11, 2019
Merged
mm4tt added a commit to mm4tt/test-infra that referenced this issue Oct 11, 2019
@mm4tt
Add scalability-presubmit-project to boskos resource types
6e2bb58 
Ref. kubernetes/perf-tests#650
@mm4tt mm4tt mentioned this issue Oct 11, 2019
Merged
mm4tt added a commit to mm4tt/test-infra that referenced this issue Oct 11, 2019
@mm4tt
Revert "Enable boskos in k8s.io/perf-test presubmits"
faac0a6 
This reverts commit 84ae9e5.

Unfortunately, it still doesn't work. I think
kubernetes#14727 should fix the
issues. Reverting till it gets merged.

Ref. kubernetes/perf-tests#650
@mm4tt mm4tt mentioned this issue Oct 11, 2019
Merged
mm4tt added a commit to mm4tt/test-infra that referenced this issue Oct 23, 2019
@mm4tt
Enable boskos in k8s.io/perf-test presubmits
cebfa7d 
This time it should work. The `scalability-presubmit-project` has been
added to boskos in kubernetes#14727.

Velodrome reports all projects in the pool as `free`: http://velodrome.k8s.io/dashboard/db/boskos-dashboard?orgId=1

Ref. kubernetes/perf-tests#650
@mm4tt mm4tt mentioned this issue Oct 23, 2019
Merged
mm4tt added a commit to mm4tt/test-infra that referenced this issue Oct 24, 2019
@mm4tt
Add more projects to scalability-presubmit-project.
5f73d8b 
Ref. kubernetes/perf-tests#650
@mm4tt mm4tt mentioned this issue Oct 24, 2019
Merged
mm4tt added a commit to mm4tt/test-infra that referenced this issue Oct 24, 2019
@mm4tt
Migrate scalability kubernetes/kubernetes presubmits behind boskos
c00292e 
Fixes kubernetes/perf-tests#650
@mm4tt mm4tt mentioned this issue Oct 24, 2019
Merged
@mm4tt mm4tt mentioned this issue Oct 30, 2019
Closed
Sh4d1 pushed a commit to Sh4d1/test-infra that referenced this issue Oct 31, 2019
@mm4tt @Sh4d1
Add more projects to scalability-presubmit-project.
ada5688 
Ref. kubernetes/perf-tests#650
@mm4tt mm4tt mentioned this issue Dec 11, 2019
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Migrate scalability kubernetes/kubernetes presubmits behind boskos mm4tt/test-infra
3 participants
@mm4tt @wojtek-t @oxddr