Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WorkloadConfigurator] Add support for specifying number of drivers and workers-per-driver (extension to #86) #87

Closed
tsg- opened this issue Jul 29, 2013 · 4 comments
Assignees
Milestone

Comments

@tsg-
Copy link
Contributor

tsg- commented Jul 29, 2013

Workload configurator currently supports specifying only the total number of workers for a stage .. it will be useful to specify the load as:

  1. "workers=" spec: total number of workers (number of drivers defaults to that specified in controller.ini, with workers-per-driver being symmetrically divided between drivers)
  2. "drivers=" and "workers=" spec: total number of drivers and total number of workers. (number of drivers ) <= (number of drivers configured in controller.ini). Worker specification used to determine workers-per-driver (symmetric division).
  3. "drivers=" and "workers_per_driver=" spec: total number of drivers and workers-per-driver. (number of drivers ) <= (number of drivers configured in controller.ini). Total number of workers is redundant spec in this case (ignored).

Again, if all of "drivers=", "workers_per_driver=" and "workers=" is specified, the "workers=" spec is ignored. The total number of workers is instead calculated as in (3).

@ywang19
Copy link
Contributor

ywang19 commented Jul 30, 2013

There is one attribute named "driver" which is originally used to assign the work to specific driver, which should cover the spec you mentioned. one minor concern is it's a bit long to validate it last time.

@ywang19
Copy link
Contributor

ywang19 commented Aug 19, 2013

will verify to decide if needs enhancement.

@ghost ghost assigned tsg- Jan 6, 2014
@tsg-
Copy link
Contributor Author

tsg- commented Jan 7, 2014

(3) above is not supported. There was a desire to be able to configure "workers_per_driver" in addition to case (2) where the number of workers is being divided among drivers equally. An example use case would be where I've configured say 4 drivers, but I want to use only 2 and force higher number of threads each, and be able to do that without (COSbench config change + restart) and per workload. Thoughts?

@ywang19 ywang19 modified the milestones: 0.4.1, 0.4.0 Apr 9, 2014
@ywang19
Copy link
Contributor

ywang19 commented Apr 9, 2014

Need more time to understand the those scenarios, target to support in v0.4.1.

@ywang19 ywang19 assigned Khushbu27 and unassigned tsg- Dec 3, 2014
@ywang19 ywang19 modified the milestones: 0.4.2, 0.4.1 Dec 30, 2014
@ywang19 ywang19 closed this as completed Mar 16, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants