Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable test sharding (pooled environments) #546

Open
csnover opened this issue Dec 1, 2015 · 1 comment
Open

Enable test sharding (pooled environments) #546

csnover opened this issue Dec 1, 2015 · 1 comment
Labels
effort-high This will take a while enhancement A new or improved feature

Comments

@csnover
Copy link
Member

csnover commented Dec 1, 2015

Automatic test sharding per environment across multiple remote instances is a feature that has been requested before. It shouldn’t be too difficult at all to implement:

  1. Add a new configuration option for environments that says how many remote browser instances should be started for each environment pool (numShards, numInstances?);
  2. Change how test execution works so multiple tests can run in parallel across a pool (the only difficulty here would be flowing across different suites, since the control of test execution is currently delegated to each Suite; the test flow could be moved up into Executor instead, which would also make it easier to implement Feature request: Fail-fast option #413, or a different Suite type could used for the root suites, since each root suite = one environment currently, in the Runner);
  3. When each test runs, set the remote property (like in the example which does it indirectly through a test interface) to one from a free pool that is maintained by the test system. Do the same for Suite methods by creating a delegate object (lang.delegate).
@csnover csnover added enhancement A new or improved feature help-wanted effort-high This will take a while effort-medium This may take a couple of days and removed effort-high This will take a while labels Dec 1, 2015
@csnover csnover added effort-high This will take a while and removed effort-medium This may take a couple of days labels Jan 6, 2016
@jason0x43 jason0x43 changed the title Enable functional test sharding (pooled environments) Enable test sharding (pooled environments) May 30, 2018
@jason0x43
Copy link
Member

In combination with #803, this update should allow general test sharding.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
effort-high This will take a while enhancement A new or improved feature
Projects
None yet
Development

No branches or pull requests

2 participants