don't run conformance tests w/ serial unless they are part of the focus

[bparees]

fixes #16626

[openshift-merge-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: bparees

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these OWNERS Files:

• test/extended/OWNERS [bparees]

You can indicate your approval by writing /approve in a comment
You can cancel your approval by writing /approve cancel in a comment

[bparees]

/test extended_builds
/test extended_image_ecosystem

[bparees]

@smarterclayton @stevekuznetsov @miminar @jim-minter I firmly believe this is the right solution to our current e2e serial testing w/ focus problem. I know the long term vision is a separate serial suite (and ultimately no serial tests at all) but for now this gets the behavior closer to correct at a minimal cost, with minimal complexity, while preserving the ability to run focused tests on serial items.

[smarterclayton]

Several of the serial tests can't be focused with that. But I'm fine if this fits your immediate need. Stop using serial. On Oct 17, 2017, at 11:04 PM, Ben Parees <notifications@github.com> wrote: @smarterclayton <https://github.com/smarterclayton> @stevekuznetsov <https://github.com/stevekuznetsov> @miminar <https://github.com/miminar> @jim-minter <https://github.com/jim-minter> I firmly believe this is the right solution to our current e2e serial testing w/ focus problem. I know the long term vision is a separate serial suite (and ultimately no serial tests at all) but for now this gets the behavior closer to correct at a minimal cost, with minimal complexity, while preserving the ability to run focused tests on serial items. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#16919 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ABG_p9PF5y5ndcZcFOu_17fCOoBRI-3wks5stRZXgaJpZM4P80BJ> .

[bparees]

/retest

[bparees]

Stop using serial.

getting rid of the build test one here:
#16924

registry ones are going to be a harder slog.

[openshift-bot]

/retest

Please review the full test history for this PR and help us cut down flakes.

[jim-minter]

does this close #16626?
is it worth opening a tracking issue for migrating registry tests of serial?

[openshift-ci-robot]

@bparees: The following test failed, say /retest to rerun them all:

Test name	Commit	Details	Rerun command
ci/openshift-jenkins/extended_builds	37dd59f	link	/test extended_builds

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

[bparees]

does this close #16626?

yes, updated the description.

is it worth opening a tracking issue for migrating registry tests of serial?

yes, opened #16942

[openshift-merge-robot]

Automatic merge from submit-queue.