Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roachtest: add a variant of tpch_concurrency with no admission control #75764

Merged
merged 1 commit into from
Feb 1, 2022

Conversation

yuzefovich
Copy link
Member

Informs: #74836.

Release note: None

@yuzefovich yuzefovich requested review from michae2 and a team January 31, 2022 23:53
@cockroach-teamcity
Copy link
Member

This change is Reviewable

Copy link
Collaborator

@michae2 michae2 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewable status: :shipit: complete! 0 of 0 LGTMs obtained (waiting on @michae2 and @yuzefovich)


pkg/cmd/roachtest/tests/tpch_concurrency.go, line 196 at r1 (raw file):

	for _, disableTxnStatsSampling := range []bool{false, true} {
		for _, disableAdmissionControl := range []bool{false, true} {

Do we need to multiply these configurations by each other? Does disabling both sampling and admission control at the same time tell us something different than disabling each individually?

What I'm getting at is: if these options are orthogonal to each other, then it seems like busywork to test all combinations of {on,off} for all options. Better to test each option disabled by itself, and then we can compare with the default configuration to know the effect of each option.

Copy link
Member Author

@yuzefovich yuzefovich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewable status: :shipit: complete! 0 of 0 LGTMs obtained (waiting on @michae2)


pkg/cmd/roachtest/tests/tpch_concurrency.go, line 196 at r1 (raw file):

Previously, michae2 (Michael Erickson) wrote…

Do we need to multiply these configurations by each other? Does disabling both sampling and admission control at the same time tell us something different than disabling each individually?

What I'm getting at is: if these options are orthogonal to each other, then it seems like busywork to test all combinations of {on,off} for all options. Better to test each option disabled by itself, and then we can compare with the default configuration to know the effect of each option.

That's true; however, I do not intend to keep all these options around for long - at the moment I'm just curious in several more datapoints for the Streamer work, and I don't think these configs are that useful on their own. I'll probably remove no_sampling option entirely too since the performance dashboards seem to be about the same, so it's not providing much value either.

Copy link
Member Author

@yuzefovich yuzefovich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewable status: :shipit: complete! 0 of 0 LGTMs obtained (waiting on @michae2)


pkg/cmd/roachtest/tests/tpch_concurrency.go, line 196 at r1 (raw file):

Previously, yuzefovich (Yahor Yuzefovich) wrote…

That's true; however, I do not intend to keep all these options around for long - at the moment I'm just curious in several more datapoints for the Streamer work, and I don't think these configs are that useful on their own. I'll probably remove no_sampling option entirely too since the performance dashboards seem to be about the same, so it's not providing much value either.

Removed the case when both are disabled.

Copy link
Collaborator

@michae2 michae2 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:lgtm:

Reviewable status: :shipit: complete! 1 of 0 LGTMs obtained (waiting on @michae2)

Copy link
Contributor

@msirek msirek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

Copy link
Member Author

@yuzefovich yuzefovich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TFTRs!

bors r+

Reviewable status: :shipit: complete! 1 of 0 LGTMs obtained (waiting on @michae2)

@craig
Copy link
Contributor

craig bot commented Feb 1, 2022

Build failed (retrying...):

@craig
Copy link
Contributor

craig bot commented Feb 1, 2022

Build succeeded:

@craig craig bot merged commit 19a5d53 into cockroachdb:master Feb 1, 2022
@yuzefovich yuzefovich deleted the tpch_concurrency branch February 1, 2022 16:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants