Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Install and set up Buildkite Test Analytics #4688

Conversation

waiting-for-dev
Copy link
Contributor

@waiting-for-dev waiting-for-dev commented Oct 24, 2022

Summary

We're configuring Buildkite Test Analytics to gather information
about our test suite so we can detect and fix flaky and slow tests.

We use the tagging feature to annotate the combination of Ruby/Rails
versions, database engine, and the presence of paperclip.

Please, @solidusio/core-team, ping me on Slack with an email address so I can invite you to see the dashboard (unfortunately, it seems to be no way to make it public).

Checklist

Check out our PR guidelines for more details.

The following are mandatory for all PRs:

  • I have written a thorough PR description.
  • I have kept my commits small and atomic.
  • I have used clear, explanatory commit messages.

The following are not always needed (cross them out if they are not):

  • [] I have added automated tests to cover my changes.
  • [] I have attached screenshots to demo visual changes.
  • [] I have opened a PR to update the guides.
  • [] I have updated the readme to account for my changes.

@github-actions github-actions bot added changelog:solidus_backend Changes to the solidus_backend gem changelog:solidus_api Changes to the solidus_api gem changelog:solidus_core Changes to the solidus_core gem labels Oct 24, 2022
@waiting-for-dev waiting-for-dev requested a review from a team October 24, 2022 04:17
@waiting-for-dev waiting-for-dev force-pushed the waiting-for-dev/install-buildkite-test-analytics branch 2 times, most recently from 0f3f0ec to f0c43e0 Compare October 24, 2022 05:52
@waiting-for-dev waiting-for-dev added the type:enhancement Proposed or newly added feature label Oct 25, 2022
We're configuring Buildkite Test Analytics [1] to gather information
about our test suite so we can detect and fix flaky and slow tests.

We use the tagging feature [2] to annotate the combination of Ruby/Rails
versions, database engine, and the presence of paperclip.

1 - https://buildkite.com/test-analytics
2 - https://buildkite.com/docs/test-analytics/ruby-collectors#tagging-duplicate-test-executions-with-a-prefix-slash-suffix
@waiting-for-dev waiting-for-dev force-pushed the waiting-for-dev/install-buildkite-test-analytics branch from f0c43e0 to e70d4e4 Compare October 25, 2022 03:56
@waiting-for-dev waiting-for-dev merged commit 6dae635 into solidusio:master Oct 26, 2022
@waiting-for-dev waiting-for-dev deleted the waiting-for-dev/install-buildkite-test-analytics branch October 26, 2022 04:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
changelog:solidus_api Changes to the solidus_api gem changelog:solidus_backend Changes to the solidus_backend gem changelog:solidus_core Changes to the solidus_core gem type:enhancement Proposed or newly added feature
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants