Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: Add optional E2E tests for sending to Sentry #12259

Merged
merged 6 commits into from
May 29, 2024
Merged

Conversation

mydea
Copy link
Member

@mydea mydea commented May 28, 2024

This adds a new E2E test react-send-to-sentry that is run optionally.

For now this is the same as the old standard-frontend-react test - eventually we can/should update that test (and others) to stop sending to sentry.

This test will run in a separate group that we do not block merging on when it fails.

For now, there is one browser and one node test that checks that they send events successfully to Sentry - IMHO that should cover stuff decently for now. I also made the source maps debug ID test optional, as that inherently sends to Sentry.

We can in follow ups get rid of all the event sending stuff from the remaining E2E tests.

Part of #11910

@mydea mydea self-assigned this May 28, 2024
@mydea mydea force-pushed the fn/optional-e2e-test branch from cdb6966 to c974252 Compare May 28, 2024 14:04
@mydea mydea marked this pull request as ready for review May 28, 2024 14:36
@mydea mydea force-pushed the fn/optional-e2e-test branch from a1891c4 to 53985f6 Compare May 28, 2024 14:36
@mydea mydea changed the title ci: Add optional E2E tests that can fail ci: Add optional E2E tests that can fail for sending to Sentry May 28, 2024
@mydea mydea changed the title ci: Add optional E2E tests that can fail for sending to Sentry ci: Add optional E2E tests for sending to Sentry May 28, 2024
Copy link
Contributor

github-actions bot commented May 28, 2024

size-limit report 📦

Path Size
@sentry/browser 21.73 KB (0%)
@sentry/browser (incl. Tracing) 32.76 KB (0%)
@sentry/browser (incl. Tracing, Replay) 68.2 KB (0%)
@sentry/browser (incl. Tracing, Replay) - with treeshaking flags 61.63 KB (0%)
@sentry/browser (incl. Tracing, Replay with Canvas) 72.25 KB (0%)
@sentry/browser (incl. Tracing, Replay, Feedback) 84.32 KB (0%)
@sentry/browser (incl. Tracing, Replay, Feedback, metrics) 86.13 KB (0%)
@sentry/browser (incl. metrics) 25.9 KB (0%)
@sentry/browser (incl. Feedback) 37.74 KB (0%)
@sentry/browser (incl. sendFeedback) 26.31 KB (0%)
@sentry/browser (incl. FeedbackAsync) 30.73 KB (0%)
@sentry/react 24.45 KB (0%)
@sentry/react (incl. Tracing) 35.78 KB (0%)
@sentry/vue 25.71 KB (0%)
@sentry/vue (incl. Tracing) 34.58 KB (0%)
@sentry/svelte 21.86 KB (0%)
CDN Bundle 23.06 KB (0%)
CDN Bundle (incl. Tracing) 34.48 KB (0%)
CDN Bundle (incl. Tracing, Replay) 68.31 KB (0%)
CDN Bundle (incl. Tracing, Replay, Feedback) 73.31 KB (0%)
CDN Bundle - uncompressed 68 KB (0%)
CDN Bundle (incl. Tracing) - uncompressed 102.1 KB (0%)
CDN Bundle (incl. Tracing, Replay) - uncompressed 212 KB (0%)
CDN Bundle (incl. Tracing, Replay, Feedback) - uncompressed 224.37 KB (0%)
@sentry/nextjs (client) 35.12 KB (0%)
@sentry/sveltekit (client) 33.37 KB (0%)
@sentry/node 114.66 KB (+0.01% 🔺)
@sentry/aws-serverless 103.37 KB (+0.01% 🔺)

timeout: 5000,
},
/* Run tests in files in parallel */
fullyParallel: true,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Feel like we should unify these configs in a future PR.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, I'll look into this in some follow up!

@mydea mydea force-pushed the fn/optional-e2e-test branch from 26644c4 to e05ca08 Compare May 29, 2024 09:53
@mydea mydea merged commit a1725a1 into develop May 29, 2024
107 checks passed
@mydea mydea deleted the fn/optional-e2e-test branch May 29, 2024 10:20
mydea added a commit that referenced this pull request May 29, 2024
Instead of just testing to send to Sentry, this now tests the actual
payloads being sent.

This kind of builds on top of
#12259, where we
specifically test the event sending now.
Lms24 added a commit that referenced this pull request Jul 8, 2024
Enable running E2E tests on PRs opened from forked
repositories. Previously we excluded these because some E2E tests
required secrets which are not available in the forks, causing e2e test
runs to always fail. Now that we separated these tests from the e2e
tests that don't require secrets
(#12259) we should be
good to re-enable the required e2e tests for external PRs.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants