Skip to content

Conversation

@seaona
Copy link
Member

@seaona seaona commented Nov 3, 2025

Description

It seems ci conditions got worse in the last week, surfacing more flakiness in different points.
This spec fails because it waits for events with a given delay but it's not enough now. Increasing the delay fixes the issue.

Open in GitHub Codespaces

Changelog

CHANGELOG entry:

Related issues

Fixes:

Manual testing steps

  1. Check ci

Screenshots/Recordings

Before

After

Pre-merge author checklist

Pre-merge reviewer checklist

  • I've manually tested the PR (e.g. pull and build branch, run the app, test code being changed).
  • I confirm that this PR addresses all acceptance criteria described in the ticket it closes and includes the necessary testing evidence such as recordings and or screenshots.

Note

Replaces largeDelayMs with a fixed 5000ms wait in Sentry/Segment tests to reduce flakiness.

  • Tests (e2e):
    • In test/e2e/flask/snaps/preinstalled-example.spec.ts:
      • Replace largeDelayMs with 5000 for driver.wait when awaiting mocked endpoints in:
        • snap_trackError (Sentry error)
        • snap_trackEvent (Segment event)
        • snap_startTrace/snap_endTrace (Sentry trace)
      • Simplify helpers import (remove unused largeDelayMs).

Written by Cursor Bugbot for commit 5bbc0b9. This will update automatically on new commits. Configure here.

@metamaskbot metamaskbot added the team-qa QA team label Nov 3, 2025
@metamaskbot
Copy link
Collaborator

metamaskbot commented Nov 3, 2025

✨ Files requiring CODEOWNER review ✨

🫰 @MetaMask/core-platform (1 files, +4 -9)
  • 📁 test/
    • 📁 e2e/
      • 📁 flask/
        • 📁 snaps/
          • 📄 preinstalled-example.spec.ts +4 -9

@seaona seaona self-assigned this Nov 3, 2025
@seaona seaona added the no-changelog no-changelog Indicates no external facing user changes, therefore no changelog documentation needed label Nov 3, 2025
@seaona seaona changed the title fix: flask fix: flaky tests Preinstalled example Snap... Nov 3, 2025
@seaona seaona marked this pull request as ready for review November 3, 2025 08:44
@seaona seaona requested a review from a team as a code owner November 3, 2025 08:44
@github-actions github-actions bot added size-S and removed size-XS labels Nov 3, 2025
@metamaskbot
Copy link
Collaborator

Builds ready [5bbc0b9]
UI Startup Metrics (1267 ± 98 ms)
PlatformBuildTypePageMetricMean (ms)Min (ms)Max (ms)Std Dev (ms)P 75 (ms)P 95 (ms)
ChromeBrowserifyStandard HomeuiStartup1267112816549813321443
load108295013919011491244
domContentLoaded107794713868811441233
domInteractive2214117162052
firstPaint66387140645310991216
backgroundConnect2322172558236249
firstReactRender31184983845
getState231173102642
initialActions71528820
loadScripts8517071161889191005
setupStore1162741119
numNetworkReqs1367620674
BrowserifyPower User HomeuiStartup20871800312139425673121
load1090905177525713941775
domContentLoaded1078900176725713851767
domInteractive281678184378
firstPaint741192147245910001472
backgroundConnect21419124114223241
firstReactRender29253533035
getState20417126629218266
initialActions42122512
loadScripts881712155824711721558
setupStore1583282432
numNetworkReqs19910134897311348
WebpackStandard HomeuiStartup88074612501018911194
load655593103692650924
domContentLoaded64558799086643909
domInteractive16125581437
firstPaint232561036249203917
backgroundConnect2713105172773
firstReactRender29175073436
getState1352331518
initialActions3118358
loadScripts64258597984641899
setupStore1162131216
numNetworkReqs1367619871
WebpackPower User HomeuiStartup14161220192425717261924
load73062611671538391167
domContentLoaded69861410261208211026
domInteractive281396272996
firstPaint34770888251634888
backgroundConnect682021363142213
firstReactRender27263012830
getState15711319723169197
initialActions51328832
loadScripts69461210161178091016
setupStore1363082030
numNetworkReqs1549928368202283
FirefoxBrowserifyStandard HomeuiStartup15461272210913615981786
load1304110715268013691446
domContentLoaded1304110715258013691446
domInteractive1203433751132226
firstPaint------
backgroundConnect4826218265384
firstReactRender27225362840
getState11419721928
initialActions629311414
loadScripts1275109014407613351403
setupStore167191211431
numNetworkReqs1366617761
BrowserifyPower User HomeuiStartup27142357369240830283692
load15091260201923717582019
domContentLoaded15091260201823717582018
domInteractive23599566189548566
firstPaint------
backgroundConnect13234444122262444
firstReactRender44336085160
getState15110329546181295
initialActions13276191676
loadScripts14681213198523517101985
setupStore45102696256269
numNetworkReqs1366633877194338
WebpackStandard HomeuiStartup16331446220018116522147
load13821231167310014211593
domContentLoaded13821230167310014211592
domInteractive1034028639112175
firstPaint------
backgroundConnect51272193354126
firstReactRender352280163476
getState84425816
initialActions11119036324
loadScripts1352120816209013921545
setupStore167237251243
numNetworkReqs1266716760
WebpackPower User HomeuiStartup26502220418648128384186
load15091261186818416621868
domContentLoaded15081261186718516621867
domInteractive17366488132304488
firstPaint------
backgroundConnect106313629799362
firstReactRender463364105564
getState1559724144196241
initialActions2011604212160
loadScripts14721239182117716231821
setupStore3181133045113
numNetworkReqs1486534590219345
📊 Page Load Benchmark Results

Current Commit: 5bbc0b9 | Date: 11/3/2025

📄 Localhost MetaMask Test Dapp

Samples: 100

Summary

  • pageLoadTime-> current mean value: 1.06s (±54ms) 🟡 | historical mean value: 1.04s ⬆️ (historical data)
  • domContentLoaded-> current mean value: 738ms (±51ms) 🟢 | historical mean value: 725ms ⬆️ (historical data)
  • firstContentfulPaint-> current mean value: 78ms (±10ms) 🟢 | historical mean value: 77ms ⬆️ (historical data)

📈 Detailed Results

Metric Mean Std Dev Min Max P95 P99
pageLoadTime 1.06s 54ms 1.02s 1.34s 1.11s 1.34s
domContentLoaded 738ms 51ms 709ms 1.02s 777ms 1.02s
firstPaint 78ms 10ms 64ms 152ms 84ms 152ms
firstContentfulPaint 78ms 10ms 64ms 152ms 84ms 152ms
largestContentfulPaint 0ms 0ms 0ms 0ms 0ms 0ms
Bundle size diffs [🚨 Warning! Bundle size has increased!]
  • background: 68 Bytes (0%)
  • ui: 0 Bytes (0%)
  • common: 10 Bytes (0%)

@seaona seaona enabled auto-merge November 3, 2025 09:12
@seaona seaona added this pull request to the merge queue Nov 3, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Nov 3, 2025
@seaona seaona added this pull request to the merge queue Nov 3, 2025
Merged via the queue into main with commit 09de89d Nov 3, 2025
338 of 342 checks passed
@seaona seaona deleted the flaky-snap-events branch November 3, 2025 11:10
@github-actions github-actions bot locked and limited conversation to collaborators Nov 3, 2025
@metamaskbot metamaskbot added the release-13.9.0 Issue or pull request that will be included in release 13.9.0 label Nov 3, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

flaky tests no-changelog no-changelog Indicates no external facing user changes, therefore no changelog documentation needed release-13.9.0 Issue or pull request that will be included in release 13.9.0 size-S team-qa QA team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants