Skip to content

Conversation

@seaona
Copy link
Member

@seaona seaona commented Nov 3, 2025

Description

The timeout in clickElementAndWaitToDisappear has a default max value of 2seconds. This is insufficient in the update modal test, where sometimes the spec fails as the element didn't disappear yet:

image

This increases the default timeout to 3 seconds at the driver method level. This won't mean that we will always wait until the full 3 seconds but that now, we have a bigger window to wait.
I chose to change this at the driver method, to help stabilize all ci in general, not just for that case, as 3 seconds still seams a reasonable amount of time (in the case we need to fully wait for them).

Open in GitHub Codespaces

Changelog

CHANGELOG entry:

Related issues

Fixes:

Manual testing steps

  1. Check ci. I edited the spec file to trigger the quality gate and run the Update Modal spec 5 more times x4 (each build), so it was run 20+4 times and it passed (other specs failed due to existing flakiness, being fixed in different PRs)

0b857c0

Screenshots/Recordings

Before

After

Pre-merge author checklist

Pre-merge reviewer checklist

  • I've manually tested the PR (e.g. pull and build branch, run the app, test code being changed).
  • I confirm that this PR addresses all acceptance criteria described in the ticket it closes and includes the necessary testing evidence such as recordings and or screenshots.

Note

Increase default timeout from 2s to 3s in clickElementAndWaitToDisappear to improve reliability of disappearing elements.

  • Tests (E2E):
    • test/e2e/webdriver/driver.js:
      • clickElementAndWaitToDisappear: default timeout increased 2000ms3000ms.

Written by Cursor Bugbot for commit 919feab. This will update automatically on new commits. Configure here.

@seaona seaona self-assigned this Nov 3, 2025
@seaona seaona added no-changelog no-changelog Indicates no external facing user changes, therefore no changelog documentation needed flaky tests labels Nov 3, 2025
@metamaskbot metamaskbot added the team-qa QA team label Nov 3, 2025
@metamaskbot
Copy link
Collaborator

Builds ready [0b857c0]
UI Startup Metrics (1269 ± 93 ms)
PlatformBuildTypePageMetricMean (ms)Min (ms)Max (ms)Std Dev (ms)P 75 (ms)P 95 (ms)
ChromeBrowserifyStandard HomeuiStartup1269109816619313151431
load108594914618611291219
domContentLoaded107994414518511241210
domInteractive211481131856
firstPaint64878127143210961199
backgroundConnect2302182517233244
firstReactRender30184883845
getState21106582536
initialActions71739819
loadScripts855725121082904978
setupStore1072731119
numNetworkReqs1367619671
BrowserifyPower User HomeuiStartup21971924321140826393211
load1156981165922814321659
domContentLoaded1145976165022414181650
domInteractive321584235884
firstPaint76493165750410631657
backgroundConnect25623531117265311
firstReactRender29253323133
getState18916923117206231
initialActions62123812
loadScripts904750139421911691394
setupStore1493261232
numNetworkReqs15610031888298318
WebpackStandard HomeuiStartup8557331247808681016
load635583100271640787
domContentLoaded62757795766635771
domInteractive161175101436
firstPaint200581002197189608
backgroundConnect261392152770
firstReactRender28174273436
getState1261831416
initialActions31153410
loadScripts62357594564633761
setupStore1152231316
numNetworkReqs1367519871
WebpackPower User HomeuiStartup12621103176321914571763
load62955481788747817
domContentLoaded61154379979709799
domInteractive221259143559
firstPaint36972802275712802
backgroundConnect751228690204286
firstReactRender26243122631
getState1369216621146166
initialActions51197719
loadScripts60754178976701789
setupStore1362782227
numNetworkReqs1499929266195292
FirefoxBrowserifyStandard HomeuiStartup15821361214214016321868
load1330116415538413911478
domContentLoaded1330116415538413901478
domInteractive1213838052130234
firstPaint------
backgroundConnect56272243262126
firstReactRender28235552840
getState95556920
initialActions62446517
loadScripts1296114414687713511436
setupStore179234241436
numNetworkReqs1366817762
BrowserifyPower User HomeuiStartup25302111336434427363364
load13801147181621016031816
domContentLoaded13791147181621016021816
domInteractive19592557144199557
firstPaint------
backgroundConnect12732479127190479
firstReactRender46281011752101
getState1459120632170206
initialActions10135101535
loadScripts13361127178618215711786
setupStore4361925157192
numNetworkReqs1407031878214318
WebpackStandard HomeuiStartup17491565261816317912087
load14731298176610015261687
domContentLoaded14731297176510015261687
domInteractive1053430537117157
firstPaint------
backgroundConnect60295465661127
firstReactRender402694194083
getState84274916
initialActions7221121520
loadScripts1438127916848614961621
setupStore17979131543
numNetworkReqs1366918766
WebpackPower User HomeuiStartup25582246310828729203108
load15611293196721917701967
domContentLoaded15611293196621917701966
domInteractive20245414135380414
firstPaint------
backgroundConnect823124155107241
firstReactRender44325585355
getState1257519733139197
initialActions1017418774
loadScripts15281262189221217371892
setupStore2991433439143
numNetworkReqs1346031285227312
📊 Page Load Benchmark Results

Current Commit: 0b857c0 | Date: 11/3/2025

📄 Localhost MetaMask Test Dapp

Samples: 100

Summary

  • pageLoadTime-> current mean value: 1.00s (±39ms) 🟡 | historical mean value: 1.04s ⬇️ (historical data)
  • domContentLoaded-> current mean value: 694ms (±36ms) 🟢 | historical mean value: 729ms ⬇️ (historical data)
  • firstContentfulPaint-> current mean value: 78ms (±12ms) 🟢 | historical mean value: 77ms ⬆️ (historical data)

📈 Detailed Results

Metric Mean Std Dev Min Max P95 P99
pageLoadTime 1.00s 39ms 974ms 1.28s 1.03s 1.28s
domContentLoaded 694ms 36ms 669ms 963ms 714ms 963ms
firstPaint 78ms 12ms 64ms 188ms 84ms 188ms
firstContentfulPaint 78ms 12ms 64ms 188ms 84ms 188ms
largestContentfulPaint 0ms 0ms 0ms 0ms 0ms 0ms
Bundle size diffs [🚨 Warning! Bundle size has increased!]
  • background: 68 Bytes (0%)
  • ui: 0 Bytes (0%)
  • common: 10 Bytes (0%)

@seaona seaona enabled auto-merge November 3, 2025 15:20
@metamaskbot
Copy link
Collaborator

Builds ready [919feab]
UI Startup Metrics (1321 ± 101 ms)
PlatformBuildTypePageMetricMean (ms)Min (ms)Max (ms)Std Dev (ms)P 75 (ms)P 95 (ms)
ChromeBrowserifyStandard HomeuiStartup13211145156010113961505
load113098013139212051289
domContentLoaded112497713039111981284
domInteractive231571132157
firstPaint62479131145211181278
backgroundConnect2372192739241255
firstReactRender331870104048
getState22993122443
initialActions7010211819
loadScripts8947551075909691055
setupStore1173141219
numNetworkReqs1367620674
BrowserifyPower User HomeuiStartup20351782322342324643223
load1075909176526213721765
domContentLoaded1066902174926013631749
domInteractive281478205078
firstPaint71118017544929761754
backgroundConnect24221630720249307
firstReactRender27244042840
getState17415224623188246
initialActions52153515
loadScripts843689145724511271457
setupStore1081111111
numNetworkReqs1548531387281313
WebpackStandard HomeuiStartup8727371268958851154
load64959298983651932
domContentLoaded64158697580645908
domInteractive16124681438
firstPaint19458978193185636
backgroundConnect2712105172975
firstReactRender2918117113438
getState1272331417
initialActions31234413
loadScripts63858496477643897
setupStore1162431218
numNetworkReqs1367419870
WebpackPower User HomeuiStartup14301226210529017992105
load72462110081377681008
domContentLoaded705610959123742959
domInteractive271486234786
firstPaint28473959251420959
backgroundConnect731323889218238
firstReactRender27252912829
getState14911016918160169
initialActions219249
loadScripts700608948119732948
setupStore1262672326
numNetworkReqs1418128270175282
FirefoxBrowserifyStandard HomeuiStartup14841247218914215541710
load1253108115269013251407
domContentLoaded1253108115269013241407
domInteractive1153433948128227
firstPaint------
backgroundConnect4626327345087
firstReactRender25215852630
getState949110823
initialActions41194415
loadScripts1225106314128412901383
setupStore137177171130
numNetworkReqs1367317762
BrowserifyPower User HomeuiStartup25752175355036627523550
load14401140187320216531873
domContentLoaded14391140187320216531873
domInteractive240101688200460688
firstPaint------
backgroundConnect1174136892161368
firstReactRender433276104976
getState1338624537139245
initialActions13197231797
loadScripts13971109184320415721843
setupStore3772275347227
numNetworkReqs1326931380180313
WebpackStandard HomeuiStartup16281436213615217051981
load13801195170211414601606
domContentLoaded13801194170211414591605
domInteractive993231441104186
firstPaint------
backgroundConnect50241342559111
firstReactRender322278133072
getState949111919
initialActions51567417
loadScripts13481178162810514171573
setupStore157157171246
numNetworkReqs1366918867
WebpackPower User HomeuiStartup25902156369648627293696
load15111257194623018231946
domContentLoaded15101257194623018231946
domInteractive19337638184438638
firstPaint------
backgroundConnect963228771141287
firstReactRender433298165198
getState1237620839136208
initialActions905613956
loadScripts14761237189322317821893
setupStore4572306047230
numNetworkReqs1376634192212341
📊 Page Load Benchmark Results

Current Commit: 919feab | Date: 11/3/2025

📄 Localhost MetaMask Test Dapp

Samples: 100

Summary

  • pageLoadTime-> current mean value: 1.04s (±45ms) 🟡 | historical mean value: 1.04s ⬇️ (historical data)
  • domContentLoaded-> current mean value: 728ms (±64ms) 🟢 | historical mean value: 729ms ⬇️ (historical data)
  • firstContentfulPaint-> current mean value: 79ms (±42ms) 🟢 | historical mean value: 77ms ⬆️ (historical data)

📈 Detailed Results

Metric Mean Std Dev Min Max P95 P99
pageLoadTime 1.04s 45ms 1.01s 1.37s 1.06s 1.37s
domContentLoaded 728ms 64ms 701ms 1.31s 742ms 1.31s
firstPaint 79ms 42ms 60ms 496ms 88ms 496ms
firstContentfulPaint 79ms 42ms 60ms 496ms 88ms 496ms
largestContentfulPaint 0ms 0ms 0ms 0ms 0ms 0ms
Bundle size diffs [🚨 Warning! Bundle size has increased!]
  • background: 68 Bytes (0%)
  • ui: 0 Bytes (0%)
  • common: 10 Bytes (0%)

@davidmurdoch davidmurdoch disabled auto-merge November 3, 2025 15:36
@davidmurdoch davidmurdoch merged commit ea49362 into main Nov 3, 2025
186 of 187 checks passed
@davidmurdoch davidmurdoch deleted the flaky-wait-disappear branch November 3, 2025 15:36
@github-actions github-actions bot locked and limited conversation to collaborators Nov 3, 2025
@metamaskbot metamaskbot added the release-13.9.0 Issue or pull request that will be included in release 13.9.0 label Nov 3, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

flaky tests no-changelog no-changelog Indicates no external facing user changes, therefore no changelog documentation needed release-13.9.0 Issue or pull request that will be included in release 13.9.0 size-XS team-qa QA team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants