Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[No QA] Skip calling specific APIs in the E2E tests #53604

Merged
merged 3 commits into from
Dec 5, 2024

Conversation

tgolen
Copy link
Contributor

@tgolen tgolen commented Dec 4, 2024

Explanation of Change

Fixed Issues

Fixes a fire that we are experiencing on the server, reported in Slack

Tests

Run the E2E tests and see that they pass and that there are no logs for calling these APIs

Offline tests

None

QA Steps

None

PR Author Checklist

  • I linked the correct issue in the ### Fixed Issues section above
  • I wrote clear testing steps that cover the changes made in this PR
    • I added steps for local testing in the Tests section
    • I added steps for the expected offline behavior in the Offline steps section
    • I added steps for Staging and/or Production testing in the QA steps section
    • I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
    • I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).
  • I included screenshots or videos for tests on all platforms
  • I ran the tests on all platforms & verified they passed on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
  • I followed proper code patterns (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
      • If any non-english text was added/modified, I used JaimeGPT to get English > Spanish translation. I then posted it in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I followed the guidelines as stated in the Review Guidelines
  • I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
  • I verified that if a function's arguments changed that all usages have also been updated correctly
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • I added unit tests for any new feature or bug fix in this PR to help automatically prevent regressions in this user flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

Android: Native
Android: mWeb Chrome
iOS: Native
iOS: mWeb Safari
MacOS: Chrome / Safari
MacOS: Desktop

@tgolen tgolen changed the title Skip calling specific APIs in the E2E tests [No QA] Skip calling specific APIs in the E2E tests Dec 4, 2024
fetch(url, {
const sendRequest = (url: string, data: Record<string, unknown>): Promise<Response> => {
// Don't process these specific API commands because running them over and over again in the tests hammers the server in a bad way.
if (url.indexOf('command=OptInToPushNotifications') > -1 || url.indexOf('command=OptOutOfPushNotifications') > -1) {
Copy link
Contributor

@chiragsalian chiragsalian Dec 4, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

NAB. i feel like .includes is more DRY and easier to read i.e.,

url.includes('command=OptInToPushNotifications') || url.includes('command=OptOutOfPushNotifications')

chiragsalian
chiragsalian previously approved these changes Dec 4, 2024
chiragsalian
chiragsalian previously approved these changes Dec 4, 2024
@tgolen tgolen marked this pull request as ready for review December 4, 2024 23:07
@tgolen tgolen requested a review from a team as a code owner December 4, 2024 23:07
@melvin-bot melvin-bot bot requested review from mjasikowski and removed request for a team December 4, 2024 23:08
Copy link

melvin-bot bot commented Dec 4, 2024

@mjasikowski Please copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

@tgolen
Copy link
Contributor Author

tgolen commented Dec 4, 2024

@hannojg Could you review this, please? Or see if you have a better solution in mind?

@hannojg
Copy link
Contributor

hannojg commented Dec 5, 2024

I think the solution is good as it keeps the custom logic inside the e2e code! LGTM

@mountiny
Copy link
Contributor

mountiny commented Dec 5, 2024

Reviewer Checklist

  • I have verified the author checklist is complete (all boxes are checked off).
  • I verified the correct issue is linked in the ### Fixed Issues section above
  • I verified testing steps are clear and they cover the changes made in this PR
    • I verified the steps for local testing are in the Tests section
    • I verified the steps for Staging and/or Production testing are in the QA steps section
    • I verified the steps cover any possible failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
  • I checked that screenshots or videos are included for tests on all platforms
  • I included screenshots or videos for tests on all platforms
  • I verified tests pass on all platforms & I tested again on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • If there are any errors in the console that are unrelated to this PR, I either fixed them (preferred) or linked to where I reported them in Slack
  • I verified proper code patterns were followed (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick).
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I verified that this PR follows the guidelines as stated in the Review Guidelines
  • I verified other components that can be impacted by these changes have been tested, and I retested again (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar have been tested & I retested again)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
  • If a new component is created I verified that:
    • A similar component doesn't exist in the codebase
    • All props are defined accurately and each prop has a /** comment above it */
    • The file is named correctly
    • The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
    • The only data being stored in the state is data necessary for rendering and nothing else
    • For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
    • Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
    • All JSX used for rendering exists in the render method
    • The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG)
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • For any bug fix or new feature in this PR, I verified that sufficient unit tests are included to prevent regressions in this flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
  • I have checked off every checkbox in the PR reviewer checklist, including those that don't apply to this PR.

Screenshots/Videos

Android: Native
Android: mWeb Chrome
iOS: Native
iOS: mWeb Safari
MacOS: Chrome / Safari
MacOS: Desktop

Copy link
Contributor

@mountiny mountiny left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changes look good to me, Hanno approved as well, I guess no reason to wait now so going to merge this PR

@mountiny mountiny merged commit 9184118 into main Dec 5, 2024
17 of 19 checks passed
@mountiny mountiny deleted the tgolen-skip-apis-in-e2e-tests branch December 5, 2024 12:16
@OSBotify
Copy link
Contributor

OSBotify commented Dec 5, 2024

✋ This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

@github-actions github-actions bot added the DeployBlockerCash This issue or pull request should block deployment label Dec 5, 2024
Copy link
Contributor

github-actions bot commented Dec 5, 2024

Performance Comparison Report 📊

Significant Changes To Duration

Name Duration
Linking 734.001 ms → 977.792 ms (+243.791 ms, +33.2%) 🔴🔴
Show details
Name Duration
Linking Baseline
Mean: 734.001 ms
Stdev: 175.727 ms (23.9%)
Runs: 466.4233810007572 481.07133000157773 489.296996999532 492.00744599848986 492.0176190007478 494.95105000026524 496.98246300034225 507.35066800192 512.516072999686 512.9548749998212 513.8693029992282 515.4165449999273 520.8536369986832 521.5280770007521 522.3996169995517 523.906452998519 533.485555998981 536.4692379981279 537.9507250003517 538.8765869997442 547.9370120018721 575.3114420007914 755.3887949995697 784.9691169988364 793.0369869992137 797.3819179981947 798.6516109984368 800.4726979993284 804.7938640005887 826.9029959999025 827.8948160000145 831.6543379984796 832.1979169994593 836.5073649995029 838.1481940001249 843.1084800027311 846.2836509998888 847.4714770000428 850.5929370000958 852.7059739995748 852.8649900015444 855.2910970002413 857.4301350004971 857.5306399986148 858.0049239993095 858.2806400004774 859.0767830014229 861.7371830008924 868.1413979995996 869.4258630014956 870.7544359974563 872.8611660003662 874.4832370020449 874.4891769997776 877.719604998827 878.1126300022006 878.5659179985523 882.4257409982383 885.4670410007238 898.0234379991889 1281.6365970000625

Current
Mean: 977.792 ms
Stdev: 46.686 ms (4.8%)
Runs: 881.4894619993865 894.0588790010661 904.8701179996133 907.1295979991555 916.0704350024462 920.8883870001882 922.5166830010712 924.0729580000043 927.5765799991786 933.5406910032034 936.4139409996569 938.2302659992129 943.6842860002071 943.9318849984556 944.0189209990203 946.2089440003037 955.376099999994 961.7888999991119 962.5775150004774 968.7799490001053 973.70389899984 977.7132169995457 982.5877289995551 982.8502610009164 987.1121830008924 987.6048179995269 989.6257330011576 990.1822520010173 1000.4278980009258 1007.4913739971817 1007.9750569984317 1009.0184739995748 1009.0211590006948 1010.3396000005305 1010.5242110006511 1012.7913819998503 1014.1388759985566 1022.1523450016975 1022.1689450014383 1025.781819999218 1026.3918460011482 1027.7007660008967 1027.74190299958 1037.6599940024316 1038.3234869986773 1040.149007000029 1101.8000489994884

Meaningless Changes To Duration

Show entries
Name Duration
App start time nativeLaunch 24.102 ms → 24.746 ms (+0.644 ms, +2.7%)
App start time nativeLaunchEnd_To_appCreationStart 78.083 ms → 75.552 ms (-2.532 ms, -3.2%)
App start time appCreation 83.333 ms → 81.733 ms (-1.600 ms, -1.9%)
App start time contentAppeared_To_screenTTI 565.662 ms → 573.742 ms (+8.080 ms, +1.4%)
App start time appCreationEnd_To_contentAppeared 625.719 ms → 627.569 ms (+1.850 ms, ±0.0%)
App start time runJsBundle 442.817 ms → 440.250 ms (-2.567 ms, -0.6%)
App start time TTI 1378.793 ms → 1387.063 ms (+8.271 ms, +0.6%)
App start time regularAppStart 0.021 ms → 0.021 ms (+0.000 ms, +1.7%)
App start time (CPU) 127.094 % → 127.783 % (+0.689 %, +0.5%)
App start time (FPS) 60.000 FPS → 60.000 FPS
App start time (RAM) 346.928 MB → 347.586 MB (+0.658 MB, ±0.0%)
App start time (CPU/JS) 77.772 % → 77.786 % (+0.015 %, ±0.0%)
App start time (CPU/UI) 19.587 % → 19.322 % (-0.265 %, -1.4%)
Open search router TTI Load Search Options 95.128 ms → 95.926 ms (+0.798 ms, +0.8%)
Open search router TTI Open Search Router TTI 711.730 ms → 705.455 ms (-6.275 ms, -0.9%)
Open search router TTI (CPU) 144.178 % → 146.133 % (+1.955 %, +1.4%)
Open search router TTI (FPS) 56.199 FPS → 56.298 FPS (+0.099 FPS, ±0.0%)
Open search router TTI (RAM) 371.580 MB → 371.351 MB (-0.229 MB, ±0.0%)
Open search router TTI (CPU/JS) 76.907 % → 78.197 % (+1.290 %, +1.7%)
Open search router TTI (CPU/UI) 25.076 % → 25.475 % (+0.399 %, +1.6%)
Report typing Composer typing rerender count 1.000 renders → 1.000 renders
Report typing Message sent 388.131 ms → 387.328 ms (-0.803 ms, ±0.0%)
Report typing (CPU) 100.639 % → 100.634 % (-0.004 %, ±0.0%)
Report typing (FPS) 60.000 FPS → 60.000 FPS
Report typing (RAM) 454.574 MB → 454.267 MB (-0.307 MB, ±0.0%)
Report typing (CPU/JS) 45.203 % → 44.903 % (-0.300 %, -0.7%)
Report typing (CPU/UI) 25.765 % → 25.947 % (+0.183 %, +0.7%)
Chat opening Chat TTI 560.101 ms → 569.987 ms (+9.886 ms, +1.8%)
Chat opening (CPU) 154.664 % → 152.823 % (-1.842 %, -1.2%)
Chat opening (FPS) 57.603 FPS → 60.000 FPS (+2.397 FPS, -4.2%)
Chat opening (RAM) 366.341 MB → 363.102 MB (-3.240 MB, -0.9%)
Chat opening (CPU/JS) 77.455 % → 78.620 % (+1.165 %, +1.5%)
Chat opening (CPU/UI) 30.966 % → 31.637 % (+0.672 %, +2.2%)
Linking (CPU) 159.751 % → 156.498 % (-3.253 %, -2.0%)
Linking (FPS) 60.000 FPS → 59.974 FPS (-0.026 FPS, ±0.0%)
Linking (RAM) 398.099 MB → 408.975 MB (+10.876 MB, +2.7%)
Linking (CPU/JS) 86.161 % → 84.986 % (-1.175 %, -1.4%)
Linking (CPU/UI) 33.553 % → 31.957 % (-1.597 %, -4.8%)
Show details
Name Duration
App start time nativeLaunch Baseline
Mean: 24.102 ms
Stdev: 2.691 ms (11.2%)
Runs: 21 21 21 21 21 21 21 22 22 22 22 22 22 22 22 22 22 22 22 22 22 23 23 23 23 23 23 23 23 23 23 23 23 24 24 24 24 24 24 24 25 25 25 25 26 26 27 27 28 28 28 28 28 28 29 29 30 30 31

Current
Mean: 24.746 ms
Stdev: 3.160 ms (12.8%)
Runs: 21 21 21 22 22 22 22 22 22 22 22 22 22 22 22 22 23 23 23 23 23 23 23 23 23 23 23 23 23 24 24 24 24 24 24 24 25 25 25 25 26 26 26 26 26 27 27 27 27 28 28 29 29 31 31 32 32 33 33
App start time nativeLaunchEnd_To_appCreationStart Baseline
Mean: 78.083 ms
Stdev: 10.125 ms (13.0%)
Runs: 60 61 64 65 66 66 66 67 68 69 69 69 69 70 70 70 70 70 71 71 72 72 73 73 74 75 75 76 76 76 77 77 77 79 79 80 80 80 81 81 81 82 82 85 86 86 86 88 88 88 89 92 93 93 95 95 96 96 96 104

Current
Mean: 75.552 ms
Stdev: 7.925 ms (10.5%)
Runs: 60 61 63 63 66 66 67 67 67 68 69 69 69 69 69 70 70 71 71 72 73 73 73 74 74 74 74 75 75 75 75 75 75 75 76 77 77 78 78 78 79 79 79 80 81 81 84 84 84 86 86 86 86 87 89 92 93 95
App start time appCreation Baseline
Mean: 83.333 ms
Stdev: 10.445 ms (12.5%)
Runs: 66 67 67 68 69 70 70 71 71 72 73 73 73 74 75 77 77 77 77 78 78 78 79 79 80 80 81 81 81 81 82 83 83 83 84 85 85 86 86 87 88 88 89 89 89 90 92 92 96 96 97 97 97 99 100 101 102 103 103 105

Current
Mean: 81.733 ms
Stdev: 9.951 ms (12.2%)
Runs: 65 66 66 67 68 69 70 70 70 71 73 73 73 74 74 74 74 76 76 76 77 77 77 78 78 79 79 80 81 81 81 81 82 82 83 84 84 84 85 86 86 86 87 87 88 88 89 89 90 90 91 92 94 95 95 96 103 104 104 106
App start time contentAppeared_To_screenTTI Baseline
Mean: 565.662 ms
Stdev: 42.637 ms (7.5%)
Runs: 481.5870570000261 485.8545069992542 486.3971919994801 505.3127309996635 508.43269000016153 514.3004410006106 516.832043999806 518.3623849991709 520.7450840007514 521.1272180005908 521.3218559995294 529.2360609993339 533.7874539997429 534.5413910001516 538.6799149997532 538.8330889996141 539.8971870001405 542.6279429998249 544.0132880005985 544.3067409992218 546.2543930001557 548.3529119994491 549.3976729996502 551.3380149994045 552.7343039996922 553.1127070002258 556.1165050007403 557.8627560008317 558.3519460000098 563.4217460006475 564.6500209998339 564.7968359999359 575.5143119990826 575.5999999996275 578.7985030002892 584.718642000109 584.9974489994347 586.6020800005645 588.3887799996883 589.5207320004702 589.553184999153 590.5830419994891 592.9067279994488 601.3976709991693 602.7223450001329 602.896759999916 611.3751790001988 611.9866320006549 615.5216649994254 615.5642349999398 617.3802600000054 617.4504680000246 628.9212469998747 629.1281969994307 630.1394110005349 649.9699140004814 678.504979999736

Current
Mean: 573.742 ms
Stdev: 33.056 ms (5.8%)
Runs: 498.8654449991882 499.242662999779 517.4782800003886 522.5178469996899 522.7375910002738 530.8595189992338 533.3888910003006 538.0835459996015 540.3182490002364 541.5928240008652 542.6023789998144 543.4389619994909 545.223008999601 552.0210469998419 553.4229799993336 557.8527540005744 559.1683360002935 562.0698290001601 563.0866899993271 563.3357079997659 564.2375249993056 564.8699360005558 565.111400000751 567.1746769994497 567.1758510004729 567.5844999998808 571.6362670008093 572.4088799990714 572.6502000000328 573.5556010007858 573.9177429992706 574.0479129999876 575.0630009993911 575.4646450001746 577.2214659992605 577.6165130008012 579.3236320000142 586.9180420003831 587.9918559994549 588.0842860005796 592.6197980009019 595.5388440005481 597.3244589995593 599.840823000297 601.3698399998248 606.2627230007201 606.8582910001278 607.944618999958 615.5088909994811 619.0689780004323 619.7745260000229 620.47829500027 622.3006580006331 624.819063000381 632.2166559994221 633.0557450000197 638.9732499998063
App start time appCreationEnd_To_contentAppeared Baseline
Mean: 625.719 ms
Stdev: 43.350 ms (6.9%)
Runs: 529 537 537 539 554 558 562 572 579 581 581 588 588 595 596 605 605 606 609 614 615 622 622 623 624 625 629 630 631 632 637 639 639 646 648 652 653 653 655 656 656 657 657 657 659 660 661 663 664 665 665 669 669 680 693 705 720

Current
Mean: 627.569 ms
Stdev: 45.421 ms (7.2%)
Runs: 535 536 538 556 558 563 567 574 579 580 580 582 582 591 595 605 606 608 610 611 615 618 620 622 623 623 625 629 631 631 634 639 639 639 642 643 647 648 648 649 650 651 654 657 658 660 661 662 665 666 670 673 687 692 695 701 735 741
App start time runJsBundle Baseline
Mean: 442.817 ms
Stdev: 29.455 ms (6.7%)
Runs: 370 376 383 385 391 392 399 399 409 413 413 419 422 422 423 424 430 432 433 435 436 436 437 437 438 439 439 442 443 444 451 453 455 455 455 456 457 457 458 459 462 462 464 466 466 468 470 470 471 471 472 472 474 475 476 478 478 481 484 492

Current
Mean: 440.250 ms
Stdev: 29.555 ms (6.7%)
Runs: 373 379 382 384 389 390 403 408 411 412 413 415 415 417 419 419 420 423 428 429 430 431 432 432 432 435 437 437 438 438 439 439 445 446 447 451 451 454 458 458 461 462 464 464 464 469 469 471 472 472 472 472 475 477 478 479 482 482 485 486
App start time TTI Baseline
Mean: 1378.793 ms
Stdev: 76.182 ms (5.5%)
Runs: 1208.4326900001615 1230.587057000026 1241.0132880005985 1256.6799149997532 1261.7874539997429 1262.3004410006106 1265.3529119994491 1270.2360609993339 1271.3971919994801 1284.3127309996635 1290.8545069992542 1294.9067279994488 1295.5413910001516 1307.7450840007514 1314.3218559995294 1325.1272180005908 1327.6279429998249 1339.6020800005645 1348.7343039996922 1349.832043999806 1353.362384999171 1359.3976729996502 1359.583041999489 1361.7985030002892 1362.3380149994045 1366.1165050007403 1371.3802600000054 1376.2543930001557 1378.8330889996141 1382.650020999834 1389.8971870001405 1403.3519460000098 1408.2267310004681 1414.6773220002651 1415.8627560008317 1416.5216649994254 1421.5143119990826 1425.1127070002258 1431.9271699991077 1432.553184999153 1432.718642000109 1435.9212469998747 1437.3976709991693 1438.3751790001988 1442.9974489994347 1444.139411000535 1446.3067409992218 1446.7968359999359 1446.896759999916 1449.4504680000246 1450.5642349999398 1452.5999999996275 1452.986632000655 1463.1281969994307 1463.3887799996883 1466.5207320004702 1479.9699140004814 1483.722345000133 1489.4217460006475 1526.504979999736

Current
Mean: 1387.063 ms
Stdev: 68.204 ms (4.9%)
Runs: 1239.8654449991882 1258.3888910003006 1260.4782800003886 1274.51784699969 1278.9177429992706 1281.3182490002364 1282.242662999779 1285.2214659992605 1287.8595189992338 1294.8699360005558 1296.0479129999876 1328.47829500027 1330.6165130008012 1343.223008999601 1343.7375910002738 1345.111400000751 1345.1746769994497 1346.5928240008652 1365.6023789998144 1366.3244589995593 1367.021046999842 1370.0842860005796 1372.2375249993056 1381.4389619994909 1381.9918559994549 1384.944618999958 1392.4233989994973 1393.2627230007201 1403.4088799990714 1405.0689780004323 1405.4646450001746 1406.5388440005481 1409.6362670008093 1412.175851000473 1413.1683360002935 1414.3698399998248 1415.063000999391 1415.0835459996015 1419.5556010007858 1423.3357079997659 1425.086689999327 1427.774526000023 1428.06982900016 1429.6502000000328 1431.0557450000197 1431.4229799993336 1431.8527540005744 1433.3236320000142 1434.624322000891 1438.9180420003831 1444.619798000902 1446.8582910001278 1447.4301280006766 1448.5844999998808 1449.508890999481 1457.819063000381 1479.3006580006331 1506.9732499998063 1530.840823000297 1559.216655999422
App start time regularAppStart Baseline
Mean: 0.021 ms
Stdev: 0.002 ms (8.7%)
Runs: 0.017333999276161194 0.01753699965775013 0.01769999973475933 0.017781998962163925 0.01810700073838234 0.018187999725341797 0.018636999651789665 0.019043000414967537 0.019164999946951866 0.01924700103700161 0.019287999719381332 0.01936899870634079 0.019612999632954597 0.019816000014543533 0.01981700025498867 0.019857000559568405 0.020142000168561935 0.02018200047314167 0.020222999155521393 0.020304000005126 0.020305000245571136 0.0204670000821352 0.020508000627160072 0.020711999386548996 0.02075199969112873 0.02075199969112873 0.02075199969112873 0.020791999995708466 0.020833000540733337 0.020833000540733337 0.020833000540733337 0.020914999768137932 0.020955998450517654 0.02103700116276741 0.02103700116276741 0.021118000149726868 0.021239999681711197 0.021402999758720398 0.0215659998357296 0.02160700038075447 0.02168700098991394 0.02221599966287613 0.022338999435305595 0.02237899973988533 0.022379999980330467 0.022420000284910202 0.022502001374959946 0.02254200167953968 0.022582998499274254 0.022704999893903732 0.022745998576283455 0.022867999970912933 0.022989999502897263 0.023559998720884323 0.023723000660538673 0.024007000029087067 0.025472000241279602 0.02583799883723259

Current
Mean: 0.021 ms
Stdev: 0.002 ms (8.8%)
Runs: 0.017904000356793404 0.01814800128340721 0.01839200034737587 0.01839200034737587 0.018718000501394272 0.018758000805974007 0.01879899948835373 0.019409000873565674 0.019491000100970268 0.019571999087929726 0.019897999241948128 0.019938999786973 0.02006099931895733 0.02018199861049652 0.02018199861049652 0.020183000713586807 0.020263999700546265 0.020385000854730606 0.02042599953711033 0.020508000627160072 0.0206300001591444 0.020793000236153603 0.020834000781178474 0.020875001326203346 0.021077999845147133 0.02115900069475174 0.021240001544356346 0.02132200077176094 0.021443000063300133 0.021483998745679855 0.021483998745679855 0.02148500084877014 0.0215659998357296 0.0215659998357296 0.0215659998357296 0.021606000140309334 0.02197299897670746 0.021973000839352608 0.022012999281287193 0.022012999281287193 0.022095000371336937 0.022216999903321266 0.022216999903321266 0.022257000207901 0.022339001297950745 0.022501999512314796 0.02294899895787239 0.023315999656915665 0.0233559999614954 0.023722998797893524 0.023843999952077866 0.024617999792099 0.025918999686837196 0.02600100077688694 0.026367001235485077
App start time (CPU) Baseline
Mean: 127.094 %
Stdev: 10.691 % (8.4%)
Runs: 109.52259743198147 110.69771687323151 110.8638748670303 111.14226846769445 111.78706619588384 113.94701754105819 114.88893837332296 115.75301918067721 116.76646706586823 116.80876494023903 117.10615280594998 117.74938766421732 117.93108128607811 118.22099914663079 118.41607862903228 118.78121322009098 118.96926111122177 119.94315229201773 120.65315227174891 121.0068903846001 121.24248496993985 121.82217317338456 122.47671654702523 123.02735793999597 123.52955127597005 123.90036335819472 124.58637253157804 124.76130979042408 124.79282868525893 125.1866490996926 126.18688297805448 126.79282868525895 126.80079681274898 126.84812965892021 127.43499085328351 127.97638021165372 128.83620122949677 128.8965385350928 128.98444472778277 129.1100953625811 129.2475971366045 129.61765114387188 130.1775147928994 130.69190062741623 133.36118745693173 135.63484852014946 136.4352318548387 137.12832550860725 138.60923571184335 139.07053431701323 139.84409122106445 140.31454648174235 140.72304085997752 143.43434343434345 144.4410753992318 146.66968268330243 146.91196316583304 148.51587301587304 149.91400801539973 150.75899922813647

Current
Mean: 127.783 %
Stdev: 10.536 % (8.2%)
Runs: 107.16737012346653 109.53251008064517 111.68499654078295 112.49369959677422 113.8315638792795 114.26865981521853 115.57005104934774 116.6611001105359 116.67619092972686 117.04246816987266 117.95503357312232 118.2902584493042 118.51423870891922 118.76247504990016 118.81188118811879 119.02333290832595 120.94906945364832 121.21337169087593 121.24248496993987 121.60932669016721 121.94508538990328 122.83214540412835 122.87244214955061 122.97582120416769 123.26975084412156 123.3335309578862 124.79223825997056 124.79282868525894 124.95808182427902 125.949508045465 126.23903852176636 126.64114003069554 128.00362702130872 128.67793240556662 129.81430056932953 130.67918014246317 130.92088486548516 131.7768924302789 131.87272901128327 132.43173926767676 132.6999693533558 132.73907797815596 132.85799168152104 135.06311528419846 135.47681851667025 135.80590417554666 135.8810622146411 136.30229419703105 137.55954851845263 138.7417692527913 140.73083778966122 141.81269239876872 142.01561588263084 142.04672479320368 144.0982047412438 145.34165971910474 146.30336345480785 146.9471636546185 148.16386845249323 150.30060120240478
App start time (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
App start time (RAM) Baseline
Mean: 346.928 MB
Stdev: 7.597 MB (2.2%)
Runs: 332.095703125 332.923828125 335.572265625 336.056640625 336.33203125 337.2109375 338.029296875 338.5546875 338.697265625 339.474609375 339.595703125 339.69921875 339.763671875 339.8125 339.99609375 342.37109375 342.8203125 342.947265625 343.14453125 343.283203125 343.435546875 343.544921875 343.7734375 344.107421875 344.244140625 344.556640625 344.630859375 345.748046875 346.08984375 346.29296875 346.896484375 346.919921875 347.048828125 347.064453125 348.095703125 348.58984375 349.39453125 349.533203125 349.931640625 350.658203125 350.728515625 350.767578125 351.236328125 351.33984375 352.171875 352.73046875 352.8671875 354.322265625 354.986328125 355.8203125 356.12109375 356.23828125 356.287109375 356.634765625 358.193359375 358.76953125 361.396484375 362.62109375 366.552734375

Current
Mean: 347.586 MB
Stdev: 8.820 MB (2.5%)
Runs: 334.830078125 337.041015625 338.015625 338.1640625 338.26953125 338.431640625 338.4375 338.498046875 338.62890625 338.677734375 338.921875 339.087890625 339.28125 339.326171875 339.666015625 339.73828125 339.775390625 340.09375 340.16015625 340.41796875 340.732421875 341.140625 341.599609375 342.677734375 343.6796875 344.466796875 345.166015625 345.435546875 345.927734375 346.541015625 346.625 346.826171875 347.626953125 347.736328125 347.888671875 349.255859375 349.375 349.4375 349.865234375 350.314453125 350.716796875 351.072265625 352.509765625 353 354.025390625 354.46484375 354.830078125 355.376953125 355.798828125 355.80078125 355.9375 356.201171875 356.359375 357.90625 359.509765625 359.677734375 365.572265625 365.845703125 366.107421875 376.64453125
App start time (CPU/JS) Baseline
Mean: 77.772 %
Stdev: 2.844 % (3.7%)
Runs: 70.9 70.9 72.8 73.9 74 74.7 74.9 74.9 74.9 74.9 74.9 75 75.1 75.2 75.2 75.4 75.9 75.9 75.9 76 76.3 76.6 76.7 76.8 76.9 76.9 77 77.1 77.5 77.7 78 78 78.6 78.7 78.9 78.9 79 79.1 79.1 79.2 79.5 79.6 79.6 79.9 80 80.2 80.4 80.5 80.5 80.8 80.8 80.9 80.9 81 81.4 81.7 81.7 81.9 82.7 84

Current
Mean: 77.786 %
Stdev: 3.110 % (4.0%)
Runs: 70.8 71.9 72.2 72.4 72.9 73.1 73.7 74 74.1 74.1 75 75 75.6 75.7 75.7 75.8 75.9 76 76.2 76.7 76.8 76.9 77.4 77.5 77.6 77.6 77.6 77.9 77.9 78 78 78 78.3 78.6 78.6 78.6 78.7 78.8 78.8 78.9 79.1 79.7 79.8 79.8 79.8 79.8 80 80.4 80.5 80.6 80.8 80.8 81 82 82.2 82.9 83.3 83.9 85.7
App start time (CPU/UI) Baseline
Mean: 19.587 %
Stdev: 4.544 % (23.2%)
Runs: 12.9 13 13.1 13.9 14 14 14 14.9 14.9 15 15 15 15.8 15.9 15.9 16 16 16 16 16.9 16.9 17 17.1 17.8 17.9 18 18.9 19 19 19 19 19 19 19 19.1 19.8 19.9 20 20 20 20.9 20.9 22 23 23.1 23.1 24 24.1 24.3 24.9 24.9 25 25.5 26.1 26.1 27.1 27.8 28.5 28.9 31.4

Current
Mean: 19.322 %
Stdev: 4.785 % (24.8%)
Runs: 9.9 11 11.9 12 12 13 13.9 14 14 14.9 14.9 14.9 14.9 14.9 15 15 15.8 15.8 16 16.9 17 17 17 17.8 17.9 17.9 17.9 17.9 18 19 19.1 20 20 20 20.1 20.9 21 21 21 21 21.1 21.8 21.9 22 23 23 24 24 24.2 25 25 26 26.1 26.2 26.2 26.9 27.1 27.2 27.3 29.1
Open search router TTI Load Search Options Baseline
Mean: 95.128 ms
Stdev: 5.644 ms (5.9%)
Runs: 83.78177900053561 84.94616699963808 85.17627000063658 85.17627000063658 85.7120369989425 86.09171499870718 86.76981600001454 86.90901700034738 87.09855099953711 87.57128900103271 87.72859700024128 87.72859700024128 87.75797599926591 87.89363699965179 88.30847200006247 88.85489899851382 88.88834699988365 89.26415999978781 89.27209500037134 89.48376500047743 89.65364600159228 90.01102699898183 90.03653999976814 90.22546400129795 90.37915099970996 90.48315400071442 90.64685100130737 90.65722700022161 90.73026599921286 90.73905400000513 90.79036400094628 91.16756200045347 91.25138299912214 91.32548000104725 91.35441100038588 91.41288300044835 91.67110199853778 91.67110199853778 91.74658199958503 91.78580700047314 91.99092600122094 92.14200900122523 92.14200900122523 92.33483900129795 92.45886299945414 92.76729400083423 93.3707280009985 93.41646300069988 93.54703699983656 93.58109600096941 93.90189599990845 94.11352599970996 94.26476999931037 94.35994499921799 94.51281799934804 94.65857000090182 94.84993500076234 94.99674500152469 95.06538899987936 95.11470500007272 95.12149999849498 95.38993299938738 95.39030000008643 95.45699100010097 95.51790300011635 95.54280599951744 95.68074500001967 95.68102999962866 95.71960400044918 95.72810800001025 95.81933600082994 95.8226730003953 95.85786999948323 95.97143500111997 96.14412399940193 96.28804500028491 96.43623900040984 96.43623900040984 96.46508800052106 96.46643100120127 96.57629399932921 97.44445800036192 97.76078299991786 97.76078299991786 97.76176000013947 97.89648400060833 98.08487999998033 98.33597800135612 98.65140799991786 99.00720199942589 99.14619900099933 99.15222200006247 99.36291499994695 99.61153200082481 99.66919000074267 99.71004300005734 100.27323400042951 100.61938500031829 100.71606500074267 100.81062900088727 101.10123699903488 101.17846600152552 101.26196299865842 102.0491529982537 102.22884099930525 102.58781000040472 102.61641400121152 102.69755100086331 102.87284300103784 103.50150599889457 103.9757489990443 104.23685699887574 105.01839199848473 105.23278800025582 105.2735190000385 107.07316100038588 107.36543799936771 107.45552599988878 108.12764500081539 108.46236100047827

Current
Mean: 95.926 ms
Stdev: 6.086 ms (6.3%)
Runs: 82.33862299844623 82.4157720003277 83.60107400082052 83.60107400082052 84.82723000086844 85.08752400055528 86.56836000084877 86.64245600067079 87.23099699988961 87.62927299924195 87.72798699885607 88.37235599942505 88.984659999609 89.60046299919486 89.65502999909222 89.8035070002079 89.8035070002079 89.90218099951744 90.33577500097454 90.3512779995799 90.74804699979722 90.75614500045776 90.92419500090182 91.38590499944985 91.43632000125945 91.63484699837863 92.01745700091124 92.02518700063229 92.03853299841285 92.23779300041497 92.26049800030887 92.36140900105238 92.45796700008214 92.57527700066566 92.58475699834526 92.59322099946439 92.62129699997604 92.65938300080597 92.74967500008643 92.76916499994695 93.19506900012493 93.57092300057411 93.58317100070417 93.60677099972963 93.83064799942076 93.98331700079143 94.0320640001446 94.20886299945414 94.24304200150073 94.36124599911273 94.37735999934375 94.38822500035167 94.42085800133646 94.47615499980748 94.61242699995637 94.65661700069904 94.84655700065196 94.85786999948323 95.06583700142801 95.09627299942076 95.27571599930525 95.67484600096941 95.78605099953711 96.20316600054502 96.42370600067079 96.51167800091207 96.52123999968171 96.70137500017881 96.70813000015914 96.73242200165987 96.82181799970567 97.1026610005647 97.26700800098479 97.64058400131762 97.81245900131762 97.98030599951744 97.98055000044405 98.23905500024557 98.36547899991274 98.39282199926674 98.40856899879873 98.42793800123036 98.48018399998546 98.62703499943018 98.67736800014973 98.79443399980664 99.5118010006845 99.82759599946439 99.91011600010097 99.9983719997108 100.29329399950802 100.41984099894762 100.82889799959958 101.1726070009172 101.23677599988878 101.42671800032258 101.50439400039613 101.7086589988321 102.01102700084448 102.39269999973476 102.55712899938226 102.578572999686 102.59505199827254 102.72416199930012 102.96419299952686 103.04899100027978 103.3194989990443 105.26798499934375 105.57112700119615 105.67207900062203 106.92997199855745 107.14021799899638 107.34948799945414 107.35921300016344 107.97534199990332 109.53820800036192 109.87967900000513 112.30668099969625
Open search router TTI Open Search Router TTI Baseline
Mean: 711.730 ms
Stdev: 31.038 ms (4.4%)
Runs: 632.4744879994541 642.5528970006853 647.7126470003277 653.578451000154 665.1927090007812 666.9729410000145 675.3828130010515 675.8646649997681 679.469117000699 681.3695080000907 689.1237800009549 689.7741289995611 690.7693680003285 691.9847820010036 692.3027759995311 692.3656009994447 695.566122001037 698.9641529992223 699.9180100001395 700.1344820000231 700.1770839989185 700.3240969981998 702.332480000332 708.9118659999222 709.3707689996809 709.3880209997296 710.9083660002798 711.2564700003713 712.4295249991119 713.1406260002404 716.6011960003525 720.8303629998118 721.5340180005878 721.921509001404 722.3466800004244 723.0994469989091 723.5045570004731 723.531697999686 726.1273599993438 726.2259519994259 727.5046389997005 730.0641690008342 733.6868900004774 734.954183999449 735.3468429986387 735.8791100010276 737.2133390009403 740.7394609991461 743.4321289993823 746.5620120000094 746.8135180007666 747.1892090011388 748.2212329991162 751.5869149994105 752.3845219984651 754.7795010004193 758.360433999449 790.1765960007906

Current
Mean: 705.455 ms
Stdev: 28.172 ms (4.0%)
Runs: 623.0686039999127 648.9271239992231 657.1370450016111 658.7293699998409 658.7387290000916 662.94165099971 665.0191249996424 668.5931810010225 673.9187010005116 680.2371830008924 681.3046059999615 684.5090330000967 686.5025229994208 688.059366999194 692.2177740000188 693.4427899997681 695.5927740000188 695.6769200004637 700.9179689995944 701.643595000729 702.9474689997733 704.9801440015435 705.8515220005065 706.8171800002456 707.0877279993147 707.5559490006417 707.8933110013604 710.5598150007427 711.5939539987594 712.5579429995269 713.7914230003953 714.7059330008924 715.6818039994687 716.2454840000719 716.6859540008008 718.1899820007384 718.2711190003902 718.5796310007572 720.1782630011439 720.7180180009454 722.3435469996184 725.7243649996817 726.4965419992805 727.2545580007136 731.7289230003953 732.7194830011576 736.9732670001686 737.4250489994884 741.6300869993865 742.2151280008256 745.4925539996475 747.6314289998263 751.0232340004295 757.8427329994738
Open search router TTI (CPU) Baseline
Mean: 144.178 %
Stdev: 4.743 % (3.3%)
Runs: 133.53383406972995 134.16290193070026 136.20692695839338 136.73705179282874 137.4686408191681 137.7538287061711 138.19630996641996 138.32288685715602 138.822330792035 138.8526757657327 139.24261851236125 139.53912382280024 139.59316046666865 139.7131474103586 139.86260056605258 140.0016966075863 140.64529340057547 141.06923667866818 142.02570953710114 142.05571218378435 142.31108608299346 142.80059800717297 142.85373178941097 143.10319202271606 143.3804005593757 143.65022700901602 143.7946060071094 144.16201598321842 144.31432239478124 144.37093865539242 144.73926354018968 144.84989403704222 145.08875771778656 145.08954907381724 145.16783166734265 145.1955108712107 145.71045119032857 145.8376228398701 146.48093111593764 146.51022627517264 147.152132433044 147.43516825610533 147.52823338937014 147.62599717909922 147.80936300414697 147.87343613916343 148.00537901769596 148.10695944573038 148.59081293671267 148.6091208289373 148.82825707423498 149.17632587908923 149.67096158578 149.69675785506033 149.9482395218341 150.10344988188038 151.75996647283773 152.12866817084947 152.31337325349304 155.0888180961105

Current
Mean: 146.133 %
Stdev: 4.890 % (3.3%)
Runs: 135.81836327345314 137.19681996516715 137.58895532048942 138.79923592204338 139.30950767307257 139.8629648165118 139.98434384350043 140.77394695293071 140.78612899904917 140.84543589170386 141.19568959247496 141.33154010703697 142.50342348415063 142.74444828763927 142.82376903633923 142.84143023255913 143.31054623820097 143.4392017537401 143.6185904351072 143.73310859053757 143.97949052182804 144.29034014150537 144.52125232457567 144.71405897594795 144.97456928020196 145.18085485622876 145.2033627886683 145.5584241728821 145.57889668377368 145.73202432344624 145.93888303837898 146.03675426394767 146.05731065321646 146.61624405126057 146.7856557800734 147.04836235996572 147.16353845362266 147.67406061551748 147.69029015511938 147.82269218253012 148.782793988119 148.93335912422228 149.09031953705906 149.14557847904135 149.2118974125591 149.6938099306181 150.3737417807576 150.59873056679749 150.81513569715298 151.18345181595163 151.3718089668912 151.39905202116495 153.32380873539034 153.65739110740486 153.92404519847668 154.65130614664278 155.89590134794284 156.190429510975 156.50620885795192
Open search router TTI (FPS) Baseline
Mean: 56.199 FPS
Stdev: 1.390 FPS (2.5%)
Runs: 52.65653214139945 52.78565212861835 53.827417996176116 53.93437398405248 54.22648449298784 54.55479513117143 54.60756066930875 54.758415458948114 54.788748293377026 54.80664347461397 54.95349236035497 55.03350661668219 55.13403930534214 55.2875991669193 55.36538569019215 55.40855146006231 55.445477073779465 55.53831451735771 55.59396952202884 55.69225275308065 55.7171204992433 55.71752763147313 55.95312075753529 55.97919083301336 55.98532872923404 56.16128219768151 56.18684985214377 56.21402016237815 56.33835860995214 56.40036488342098 56.52814372809656 56.54894545111122 56.6405584302381 56.64388097806085 56.66354530647651 56.670340476231466 56.71387589321492 56.74127531256944 56.850328378919684 57.08002777647431 57.1072448222949 57.23453975496487 57.24395896766215 57.34056191038358 57.34934450293407 57.362582154714445 57.62451067307034 57.845583537856584 57.86417221444854 57.96066364694222 57.97588864035461 57.99151863440793 58.052742857891104 58.22975935826307 58.43383647266187 59.40962214604449

Current
Mean: 56.298 FPS
Stdev: 1.553 FPS (2.8%)
Runs: 52.341958453531475 52.81223695645609 53.53678088312788 54.04955595922959 54.15943338465407 54.48484208365158 54.50586235593684 54.51203608044237 54.56766016186336 54.69747881607163 54.8735649617157 54.95209573363812 55.05651425197246 55.07526127059127 55.21127251911696 55.31259007914584 55.38363894515771 55.41583875306632 55.498279088934346 55.687560085568144 55.71111052559014 55.766849127302805 55.853750403245776 55.8670562032555 55.875826699027336 56.09103819620239 56.101289126821094 56.156269829227824 56.2580044606646 56.27011040205848 56.291446957464274 56.33685791726657 56.43420472439998 56.491721824913775 56.68869222355796 56.85708730064003 56.89208984224494 56.8960536390985 56.91836034138938 57.06370069486347 57.08396282019821 57.154411911474796 57.22994735603104 57.27004037960004 57.39692810324034 57.64371637506976 57.77831476592164 57.7902343519989 57.874384965452656 57.89423331885107 57.96375397912762 58.09995803069239 58.333436463962954 58.40070197507678 58.49900883652977 58.61000744492069 58.63619551450738 58.99211529093202 60
Open search router TTI (RAM) Baseline
Mean: 371.580 MB
Stdev: 3.219 MB (0.9%)
Runs: 363.40625 363.94140625 364.8098958333333 366.123046875 367.33984375 367.5439453125 367.6162109375 367.6650390625 368.3623046875 368.8115234375 369.2119140625 369.2314453125 369.599609375 369.6748046875 369.744140625 369.75390625 369.826171875 370.1591796875 370.1640625 370.2216796875 370.37109375 370.689453125 370.810546875 371.080078125 371.1845703125 371.400390625 371.4345703125 371.46875 371.8720703125 372.0810546875 372.091796875 372.1015625 372.4453125 372.515625 372.5927734375 372.822265625 372.904296875 373.0341796875 373.158203125 373.2001953125 373.23828125 373.46875 373.6826171875 373.96875 374.138671875 374.28125 374.44140625 374.5087890625 374.8623046875 375.0771484375 375.185546875 375.390625 375.779296875 376.2294921875 376.751953125 377.5986328125 379

Current
Mean: 371.351 MB
Stdev: 4.016 MB (1.1%)
Runs: 361.5338541666667 361.81640625 363.4700520833333 365.38671875 366.4453125 366.654296875 366.7216796875 366.7981770833333 366.8046875 367.2587890625 367.29296875 367.6650390625 367.9166666666667 368.376953125 368.568359375 368.6692708333333 368.88671875 369.103515625 369.1826171875 369.361328125 369.5390625 369.7880859375 370.28515625 370.5283203125 370.64453125 370.65625 370.6748046875 370.7841796875 371.2578125 371.3759765625 371.4033203125 371.5322265625 371.6796875 371.68359375 371.9951171875 372.353515625 372.572265625 373.0693359375 373.4306640625 373.77734375 373.8896484375 373.94140625 374.390625 374.408203125 374.4296875 374.6044921875 374.6787109375 374.84765625 374.9462890625 374.998046875 375.01953125 375.3037109375 375.4072265625 375.412109375 375.798828125 375.9873046875 377.8095703125 378.494140625 378.671875 381.095703125
Open search router TTI (CPU/JS) Baseline
Mean: 76.907 %
Stdev: 3.487 % (4.5%)
Runs: 66.9 70.4 71.5 71.5 71.9 72.5 72.7 73.2 73.2 73.3 73.4 73.5 73.9 74 74.3 74.4 74.5 74.7 75 75.3 75.4 75.4 75.9 76.3 76.4 76.4 76.5 76.6 77.3 77.4 77.4 77.4 77.4 77.6 77.7 77.8 77.8 77.9 78.2 78.3 78.3 78.6 78.6 79.1 79.4 79.5 79.8 79.8 79.9 80 80.2 80.5 80.9 81 81.4 82.2 83 83.5 83.6 83.9

Current
Mean: 78.197 %
Stdev: 2.730 % (3.5%)
Runs: 70.9 72.7 74 74.1 74.4 74.4 74.8 74.9 74.9 75 75.2 75.3 75.4 75.5 75.8 76.2 76.4 76.4 76.4 76.9 77.2 77.2 77.4 77.9 77.9 78 78.2 78.3 78.4 78.4 78.5 78.7 79 79.2 79.3 79.3 79.3 79.5 79.6 79.6 79.7 79.9 79.9 80 80 80.2 80.3 80.4 80.5 81 81 81.1 81.3 81.4 81.5 81.7 81.8 82.7 83.1 83.8
Open search router TTI (CPU/UI) Baseline
Mean: 25.076 %
Stdev: 1.570 % (6.3%)
Runs: 21.8 21.9 22.1 22.4 22.9 23.1 23.1 23.3 23.4 23.5 23.7 23.8 23.9 23.9 24 24 24.4 24.4 24.4 24.4 24.5 24.6 24.7 24.9 24.9 24.9 24.9 24.9 25 25 25 25.2 25.2 25.4 25.4 25.4 25.4 25.4 25.4 25.5 25.6 25.8 25.9 25.9 26 26.2 26.4 26.4 26.4 26.5 26.5 26.8 26.9 27.3 27.4 27.8 27.9 28.4 29.4

Current
Mean: 25.475 %
Stdev: 1.695 % (6.7%)
Runs: 22.3 23 23.2 23.4 23.4 23.4 23.4 23.5 23.5 23.6 23.8 23.9 23.9 23.9 23.9 24 24 24.3 24.4 24.5 24.5 24.6 24.7 24.8 24.9 24.9 25 25.1 25.2 25.3 25.3 25.3 25.5 25.6 25.7 25.9 25.9 25.9 26 26 26.1 26.4 26.4 26.5 26.9 26.9 26.9 27.2 27.2 27.4 27.4 27.4 27.4 27.5 27.6 27.9 28 28.9 28.9 30.2
Report typing Composer typing rerender count Baseline
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Report typing Message sent Baseline
Mean: 388.131 ms
Stdev: 33.287 ms (8.6%)
Runs: 342.01261400058866 342.67102100141346 343.27689599990845 345.6153560001403 346.1719560008496 347.53308200091124 348.2978109996766 348.9466149993241 349.0217690002173 349.02868700027466 351.3968509994447 351.9904779996723 353.3706870004535 356.5566819999367 357.031656999141 358.54899200052023 358.6522630006075 363.03259299881756 366.765909999609 369.9514569994062 371.58117699995637 371.6033939998597 372.10929400101304 372.1809080000967 372.6593839991838 373.7526450008154 374.90405300073326 374.91308600082994 378.73815999925137 383.33919299952686 387.6331389993429 387.9402670003474 392.18404100090265 392.18933099880815 393.4321690015495 395.9003500007093 396.7176109999418 399.76786299981177 400.0970859993249 401.6416020002216 402.02685599960387 409.12060599960387 409.2428799998015 412.403523998335 413.4019370004535 413.5408939998597 414.0563559997827 414.9530849996954 419.1456310003996 421.8703209999949 423.74629699997604 424.6675220001489 428.54642800055444 434.9999189991504 435.5404059998691 438.5270189996809 441.88883499987423 451.05057800002396 467.6029870007187 468.3704840000719

Current
Mean: 387.328 ms
Stdev: 33.379 ms (8.6%)
Runs: 336.74092600122094 337.66552699916065 339.7871099989861 340.23030599951744 342.75508600100875 343.16918999888003 345.0463870000094 347.64131699874997 347.64595600031316 347.78967299871147 347.8154300004244 348.4386400002986 349.2255859989673 349.4124759994447 356.6425780002028 357.57617200165987 359.3537600003183 361.5653490014374 364.65327999927104 364.7679040003568 370.04622500017285 371.8547770008445 372.3054200001061 374.48925800062716 374.6493330001831 376.82548099942505 378.7262369990349 380.4096280001104 385.54166699945927 386.03975399956107 391.8679200001061 393.6394449993968 393.84741199947894 395.09908100031316 397.0181079991162 400.465453999117 402.7520350012928 403.80106600001454 403.85355599969625 405.21769299916923 405.35038300044835 407.1305339988321 409.71284999884665 410.1024580001831 410.7504070010036 413.87357600033283 414.6556399986148 415.25968400016427 418.9487299993634 419.5540369991213 420.27172899991274 420.4257399998605 424.8609219994396 425.55135099962354 427.47379600070417 430.0297039989382 436.5098470002413 453.93163999915123 464.12715600058436 464.7606610003859
Report typing (CPU) Baseline
Mean: 100.639 %
Stdev: 3.074 % (3.1%)
Runs: 95.46745424463457 95.9244497196075 96.09987138471855 96.31868232030251 96.44034910218178 96.51803140445985 97.07994343297811 97.15965448949274 97.28339872890372 97.74750347262137 97.84139843122847 97.841447697154 98.06600398897592 98.11583835136679 98.28066782838617 98.35828432871776 98.67148641183066 98.88967169138598 99.0211637601684 99.06315924070371 99.12936883331075 99.2401804625757 99.24482529720405 99.2890794419915 99.60983668022502 99.71920664463246 99.94141074130984 99.95545599983933 100.14893899205785 100.2020032716641 100.25704976414154 100.37168790778375 100.54740721272104 100.58918481433341 100.74346459496083 100.77405996191627 101.19126565377458 101.2767129247064 101.29455059992745 101.3009729523476 101.50826890050286 101.82281210999757 102.42552212868347 102.47624596489462 102.69468012909442 102.9869020553662 103.25843332208841 103.41402042335808 104.2608275126204 104.55934911484385 104.63073069694067 104.880833949084 104.88536773620143 105.0414303437566 105.44664073146407 106.08766013497991 106.53343388766581 107.41023485525481 108.35968642397486

Current
Mean: 100.634 %
Stdev: 3.032 % (3.0%)
Runs: 94.37633421549047 95.52248811186618 95.73987470040491 96.78560782827721 96.92442083578857 97.0374811386721 97.31613733777024 97.83440068589488 98.0913452973381 98.18449003252645 98.2042475232572 98.27654089298508 98.3173440427411 98.53979298810361 98.57227599038366 98.59209545739682 98.59577296164169 98.69899878080031 98.7460495529662 98.8455085338749 99.14672121891904 99.16685848679917 99.17504973242406 99.22250062760997 99.3416826626458 99.53814470652092 99.54817434511067 99.54995435904571 99.67128478450842 100.00968248289027 100.28546429061554 100.38013119382224 100.57824561125082 100.75965920564462 100.77911634357945 100.98107167782088 101.12219146795415 101.24994207463665 101.26868676723349 101.29599329428251 101.42768780184889 101.57021914065474 101.76404361651507 101.82726419809029 102.07199971025011 102.60217279659291 102.6648426442325 102.8736315608513 102.88211432005438 103.07129797684247 103.3644967608057 104.21608227161111 104.51628823629925 105.40284491077006 106.24819634444022 106.26197736645527 106.38683362041193 107.1404733364741 107.63317202382937 107.87122358785058
Report typing (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Report typing (RAM) Baseline
Mean: 454.574 MB
Stdev: 4.472 MB (1.0%)
Runs: 444.26801215277777 446.31272977941177 446.560546875 446.8059895833333 447.3517795138889 448.13074448529414 448.1380208333333 450.4092371323529 450.59722222222223 450.67210477941177 450.8062959558824 451.01714409722223 451.19255514705884 451.24011948529414 451.51410590277777 451.5427517361111 451.6119791666667 452.20616319444446 452.39409722222223 452.4225643382353 452.42784926470586 452.56847426470586 452.8216145833333 453.1360294117647 453.20909926470586 453.4928768382353 453.55360243055554 453.9453125 454.2814670138889 454.29405381944446 454.30675551470586 454.4460018382353 454.47242647058823 454.8210018382353 454.9508272058824 455.16493055555554 455.7740885416667 455.95399305555554 456.31985294117646 457.53125 457.9440104166667 458.02625868055554 458.21208639705884 458.3251378676471 458.4479166666667 458.88671875 458.9075520833333 459.27256944444446 459.4381510416667 459.70225694444446 459.9806857638889 460.15082465277777 460.16905381944446 460.37999131944446 460.6748621323529 460.95789930555554 461.6842447916667 462.99175347222223 463.0390625

Current
Mean: 454.267 MB
Stdev: 4.787 MB (1.1%)
Runs: 444.833984375 445.13304227941177 445.39866727941177 447.3302951388889 447.416015625 447.83318014705884 447.8782552083333 448.12782118055554 448.4075520833333 448.4416232638889 448.58777573529414 448.62217881944446 449.4099392361111 449.71245659722223 449.8079427083333 450.3795955882353 451.1783854166667 451.22219669117646 451.97612847222223 452.1771599264706 452.2922794117647 452.33800551470586 452.51125919117646 452.5397518382353 452.5681423611111 452.8890165441176 453.2345920138889 454.1976102941176 454.64952256944446 455.10914522058823 455.1415441176471 455.8391544117647 455.9069393382353 455.9861111111111 456.1365017361111 456.2686121323529 456.3665364583333 456.4611545138889 456.8072150735294 456.83116319444446 456.9259982638889 457.41061580882354 457.45030381944446 457.5403645833333 457.69898897058823 457.7174479166667 457.7447150735294 458.0475260416667 458.10503472222223 459.38563368055554 459.40125868055554 459.81293402777777 459.92491319444446 459.97764756944446 460.1838107638889 460.31098090277777 460.3185763888889 462.33311631944446 463.2920496323529 464.4967447916667
Report typing (CPU/JS) Baseline
Mean: 45.203 %
Stdev: 3.325 % (7.4%)
Runs: 38.5 39.9 40.5 40.7 41 41.2 41.3 41.4 41.5 42.1 42.1 42.3 42.3 42.3 42.4 42.4 42.9 43.1 43.2 43.4 43.5 43.6 43.7 43.7 43.7 43.8 43.9 43.9 44.1 44.3 44.3 44.7 44.7 45.3 45.3 45.6 45.8 46.1 46.4 46.5 46.5 47.3 47.6 47.8 48 48.2 48.3 48.5 48.8 49.2 49.3 49.4 49.8 50 50.3 50.4 50.9 51 51.4 52.1

Current
Mean: 44.903 %
Stdev: 2.975 % (6.6%)
Runs: 39.7 39.7 40.2 40.4 40.6 40.9 41 41.4 41.6 41.7 41.9 42 42 42.1 42.3 42.3 42.4 42.8 42.9 43 43 43.1 43.4 43.6 43.9 44 44.3 44.3 44.4 44.4 45.1 45.3 45.5 45.6 45.9 46 46 46.3 46.3 46.3 46.6 46.7 46.8 46.8 47 47.5 47.8 48 48.2 48.2 48.4 48.5 48.9 49 49.1 49.4 49.6 49.7 49.8 50.6
Report typing (CPU/UI) Baseline
Mean: 25.765 %
Stdev: 0.592 % (2.3%)
Runs: 24.5 24.7 24.7 24.7 24.9 24.9 24.9 24.9 25.1 25.1 25.1 25.1 25.2 25.3 25.4 25.4 25.4 25.5 25.5 25.6 25.6 25.7 25.7 25.7 25.7 25.8 25.8 25.8 25.8 25.9 25.9 25.9 26 26 26 26 26.1 26.1 26.1 26.1 26.1 26.2 26.2 26.2 26.3 26.3 26.3 26.3 26.3 26.3 26.3 26.4 26.5 26.5 26.8 26.9 27.1

Current
Mean: 25.947 %
Stdev: 0.708 % (2.7%)
Runs: 24.5 24.6 24.6 24.6 24.6 25.1 25.1 25.2 25.2 25.2 25.2 25.4 25.4 25.5 25.5 25.5 25.5 25.5 25.6 25.6 25.7 25.7 25.7 25.7 25.8 25.8 25.9 25.9 25.9 25.9 26 26.1 26.1 26.1 26.2 26.2 26.2 26.2 26.2 26.3 26.3 26.4 26.4 26.4 26.4 26.5 26.5 26.6 26.6 26.6 26.7 26.7 26.8 26.9 26.9 27.1 27.2 27.4 27.5
Chat opening Chat TTI Baseline
Mean: 560.101 ms
Stdev: 45.357 ms (8.1%)
Runs: 454.4073900002986 469.1078699994832 470.0643310006708 493.26200300082564 500.4243980012834 512.5463870000094 515.1599129997194 517.9667559992522 522.0762530006468 522.8198649995029 525.9952810015529 530.0230310000479 530.480345999822 535.3812260013074 535.6789549998939 538.5381680000573 539.3034680001438 540.746255999431 541.1767180003226 542.1853029988706 544.9608970005065 551.3201909996569 551.6121819987893 554.2855230011046 555.6553140003234 560.8196619991213 561.5895999986678 563.4432379994541 565.1986899990588 566.4267169982195 567.2604580000043 570.3553880006075 576.3994549997151 587.5486650001258 593.2613120004535 598.7112230006605 605.1357829999179 606.7546389997005 608.8428959995508 609.1511240005493 612.4209399987012 612.4293210003525 613.0253899991512 616.6231289990246 621.6818849984556 624.3168540000916 626.0207529999316 634.6608480010182 647.6741540003568

Current
Mean: 569.987 ms
Stdev: 36.685 ms (6.4%)
Runs: 478.60774799995124 491.8503419999033 506.9325770009309 509.9696040004492 526.6734209991992 532.1799719985574 534.0275879986584 538.0522050000727 538.3343909997493 538.6490080002695 541.573852000758 544.8846440017223 545.8911540005356 546.7428389992565 549.9699299987406 550.6092130001634 551.1657309997827 552.124145001173 552.3706459999084 554.9088129997253 557.7274580001831 558.0173749998212 559.5812989994884 559.8164869993925 560.8610430005938 561.2232259996235 562.2085779998451 562.4954429995269 565.0786139983684 569.3102620001882 572.6182860005647 579.875204000622 582.8927009999752 586.2045090012252 593.6535240001976 594.5283610001206 596.4257009997964 599.644817000255 602.6625980008394 605.7810469996184 606.3742270004004 607.3551029991359 608.4698489997536 612.4472250007093 614.8135170005262 615.660074999556 618.5494389999658 622.812134001404 623.9058839995414 626.7887369990349 628.2393800001591 637.7600910011679
Chat opening (CPU) Baseline
Mean: 154.664 %
Stdev: 6.413 % (4.1%)
Runs: 135.30636875001323 139.82672444363524 143.4420862686466 146.00742312211221 146.80975676051384 147.8778220451526 148.33997343957503 148.45282672460465 148.80068413386573 148.89214490134367 149.01498066116176 149.1641239427504 149.36035092052882 149.69339353572855 150.27837273065265 150.3371636540995 150.37898246831085 150.4796192020036 150.72306295240648 150.95107189816818 151.35931675046788 151.9793698915021 152.20898839770663 152.53794348510723 152.82815692296566 153.22311682938243 153.2385817012445 153.24182160040445 153.5858506235253 154.10129074099996 155.31822102100662 155.5473799961752 155.59504569163485 155.72308919788568 155.74923164425527 156.62327551264713 157.31271529295398 158.11533506691808 158.5339617142888 158.6371732411337 159.0426025579617 159.085922449858 159.3125621267426 159.44197402822883 159.53845843666198 160.73025906859627 160.7691239982016 161.5321966355964 161.87009216645956 162.1695988775988 162.39646138173686 162.5968030228236 162.78437558192684 162.85411547672183 163.24035276260398 163.52169111742384 163.655596686072 165.06304187110098 165.98157335223257

Current
Mean: 152.823 %
Stdev: 5.746 % (3.8%)
Runs: 140.4428493790848 140.78236586024173 141.0130675981602 141.1368587839177 143.7217063609289 144.10478619749992 144.70169466040343 144.82740626855554 145.99382038323057 146.10016467341885 146.3501817378558 148.46918136186505 148.71912758591847 148.724983432737 149.72217053277242 149.89287723703657 150.10480908065372 150.66979168206169 150.83017217773426 150.8924650228998 151.26840885941672 151.46893529820878 151.49431746623875 151.56674819064463 151.6561887913061 152.24073453288096 152.34261747189223 152.8798594117277 153.15138777267066 153.3278535710483 153.57717406646816 153.67850515226775 153.9452572654559 154.20596852626568 154.2532237581472 154.5169021462692 155.21453822713215 155.66280295604955 155.82946217443532 156.0129942887291 156.33790822015865 156.35378900857089 156.3949635520213 156.88568311221945 157.29952233594219 157.96882207905816 158.4114238183653 158.55042902243332 158.7292765282618 158.80377895778835 158.84705301810314 158.94069353267201 159.49698977828763 159.7923895599966 160.26262762690027 160.38044036251978 161.04728545883813 161.2521943032433 165.28513861220128
Chat opening (FPS) Baseline
Mean: 57.603 FPS
Stdev: 1.592 FPS (2.8%)
Runs: 54.041885356073614 55.09939044250344 55.4343037404797 55.51691753172528 55.57614403906 55.611676095916586 55.65869865564899 55.660451807888336 55.70122417829319 55.77823325563677 55.90477804161716 55.980468662878664 56.10217099295892 56.121637622522606 56.3953127224067 56.433442393987804 56.50582274362335 56.515352544619894 56.66324482389955 56.665186697793125 56.81010835385119 56.830142517988925 56.84316578261271 56.92815375757547 56.95370421917269 57.22322469383603 57.24897512287095 57.29991547587291 57.41280536397364 57.50699999165294 57.56873313657703 57.86784545729707 57.90948894331175 57.98030075209196 58.28165171046152 58.28988736262702 58.295640460487576 58.296624818868835 58.298110958028566 58.33689525095807 58.35665081720833 58.440207946383104 58.670685264071906 58.84368667079644 58.87786209060348 58.98944593864778 59.46859398675596 59.76923732033042 59.99785485529581 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Chat opening (RAM) Baseline
Mean: 366.341 MB
Stdev: 6.700 MB (1.8%)
Runs: 350.8606770833333 352.57421875 353.62890625 353.6419270833333 354.3763020833333 354.6328125 355.484375 356.1861979166667 358.59765625 358.7252604166667 359.7278645833333 359.8111979166667 359.9752604166667 361.1328125 361.87109375 361.92578125 362.4322916666667 362.546875 362.71484375 363.2083333333333 364.3619791666667 364.69140625 365.34765625 365.51171875 366.0169270833333 366.3932291666667 366.7109375 366.8463541666667 368.53125 368.634765625 368.7431640625 369.2421875 369.328125 369.4853515625 369.505859375 369.5751953125 369.6875 369.7783203125 369.8525390625 370.01953125 370.224609375 370.4287109375 370.4921875 370.9296875 371.21875 371.5364583333333 371.89453125 371.9677734375 372.1923828125 372.2001953125 372.2119140625 372.2685546875 372.73046875 373.6630859375 374.5224609375 374.6015625 374.9895833333333 375.2099609375 376.0390625 378.84375

Current
Mean: 363.102 MB
Stdev: 6.700 MB (1.8%)
Runs: 350.7434895833333 352.0338541666667 353.4557291666667 353.5559895833333 354.08984375 354.1640625 354.78125 355.0989583333333 355.9375 356.2981770833333 356.453125 356.6119791666667 356.7916666666667 356.8841145833333 356.9244791666667 357.0169270833333 357.6184895833333 358.1458333333333 358.2942708333333 358.7083333333333 359.4908854166667 359.6848958333333 359.8203125 359.8450520833333 359.85546875 360.2994791666667 361.9986979166667 362.2083333333333 362.25 363.7552083333333 363.7838541666667 363.9127604166667 364.0169270833333 364.4661458333333 364.7255859375 365.68359375 365.71875 366.7392578125 366.8291015625 367.21484375 367.484375 368.1875 368.3046875 368.4365234375 368.8623046875 369.0244140625 369.5361328125 369.8798828125 370.0068359375 370.486328125 370.791015625 370.921875 371.052734375 371.162109375 372.1901041666667 372.3876953125 372.447265625 374.5146484375 381.4192708333333
Chat opening (CPU/JS) Baseline
Mean: 77.455 %
Stdev: 3.393 % (4.4%)
Runs: 70.2 70.6 71.2 72.5 72.7 73.3 73.3 73.5 73.7 73.8 74.2 74.2 74.3 74.4 74.4 74.7 75.2 75.4 75.7 75.8 76.1 76.3 76.5 76.7 76.7 76.8 77 77.3 77.4 77.7 77.8 77.9 77.9 78 78.1 78.4 78.4 78.5 78.6 78.6 78.9 79.3 79.3 79.3 79.6 79.9 79.9 80.1 80.2 80.4 80.9 81.1 81.2 81.4 82.9 83.1 83.3 83.4 84 85.3

Current
Mean: 78.620 %
Stdev: 2.328 % (3.0%)
Runs: 73.9 74.2 74.8 75.1 75.1 75.2 75.3 75.3 75.5 76.2 76.4 76.5 76.6 76.7 77.2 77.2 77.4 77.5 77.7 77.9 78 78 78.1 78.2 78.3 78.3 78.4 78.5 78.5 78.5 78.6 78.7 78.8 78.8 78.9 79 79.2 79.6 79.6 79.7 79.8 79.8 79.9 80.3 80.3 80.4 80.4 80.4 80.6 80.7 80.8 80.9 81.4 82.1 82.3 82.6 83.2 83.5 83.8
Chat opening (CPU/UI) Baseline
Mean: 30.966 %
Stdev: 2.447 % (7.9%)
Runs: 25.3 25.6 25.8 26.1 26.6 27.3 27.3 28.3 28.6 28.6 28.8 28.9 28.9 29 29.3 29.4 29.7 29.9 30 30.1 30.4 30.5 30.7 30.8 30.9 31 31 31.2 31.2 31.5 31.6 31.8 31.8 31.8 31.8 31.9 31.9 32 32.3 32.3 32.5 32.5 32.6 32.6 32.7 32.9 33 33.1 33.2 33.6 33.9 34 34.3 34.3 34.3 34.4 35.1 35.1

Current
Mean: 31.637 %
Stdev: 2.363 % (7.5%)
Runs: 25.6 26.4 27.3 27.3 27.9 28.3 28.6 28.6 29.2 29.2 29.5 29.6 30 30 30.2 30.4 30.5 30.6 30.6 30.6 30.9 31.1 31.1 31.1 31.2 31.3 31.6 31.8 31.8 32 32.1 32.1 32.2 32.2 32.2 32.3 32.4 32.4 32.5 32.7 32.8 32.9 33 33.5 33.6 33.7 33.7 33.8 33.9 33.9 33.9 34 34 34.4 34.4 34.6 35.7 36.6 36.8
Linking (CPU) Baseline
Mean: 159.751 %
Stdev: 2.334 % (1.5%)
Runs: 154.92320769444453 155.2756844492055 155.98398829910764 156.0574183011905 156.26830725962716 156.29613016141894 156.40729285549207 156.7322385884542 157.03295058607148 157.04910179640726 157.1348240963607 158.07830379492896 158.1157543984722 158.60043627988154 158.63145659102875 158.79339608698848 158.7984571157537 158.91214504616454 159.01391947241098 159.08579128687282 159.0940490722434 159.2881991446117 159.43461208866657 159.4524868575876 159.4868356404784 159.52273758322613 159.6705288880704 159.70838203451711 159.72972220094692 159.74100326161187 159.96966763563455 160.15352066642262 160.17494570728454 160.19011357232026 160.34156875097852 160.48419023745456 160.6065613254565 160.7049601161863 160.81555101621376 160.9695544717468 161.09382737491092 161.26359566018712 161.28323847319515 161.28466215980552 161.29708710069906 161.44665576380885 161.59336275033922 161.64194909021143 161.95418188641133 162.38103615906525 162.56952925498368 162.84720615179646 163.40801402224744 164.32712505356224 165.33545966334563 165.58203116455428

Current
Mean: 156.498 %
Stdev: 4.013 % (2.6%)
Runs: 149.76649677902444 149.95616910645106 150.64795874832802 150.6765029258519 150.84868544510095 150.88879283058748 151.38587430760745 151.48352346958248 152.14650910662078 152.21695185979868 152.56076172134857 152.6119664241067 152.82580461180765 152.92310811671965 153.00455606317072 153.3510109940141 153.3859380961021 153.5300272355379 153.57401554799605 154.12035998690436 154.36044993357524 154.40518389620203 154.71643480185952 154.9161130246032 154.93247468913984 154.98655249295837 155.23605398019328 155.41202798093016 155.57942369167728 155.96303853732385 156.1729873586162 156.26448976984975 156.63292297881932 156.69386671536788 156.79635586689452 157.27717933350365 157.43492968071004 157.76665092465268 158.1454602657344 158.25148000626814 158.35166384841483 159.0031535975531 159.52147050890383 159.90525783234537 159.95869820917662 160.14045428722534 160.24629856256126 160.65632569088635 160.69821473316054 160.78126152157347 161.5488213954359 161.69218830022325 161.71647887780964 161.98008119839045 162.62432473538595 162.70474496441497 163.0845607913145 163.10182927542033 163.37642428250544 164.9094002814976
Linking (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.974 FPS
Stdev: 0.069 FPS (0.1%)
Runs: 59.70428688283473 59.72550471184973 59.77856214709178 59.87609238593004 59.88713181320554 59.89301777867872 59.897788497180066 59.967928186361554 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Linking (RAM) Baseline
Mean: 398.099 MB
Stdev: 4.689 MB (1.2%)
Runs: 387.209375 388.6859375 390.20625 391.22421875 391.4109375 391.7453125 391.7682291666667 391.96015625 392.10078125 392.11328125 392.20234375 392.30703125 392.91484375 393.24921875 393.5734375 394.628125 395.92734375 396.201171875 396.6171875 397.0462239583333 397.6145833333333 397.8522135416667 397.85546875 398.0123697916667 398.013671875 398.2233072916667 398.73046875 398.7434895833333 398.79453125 398.81640625 398.87421875 398.9270833333333 399.30546875 399.3248697916667 399.4134114583333 399.6705729166667 399.802734375 399.8421875 399.9654947916667 400.0364583333333 400.4505208333333 400.884375 400.935546875 400.96875 401.2604166666667 401.2610677083333 401.7805989583333 401.80859375 401.9270833333333 402.2649739583333 402.439453125 403.1022135416667 403.2623697916667 403.48828125 404.5032552083333 405.05234375 405.475 405.900390625 410.1796875

Current
Mean: 408.975 MB
Stdev: 3.306 MB (0.8%)
Runs: 400.2688802083333 401.1921875 405.2115885416667 405.2291666666667 405.7063802083333 405.7317708333333 405.8470052083333 405.8528645833333 406.216796875 406.33203125 406.3450520833333 406.642578125 406.6490885416667 406.677734375 406.7955729166667 407.0970052083333 407.3391927083333 407.4752604166667 407.71484375 407.75390625 407.884765625 407.9505208333333 407.958984375 408.1067708333333 408.1549479166667 408.1751302083333 408.48046875 408.517578125 408.7096354166667 408.8606770833333 408.9765625 409.2766927083333 409.2955729166667 409.4166666666667 409.4635416666667 409.4752604166667 409.57310267857144 409.6907552083333 409.7864583333333 409.8802083333333 410.3619791666667 410.951171875 411.1282552083333 411.16796875 411.765625 411.8671875 412.3834635416667 412.9095052083333 412.9811197916667 414.076171875 414.2447916666667 414.6380208333333 415.07421875 416.568359375 417.7845052083333
Linking (CPU/JS) Baseline
Mean: 86.161 %
Stdev: 1.679 % (1.9%)
Runs: 82.6 83 83.4 83.5 83.5 83.6 83.8 83.8 84.2 84.2 84.5 84.6 84.7 84.9 85 85.2 85.2 85.3 85.3 85.4 85.5 85.5 85.7 85.8 85.9 86.2 86.2 86.3 86.3 86.3 86.4 86.4 86.5 86.5 86.5 86.6 86.6 86.7 86.7 86.7 86.8 87.1 87.1 87.2 87.3 87.6 87.6 87.6 87.8 87.8 87.9 87.9 88.2 88.6 88.6 89 89.3 89.3 89.8

Current
Mean: 84.986 %
Stdev: 1.787 % (2.1%)
Runs: 80.9 81.3 81.8 81.9 82.3 82.6 82.6 82.9 83 83.2 83.3 83.3 83.4 83.4 83.7 83.7 83.8 84.3 84.3 84.4 84.5 84.6 84.6 84.7 84.7 84.8 84.8 84.9 84.9 84.9 85 85 85.3 85.4 85.6 85.6 85.7 85.7 85.7 85.7 85.8 85.9 86.1 86.2 86.2 86.3 86.3 86.4 86.6 86.8 87 87.1 87.3 87.4 87.6 87.7 87.8 88.2 89.3
Linking (CPU/UI) Baseline
Mean: 33.553 %
Stdev: 1.846 % (5.5%)
Runs: 28.6 30 30.6 30.7 30.7 31.1 31.3 31.4 31.7 31.7 31.8 31.9 32 32 32 32 32.1 32.2 32.3 32.3 32.7 32.7 32.9 32.9 33 33.1 33.3 33.9 34 34 34.1 34.1 34.1 34.2 34.2 34.3 34.4 34.4 34.5 34.6 34.6 34.6 34.7 34.8 34.9 34.9 34.9 34.9 35 35 35.1 35.2 35.4 35.9 35.9 36.1 36.5 36.5 36.6 37.9

Current
Mean: 31.957 %
Stdev: 1.311 % (4.1%)
Runs: 29.1 29.3 29.7 29.8 29.9 30 30 30.2 30.2 30.3 30.6 30.9 31 31 31.1 31.2 31.3 31.4 31.4 31.5 31.5 31.6 31.6 31.6 31.7 31.7 31.9 31.9 32 32.1 32.2 32.2 32.3 32.3 32.3 32.3 32.3 32.3 32.4 32.5 32.5 32.5 32.6 32.7 32.7 32.8 33 33.1 33.1 33.2 33.2 33.3 33.3 33.5 33.7 33.8 33.8 34.3 34.5 35.2

Copy link
Contributor

github-actions bot commented Dec 5, 2024

@Expensify/mobile-deployers 📣 Please look into this performance regression as it's a deploy blocker.

Copy link
Contributor

github-actions bot commented Dec 5, 2024

🚀 Deployed to staging by https://github.com/mountiny in version: 9.0.72-0 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 failure ❌
🍎🔄 iOS HybridApp 🍎🔄 success ✅

Copy link
Contributor

github-actions bot commented Dec 5, 2024

🚀 Deployed to staging by https://github.com/mountiny in version: 9.0.72-0 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 success ✅
🍎🔄 iOS HybridApp 🍎🔄 success ✅

@mountiny mountiny removed the DeployBlockerCash This issue or pull request should block deployment label Dec 9, 2024
Copy link
Contributor

github-actions bot commented Dec 9, 2024

🚀 Deployed to production by https://github.com/luacmartins in version: 9.0.72-1 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 failure ❌
🍎🔄 iOS HybridApp 🍎🔄 failure ❌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants