Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Internal QA]: Fix: Logged-In Agents Can Appear to Delete Workspaces in NewDot Without Actual Deletion or Error Message #53333

Merged
merged 8 commits into from
Dec 3, 2024

Conversation

twilight2294
Copy link
Contributor

@twilight2294 twilight2294 commented Nov 30, 2024

Explanation of Change

Fixed Issues

$ #52854
PROPOSAL: #52854 (comment)

Tests

Precondition: User is supportal logged in OR set this line/ condition to true

  1. As supportal logged in, and goes to users workspace list page
  2. Click on the three dots of any workspace
  3. Click Delete worksapce

Verify that error modal is shown

  • Verify that no errors appear in the JS console

Offline tests

Precondition: User is supportal logged in

  1. As supportal logged in, and goes to users workspace list page
  2. Click on the three dots of any workspace
  3. Click Delete worksapce

Verify that error modal is shown

QA Steps

N/A. Internal QA

  • Verify that no errors appear in the JS console

PR Author Checklist

  • I linked the correct issue in the ### Fixed Issues section above
  • I wrote clear testing steps that cover the changes made in this PR
    • I added steps for local testing in the Tests section
    • I added steps for the expected offline behavior in the Offline steps section
    • I added steps for Staging and/or Production testing in the QA steps section
    • I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
    • I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).
  • I included screenshots or videos for tests on all platforms
  • I ran the tests on all platforms & verified they passed on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
  • I followed proper code patterns (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
      • If any non-english text was added/modified, I used JaimeGPT to get English > Spanish translation. I then posted it in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I followed the guidelines as stated in the Review Guidelines
  • I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
  • I verified that if a function's arguments changed that all usages have also been updated correctly
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • I added unit tests for any new feature or bug fix in this PR to help automatically prevent regressions in this user flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

Android: Native
Screen_recording_20241203_140955.mp4
Android: mWeb Chrome
Screen_recording_20241203_141054.mp4
iOS: Native
Simulator.Screen.Recording.-.Expensify.testing.-.2024-12-03.at.14.04.42.mp4
iOS: mWeb Safari
Simulator.Screen.Recording.-.Expensify.testing.-.2024-12-03.at.14.05.18.mp4
MacOS: Chrome / Safari
Screen.Recording.2024-12-03.at.2.01.13.PM.mov
MacOS: Desktop
Screen.Recording.2024-12-03.at.2.03.43.PM.mov

Signed-off-by: GitHub <noreply@github.com>
@@ -463,6 +463,10 @@ const translations = {
links: 'Enlaces',
days: 'días',
},
supportalNoAccess: {
title: 'No tan rápido',
description: 'No estás autorizado para realizar esta acción mientras el soporte está conectado.',
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@allgandalf can you please confirm these translation ? I am still to be added on slack, the above translation for title is already present in the codebase picked it up from there

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Asked on slack here

Signed-off-by: GitHub <noreply@github.com>
@twilight2294 twilight2294 marked this pull request as ready for review November 30, 2024 10:51
@twilight2294 twilight2294 requested a review from a team as a code owner November 30, 2024 10:51
@melvin-bot melvin-bot bot requested review from allgandalf and removed request for a team November 30, 2024 10:51
Copy link

melvin-bot bot commented Nov 30, 2024

@allgandalf Please copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

@allgandalf
Copy link
Contributor

allgandalf commented Dec 2, 2024

Reviewer Checklist

  • I have verified the author checklist is complete (all boxes are checked off).
  • I verified the correct issue is linked in the ### Fixed Issues section above
  • I verified testing steps are clear and they cover the changes made in this PR
    • I verified the steps for local testing are in the Tests section
    • I verified the steps for Staging and/or Production testing are in the QA steps section
    • I verified the steps cover any possible failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
  • I checked that screenshots or videos are included for tests on all platforms
  • I included screenshots or videos for tests on all platforms
  • I verified tests pass on all platforms & I tested again on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • If there are any errors in the console that are unrelated to this PR, I either fixed them (preferred) or linked to where I reported them in Slack
  • I verified proper code patterns were followed (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick).
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I verified that this PR follows the guidelines as stated in the Review Guidelines
  • I verified other components that can be impacted by these changes have been tested, and I retested again (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar have been tested & I retested again)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
  • If a new component is created I verified that:
    • A similar component doesn't exist in the codebase
    • All props are defined accurately and each prop has a /** comment above it */
    • The file is named correctly
    • The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
    • The only data being stored in the state is data necessary for rendering and nothing else
    • For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
    • Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
    • All JSX used for rendering exists in the render method
    • The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG)
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • For any bug fix or new feature in this PR, I verified that sufficient unit tests are included to prevent regressions in this flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
  • I have checked off every checkbox in the PR reviewer checklist, including those that don't apply to this PR.

Screenshots/Videos

Android: Native
Screen.Recording.2024-12-03.at.7.08.01.PM.mov
Android: mWeb Chrome
Screen.Recording.2024-12-03.at.7.06.18.PM.mov
iOS: Native
Screen.Recording.2024-12-03.at.7.09.18.PM.mov
iOS: mWeb Safari
Screen.Recording.2024-12-03.at.7.12.44.PM.mov
MacOS: Chrome / Safari
Screen.Recording.2024-12-03.at.7.02.56.PM.mov
MacOS: Desktop
Screen.Recording.2024-12-03.at.7.11.22.PM.mov

@allgandalf
Copy link
Contributor

@twilight2294 please update videos on all platforms

@twilight2294 twilight2294 changed the title Fix: Logged-In Agents Can Appear to Delete Workspaces in NewDot Without Actual Deletion or Error Message [Internal QA]: Fix: Logged-In Agents Can Appear to Delete Workspaces in NewDot Without Actual Deletion or Error Message Dec 3, 2024
@twilight2294
Copy link
Contributor Author

@allgandalf I updated videos and added test as well

src/languages/es.ts Outdated Show resolved Hide resolved
Co-authored-by: Gandalf <whogandalf@gmail.com>
Copy link
Contributor

@allgandalf allgandalf left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!, Please add internal QA label here 🙏

@melvin-bot melvin-bot bot requested a review from Beamanator December 3, 2024 13:43
@Beamanator Beamanator added the InternalQA This pull request required internal QA label Dec 3, 2024
Copy link
Contributor

@Beamanator Beamanator left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking great! Just got 2 little questions, but we're close to merging 🚀

@@ -439,6 +461,10 @@ function WorkspacesListPage() {
cancelText={translate('common.cancel')}
danger
/>
<SupportalActionModal
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What do y'all think about calling this SupportalActionRestrictedModal or RestrictedSupportalActionModal to make it super clear that this modal specifically tells the user that an action is restricted since they're supportaled?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I’m down with this suggestion 🙌, @twilight2294 please update this name

hideSupportalModal: () => void;
};

function SupportalActionModal({isSupportalActionRestrictedModalOpen, hideSupportalModal}: SupportalActionModalProps) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What do y'all think about shortening isSupportalActionRestrictedModalOpen to just isOpen since that's a pretty clear prop name internal to this component? 🤔

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

umm, isOpen is quite generic how about isSupportalModalOpen? defines purpose ?!

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmmm what about isModalOpen? 😅 I just don't think we need to be TOO specific, but I do agree isOpen is a bit too generic 😅

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

worksssss for mee! :team-work:

@twilight2294
Copy link
Contributor Author

I updated according to the changes @Beamanator

Copy link
Contributor

@Beamanator Beamanator left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@Beamanator Beamanator merged commit a2ad3f3 into Expensify:main Dec 3, 2024
16 checks passed
@OSBotify
Copy link
Contributor

OSBotify commented Dec 3, 2024

✋ This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

@github-actions github-actions bot added the DeployBlockerCash This issue or pull request should block deployment label Dec 3, 2024
Copy link
Contributor

github-actions bot commented Dec 3, 2024

Performance Comparison Report 📊

Significant Changes To Duration

Name Duration
Linking 754.169 ms → 873.944 ms (+119.775 ms, +15.9%) 🔴
Show details
Name Duration
Linking Baseline
Mean: 754.169 ms
Stdev: 159.151 ms (21.1%)
Runs: 514.7545569986105 519.6477050017565 526.9515389986336 530.2049969993532 530.9265139997005 532.6117349993438 537.3381350003183 539.2290850002319 555.187541000545 556.9179689995944 564.366089001298 564.7075610011816 565.1088459994644 569.0499679986387 570.928915001452 573.0727129988372 573.6268310025334 573.8876550011337 582.3968100007623 585.3041590005159 605.8802499994636 610.625895999372 612.5281580016017 673.4562589973211 819.2338870000094 820.034220000729 824.4748530015349 832.3205980006605 836.5806889999658 839.8258060012013 842.4349370002747 844.0104580000043 844.7825930006802 846.6887619998306 852.3655200004578 854.8507899995893 856.1597910001874 863.9589439965785 864.0477699991316 864.2445479985327 864.3468429986387 867.6490080002695 868.2415769994259 880.0055749993771 882.9682620000094 885.1763920001686 885.5968430005014 886.6825369987637 889.2134599983692 892.734294001013 904.5596520006657 916.0207930002362 917.9052740000188 922.0457770004869 927.89070700109 935.5619299989194 941.4495039992034 945.4630529992282 969.1657320000231 992.7413330003619

Current
Mean: 873.944 ms
Stdev: 228.613 ms (26.2%)
Runs: 504.5625 513.0690919999033 515.2231849990785 515.9193930011243 521.6275229994208 535.9009199999273 537.3432219997048 539.3276370000094 547.4787599984556 547.6082359999418 553.6585290003568 554.4794119987637 564.3649090006948 578.9746090006083 581.297159999609 586.7493500001729 587.1687019988894 589.4521900005639 614.5786940008402 622.454101998359 970.2400719989091 975.840657999739 980.8182789999992 988.0562749989331 988.093343000859 989.8382980003953 991.3567310012877 992.3503830004483 993.3826500009745 993.7952069994062 997.0405689999461 997.3243820015341 1000.6662600003183 1000.7783209979534 1004.2904880009592 1006.9204519987106 1012.6530760005116 1020.1503500007093 1024.211222998798 1029.0867120008916 1030.1326500009745 1031.4959720000625 1035.722005000338 1036.0465089995414 1043.6867270004004 1043.9371349997818 1048.341512998566 1053.4594729989767 1054.9237060006708 1057.2712000012398 1060.1829430013895 1066.1073409989476 1071.047079000622 1083.951376002282 1091.319906000048 1096.6379399970174 1103.703370001167 1106.210450001061 1123.3934330008924 1130.9565030001104

Meaningless Changes To Duration

Show entries
Name Duration
App start time nativeLaunch 33.983 ms → 32.105 ms (-1.878 ms, -5.5%)
App start time appCreation 82.068 ms → 79.224 ms (-2.844 ms, -3.5%)
App start time nativeLaunchEnd_To_appCreationStart 66.034 ms → 65.833 ms (-0.201 ms, ±0.0%)
App start time appCreationEnd_To_contentAppeared 580.847 ms → 582.596 ms (+1.749 ms, ±0.0%)
App start time contentAppeared_To_screenTTI 600.785 ms → 594.645 ms (-6.140 ms, -1.0%)
App start time runJsBundle 420.683 ms → 420.368 ms (-0.315 ms, ±0.0%)
App start time TTI 1368.069 ms → 1352.458 ms (-15.611 ms, -1.1%)
App start time regularAppStart 0.023 ms → 0.023 ms (-0.001 ms, -2.2%)
App start time (CPU) 126.512 % → 126.470 % (-0.042 %, ±0.0%)
App start time (FPS) 60.000 FPS → 60.000 FPS
App start time (RAM) 369.143 MB → 369.318 MB (+0.175 MB, ±0.0%)
App start time (CPU/JS) 77.469 % → 77.055 % (-0.414 %, -0.5%)
App start time (CPU/UI) 21.212 % → 21.903 % (+0.691 %, +3.3%)
Open search router TTI Load Search Options 95.004 ms → 94.862 ms (-0.143 ms, ±0.0%)
Open search router TTI Open Search Router TTI 703.620 ms → 705.579 ms (+1.960 ms, ±0.0%)
Open search router TTI (CPU) 150.628 % → 148.513 % (-2.115 %, -1.4%)
Open search router TTI (FPS) 60.000 FPS → 59.218 FPS (-0.782 FPS, +1.3%)
Open search router TTI (RAM) 378.890 MB → 383.833 MB (+4.943 MB, +1.3%)
Open search router TTI (CPU/JS) 78.353 % → 77.703 % (-0.649 %, -0.8%)
Open search router TTI (CPU/UI) 29.107 % → 28.446 % (-0.661 %, -2.3%)
Report typing Composer typing rerender count 1.000 renders → 1.000 renders
Report typing Message sent 423.187 ms → 423.966 ms (+0.780 ms, ±0.0%)
Report typing (CPU) 101.447 % → 101.493 % (+0.047 %, ±0.0%)
Report typing (FPS) 60.000 FPS → 60.000 FPS
Report typing (RAM) 469.924 MB → 470.402 MB (+0.478 MB, ±0.0%)
Report typing (CPU/JS) 46.405 % → 46.625 % (+0.220 %, ±0.0%)
Report typing (CPU/UI) 26.183 % → 26.229 % (+0.046 %, ±0.0%)
Chat opening Chat TTI 571.694 ms → 516.569 ms (-55.125 ms, -9.6%)
Chat opening (CPU) 157.271 % → 157.812 % (+0.540 %, ±0.0%)
Chat opening (FPS) 59.937 FPS → 59.992 FPS (+0.055 FPS, ±0.0%)
Chat opening (RAM) 374.322 MB → 374.400 MB (+0.078 MB, ±0.0%)
Chat opening (CPU/JS) 78.617 % → 78.390 % (-0.227 %, ±0.0%)
Chat opening (CPU/UI) 33.827 % → 34.437 % (+0.610 %, +1.8%)
Linking (CPU) 161.256 % → 160.478 % (-0.777 %, ±0.0%)
Linking (FPS) 59.998 FPS → 59.923 FPS (-0.075 FPS, ±0.0%)
Linking (RAM) 409.373 MB → 418.858 MB (+9.485 MB, +2.3%)
Linking (CPU/JS) 84.960 % → 85.058 % (+0.098 %, ±0.0%)
Linking (CPU/UI) 36.323 % → 34.753 % (-1.569 %, -4.3%)
Show details
Name Duration
App start time nativeLaunch Baseline
Mean: 33.983 ms
Stdev: 4.911 ms (14.5%)
Runs: 28 28 28 28 29 29 29 29 29 29 30 30 30 30 30 30 30 31 31 31 31 31 31 31 32 32 32 32 32 32 33 33 33 33 34 34 34 34 35 35 35 35 36 36 37 38 38 38 39 39 40 40 40 40 40 41 43 44 48 49

Current
Mean: 32.105 ms
Stdev: 4.327 ms (13.5%)
Runs: 26 26 27 27 27 28 28 28 28 28 28 28 28 28 29 29 29 29 29 29 29 30 30 30 30 30 30 30 31 31 31 32 32 32 33 33 33 34 34 34 34 35 35 35 36 36 36 37 38 38 39 39 39 40 41 42 42
App start time appCreation Baseline
Mean: 82.068 ms
Stdev: 9.128 ms (11.1%)
Runs: 67 67 68 68 70 70 71 71 73 73 73 74 74 74 75 75 75 76 76 77 77 78 78 78 79 80 80 81 82 82 82 83 83 83 84 84 84 85 85 86 86 86 86 86 87 88 90 90 92 94 94 94 94 95 95 99 100 101 104

Current
Mean: 79.224 ms
Stdev: 9.688 ms (12.2%)
Runs: 62 63 65 65 66 66 67 70 70 70 71 71 72 72 72 72 73 73 73 74 74 74 75 75 75 76 77 78 78 78 78 80 80 80 81 81 82 82 83 83 84 85 85 87 87 87 88 89 90 90 91 91 92 92 96 97 103 104
App start time nativeLaunchEnd_To_appCreationStart Baseline
Mean: 66.034 ms
Stdev: 12.558 ms (19.0%)
Runs: 45 48 48 48 49 50 51 54 55 55 56 56 56 56 57 57 58 58 59 59 59 59 60 60 61 61 62 62 64 64 66 66 66 67 67 68 68 68 69 69 70 70 70 70 71 74 77 79 79 80 81 82 84 85 87 88 92 94 102

Current
Mean: 65.833 ms
Stdev: 13.135 ms (20.0%)
Runs: 44 45 47 48 48 50 52 52 53 53 54 55 55 56 56 56 57 57 59 59 59 59 60 60 60 61 61 61 62 62 62 62 62 62 63 69 70 70 71 71 71 72 72 73 74 75 76 77 79 80 80 80 82 84 85 90 92 92 94 99
App start time appCreationEnd_To_contentAppeared Baseline
Mean: 580.847 ms
Stdev: 40.110 ms (6.9%)
Runs: 492 495 504 515 517 521 529 532 534 536 537 537 538 539 539 552 560 566 566 569 570 573 577 578 578 579 579 584 585 586 588 589 592 593 594 594 599 602 605 605 605 607 609 609 610 610 612 614 616 621 622 626 626 629 636 643 644 646 657

Current
Mean: 582.596 ms
Stdev: 33.033 ms (5.7%)
Runs: 502 513 517 527 530 535 536 546 548 549 552 553 558 561 562 565 565 569 570 572 573 576 580 583 583 584 584 585 585 585 585 590 590 592 594 595 595 598 598 599 602 602 604 605 606 608 608 611 613 617 622 624 629 637 643 646 647
App start time contentAppeared_To_screenTTI Baseline
Mean: 600.785 ms
Stdev: 43.534 ms (7.2%)
Runs: 506.30651500076056 510.78056200034916 530.0222970005125 531.3477449994534 531.5795419998467 542.0860779993236 543.1454499997199 543.9612380005419 561.7171909995377 562.7490320000798 564.6505919992924 565.9597740005702 566.4686629995704 572.0410149991512 572.1741710007191 575.5752750001848 576.9593250006437 577.5050109997392 577.7438399996608 578.6282620001584 580.9315290004015 581.1742490008473 584.8188540004194 585.0954700000584 587.8331419993192 588.3170619998127 589.4687719997019 599.458417000249 602.5754400007427 604.2360510006547 605.0912289991975 605.4555179998279 605.8690389990807 606.8749599996954 607.7768820002675 612.5962610002607 615.2368759997189 620.8727739993483 622.0029169991612 622.8427939992398 626.0424370002002 629.0714139994234 630.3230300005525 632.8120269998908 636.61168500036 636.9624320007861 637.6425720006227 639.1588269993663 641.5947350002825 645.5656700003892 655.3552340008318 655.6711149998009 663.1625560000539 663.5316679999232 673.9881619997323 677.0843359995633 684.1935270000249 696.8275390006602

Current
Mean: 594.645 ms
Stdev: 48.497 ms (8.2%)
Runs: 479.7668180000037 491.9417480006814 497.6272410005331 525.2105730008334 530.7686470001936 530.9496229998767 532.2128240000457 539.9129799995571 541.0590620003641 541.1001449991018 544.6184470001608 548.4038839992136 552.787595000118 562.7372200004756 569.1796579994261 572.1461229994893 573.8395910002291 577.6219890005887 578.5890399999917 579.024421999231 579.2682189997286 580.2577369995415 580.7250779997557 583.4446840006858 589.1385980006307 590.597386000678 593.7763529997319 594.8313890006393 598.9275589995086 599.5118179991841 599.851316999644 600.7703649997711 601.2153159994632 602.1748910006136 602.2502560000867 604.7278419993818 605.4405439998955 605.7905139997602 605.9106549993157 616.006126999855 616.3102460000664 622.4028270002455 624.7276130001992 628.7211399991065 628.9831140004098 629.8497000001371 631.0237629991025 634.2884999997914 637.7590180002153 640.2032609991729 643.1534460000694 657.5546589996666 659.4635860007256 671.4435990005732 676.7367330007255 678.3288599997759 697.336061000824 707.0035149995238
App start time runJsBundle Baseline
Mean: 420.683 ms
Stdev: 29.675 ms (7.1%)
Runs: 354 363 367 368 368 374 381 381 385 385 387 388 390 397 403 403 404 404 405 408 411 413 414 415 415 417 418 420 420 421 423 429 432 432 432 433 434 435 437 438 438 439 440 441 442 442 444 444 451 451 451 451 456 456 459 461 463 464 472 472

Current
Mean: 420.368 ms
Stdev: 23.919 ms (5.7%)
Runs: 372 374 379 381 382 382 384 386 387 388 393 396 398 407 411 411 413 414 414 415 417 418 418 419 419 420 421 423 423 423 423 425 425 425 426 427 428 429 429 433 433 434 435 436 438 439 444 446 447 448 448 449 454 456 457 466 473
App start time TTI Baseline
Mean: 1368.069 ms
Stdev: 82.825 ms (6.1%)
Runs: 1188.0222970005125 1191.3065150007606 1220.0860779993236 1228.3477449994534 1232.7805620003492 1244.7490320000798 1246.6505919992924 1247.961238000542 1254.0954700000584 1261.9597740005702 1269.8331419993192 1274.5050109997392 1282.5795419998467 1292.7171909995377 1293.8690389990807 1304.1454499997199 1308.1742490008473 1316.5754400007427 1322.7438399996608 1326.458417000249 1330.4687719997019 1331.4686629995704 1367.3170619998127 1370.8749599996954 1376.0410149991512 1381.3230300005525 1386.7768820002675 1387.4555179998279 1389.0714139994234 1390.9315290004015 1393.2360510006547 1393.8727739993483 1395.5752750001848 1396.9593250006437 1397.5329810008407 1398.0912289991975 1403.0029169991612 1404.5962610002607 1411.174171000719 1413.8427939992398 1420.6282620001584 1421.1625560000539 1422.962432000786 1433.1588269993663 1436.8188540004194 1441.5656700003892 1442.3552340008318 1446.6425720006227 1448.8120269998908 1451.193527000025 1453.5316679999232 1453.9881619997323 1454.236875999719 1458.0424370002002 1463.0843359995633 1465.5947350002825 1474.8275390006602 1475.61168500036 1494.0765739995986 1498.671114999801

Current
Mean: 1352.458 ms
Stdev: 79.261 ms (5.9%)
Runs: 1193.6752310004085 1195.7686470001936 1195.9417480006814 1202.787595000118 1203.7668180000037 1226.1001449991018 1230.6184470001608 1235.2128240000457 1236.627241000533 1254.059062000364 1263.2105730008334 1266.5890399999917 1276.9496229998767 1294.4446840006858 1297.5118179991841 1299.1461229994893 1304.024421999231 1310.4038839992136 1320.9831140004098 1327.2577369995415 1333.1796579994261 1338.7250779997557 1348.2153159994632 1351.6219890005887 1352.3972050007433 1352.7905139997602 1354.2682189997286 1358.8313890006393 1359.3102460000664 1360.4405439998955 1363.7372200004756 1370.7278419993818 1371.9129799995571 1374.597386000678 1375.851316999644 1378.776352999732 1393.1748910006136 1397.7276130001992 1398.8395910002291 1401.7590180002153 1402.849700000137 1403.0237629991025 1403.1385980006307 1405.2502560000867 1409.9106549993157 1423.4435990005732 1423.5546589996666 1425.7367330007255 1428.7703649997711 1433.1534460000694 1433.7211399991065 1433.9275589995086 1435.006126999855 1435.2884999997914 1441.203260999173 1451.4028270002455 1467.4635860007256 1468.336061000824 1473.0035149995238 1477.328859999776
App start time regularAppStart Baseline
Mean: 0.023 ms
Stdev: 0.002 ms (7.5%)
Runs: 0.02001899853348732 0.020304000005126 0.02034500055015087 0.02058899961411953 0.020793000236153603 0.020833000540733337 0.021118000149726868 0.021199999377131462 0.021239999681711197 0.021240999922156334 0.021402999758720398 0.021403001621365547 0.02144400030374527 0.0215659998357296 0.021688001230359077 0.0217289999127388 0.021769000217318535 0.021810000762343407 0.021810000762343407 0.02185099944472313 0.021932000294327736 0.022012999281287193 0.022216999903321266 0.022257000207901 0.022379999980330467 0.02266400121152401 0.022664999589323997 0.022664999589323997 0.023275000974535942 0.023316001519560814 0.023437000811100006 0.0235190000385046 0.023680999875068665 0.0236820001155138 0.023722000420093536 0.02376299910247326 0.02376299910247326 0.023763000965118408 0.023763000965118408 0.023802999407052994 0.023925000801682472 0.023966999724507332 0.024007000029087067 0.02404800057411194 0.02404800057411194 0.024170000106096268 0.02421100065112114 0.02433199994266033 0.02433300018310547 0.0247809998691082 0.024984000250697136 0.025635000318288803 0.02571600116789341 0.02628599852323532 0.026327000930905342 0.0264079999178648 0.026448000222444534 0.027222000062465668

Current
Mean: 0.023 ms
Stdev: 0.002 ms (8.8%)
Runs: 0.018187999725341797 0.018188999965786934 0.01827000081539154 0.018473001196980476 0.01953200064599514 0.02006099931895733 0.02071099914610386 0.02075200155377388 0.020834000781178474 0.021077999845147133 0.021118000149726868 0.021118000149726868 0.021239999681711197 0.021402999758720398 0.02144399844110012 0.021484000608325005 0.021484000608325005 0.021524999290704727 0.0215659998357296 0.0215659998357296 0.021687999367713928 0.022012999281287193 0.022053999826312065 0.022094998508691788 0.022095000371336937 0.022135000675916672 0.02237900160253048 0.022461000829935074 0.022664999589323997 0.02282699942588806 0.022866999730467796 0.022908998653292656 0.022989999502897263 0.023031000047922134 0.023111999034881592 0.023194000124931335 0.02323400042951107 0.023275000974535942 0.023314999416470528 0.0233559999614954 0.023396000266075134 0.023517999798059464 0.02380400151014328 0.023885000497102737 0.023885000497102737 0.02392600104212761 0.02433300018310547 0.02433300018310547 0.024658000096678734 0.024821000173687935 0.02502400055527687 0.025105999782681465 0.025228001177310944 0.025349998846650124 0.02555299922823906 0.026570999994874 0.027546999976038933
App start time (CPU) Baseline
Mean: 126.512 %
Stdev: 9.221 % (7.3%)
Runs: 111.76143141153082 111.9238860202716 112.50577390396239 113.50293542074365 113.90079608083282 114.00346523585961 114.7632566720743 115.4426877470356 115.71371769383698 117.0186113099499 118.66506031761176 118.73184437354165 119.1040767934177 119.81673306772907 119.82782615610958 119.89625167336014 119.89820359281437 120.75539968826541 121.05956563398273 121.55410848283553 121.97502574870855 122.8401136268561 122.8560500723116 123.49504950495049 123.90618762475049 124.45698541785706 124.7848605577689 124.86005808834369 125.61111111111114 125.77536024429811 125.79034809180986 125.8461256509042 125.98704959001017 126.19940841209149 126.40293695991382 126.8321932134647 127.1185762687457 127.79282868525894 127.8942115768463 128.17917575002596 128.93516115897128 129.6311758952215 129.83633023437065 130.12799016320145 131.03517374699422 131.49766340183086 131.67793240556662 132.121104955008 133.9141568780271 135.78884462151396 139.55356219831262 139.796812749004 140.66600397614317 141.7550683639793 142.19711909628754 142.2845691382765 142.70123974157508 143.81287526343 146.70658682634735 148.23585037282783

Current
Mean: 126.470 %
Stdev: 8.552 % (6.8%)
Runs: 114.6963884730539 115.85298086846072 116.52661064425774 116.57258064516132 116.58789776312189 116.76646706586826 116.80876494023903 116.91017964071855 117.83009358677594 117.89947606430663 118 118.65909615032879 118.73161033797219 118.92709722233307 119.07854888584271 119.68986083499006 119.71968190854874 119.8580062709913 119.86543768540093 119.89605204555582 119.95904158915437 120.65709219012172 120.6610683016437 120.90219560878242 120.94308138188724 121.84607784156782 124.08935894840064 124.65706038122956 125.03293492059693 125.53778268063978 125.89421157684629 125.9968807280445 126.52031920254917 126.90199883871684 127 127.6580816909088 127.79282868525893 128.26160148139837 129.7535547285046 130.7333166356194 130.73852295409182 130.77543976842574 130.8515625 130.89021956087828 131.796812749004 131.82627680808935 132.82828081610535 133.6719681908549 133.89620758483036 135.0289923084877 135.89421157684637 136.1829025844931 136.55159799922075 136.90019960079846 136.9871216536659 138.70178926441355 140.50387596899228 143.67793240556662 149.93056639413473 150.90940902330988
App start time (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
App start time (RAM) Baseline
Mean: 369.143 MB
Stdev: 5.686 MB (1.5%)
Runs: 357.556640625 358.21484375 359.712890625 361.134765625 361.791015625 362.125 362.62109375 363.05078125 364.15625 364.46875 364.484375 364.794921875 364.919921875 364.98046875 365.134765625 365.142578125 365.486328125 365.59765625 366.0859375 366.380859375 366.580078125 366.83203125 366.861328125 367.111328125 367.134765625 368.005859375 368.5234375 368.919921875 368.97265625 368.98828125 368.994140625 369.703125 370.3671875 370.640625 370.7890625 371.162109375 371.177734375 371.630859375 372.1328125 372.369140625 372.77734375 372.931640625 373.302734375 373.341796875 373.802734375 373.919921875 373.94140625 374.2109375 374.8203125 375.015625 375.01953125 377.79296875 380.6328125 380.7265625 382.37109375 382.673828125

Current
Mean: 369.318 MB
Stdev: 5.990 MB (1.6%)
Runs: 357.578125 357.732421875 361.69921875 361.88671875 362.431640625 362.79296875 362.873046875 362.998046875 363.224609375 363.361328125 363.451171875 363.865234375 364.103515625 364.10546875 364.16796875 364.353515625 365.365234375 365.478515625 366.00390625 366.359375 367.16796875 367.19921875 367.421875 367.427734375 367.5078125 368.388671875 368.421875 368.625 368.86328125 369.357421875 369.7109375 369.732421875 369.935546875 369.96484375 370.185546875 370.978515625 370.986328125 371.00390625 371.22265625 371.2265625 371.861328125 372.666015625 373.099609375 373.15625 373.18359375 373.248046875 374.599609375 375.681640625 375.755859375 376.61328125 377.080078125 377.46484375 377.517578125 380.78125 380.826171875 381.517578125 386.923828125
App start time (CPU/JS) Baseline
Mean: 77.469 %
Stdev: 3.535 % (4.6%)
Runs: 69.8 70.9 71.8 72.3 72.7 72.8 72.9 72.9 72.9 73.6 73.8 73.9 74.7 74.9 75.7 75.7 75.8 75.8 75.9 75.9 75.9 76 76 76.1 76.8 76.9 76.9 77.7 77.8 77.8 77.8 77.9 77.9 77.9 77.9 77.9 78 78 79 79 79 79.4 79.7 79.7 79.8 79.8 79.9 79.9 79.9 80 80.9 81.2 82.1 82.3 84.1 84.2 84.3 84.8 85.8

Current
Mean: 77.055 %
Stdev: 3.604 % (4.7%)
Runs: 69 71.1 71.8 71.8 72 72.2 72.7 72.8 72.8 72.9 73 73.8 73.9 74.8 74.8 74.9 74.9 75.3 75.3 75.7 75.9 75.9 75.9 75.9 75.9 75.9 75.9 75.9 76 76 76.7 76.8 76.9 76.9 76.9 76.9 77 77.2 77.8 78.5 78.8 79.8 79.9 80 80.1 80.7 80.7 80.8 80.9 80.9 80.9 81 81.1 81.2 81.5 81.9 82.8 83.8 84.8 85.4
App start time (CPU/UI) Baseline
Mean: 21.212 %
Stdev: 3.750 % (17.7%)
Runs: 13 13.9 14.1 15 15 16 16.9 17.9 17.9 17.9 17.9 18 18 18 18 18.9 18.9 19 19 19 19.9 19.9 20 20 20 20 20.1 21 21 21 21 21.7 21.9 22 22 23 23 23.1 23.9 23.9 23.9 24 24 24 24 24 24 24.9 25.1 25.1 26.8 26.9 26.9 27 27 27 27 28

Current
Mean: 21.903 %
Stdev: 4.250 % (19.4%)
Runs: 13 15 15.1 15.9 16 16 16 16 16.9 17 17 17 17.9 18 19 19 19 19 19.7 19.9 20 20.1 20.9 20.9 20.9 21 21 22 22 22 22.1 22.8 22.9 23 23.8 23.9 24 24 24 24 24 24.1 24.1 24.1 25 25 25.1 26 26 26 26.9 27 27 27 27.8 27.9 28 31.1 32.5
Open search router TTI Load Search Options Baseline
Mean: 95.004 ms
Stdev: 5.921 ms (6.2%)
Runs: 84.8394780009985 85.04366100020707 86.09346499852836 86.21293099969625 86.24711200036108 86.48852499946952 86.75423200055957 86.78141199983656 87.24165900051594 88.19132499955595 88.54248099960387 88.76066100038588 88.9609370008111 89.25012199953198 89.52726299874485 89.6890460010618 89.82352700084448 89.86686299927533 89.89843699894845 89.90783699974418 89.99414099939167 89.99589099921286 90.01558399945498 90.03975499980152 90.081747001037 90.11462399922311 90.31241799890995 90.32824700139463 90.43709300085902 90.5300699993968 90.60620100051165 90.63269099965692 90.734822999686 90.80122900009155 90.8519289996475 91.02237999998033 91.1495369989425 91.27754699997604 91.7918700017035 91.81880700029433 91.88915999978781 91.96512899920344 91.9794520009309 92.09501099959016 92.30721000023186 92.3671059999615 92.39225200004876 92.52575699985027 92.57877600006759 92.60062699951231 92.8234870005399 92.90763299912214 92.98482300154865 93.05952999927104 93.21081499941647 93.3804519996047 93.46256499923766 93.46394900046289 93.60705599933863 93.75846300087869 93.85009700059891 94.01782200112939 94.16996300034225 94.22416199930012 94.37626099959016 94.48958300054073 94.77449600026011 94.79081199876964 95.26965400017798 95.31632500141859 95.72709100134671 95.83520500175655 95.98498599976301 96.00919600017369 96.25292900018394 96.35485799983144 96.72330700047314 96.8832600004971 97.02282699942589 97.11661799997091 97.55887900106609 97.65836599841714 97.69685800001025 97.95365400053561 98.32287600077689 98.59830700047314 98.62024000100791 98.69120300002396 98.83642599917948 98.8651119992137 99.03991699963808 99.33817500062287 99.52506600134075 99.6727700009942 99.69046999886632 99.73803699947894 100.07763700000942 100.84948799945414 101.019532000646 101.04744399897754 101.2198489997536 101.2898769993335 101.497110998258 101.69303400069475 101.99548400007188 102.67964699864388 103.56884800083935 106.0401610005647 107.23913599923253 107.3923340011388 107.8616540003568 108.08740199916065 108.24267500080168 108.60925299860537 108.62711600027978 109.50219700112939 111.95979799889028

Current
Mean: 94.862 ms
Stdev: 5.324 ms (5.6%)
Runs: 83.921875 84.57251000031829 84.93664600141346 85.56192999891937 86.76432299986482 87.0694989990443 87.13423600047827 88.29919500090182 88.63509099930525 89.0961920004338 89.43453000113368 89.46720400080085 89.48791499994695 89.50577799975872 89.56087299995124 89.56982400082052 89.65832499973476 89.84309899993241 89.87170400097966 89.96350100077689 90.30529800057411 90.34969099983573 90.35396399907768 90.36922300048172 90.49112999998033 90.51835099980235 90.69600399956107 90.76249199919403 90.79842099919915 90.84956900030375 90.87390200048685 90.956299001351 91.00695800036192 91.08479799889028 91.08740199916065 91.10669000074267 91.15600600093603 91.23457800038159 91.37174499966204 91.53357000090182 91.55183900147676 91.81331299990416 92.0633950009942 92.21887199953198 92.69156900048256 92.70259599946439 93.14664799906313 93.15189700014889 93.21724399924278 93.44563799910247 93.45910600014031 93.4819329995662 93.61417699977756 93.64986199885607 93.72469099983573 93.76948999986053 93.82177799940109 93.87247800081968 93.9117839988321 94.18611700087786 94.50321500003338 94.71512800082564 94.71907600015402 94.76086399890482 94.79044600017369 95.02889000065625 95.0328780002892 95.06465699896216 95.10819500125945 95.14603699930012 95.20206699892879 95.36226399987936 95.62597700022161 95.67036999948323 95.7476399987936 95.8410229999572 95.8424880001694 95.88216199912131 95.91857899911702 96.20471199974418 96.21614599972963 96.24405900016427 96.36104300059378 96.72245300002396 96.88574199937284 97.03462700173259 97.20804900117218 97.5077309999615 97.57027100026608 97.8878169991076 98.09155200049281 98.22428400069475 98.52600100077689 98.79956100136042 99.20841400139034 99.40083800069988 99.54585800133646 99.59179700165987 100.24918700009584 100.35408600047231 100.5484210010618 100.68530299887061 100.80891900137067 101.01509599946439 101.38793900050223 101.987549001351 102.02689599990845 103.52018300071359 104.15519200079143 104.53519699908793 104.58532699942589 104.78344699926674 105.73640900105238 106.03889999911189 106.3652749992907 106.41845699958503 106.71028599888086 107.95039900019765 108.72818999923766
Open search router TTI Open Search Router TTI Baseline
Mean: 703.620 ms
Stdev: 20.550 ms (2.9%)
Runs: 663.973105000332 672.9078369997442 673.6768800001591 674.5854090005159 676.7590330000967 678.3728030007333 679.0921630002558 679.96606499888 684.0440680012107 684.7469900008291 686.3302009999752 686.6670330017805 686.7100419998169 686.9433190003037 689.4629309996963 689.9086100012064 691.9773360006511 694.2325849998742 695.3989269994199 697.7020670007914 697.8791099991649 697.9036860000342 699.0667720008641 700.1182869989425 701.4582519996911 701.829142998904 704.6829020008445 704.9662680011243 705.6704110000283 705.6918129995465 705.7565919999033 706.0270589999855 706.7216389998794 707.9728199988604 708.5003249999136 709.4938150011003 709.9152840003371 712.7995199989527 712.950724998489 714.0316579993814 716.0447589997202 720.7175300009549 721.6144610010087 725.6824550013989 727.1208909992129 733.656128000468 735.9704189989716 736.9391680005938 742.7829180005938 744.2290860004723 747.0255139991641 749.5593270007521

Current
Mean: 705.579 ms
Stdev: 18.253 ms (2.6%)
Runs: 655.5261230003089 664.2610280010849 673.8362219985574 678.969402000308 682.4424639996141 684.4300950001925 687.2209070008248 689.2564300000668 689.9681809991598 690.3529460001737 691.7442630007863 693.2119549997151 695.5855310000479 695.7246909998357 697.6872159987688 698.8883059993386 699.8850509990007 702.2991540003568 702.4032800011337 702.4603679999709 704.8232419993728 704.9391690008342 705.821410998702 705.8544110003859 706.3085940014571 706.3105880003422 707.2716070003808 707.51570700109 708.8214520011097 709.4941000007093 710.2490640003234 711.1933600008488 711.7192379999906 712.7130950000137 713.2157399989665 713.836750999093 714.1979980003089 715.878622001037 716.1496590003371 716.1581629998982 716.5297449994832 717.5021569989622 718.1927090007812 723.553752001375 728.0703940000385 728.7112639993429 732.456706000492 739.1521809995174 747.5064700003713 748.6712650004774
Open search router TTI (CPU) Baseline
Mean: 150.628 %
Stdev: 4.007 % (2.7%)
Runs: 142.28542914171666 142.60823508244732 143.29287795238844 144.22096265142878 144.33746749270327 145.11531550129982 145.77765539496974 145.8065551271043 146.35917665529536 146.63248048513722 146.6427451228882 146.64894408265422 147.28223003573518 147.54090729924562 147.58146693525902 147.90659255649135 148.2426931136297 148.70168405581387 148.733227143165 149.24409630044087 149.29825162952392 149.33184216832274 149.62018592297468 149.67130033449365 149.85910030691787 149.90705952301343 150.1691547578036 150.2061634886634 150.51815965051117 150.7292010220472 150.78220821894004 150.89559429673056 150.9322709163346 151.23126629821866 151.5791041263696 152.0046902893882 152.262952625916 152.58940434891917 152.63329149816386 152.772461309876 152.87113416503576 153.18694670967565 153.4103992654422 153.4152867064294 153.52485296956843 153.5615793946959 154.02077493134118 154.9530421229254 155.2049594126381 155.2517760857994 155.4459071480904 155.95468195406409 155.9785957868521 156.27998252133835 156.68396988038867 157.14474295803484 158.07231764843146 159.51054620922508

Current
Mean: 148.513 %
Stdev: 3.528 % (2.4%)
Runs: 139.78935046082583 141.03529761765216 143.02183803518 143.1162497991955 143.17033587185784 143.641743166499 143.64425601873816 144.12979039590107 144.1874744556463 144.5208728652753 144.79356141170405 145.05367647945346 145.25236033349702 145.41448500035673 145.79377626856532 145.8665788249175 145.8927693594708 146.21491105483517 146.7218078684676 146.75444447067014 147.15765315511067 147.40089477659808 147.48548153311214 148.20606509066195 148.24202463824335 148.27888446215135 148.43351834234193 148.48176237742115 148.5718710061521 148.58849355407423 148.8949972021478 149.24492051753077 149.26438135234616 149.29666337908986 149.32134568712652 149.4192918390807 149.9153176282246 150.00157923168058 150.21935984158287 150.39500711926766 150.46360482523193 150.6963480163197 150.92695883134124 150.99958551536753 151.1601344693922 151.2700951298461 151.5342526514222 151.53716688557947 151.53855635342862 152.15521552155212 152.22165364342464 152.3998776449354 152.5395424290861 152.87304945010783 152.88528775645096 152.92720919989043 153.11232199371042 153.20177279049472 154.750553162226 156.7436810770141
Open search router TTI (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.218 FPS
Stdev: 0.974 FPS (1.6%)
Runs: 56.87230587945624 56.954561776713824 57.1050226844815 57.13133456490133 57.373643354929875 57.48079612675807 57.62883234801008 57.67869465177516 57.84017364859681 58.089481275870455 58.163371151290264 58.17798312918639 58.31302070747159 58.75549850398086 58.777726010928106 58.911587472265914 58.967601261003615 59.026786073543676 59.03619675809742 59.184689110860994 59.21102282581391 59.22563036212218 59.3360746926065 59.35837284204844 59.38915078570406 59.530326296879196 59.5493654271582 59.70484349556764 59.717115865729454 59.72147557140663 59.74627410023836 59.74977535566846 59.8570245211367 59.919810243641656 59.93638000319586 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Open search router TTI (RAM) Baseline
Mean: 378.890 MB
Stdev: 4.316 MB (1.1%)
Runs: 371.0520833333333 371.24609375 371.7213541666667 372.3528645833333 372.9505208333333 372.9908854166667 373.16015625 373.2473958333333 373.57421875 373.94140625 374.7578125 374.9973958333333 375.0361328125 375.57421875 375.6041666666667 376.5924479166667 376.6614583333333 376.6653645833333 376.6796875 376.734375 376.76171875 376.765625 376.9869791666667 377.2216796875 377.4153645833333 377.5234375 377.6315104166667 377.6901041666667 377.7018229166667 377.8229166666667 377.9166666666667 378.23828125 378.2838541666667 378.58984375 378.8212890625 378.9348958333333 380.4583333333333 380.576171875 381.3606770833333 381.6083984375 381.859375 381.9814453125 382.08984375 382.2412109375 382.2958984375 382.478515625 382.5380859375 383.0751953125 383.5651041666667 383.8837890625 383.9033203125 383.953125 384.0673828125 384.5390625 385.193359375 385.2760416666667 385.7333984375 386.0302734375 386.6328125 388.2330729166667

Current
Mean: 383.833 MB
Stdev: 4.863 MB (1.3%)
Runs: 372.1510416666667 372.38671875 373.9010416666667 374.3294270833333 374.8502604166667 375.08984375 377.7109375 377.8385416666667 377.96484375 378.1380208333333 378.1731770833333 379.1015625 379.2552083333333 379.7005208333333 379.826171875 380.6549479166667 381.013671875 381.6533203125 382.4775390625 382.65234375 382.900390625 383.4267578125 383.455078125 384.224609375 384.318359375 384.4505208333333 384.5693359375 384.619140625 384.8603515625 385.0546875 385.0576171875 385.322265625 385.4599609375 385.87109375 385.9931640625 386.0341796875 386.0576171875 386.08203125 386.1162109375 386.1494140625 386.849609375 387.1298828125 387.2275390625 387.271484375 387.291015625 387.431640625 387.69140625 388.0283203125 388.1279296875 388.150390625 388.171875 388.28515625 388.4228515625 388.7080078125 388.767578125 389.84375 390.3212890625 390.7177734375 390.81640625 391.8447265625
Open search router TTI (CPU/JS) Baseline
Mean: 78.353 %
Stdev: 2.110 % (2.7%)
Runs: 73.5 74 74.1 74.9 75.4 75.8 75.8 75.8 75.9 75.9 76.1 76.5 76.5 76.9 77 77.1 77.1 77.1 77.2 77.4 77.5 77.5 77.7 78.3 78.3 78.4 78.4 78.6 78.7 78.8 78.8 78.8 78.8 78.9 78.9 78.9 79 79.1 79.1 79.3 79.3 79.3 79.3 79.4 79.4 79.8 79.9 79.9 80.1 80.1 80.3 80.9 80.9 81 81 82.3 82.7 82.7 82.7

Current
Mean: 77.703 %
Stdev: 2.167 % (2.8%)
Runs: 72.5 72.9 73.8 73.9 74 74.9 75.1 75.3 75.4 75.7 75.9 76.2 76.3 76.3 76.4 76.4 76.4 76.4 76.5 76.7 76.7 76.8 76.8 76.9 77 77.1 77.1 77.5 77.7 77.7 77.8 77.9 77.9 78 78 78.1 78.1 78.4 78.9 78.9 79 79 79.1 79.1 79.1 79.2 79.4 79.4 79.4 80.1 80.3 80.4 80.4 80.6 80.7 80.8 81.1 81.4 81.5 81.9
Open search router TTI (CPU/UI) Baseline
Mean: 29.107 %
Stdev: 1.965 % (6.7%)
Runs: 24.5 24.5 25.3 25.9 26.4 26.5 27.1 27.2 27.2 27.5 27.5 27.5 27.6 27.8 27.9 28 28.1 28.2 28.2 28.4 28.4 28.4 28.4 28.5 28.5 28.6 28.6 28.7 29 29.2 29.2 29.3 29.3 29.3 29.3 29.3 29.4 29.5 29.6 29.7 29.9 30 30 30.6 30.6 30.6 30.7 30.7 30.9 30.9 30.9 31.1 31.2 31.2 31.4 31.5 31.8 32.7 34 34.2

Current
Mean: 28.446 %
Stdev: 1.704 % (6.0%)
Runs: 25.3 25.4 25.5 25.7 25.8 25.9 25.9 26.3 26.4 26.4 26.4 26.9 27 27.2 27.4 27.4 27.5 27.6 27.9 27.9 27.9 27.9 27.9 27.9 28 28.3 28.4 28.4 28.4 28.4 28.4 28.5 28.5 28.6 28.9 28.9 28.9 28.9 29.2 29.3 29.3 29.4 29.4 29.4 29.4 29.4 29.5 29.8 30.4 30.4 30.4 30.8 30.8 30.9 31.2 31.3 31.4 31.4 32.3
Report typing Composer typing rerender count Baseline
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Report typing Message sent Baseline
Mean: 423.187 ms
Stdev: 32.360 ms (7.6%)
Runs: 353.8738609999418 357.8134359996766 367.8568110000342 371.68070399947464 373.687826000154 376.54793299920857 377.7879230007529 380.6596280001104 382.03751699998975 382.750041000545 386.0390220005065 389.8233650010079 392.57629400119185 393.7487790007144 394.50305199995637 394.60144100151956 397.82568399980664 399.63692199997604 401.9299720004201 403.3262540008873 403.74812899902463 408.12060599960387 410.9391689989716 411.23706099949777 414.3541670013219 418.0165200009942 419.7595220003277 421.8059080000967 430.61263000033796 431.8722329996526 432.46602400019765 432.9003500007093 434.7895919997245 438.92329899966717 439.34728999994695 439.7278240006417 439.9202880002558 440.7922370005399 441.27058999985456 443.1649169996381 449.0643319990486 449.18587299995124 452.67696199938655 453.28364999964833 453.5874840002507 454.1339110005647 455.38867200165987 455.38899799995124 456.5420740004629 457.7052410002798 457.749430000782 458.50447599962354 458.74292100034654 460.5270189996809 462.62133800052106 462.73140499927104 463.7832040004432 464.28658100031316 465.57568399980664 467.23852599970996

Current
Mean: 423.966 ms
Stdev: 34.647 ms (8.2%)
Runs: 352.3684080000967 361.2019859999418 370.7502030003816 371.6916510015726 379.20349200069904 380.441813999787 380.89449100010097 380.9281820002943 381.1918129995465 381.2871090006083 381.4090170003474 382.2882080003619 388.80794299952686 389.14172400161624 393.9934490006417 394.2716480009258 397.2350670006126 397.8644620012492 398.02669299952686 399.3731689993292 403.7926850002259 404.9625659994781 406.1946610007435 409.6176350004971 411.00130199827254 418.18880300037563 418.51546300016344 418.5893970001489 419.6367190014571 422.8651529997587 425.57881699874997 437.2810469996184 437.53698700107634 438.5666100010276 440.69291200116277 442.1136880014092 442.53332499973476 442.6415609996766 444.4482020009309 447.52046700008214 448.9358719997108 452.76228800043464 453.33032199926674 453.5124520007521 454.3657629992813 455.52941900119185 456.48779300041497 457.3851319998503 458.2836920004338 458.5841879993677 460.03780199959874 460.2676600012928 461.77917500026524 462.74121100082994 464.4439289998263 465.10803200118244 469.66369700059295 477.9757899995893 484.9791260007769 487.1643889993429
Report typing (CPU) Baseline
Mean: 101.447 %
Stdev: 2.822 % (2.8%)
Runs: 96.58985219573103 96.90155395720977 97.37772965354186 97.89385279119793 97.90590449631907 98.01670105079202 98.01835007927825 98.17478997463188 98.3222530773566 98.63223888645894 98.75478865528768 98.7784849685471 98.95759975603399 99.2946982102078 99.39600925881963 99.62122186517988 99.67587889215314 99.95538874916438 99.99309723038115 100.01923096637233 100.02602338357052 100.2853983458013 100.37385435298374 100.49171881371576 100.53634732544758 100.56333090814162 100.59856918774652 100.63208964830403 100.70028693642037 100.78783925618829 100.78994168772563 100.97999864843261 101.0407776267974 101.11957919942772 101.1864549925994 101.6204537421742 101.67277669755381 101.91871187343905 102.51622670383033 102.65461912751584 102.695432296155 102.76786131999482 102.99739469569032 103.0358801221967 103.38469089056893 103.42777394918072 103.70647313557667 103.86976435542786 104.44263871207401 105.12138526916513 105.22212438989354 105.46855909335241 105.55539435178012 105.60832141612052 105.76143931175177 106.28852367813894 107.1336322839135 107.3036627324386 108.78155216368245

Current
Mean: 101.493 %
Stdev: 2.686 % (2.6%)
Runs: 97.67881768146043 97.71147871349575 97.73322368559906 97.89714609769868 98.10995188765101 98.13769981312306 98.14909299370646 98.27804334851588 98.33300308523816 98.54493803428785 98.70849475925559 99.21731511621347 99.24200942976243 99.3653160208626 99.45821767376387 99.56820693929708 99.73725820054258 99.74899042889173 99.7764666615841 99.91635324370677 99.93649979206396 99.97878332521834 100.02485631617978 100.07474767910472 100.33946858638666 100.38202482161388 100.48029268204706 100.49436278917041 100.54039213744467 100.88024547708612 100.98724503062142 101.02473710518069 101.05392026234037 101.40521993317631 101.57561732323093 102.01750405715102 102.11581546412076 102.49968278104863 102.73496264572931 102.99593569010874 103.09230350089211 103.10523175921293 103.29998417618957 103.42505796172266 103.519874461542 103.75325916573144 103.8164206960692 104.47330699566373 104.48220468662447 104.6249352123864 104.72749715201573 105.02479701925394 105.35529422058777 105.42245054113967 105.57507991267408 105.92369710709777 106.32669030324264 107.01814472644787 108.27527268636193
Report typing (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Report typing (RAM) Baseline
Mean: 469.924 MB
Stdev: 5.090 MB (1.1%)
Runs: 455.58832465277777 456.5807291666667 463.4388020833333 463.5920138888889 463.7825520833333 463.9318576388889 464.1946614583333 464.3044704861111 464.9939236111111 465.099609375 465.3342927631579 465.42469618055554 465.4494357638889 465.58353365384613 466.1369357638889 466.1569010416667 466.22113715277777 466.3630642361111 466.6432291666667 467.29014756944446 467.39496527777777 467.5572916666667 467.98936631944446 468.1998697916667 468.4006990131579 468.4329427083333 468.8046875 469.3869357638889 469.9720052083333 470.49717881944446 470.6369357638889 470.93988715277777 470.9806857638889 471.0696614583333 471.2958470394737 471.30859375 471.37586805555554 471.6510416666667 471.9884982638889 472.2384982638889 472.6501736111111 472.9427083333333 472.9431423611111 473.3810763888889 473.7786458333333 473.9748263888889 474.1627604166667 474.86610243055554 475.04839409722223 475.2712673611111 475.4010416666667 475.41905381944446 475.7638888888889 476.17816840277777 476.19901315789474 476.2545572916667 476.578125 477.44683159722223 480.3669704861111 480.59331597222223

Current
Mean: 470.402 MB
Stdev: 5.168 MB (1.1%)
Runs: 460.43055555555554 461.78363715277777 463.21504934210526 463.2421875 463.31987847222223 463.39453125 463.8622532894737 464.5859375 464.59223090277777 464.8365885416667 464.87913602941177 465.28819444444446 465.39952256944446 465.6271701388889 465.8930921052632 466.48676215277777 466.9767795138889 467.0564236111111 467.3020833333333 467.51671006944446 467.5529513888889 467.658203125 467.72743055555554 467.732421875 467.96375868055554 468.44422743055554 468.5914522058824 468.7766927083333 469.5631510416667 469.9459635416667 470.3040364583333 470.59461805555554 470.8346354166667 471.0670572916667 471.4201388888889 471.68901909722223 471.73676215277777 472.3552517361111 473.0065104166667 473.31532118055554 473.38715277777777 473.4479166666667 473.53819444444446 473.71983506944446 474.166015625 474.396484375 475.1291232638889 475.3595920138889 475.5885416666667 475.7356770833333 476.5513980263158 476.8752170138889 477.0041232638889 477.79340277777777 477.8782894736842 477.9069010416667 477.94574652777777 479.10004340277777 480.68446180555554 481.9557291666667
Report typing (CPU/JS) Baseline
Mean: 46.405 %
Stdev: 2.796 % (6.0%)
Runs: 40.5 41.2 42.5 42.5 42.7 42.8 42.9 42.9 43.1 43.1 43.6 43.6 43.7 43.7 43.8 43.9 43.9 44.1 44.4 44.6 44.7 45 45.3 45.6 45.6 46 46.2 46.2 46.2 46.7 46.8 46.9 47 47.3 47.3 47.4 47.5 47.6 47.9 48 48.1 48.5 48.6 48.6 49 49 49.2 49.3 49.3 49.7 49.7 49.9 50 50 50.3 50.6 50.9 51.1 51.4

Current
Mean: 46.625 %
Stdev: 3.209 % (6.9%)
Runs: 40.6 40.9 41.5 41.7 41.7 41.9 42.5 42.8 43.1 43.2 43.3 43.4 43.4 43.5 43.6 43.9 44.4 44.5 44.6 45 45.3 45.4 45.8 46 46 46.1 46.2 46.2 46.3 46.6 46.8 46.8 47 47.5 47.5 47.7 47.8 47.8 48 48.1 48.2 48.3 48.4 48.6 49.4 49.4 49.6 49.6 49.7 49.8 49.9 50 50.1 50.2 50.5 51.1 51.1 51.2 51.8 56.2
Report typing (CPU/UI) Baseline
Mean: 26.183 %
Stdev: 0.780 % (3.0%)
Runs: 24.5 24.6 24.7 24.7 25.1 25.1 25.2 25.2 25.2 25.2 25.3 25.3 25.4 25.6 25.7 25.7 25.7 25.8 25.8 25.8 26 26 26 26 26.1 26.1 26.1 26.2 26.2 26.2 26.3 26.4 26.4 26.5 26.5 26.5 26.5 26.5 26.6 26.6 26.6 26.7 26.7 26.7 26.7 26.8 26.9 26.9 27 27 27 27 27 27.2 27.4 27.4 27.4 27.5 27.6

Current
Mean: 26.229 %
Stdev: 0.694 % (2.6%)
Runs: 25.1 25.1 25.2 25.2 25.2 25.3 25.4 25.4 25.4 25.4 25.5 25.6 25.7 25.7 25.7 25.7 25.8 25.8 25.8 25.9 25.9 25.9 26 26 26 26 26.1 26.1 26.1 26.1 26.2 26.2 26.3 26.3 26.4 26.4 26.4 26.5 26.6 26.6 26.6 26.6 26.6 26.6 26.7 26.7 26.8 26.8 26.8 26.8 27 27 27.2 27.2 27.3 27.3 27.7 27.9 27.9
Chat opening Chat TTI Baseline
Mean: 571.694 ms
Stdev: 37.780 ms (6.6%)
Runs: 495.2789309993386 500.59139000065625 511.269532000646 514.0592860002071 516.2185469996184 519.746012000367 524.3260500002652 526.8451329991221 535.6330570001155 537.2008060012013 538.9198809992522 539.5474040005356 546.4312340002507 548.9822599999607 555.5910240001976 558.2092289999127 559.6546229999512 562.5020749997348 566.9106849990785 567.2823489997536 567.3931480012834 568.8042810000479 570.934651998803 574.4687099996954 576.5568440016359 577.4043779987842 577.5740160010755 579.3267010003328 579.8176680002362 582.5494389999658 583.1127109993249 586.8273929990828 587.7396249994636 591.0742600001395 593.1890059988946 593.6957609988749 594.7908939998597 598.828735999763 599.331421000883 600.1950679998845 609.0738120004535 612.6950270012021 617.4031170010567 622.0489910002798 623.4008790012449 635.8048509992659 644.2111419998109 667.8713389988989

Current
Mean: 516.569 ms
Stdev: 117.874 ms (22.8%)
Runs: 281.5801190007478 290.33874499984086 299.9886880014092 304.49536100029945 305.5725510008633 306.7891039997339 322.52982600033283 325.6159259993583 338.7578539997339 346.9747310001403 349.8442379999906 350.1768799982965 357.55004899948835 357.89156100153923 365.4368079993874 368.69246400147676 497.1236569993198 515.8492029998451 518.1698409989476 530.6920170001686 532.377563001588 538.0055340006948 540.1009519994259 542.3769940007478 546.4322520010173 550.2015790008008 559.9508460015059 563.3079829998314 568.4091800004244 571.9782720003277 573.0451250001788 577.7721769995987 579.9147140011191 580.6471760012209 580.9514570012689 581.3343510013074 585.7675790004432 585.9986169990152 586.0428059995174 587.9312750007957 588.8311359994113 591.2552090007812 597.7848309986293 599.6722000017762 604.3782150000334 605.9322919994593 606.9400229994208 607.1421710010618 614.6695149987936 616.285563999787 620.1266680005938 622.6492929998785 622.9616299998015 623.1993410009891 623.296875 624.35136000067 631.6970220003277 631.800171000883 639.6718760002404 654.864095998928
Chat opening (CPU) Baseline
Mean: 157.271 %
Stdev: 6.694 % (4.3%)
Runs: 144.01769990944112 145.3328485001791 145.48375353156223 146.48838677588412 147.039254823686 148.46119862567096 149.15029487949664 149.84628897672383 150.17339272928552 150.17371886536606 150.20272322842453 150.25685067871785 150.71305500331357 150.72256958194185 150.76833314546508 150.9431916367836 151.009855035436 151.58896242602515 152.76977180740263 152.94743790223092 153.01460823373165 154.03889388386185 154.694226006981 156.2187709574212 157.0068594851204 157.68435971166022 157.75249500998 157.85296082454366 157.92599986490998 158.10525008530456 158.22576361221775 158.54803204958336 158.92415417940575 158.93563196658505 159.03703703703704 159.25723359625394 159.36977977495042 160.27534354474452 160.31301976559783 160.89419984473773 161.01882120450955 161.1474806227801 161.17757167268806 161.3416075178246 161.9129614900661 162.08148206534116 162.73442254175026 163.1265564803492 163.3971309993996 163.69308669290675 163.73819160883005 164.82032023520281 165.0743467481961 165.33231668572873 166.1040462427745 166.12109292618248 166.7225548902197 167.79461078637982 168.59992237808214 174.17953743708904

Current
Mean: 157.812 %
Stdev: 4.904 % (3.1%)
Runs: 145.35571650048922 148.5343915343916 149.2317418114557 150.01719986240116 150.56473136579888 150.96632763689087 151.1161832656015 151.66531553393745 151.69134963768113 153.1297225781752 153.74719082910246 153.76984278455046 154.1418081253854 154.1952911866744 154.23904382470113 154.30530656234512 154.39679472396497 154.4665159429328 154.83558418614388 155.25230354889683 155.6898657873515 156.38514388313666 156.62387560836333 156.85430577227203 157.16495863824963 157.31635004331656 157.55564700503666 157.9852139996444 158.1288184471383 158.15366500908124 158.16121435062286 158.59833673598857 158.6977431893947 158.70308063379215 158.74165146114765 158.84878147447318 158.90571049136776 158.91368027606197 159.0365086559949 159.3059886296258 159.32217163093665 159.44084206618535 159.72472885156446 160.78143712574857 161.64298810833466 161.65377827211466 162.1410788341023 162.2177954847277 162.7773599089943 163.34229091079803 163.48073785280718 163.54847277556433 163.67314595988452 163.86493791011233 164.09145454111712 164.88180610889756 165.38696028954476 166.65106838116606 166.9901050871772 167.68484544854527
Chat opening (FPS) Baseline
Mean: 59.937 FPS
Stdev: 0.173 FPS (0.3%)
Runs: 59.33419187210732 59.345551102462345 59.40844835524572 59.523191033512916 59.6594843074972 59.690281966849085 59.94774406834387 59.990862009368 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.992 FPS
Stdev: 0.046 FPS (0.1%)
Runs: 59.69581476041528 59.938778220871335 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Chat opening (RAM) Baseline
Mean: 374.322 MB
Stdev: 6.973 MB (1.9%)
Runs: 363.4921875 363.8893229166667 364.01171875 364.1575520833333 364.6770833333333 365.1770833333333 365.3346354166667 365.8359375 365.859375 366.1549479166667 367.7877604166667 368.2161458333333 368.3359375 368.859375 369.03125 369.9765625 370.03515625 370.2200520833333 370.2291666666667 370.2434895833333 370.4348958333333 370.6705729166667 370.7044270833333 370.9921875 371.12109375 371.4544270833333 371.6549479166667 371.71875 371.74609375 372.5104166666667 372.5286458333333 373.3046875 373.4114583333333 373.90234375 374.1471354166667 374.9036458333333 375.14453125 376.0559895833333 376.1341145833333 377.4775390625 378.625 378.9583333333333 378.978515625 379.2158203125 380.57421875 380.6396484375 381.611328125 381.6513671875 382.630859375 383.0087890625 383.2880859375 383.5810546875 384.02734375 384.1376953125 384.201171875 384.6630859375 385.4677734375 385.7470703125 386.4228515625 390.3580729166667

Current
Mean: 374.400 MB
Stdev: 6.197 MB (1.7%)
Runs: 365.0234375 365.1614583333333 366.4466145833333 366.4622395833333 366.6380208333333 366.7565104166667 366.81640625 367.0572916666667 367.37890625 367.83203125 368.41015625 368.7369791666667 368.7486979166667 369.6197916666667 369.69140625 370.04296875 370.3619791666667 370.3854166666667 370.984375 371.17578125 371.1796875 371.21875 371.3893229166667 371.4635416666667 371.5989583333333 371.6263020833333 371.6848958333333 371.7734375 371.7994791666667 372.1705729166667 372.2994791666667 372.5598958333333 372.69140625 373.0234375 373.28125 373.41015625 374.4986979166667 375.3046875 376.2317708333333 376.2369791666667 376.7239583333333 378.46484375 379.5908203125 379.859375 380.0338541666667 380.609375 380.97265625 381.291015625 381.3037109375 382.7216796875 382.9716796875 382.984375 383.072265625 383.1494140625 384.0126953125 384.1552734375 384.1552734375 385.3271484375 385.9287109375 387.4853515625
Chat opening (CPU/JS) Baseline
Mean: 78.617 %
Stdev: 2.488 % (3.2%)
Runs: 73.5 73.7 73.9 73.9 74.5 74.5 74.9 75.1 75.2 76.3 76.5 76.7 76.8 77 77 77.1 77.2 77.2 77.3 77.9 77.9 77.9 78 78 78.1 78.4 78.5 78.5 79.1 79.1 79.1 79.2 79.2 79.2 79.3 79.3 79.3 79.4 79.4 79.7 80 80.1 80.2 80.2 80.3 80.3 80.4 80.4 80.5 80.8 80.9 80.9 81 81.4 81.4 81.9 82.1 83 83.5 84.9

Current
Mean: 78.390 %
Stdev: 2.212 % (2.8%)
Runs: 73.9 74.5 74.5 75.4 75.6 75.7 75.8 75.8 76.4 76.4 76.4 76.6 76.8 76.9 76.9 77 77 77.2 77.2 77.2 77.3 77.6 77.8 77.8 77.8 77.8 77.9 77.9 77.9 78 78 78 78.1 78.2 78.2 78.5 78.6 78.8 78.9 79 79.1 79.2 79.4 79.5 79.8 80.1 80.2 80.6 81 81.1 81.3 81.4 81.5 81.8 81.9 82.5 82.8 83.2 83.3
Chat opening (CPU/UI) Baseline
Mean: 33.827 %
Stdev: 2.659 % (7.9%)
Runs: 27.2 27.8 28.4 29.9 29.9 29.9 30.3 30.6 30.6 31.2 31.3 31.7 31.9 31.9 31.9 31.9 32.3 32.4 32.5 32.6 32.6 33 33.1 33.2 33.3 33.3 33.6 33.7 33.8 33.9 33.9 34 34 34.3 34.3 34.4 34.5 35 35.3 35.4 35.4 35.5 35.5 35.9 36.2 36.2 36.2 36.3 36.4 36.5 36.7 37.1 37.2 37.2 37.4 37.4 37.7 37.8 37.9 38.3

Current
Mean: 34.437 %
Stdev: 2.494 % (7.2%)
Runs: 28.8 30.3 30.3 30.5 31.1 31.2 31.3 31.7 31.7 31.9 31.9 32.1 32.3 32.3 32.4 32.4 32.6 32.6 33 33.2 33.3 33.3 33.4 33.4 33.5 33.5 33.7 33.9 34.1 34.4 34.4 34.5 34.5 34.6 34.9 35 35.1 35.3 35.9 35.9 35.9 35.9 36.3 36.4 36.5 36.5 36.6 36.9 37 37 37.1 37.4 37.4 37.5 37.5 37.9 38.4 38.7 39.4 39.7
Linking (CPU) Baseline
Mean: 161.256 %
Stdev: 3.271 % (2.0%)
Runs: 154.4022597614579 155.07938348708478 155.3470131605204 155.45879960420808 155.92054382284473 156.54910626266405 156.72569728916613 157.40360439331386 157.4564937143431 157.49514251709067 158.04113108373363 158.13720319968513 158.25824130310684 158.48357927125008 158.61719572793393 158.7029295103285 158.83167577015652 159.35208228400788 159.6425534777356 159.8867727043047 159.88999872892862 159.981277682108 160.01728933299188 160.16110162758144 160.5545431610547 160.63526321913363 160.69167240298796 160.7733881506576 161.039763469975 161.26844428655036 161.42731972246648 161.4745250534787 161.60592265773187 162.10898437761847 162.14780041687914 162.4193074674025 162.55122463616135 162.72672075504286 163.10438649895082 163.16165772781238 163.16799003592885 163.64823818498465 163.7055238792005 163.71318668074434 163.74793419579672 163.81704776422234 164.07199339248012 164.35365045996065 164.4459601875945 164.8154383533869 164.88131566996992 165.03465363983508 165.09022344494895 165.75756298576187 165.78503072044472 165.87219277267647 166.25111056356374 166.2771068062428 166.43531063414036 166.93145477295968

Current
Mean: 160.478 %
Stdev: 3.475 % (2.2%)
Runs: 152.3155214176733 153.55689091391955 154.47435177080624 154.47806297458868 154.60471994034657 155.0174172387706 155.9968908156009 156.83784673268144 156.87806619813173 157.26019208775412 157.36703877194978 157.59234174495145 157.9577919616262 157.98721754429602 158.29288169223688 158.42116532116853 158.65149503189886 158.66760414472367 159.08512326502358 159.11844732696372 159.18459829394874 159.22130421358634 159.41815945584108 159.46868266766586 159.58893886766788 159.71406760253595 159.7913986457271 159.79721301089725 160.13878247522896 160.24386850860134 160.40552221911344 160.442809552261 160.56704884173917 160.8524162542131 161.07988243900604 161.29155667643093 161.35501690662207 161.47416492782045 161.8057858024247 162.06783695775792 162.0868547535216 162.7790943581539 162.84653070939035 163.0358657379873 163.11755589163567 163.22498135426466 163.37435480115258 163.5051340525292 163.78894281981343 163.8458364983293 163.92617421368465 164.14054432361152 164.38589382264846 164.50604120876827 164.54863220205408 164.61867664637364 165.2009083570912 166.24489755071542 167.59802208156063 169.45495710742856
Linking (FPS) Baseline
Mean: 59.998 FPS
Stdev: 0.008 FPS (0.0%)
Runs: 59.960003934665735 59.96043195123958 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.923 FPS
Stdev: 0.147 FPS (0.2%)
Runs: 59.383153706415804 59.47790709333855 59.517961888124525 59.68315033756562 59.705063762859254 59.70868751714381 59.74800792882795 59.77866651747104 59.83746022243242 59.84342455683353 59.86092465479814 59.89550576130683 59.90110613334374 59.90282547259475 59.92024370236312 59.98548620881115 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Linking (RAM) Baseline
Mean: 409.373 MB
Stdev: 3.727 MB (0.9%)
Runs: 400.02109375 402.31328125 402.4984375 402.559375 402.76484375 403.431640625 403.814453125 404.03203125 405.330078125 405.6686197916667 405.9055989583333 406.4830729166667 406.65078125 406.7623697916667 406.7643229166667 406.8046875 406.99609375 407.431640625 407.4420572916667 407.9498697916667 407.9759114583333 408.2923177083333 408.4921875 408.5475260416667 408.783203125 409.3326822916667 409.44140625 409.5260416666667 409.5520833333333 409.677734375 409.6927083333333 409.908203125 410.0299479166667 410.0709635416667 410.5234375 410.53125 410.9765625 411.1315104166667 411.1614583333333 411.3723958333333 411.4303385416667 411.4440104166667 411.5794270833333 411.9993489583333 412.103515625 412.296875 412.4388020833333 412.478515625 412.5768229166667 412.70703125 413.0240885416667 413.0481770833333 413.19140625 413.8704427083333 414.2161458333333 414.720703125 415.1985677083333 415.4537760416667 415.63671875 416.3209635416667

Current
Mean: 418.858 MB
Stdev: 3.646 MB (0.9%)
Runs: 412.380859375 413.5345052083333 414.1080729166667 414.138671875 414.5423177083333 414.91015625 415.16015625 415.2044270833333 415.4173177083333 415.7194010416667 415.7526041666667 415.8600260416667 415.875 416.12890625 416.142578125 416.1575520833333 416.46875 416.537109375 416.6673177083333 416.8268229166667 416.9739583333333 417.2005208333333 417.2766927083333 417.4557291666667 417.7897135416667 418.04296875 418.2623697916667 418.2630208333333 418.45200892857144 418.4798177083333 418.4856770833333 418.5546875 418.5872395833333 418.61328125 418.876953125 419.1106770833333 419.1653645833333 419.3014322916667 419.41796875 419.6998697916667 419.8098958333333 419.8912760416667 420.140625 420.203125 420.2825520833333 420.6380208333333 421.736328125 422.0872395833333 422.41629464285717 422.8053385416667 423.4146205357143 424.46763392857144 425.4564732142857 425.7701822916667 425.83426339285717 426.8950892857143 428.13002232142856 428.2265625
Linking (CPU/JS) Baseline
Mean: 84.960 %
Stdev: 1.301 % (1.5%)
Runs: 81.6 82.4 82.6 82.7 82.9 83 83 83.2 83.4 83.6 83.7 84 84.1 84.1 84.1 84.1 84.2 84.3 84.4 84.4 84.5 84.5 84.7 84.7 84.9 84.9 84.9 85 85.1 85.1 85.2 85.4 85.4 85.5 85.5 85.6 85.6 85.6 85.7 85.9 85.9 85.9 85.9 85.9 85.9 86 86 86.1 86.2 86.2 86.2 86.4 86.4 86.6 86.8 86.9 87.2 87.7

Current
Mean: 85.058 %
Stdev: 1.373 % (1.6%)
Runs: 81.8 82.1 82.1 82.3 82.9 83 83.4 83.7 83.9 84 84 84 84.1 84.2 84.3 84.4 84.4 84.5 84.5 84.5 84.6 84.6 84.7 84.8 84.9 85 85.1 85.2 85.2 85.2 85.3 85.4 85.4 85.5 85.5 85.5 85.6 85.6 85.8 85.8 85.8 85.8 85.8 85.9 86 86.1 86.1 86.3 86.4 86.5 86.6 86.9 87.2 87.2 87.3 87.4 88.2
Linking (CPU/UI) Baseline
Mean: 36.323 %
Stdev: 1.516 % (4.2%)
Runs: 33.4 33.5 33.5 33.6 33.6 33.9 34.1 34.3 34.5 34.5 34.8 35.1 35.3 35.5 35.5 35.5 35.5 35.5 35.6 35.6 35.6 35.8 36 36.2 36.3 36.3 36.5 36.5 36.5 36.6 36.6 36.6 36.9 36.9 36.9 37 37.1 37.1 37.3 37.3 37.3 37.4 37.4 37.5 37.5 37.5 37.5 37.6 37.7 37.7 37.8 37.9 38.2 38.5 39.2 39.3 39.6

Current
Mean: 34.753 %
Stdev: 2.125 % (6.1%)
Runs: 30.3 30.5 31.5 31.8 31.9 32.2 32.6 32.7 33 33.1 33.1 33.1 33.1 33.2 33.2 33.3 33.3 33.3 33.3 33.5 33.6 33.8 33.8 33.9 33.9 33.9 34 34 34.3 34.4 34.6 34.6 34.6 34.8 34.8 34.8 34.9 35.1 35.2 35.3 35.7 35.8 35.9 36.1 36.2 36.2 36.6 36.6 37 37.1 37.2 37.3 37.4 37.4 37.9 38.2 38.2 38.5 38.8 40.8

Copy link
Contributor

github-actions bot commented Dec 3, 2024

@Expensify/mobile-deployers 📣 Please look into this performance regression as it's a deploy blocker.

Copy link
Contributor

github-actions bot commented Dec 4, 2024

🚀 Deployed to staging by https://github.com/Beamanator in version: 9.0.71-0 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 success ✅
🍎🔄 iOS HybridApp 🍎🔄 success ✅

@Beamanator Beamanator removed the DeployBlockerCash This issue or pull request should block deployment label Dec 4, 2024
@Beamanator
Copy link
Contributor

This is very unlikely the real performance blocker as we're just adding a Modal in 1 scenario

@Beamanator
Copy link
Contributor

Looking good!!

Screenshot 2024-12-04 at 7 41 08 AM

Copy link
Contributor

github-actions bot commented Dec 5, 2024

🚀 Deployed to production by https://github.com/puneetlath in version: 9.0.71-2 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 failure ❌
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 failure ❌
🍎🔄 iOS HybridApp 🍎🔄 failure ❌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
InternalQA This pull request required internal QA
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants