Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use reconnect when starting hybrid app #52824

Merged

Conversation

jnowakow
Copy link
Contributor

@jnowakow jnowakow commented Nov 20, 2024

Explanation of Change

The problem was caused by openApp being called each time ND was opened in hybrid app. It downloads all information needed to open app for the first time. On subsequent start ups Onyx is filled with the data so reconnectApp should be called.

Fixed Issues

$ #49964
PROPOSAL: N/A

Tests

  • Have a long chat with User B

  • As User A, access the chat on your device so it’s cached and kill the app

  • As User B, message User A

  • As User A, tap on the notification for the message.

  • Observe that there are no loading skeletons for previous messages

  • Verify that no errors appear in the JS console

Offline tests

N/A

QA Steps

Same as tests

  • Verify that no errors appear in the JS console

PR Author Checklist

  • I linked the correct issue in the ### Fixed Issues section above
  • I wrote clear testing steps that cover the changes made in this PR
    • I added steps for local testing in the Tests section
    • I added steps for the expected offline behavior in the Offline steps section
    • I added steps for Staging and/or Production testing in the QA steps section
    • I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
    • I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).
  • I included screenshots or videos for tests on all platforms
  • I ran the tests on all platforms & verified they passed on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
  • I followed proper code patterns (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
      • If any non-english text was added/modified, I verified the translation was requested/reviewed in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I followed the guidelines as stated in the Review Guidelines
  • I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.js or at the top of the file that uses the constant) are defined as such
  • I verified that if a function's arguments changed that all usages have also been updated correctly
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

Android: Native

N/A

Android: mWeb Chrome

N/A

iOS: Native

N/A

iOS: mWeb Safari

N/A

MacOS: Chrome / Safari

N/A

MacOS: Desktop

N/A

@jnowakow jnowakow requested a review from a team as a code owner November 20, 2024 14:44
@melvin-bot melvin-bot bot requested a review from aldo-expensify November 20, 2024 14:44
Copy link

melvin-bot bot commented Nov 20, 2024

@aldo-expensify Please copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

@melvin-bot melvin-bot bot removed the request for review from a team November 20, 2024 14:44
Copy link
Contributor

@war-in war-in left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@Julesssss Julesssss left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! Just going to get a C+ review before we merge.

@Julesssss
Copy link
Contributor

Julesssss commented Nov 21, 2024

Reviewer Checklist

  • I have verified the author checklist is complete (all boxes are checked off).
  • I verified the correct issue is linked in the ### Fixed Issues section above
  • I verified testing steps are clear and they cover the changes made in this PR
    • I verified the steps for local testing are in the Tests section
    • I verified the steps for Staging and/or Production testing are in the QA steps section
    • I verified the steps cover any possible failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
  • I checked that screenshots or videos are included for tests on all platforms
  • I included screenshots or videos for tests on all platforms
  • I verified tests pass on all platforms & I tested again on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • If there are any errors in the console that are unrelated to this PR, I either fixed them (preferred) or linked to where I reported them in Slack
  • I verified proper code patterns were followed (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick).
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I verified that this PR follows the guidelines as stated in the Review Guidelines
  • I verified other components that can be impacted by these changes have been tested, and I retested again (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar have been tested & I retested again)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.js or at the top of the file that uses the constant) are defined as such
  • If a new component is created I verified that:
    • A similar component doesn't exist in the codebase
    • All props are defined accurately and each prop has a /** comment above it */
    • The file is named correctly
    • The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
    • The only data being stored in the state is data necessary for rendering and nothing else
    • For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
    • Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
    • All JSX used for rendering exists in the render method
    • The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG)
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
  • I have checked off every checkbox in the PR reviewer checklist, including those that don't apply to this PR.

Screenshots/Videos

Android: Native
Android: mWeb Chrome
iOS: Native
iOS: mWeb Safari
MacOS: Chrome / Safari
MacOS: Desktop

@Julesssss Julesssss merged commit 0250799 into Expensify:main Nov 21, 2024
16 of 19 checks passed
@OSBotify
Copy link
Contributor

✋ This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

@github-actions github-actions bot added the DeployBlockerCash This issue or pull request should block deployment label Nov 21, 2024
Copy link
Contributor

Performance Comparison Report 📊

Significant Changes To Duration

Name Duration
Linking 781.753 ms → 1098.965 ms (+317.212 ms, +40.6%) 🔴🔴
Show details
Name Duration
Linking Baseline
Mean: 781.753 ms
Stdev: 29.037 ms (3.7%)
Runs: 700.6680510006845 714.3423260003328 720.4094239994884 724.6530349999666 733.2572019994259 744.5150150004774 747.6999110002071 752.1405849996954 756.7166750002652 759.5508630014956 760.0677910000086 761.1100679989904 765.2211099993438 765.2844650000334 765.5337319988757 765.9406329989433 770.6630460005254 770.9418949987739 771.5207519996911 772.2635099999607 772.5526129994541 774.4482429996133 774.9396169986576 775.3297119997442 776.3270670007914 776.5691729988903 777.4427899997681 779.3456629998982 780.140055000782 782.0064700003713 782.012328999117 783.2910160012543 788.585572000593 790.085124000907 790.1412760000676 791.3739429991692 791.6282150000334 792.0127770006657 795.1068930011243 795.7571619991213 795.9303390011191 796.4361579995602 797.6658939998597 798.6486420016736 800.6117350012064 802.1924639996141 806.1961679998785 808.0876470003277 808.2088630013168 808.3998220004141 809.4832359999418 810.4344480000436 810.4373779986054 818.793335000053 822.6451420001686 824.9048669990152 832.0732020009309 839.5286870002747 841.1801360007375

Current
Mean: 1098.965 ms
Stdev: 251.917 ms (22.9%)
Runs: 888.0810550004244 919.6807460002601 919.7280270010233 921.12845900096 921.6982020009309 922.5457760002464 923.3637290000916 925.7168779987842 926.3148609995842 929.3824879992753 929.5364180002362 931.8400070015341 931.8769950009882 932.6475430000573 935.9246020000428 935.9992270004004 937.6866449993104 938.1957200001925 939.409383000806 939.8544929996133 939.9467780012637 945.4732260014862 947.9564220011234 948.1135660000145 948.6546229999512 950.9430749993771 959.2040609996766 961.5379649996758 962.5372730009258 963.4429529998451 963.5428470000625 965.0026049986482 967.897665001452 970.2331540007144 970.4582119993865 970.8498539999127 971.4645999986678 971.8929859995842 972.2903649993241 973.5491949990392 973.8701590001583 981.9615480005741 984.5786950010806 986.2791750002652 987.6813570000231 988.1996260005981 988.4962169993669 990.7057699989527 990.9182950016111 994.8780530001968 996.0299079995602 997.3783769998699 997.3986820001155 1013.9146730005741 1014.5426439996809 1021.4198410008103 1030.968913000077 1041.5537930000573 1042.7026780005544 1073.6829019989818 1419.9355480000377 1431.632569000125 1445.553874000907 1466.515870001167 1470.3041190002114 1482.1146249994636 1496.715414000675 1506.8058279994875 1507.4406739994884 1511.5353600010276 1526.96537300013 1536.151449000463 1569.4482429996133 1681.06742499955 1681.859944999218 1688.8080240003765 1703.4049490001053 1720.2533379998058

Meaningless Changes To Duration

Show entries
Name Duration
App start time nativeLaunch 25.879 ms → 26.707 ms (+0.828 ms, +3.2%)
App start time nativeLaunchEnd_To_appCreationStart 82.483 ms → 81.814 ms (-0.670 ms, -0.8%)
App start time appCreation 83.483 ms → 84.150 ms (+0.667 ms, +0.8%)
App start time runJsBundle 495.283 ms → 494.950 ms (-0.333 ms, ±0.0%)
App start time TTI 1546.525 ms → 1540.912 ms (-5.612 ms, ±0.0%)
App start time contentAppeared_To_screenTTI 642.506 ms → 646.601 ms (+4.095 ms, +0.6%)
App start time appCreationEnd_To_contentAppeared 698.750 ms → 698.533 ms (-0.217 ms, ±0.0%)
App start time regularAppStart 0.024 ms → 0.024 ms (+0.000 ms, +1.7%)
App start time (CPU) 134.571 % → 134.975 % (+0.404 %, ±0.0%)
App start time (FPS) 59.515 FPS → 59.605 FPS (+0.090 FPS, ±0.0%)
App start time (RAM) 362.655 MB → 362.284 MB (-0.371 MB, ±0.0%)
App start time (CPU/JS) 71.685 % → 73.524 % (+1.839 %, +2.6%)
App start time (CPU/UI) 29.543 % → 29.123 % (-0.420 %, -1.4%)
Open search router TTI Load Search Options 117.852 ms → 119.456 ms (+1.604 ms, +1.4%)
Open search router TTI Open Search Router TTI 573.488 ms → 571.928 ms (-1.560 ms, ±0.0%)
Open search router TTI (CPU) 135.500 % → 135.084 % (-0.416 %, ±0.0%)
Open search router TTI (FPS) 59.500 FPS → 59.930 FPS (+0.431 FPS, -0.7%)
Open search router TTI (RAM) 370.085 MB → 369.486 MB (-0.599 MB, ±0.0%)
Open search router TTI (CPU/JS) 68.363 % → 69.089 % (+0.726 %, +1.1%)
Open search router TTI (CPU/UI) 27.688 % → 27.334 % (-0.354 %, -1.3%)
Report typing Composer typing rerender count 1.000 renders → 1.000 renders
Report typing Message sent 435.264 ms → 435.918 ms (+0.654 ms, ±0.0%)
Report typing (CPU) 100.005 % → 100.063 % (+0.058 %, ±0.0%)
Report typing (FPS) 60.000 FPS → 60.000 FPS
Report typing (RAM) 505.457 MB → 506.531 MB (+1.074 MB, ±0.0%)
Report typing (CPU/JS) 46.960 % → 47.002 % (+0.042 %, ±0.0%)
Report typing (CPU/UI) 24.936 % → 24.972 % (+0.036 %, ±0.0%)
Chat opening Chat TTI 544.889 ms → 526.537 ms (-18.352 ms, -3.4%)
Chat opening (CPU) 141.586 % → 140.339 % (-1.247 %, -0.9%)
Chat opening (FPS) 60.000 FPS → 60.000 FPS
Chat opening (RAM) 383.460 MB → 382.734 MB (-0.726 MB, ±0.0%)
Chat opening (CPU/JS) 71.753 % → 71.653 % (-0.100 %, ±0.0%)
Chat opening (CPU/UI) 29.225 % → 29.698 % (+0.473 %, +1.6%)
Linking (CPU) 148.383 % → 147.885 % (-0.498 %, ±0.0%)
Linking (FPS) 60.000 FPS → 60.000 FPS
Linking (RAM) 423.567 MB → 436.659 MB (+13.091 MB, +3.1%)
Linking (CPU/JS) 80.495 % → 80.695 % (+0.200 %, ±0.0%)
Linking (CPU/UI) 28.542 % → 28.152 % (-0.390 %, -1.4%)
Show details
Name Duration
App start time nativeLaunch Baseline
Mean: 25.879 ms
Stdev: 3.063 ms (11.8%)
Runs: 21 21 22 22 22 22 23 23 23 23 23 24 24 24 24 24 24 24 24 24 24 24 25 25 25 25 25 25 25 25 25 25 25 25 26 26 26 26 26 27 27 27 27 28 28 28 29 29 29 30 30 31 31 31 31 31 33 35

Current
Mean: 26.707 ms
Stdev: 3.996 ms (15.0%)
Runs: 21 21 21 22 22 22 22 22 22 22 23 23 23 23 23 23 24 24 24 25 25 25 25 25 26 26 26 26 26 26 26 26 27 27 27 28 28 28 28 28 29 29 29 30 30 30 30 30 30 31 32 32 32 32 33 34 36 39
App start time nativeLaunchEnd_To_appCreationStart Baseline
Mean: 82.483 ms
Stdev: 11.372 ms (13.8%)
Runs: 61 64 65 65 67 67 68 70 70 71 72 72 72 73 74 74 74 75 75 76 76 76 77 77 77 78 78 80 82 83 83 84 84 85 86 87 87 87 88 88 88 89 89 89 89 90 90 91 91 92 94 94 96 96 97 101 101 104 109 111

Current
Mean: 81.814 ms
Stdev: 12.729 ms (15.6%)
Runs: 57 58 59 60 62 67 68 68 69 71 72 72 72 73 73 73 75 75 75 76 76 76 77 77 77 79 79 79 79 81 81 82 82 82 83 83 84 86 86 86 87 88 89 90 91 92 93 93 93 96 96 97 98 99 103 103 108 108 113
App start time appCreation Baseline
Mean: 83.483 ms
Stdev: 10.706 ms (12.8%)
Runs: 63 66 67 67 69 69 71 71 72 73 73 75 75 75 75 76 77 77 78 78 78 78 78 79 79 80 81 81 82 82 82 83 83 83 86 86 86 86 86 87 88 88 88 89 90 90 92 92 93 93 94 98 99 100 100 101 102 105 106 108

Current
Mean: 84.150 ms
Stdev: 10.751 ms (12.8%)
Runs: 61 66 67 69 70 70 71 73 75 75 75 76 76 76 77 77 77 77 78 78 78 79 79 80 80 80 80 80 81 82 83 83 84 85 85 86 87 87 88 88 89 89 89 90 92 92 92 93 93 94 94 95 98 99 102 102 104 105 108 110
App start time runJsBundle Baseline
Mean: 495.283 ms
Stdev: 37.961 ms (7.7%)
Runs: 414 428 429 430 436 440 442 443 444 447 452 455 456 457 457 457 458 461 462 481 483 485 493 495 495 497 497 500 501 502 503 507 511 514 517 517 518 519 519 519 521 521 521 523 526 526 527 527 528 529 529 535 538 538 539 545 547 550 551 555

Current
Mean: 494.950 ms
Stdev: 40.944 ms (8.3%)
Runs: 408 408 416 417 418 422 428 431 433 447 450 458 458 459 461 462 469 475 482 485 487 489 489 491 493 496 496 506 507 508 509 510 510 514 515 519 519 520 520 522 523 523 526 530 531 531 532 532 532 532 533 533 535 536 538 539 540 542 545 557
App start time TTI Baseline
Mean: 1546.525 ms
Stdev: 125.247 ms (8.1%)
Runs: 1328.5567730003968 1331.126171999611 1333.0780189996585 1333.455020999536 1363.8831089995801 1365.7883930001408 1367.6633339999244 1378.3796560000628 1380.1169819999486 1385.4434340000153 1391.4309909995645 1407.9556440003216 1412.7096030004323 1418.8194049997255 1430.7793230004609 1436.4436499997973 1447.5760089997202 1452.014458999969 1455.039571000263 1480.081941000186 1516.9465629998595 1522.130129000172 1522.976219999604 1546.2170439995825 1548.4384080003947 1553.4468970000744 1554.6079099997878 1555.3270870000124 1562.593683999963 1566.654384999536 1572.517951999791 1573.1156350001693 1575.26948599983 1577.583262999542 1581.3599530002102 1591.2419199999422 1595.60821700003 1603.9105270002037 1605.906200000085 1613.7670769998804 1615.5411769999191 1616.456654000096 1619.6769479997456 1621.1679849997163 1624.066603999585 1628.0661220001057 1642.4566749995574 1644.1549439998344 1644.3138629999012 1645.0715579995885 1646.3810360003263 1659.818690000102 1680.6469099996611 1692.5127720003948 1700.4764229999855 1740.572780000046 1754.3507200004533 1782.2197179999202 1787.0922779999673 1806.4702859995887

Current
Mean: 1540.912 ms
Stdev: 125.302 ms (8.1%)
Runs: 1273.882005999796 1294.895361999981 1332.9348229998723 1349.5827839998528 1351.97174299974 1352.082112999633 1355.3875860003754 1358.9550930000842 1362.4424830004573 1375.9818219998851 1387.0961549999192 1388.7620280003175 1397.4982040002942 1397.909466999583 1403.0276210000739 1405.2864140002057 1448.6052639996633 1475.785508999601 1514.4259320003912 1515.2465380001813 1522.0756029998884 1522.5541530000046 1544.311236999929 1551.125616000034 1557.7301570000127 1561.6027140002698 1563.1453350000083 1565.6381500000134 1567.5026740003377 1580.0247349999845 1583.6642159996554 1585.2571719996631 1585.4310320001096 1587.1243740003556 1588.8268860001117 1590.0115590002388 1593.5152310002595 1599.3107040002942 1600.357169999741 1604.2322180001065 1605.3807530002668 1606.87384799961 1613.8562110001221 1618.4786179997027 1620.279365000315 1622.9389389995486 1625.7312179999426 1625.737027999945 1647.8389790002257 1648.8602489996701 1650.015495000407 1656.4820600003004 1659.160671000369 1662.6149059999734 1673.3839699998498 1684.9931859998032 1701.8701229998842 1732.511877999641 1779.2849460002035 1823.2366369999945
App start time contentAppeared_To_screenTTI Baseline
Mean: 642.506 ms
Stdev: 54.183 ms (8.4%)
Runs: 533.4550209995359 544.8831089995801 551.9556440003216 552.126171999611 567.4434340000153 573.0780189996585 580.5567730003968 581.5760089997202 582.6633339999244 586.7883930001408 588.3796560000628 591.0395710002631 592.1169819999486 594.8194049997255 596.4309909995645 604.9465629998595 608.0144589999691 618.4468970000744 621.7793230004609 622.4436499997973 627.9762199996039 630.2170439995825 631.6079099997878 632.2694859998301 632.7096030004323 633.130129000172 635.5832629995421 637.5411769999191 644.0819410001859 645.3270870000124 649.1156350001693 649.3599530002102 657.5936839999631 659.4384080003947 661.60821700003 669.1549439998344 673.456654000096 673.9105270002037 677.0666039995849 680.0661220001057 680.2419199999422 683.517951999791 684.654384999536 687.6769479997456 690.0715579995885 691.1679849997163 691.6469099996611 695.8186900001019 695.9062000000849 699.4566749995574 700.3138629999012 704.5127720003948 711.7670769998804 714.4764229999855 747.3810360003263 807.5727800000459

Current
Mean: 646.601 ms
Stdev: 52.309 ms (8.1%)
Runs: 541.8820059997961 545.5827839998528 550.8953619999811 561.4982040002942 562.0961549999192 569.3875860003754 569.9348229998723 584.97174299974 586.7620280003175 588.2864140002057 589.6052639996633 598.785508999601 599.4424830004573 602.9818219998851 604.082112999633 608.909466999583 613.0276210000739 615.7301570000127 629.2571719996631 629.5152310002595 631.5541530000046 632.1453350000083 635.0756029998884 639.2465380001813 644.1256160000339 648.279365000315 652.311236999929 653.6642159996554 654.6381500000134 654.8268860001117 655.4259320003912 656.9389389995486 663.1243740003556 663.357169999741 664.5026740003377 668.3107040002942 669.6027140002698 671.0247349999845 672.4310320001096 674.2322180001065 681.4786179997027 682.0154950004071 685.8389790002257 688.8562110001221 690.0115590002388 691.87384799961 692.4820600003004 697.1606710003689 698.8701229998842 702.9931859998032 705.3807530002668 706.7312179999426 711.8602489996701 719.737027999945 731.3839699998498 755.6149059999734 756.511877999641
App start time appCreationEnd_To_contentAppeared Baseline
Mean: 698.750 ms
Stdev: 55.521 ms (7.9%)
Runs: 578 587 598 601 611 617 620 622 623 624 625 628 637 644 646 654 663 663 669 676 680 693 696 698 703 706 710 712 713 714 719 720 720 721 722 725 727 728 728 729 732 733 735 736 737 740 740 743 748 750 752 753 753 761 762 769 774 785 786 786

Current
Mean: 698.533 ms
Stdev: 60.600 ms (8.7%)
Runs: 571 577 582 586 597 602 606 614 614 614 620 628 629 646 647 653 664 671 671 673 690 697 697 697 701 702 703 710 712 713 722 722 724 724 730 731 731 732 734 735 738 742 744 744 744 744 745 746 750 751 753 753 754 756 759 762 767 777 778 833
App start time regularAppStart Baseline
Mean: 0.024 ms
Stdev: 0.002 ms (10.2%)
Runs: 0.018636000342667103 0.0188809996470809 0.019082999788224697 0.019733999855816364 0.019896999932825565 0.019938000477850437 0.020222999155521393 0.021076999604701996 0.0211990000680089 0.021280999295413494 0.0217289999127388 0.02185099944472313 0.021851000376045704 0.021972999908030033 0.02233900036662817 0.022420000284910202 0.022867999970912933 0.022908000275492668 0.02290899958461523 0.023152999579906464 0.02339700050652027 0.02343699987977743 0.023641000501811504 0.0236820001155138 0.02376299910247326 0.023763000033795834 0.023926000110805035 0.024047999642789364 0.024413999170064926 0.0244140001013875 0.024616999551653862 0.024617999792099 0.024658000096678734 0.024739000014960766 0.0247809998691082 0.024903000332415104 0.024942999705672264 0.025064999237656593 0.02522800024598837 0.025675000622868538 0.025756999850273132 0.02587899938225746 0.025879000313580036 0.025959999300539494 0.025960000231862068 0.026081999763846397 0.026245000772178173 0.026285999454557896 0.02632599975913763 0.026570000685751438 0.02669299952685833 0.026732999831438065 0.0267749996855855 0.026895999908447266 0.026936999522149563 0.026937000453472137 0.027180999517440796 0.027180999517440796 0.027546999976038933 0.029215999878942966

Current
Mean: 0.024 ms
Stdev: 0.003 ms (11.6%)
Runs: 0.018920999951660633 0.019084000028669834 0.019084000028669834 0.019694000482559204 0.019856000319123268 0.020263999700546265 0.020426000468432903 0.020914999768137932 0.021321000531315804 0.021729000844061375 0.021851000376045704 0.021890999749302864 0.022095000371336937 0.022379000671207905 0.022379999980330467 0.022704999893903732 0.022907999344170094 0.022948999889194965 0.022948999889194965 0.02323400042951107 0.023315999656915665 0.02331600058823824 0.0233559999614954 0.02355899941176176 0.02380300033837557 0.023804000578820705 0.023926000110805035 0.023926000110805035 0.024170000106096268 0.0244140001013875 0.024658000096678734 0.02469899971038103 0.024780000559985638 0.024862000718712807 0.025065000168979168 0.025268999859690666 0.025431999936699867 0.025918999686837196 0.0262040002271533 0.0262449998408556 0.026326999999582767 0.026651999913156033 0.02669299952685833 0.026733999140560627 0.026774000376462936 0.026895999908447266 0.027018999680876732 0.027099999599158764 0.027506000362336636 0.027546999976038933 0.027708999812602997 0.027790999971330166 0.027831999585032463 0.028442000038921833 0.02889000065624714 0.0289300000295043 0.0292560001835227 0.029296999797225 0.029337000101804733
App start time (CPU) Baseline
Mean: 134.571 %
Stdev: 5.289 % (3.9%)
Runs: 120.49946739259087 123.9504267636989 124.47577600961293 126.19904832587702 126.29211015666705 126.61396574440055 127.686880934759 127.77072940846794 127.84471218206161 128.28722002635047 129.63894477978982 130.25862870457274 130.36744125780976 130.4486291347272 130.5044147701343 131.0028467314815 131.15349908330217 131.66023684636016 132.56818313045576 133.44070924591028 133.484272367673 133.62864992347983 133.71698724890143 134.29107346430183 134.3093686172312 134.33244948530236 134.34284957094113 134.45688146883376 134.82584469456881 135.2006298122064 135.36038018400802 135.39775317550144 135.80890505553492 136.17483469002892 136.2021591227519 136.31087659664166 136.55014791487739 137.36406208423423 137.61008558975223 137.63698883178375 137.68049750274687 137.71509863474398 137.75534374080092 138.2372018640908 138.26302449964118 138.4859546523827 138.9760080358627 139.1277767542919 139.33485164883754 139.49432371338386 139.66769500058032 139.67747651958175 139.72957247063465 141.3618649901428 141.67094738076398 142.4602983743739 142.5204619045939 143.24134285801557 146.61168865946027

Current
Mean: 134.975 %
Stdev: 4.400 % (3.3%)
Runs: 124.1456557181048 125.19598590582089 127.73624140832106 128.8442677269715 128.9346273008769 129.5048146432062 129.66490467800057 129.78799799888338 130.60714074715924 130.7805379132043 131.61057456296734 131.64172222479928 131.69636963696368 131.873481768281 132.15890531207057 132.2695158110518 132.71446861169824 132.9046429505798 132.9311815628711 133.00075301204822 133.20730399458643 133.32077097359507 133.44515972945408 133.9132777657367 134.19885792192719 134.2889997728645 134.42605360328477 135.16214439460933 135.4935359954915 135.5663310970829 135.71158347315992 135.8079382656069 135.82600504165413 136.05970156805986 136.2074712712371 136.31499682358614 136.39815739946772 136.48367580230496 136.68477363304353 137.2832939707879 137.40877929722544 137.5562288437731 137.72740284745737 138.1005320416104 138.19903353982602 138.30667404345007 138.40143255531714 138.4374047002925 138.43818275285952 139.37754614411804 139.95475002758621 140.45508982035923 140.50080861104473 142.82505786692977 144.3930127401588 144.69503745506404 144.966437615321
App start time (FPS) Baseline
Mean: 59.515 FPS
Stdev: 0.662 FPS (1.1%)
Runs: 57.79162433712639 57.97961083562415 58.08565709286514 58.10359302666041 58.13841466281877 58.310419691845944 58.41218201524248 58.426822068057554 58.431609491341284 59.04157198673241 59.10380974726035 59.19234282678857 59.214406286175745 59.22758257412709 59.27639723254065 59.2812428989464 59.460916028732235 59.494264957338125 59.50513866886854 59.54340197291621 59.5697329355858 59.62833554133662 59.63332675968325 59.652930942124726 59.69814484192125 59.78989351946876 59.921801872050516 59.937279023138665 59.97058983285775 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.605 FPS
Stdev: 0.529 FPS (0.9%)
Runs: 58.09023974991508 58.159507350012255 58.388189786780686 58.5661683411681 58.737839470020766 58.88444977912082 58.963643806030035 58.98675454940537 59.07165462889352 59.07450333414854 59.090250857782564 59.15638798157092 59.19131844899118 59.21417388823537 59.22557569087394 59.34770426055775 59.393418995892176 59.414098400598675 59.432985854333936 59.44642791925944 59.56409006148619 59.7229085717482 59.745715194362994 59.75145948376075 59.78928577818268 59.94167364979041 59.963898932396056 59.98222273822021 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
App start time (RAM) Baseline
Mean: 362.655 MB
Stdev: 3.702 MB (1.0%)
Runs: 353.53125 353.60546875 354.962890625 355.294921875 357.1158854166667 357.8763020833333 358.2161458333333 358.3697916666667 358.791015625 358.9778645833333 359.01953125 359.3098958333333 359.9114583333333 359.9622395833333 360.021484375 360.3580729166667 360.734375 360.7760416666667 360.7890625 361.2135416666667 361.2578125 361.3802083333333 361.61328125 361.984375 362.0078125 362.1770833333333 362.2291666666667 362.48828125 362.5651041666667 363.3294270833333 363.421875 363.828125 363.9778645833333 364.0703125 364.1888020833333 364.2825520833333 364.3151041666667 364.4622395833333 364.4778645833333 364.6575520833333 364.8372395833333 364.8411458333333 364.8880208333333 364.9361979166667 364.9869791666667 365.3723958333333 365.3893229166667 365.4088541666667 365.4752604166667 365.640625 365.6888020833333 365.9166666666667 366.7473958333333 366.80078125 366.8385416666667 367.9296875 368.2864583333333 368.3502604166667 368.5833333333333 370.8059895833333

Current
Mean: 362.284 MB
Stdev: 5.005 MB (1.4%)
Runs: 352.068359375 354.00390625 354.634765625 354.7421875 354.9140625 354.9153645833333 355.0221354166667 355.2669270833333 355.3984375 355.6770833333333 357.1119791666667 357.765625 358.47265625 358.87890625 359.2395833333333 359.375 359.904296875 360.0169270833333 360.0690104166667 360.09375 360.4596354166667 360.89453125 361.1171875 361.203125 361.5963541666667 362.0104166666667 362.2447916666667 362.71484375 362.7591145833333 362.7981770833333 362.890625 363.0026041666667 363.0442708333333 363.3841145833333 363.5455729166667 363.5859375 363.7109375 363.8098958333333 364.046875 364.0520833333333 364.078125 364.1080729166667 364.7252604166667 365.0130208333333 365.2135416666667 365.4453125 365.9244791666667 366.2760416666667 366.6979166666667 367.2213541666667 368.69140625 369.2747395833333 369.6822916666667 370.6666666666667 371.41796875 371.9557291666667 372.14453125 373.48046875
App start time (CPU/JS) Baseline
Mean: 71.685 %
Stdev: 4.519 % (6.3%)
Runs: 61.9 63.4 64.5 64.5 64.6 64.6 64.9 65.1 65.1 65.2 65.7 65.8 66.4 67.2 67.7 68.6 68.6 69.5 69.9 70.5 70.6 70.6 71.2 71.2 71.3 71.9 71.9 72 72.2 72.4 72.5 72.8 72.8 72.8 73.2 73.5 73.5 74.1 74.6 74.6 74.6 74.7 75.2 75.2 75.3 75.3 75.6 75.8 75.8 75.8 76 76.5 76.7 77 77 77.1 77.3 77.9 78.6 80.3

Current
Mean: 73.524 %
Stdev: 3.597 % (4.9%)
Runs: 65.4 66.1 66.5 67.1 68 68.9 69.1 69.6 71.2 71.2 71.3 71.4 71.5 71.5 71.7 71.9 71.9 72 72 72.2 72.6 72.6 72.8 72.9 73 73.1 73.1 73.2 73.2 73.2 73.9 73.9 74.1 74.4 74.5 74.5 74.6 74.6 74.7 75.2 75.2 75.4 75.8 76 76.1 76.8 77.3 77.6 78.3 78.7 79.3 79.8 79.9 81.2 81.8
App start time (CPU/UI) Baseline
Mean: 29.543 %
Stdev: 1.715 % (5.8%)
Runs: 26.2 26.3 26.4 26.4 26.6 26.6 27.2 27.6 27.8 27.8 28.3 28.4 28.4 28.5 28.5 28.5 28.7 28.7 28.9 29.1 29.2 29.3 29.7 29.7 29.8 29.8 29.9 29.9 29.9 29.9 29.9 29.9 29.9 29.9 30.2 30.5 30.6 30.6 30.6 30.6 30.7 30.9 31 31.2 31.2 31.2 31.3 31.4 31.8 31.9 32 32.6 33.9

Current
Mean: 29.123 %
Stdev: 2.560 % (8.8%)
Runs: 22.7 23 23.2 24.1 24.2 24.8 26.1 26.1 26.3 26.4 27.2 27.4 27.5 27.8 28.1 28.2 28.6 28.7 28.8 28.8 29.1 29.1 29.2 29.2 29.2 29.3 29.3 29.3 29.6 29.7 29.7 29.9 29.9 30 30.1 30.1 30.4 30.5 30.5 30.6 30.6 30.6 30.7 30.8 31.2 31.2 31.3 31.8 31.8 31.9 32 32.1 32.5 32.5 33.3 33.9
Open search router TTI Load Search Options Baseline
Mean: 117.852 ms
Stdev: 6.491 ms (5.5%)
Runs: 104.26314300019294 104.74202500004321 105.2284750007093 107.66385900042951 109.48832200001925 109.73384600039572 110.2672530002892 110.55139200016856 110.68216999992728 111.8910320000723 112.79150399938226 113.88944500032812 113.99979700054973 114.29109700024128 114.44437600020319 114.66760300006717 114.74707000050694 114.81424999982119 115.02921600081027 115.03401700034738 115.47465000022203 115.64937400072813 115.83487899973989 116.12316900026053 116.19466200005263 116.29077199939638 116.86519400030375 117.12748199980706 117.74662300013006 117.81498199980706 118.19661499932408 118.22094800043851 118.91544600017369 119.31217500008643 119.48054999951273 119.53658000007272 119.79178899992257 120.2171219997108 120.82552099972963 120.82922400068492 121.04247999936342 121.16027900017798 121.37886600010097 121.55769900046289 121.74092700053006 122.66768399998546 122.94278999976814 122.97538300044835 123.02880800049752 123.63045300077647 124.98527100030333 125.12951700016856 126.32169599924237 130.09094300027937 130.5302729997784 134.85396299976856 134.87495899945498

Current
Mean: 119.456 ms
Stdev: 8.095 ms (6.8%)
Runs: 103.72143500018865 104.39742000028491 106.23917599953711 106.24121100082994 108.86478700023144 109.56571500003338 111.61258900072426 111.65433800034225 111.72603400051594 112.07373000029474 112.50455799978226 112.64908900018781 113.26074200030416 113.84753399994224 113.9156090002507 114.02929699979722 114.06119799986482 114.4524330003187 114.61987300030887 114.82385300006717 115.29467799980193 115.76200399920344 115.76818899996579 116.19083699956536 117.02807600051165 117.11421700008214 117.7434490006417 117.75610399991274 117.80879699997604 117.9141030004248 117.93786599952728 118.0452469997108 118.10921199992299 119.12601699959487 119.40266900043935 120.00004100054502 120.37540699914098 120.61743199918419 121.27815700042993 121.95951300021261 123.09480800013989 123.10380000062287 123.14583399984986 123.51098599936813 123.81831900030375 123.82116699963808 124.30761700030416 124.94470199942589 125.27591899968684 130.0627439999953 130.49588999990374 130.7843430005014 131.8140059998259 132.43400100059807 133.76806599926203 133.77185100037605 133.90531400032341 134.140014000237 134.39554800000042 137.29634699970484
Open search router TTI Open Search Router TTI Baseline
Mean: 573.488 ms
Stdev: 56.193 ms (9.8%)
Runs: 455.1171470005065 467.6729330001399 473.14591499976814 478.51102699991316 486.48124200012535 487.1848150007427 490.66174399945885 495.7453209999949 501.468628000468 505.10050499998033 507.6105550006032 507.84065799973905 512.6429440006614 515.6949460003525 524.4810790000483 524.5473629999906 552.3017179993913 554.8038330003619 555.5062660006806 556.0434979991987 558.1689870003611 559.6884359996766 562.1584879998118 570.2794599998742 570.5938320001587 571.1997479991987 577.4790039993823 578.8913979995996 579.8023680001497 580.37731899973 580.8352860007435 583.3377279993147 587.4775799997151 587.6669509997591 587.7458910001442 589.2250570002943 590.6708579994738 591.8445640001446 598.521931999363 598.7666429998353 609.8606780003756 611.4270019996911 613.4493410000578 613.4807129995897 613.9768470004201 618.2273359997198 618.3001709999517 620.6388340005651 621.2513429997489 623.3998620007187 628.3184409998357 629.590983000584 630.3067220002413 630.9249269999564 638.8206380000338 640.3967700004578 641.5710859997198 661.615316000767 673.8024899996817 712.6311450004578

Current
Mean: 571.928 ms
Stdev: 61.814 ms (10.8%)
Runs: 463.9829509994015 464.0674639996141 467.32556200027466 469.5905759995803 477.07714900001884 479.7051189998165 483.00655200053006 483.62630199920386 487.7870689993724 491.0949710002169 499.41975900065154 502.56766799930483 507.62080899998546 513.9960529999807 518.2894289996475 522.1651609996334 524.5826420001686 536.3972580004483 543.650880000554 553.8726399997249 555.3997400002554 559.9964610002935 560.740438000299 560.8343910006806 566.056478000246 569.1394859999418 569.1566169997677 577.568563000299 578.06896999944 581.6961669996381 584.2333179991692 585.6635339995846 586.5048019997776 586.6735439999029 591.0680339997634 594.4952389998361 598.3394780000672 599.4157309997827 603.1886809999123 604.722574999556 611.7247720006853 615.2913830000907 617.7452800003812 619.9001870006323 622.8068040004 622.8239749995992 623.2331550000235 625.5614010002464 626.1090090004727 630.131347999908 635.5131839998066 636.2343340003863 636.6830649999902 641.4300540005788 653.8173420000821 654.1051839999855 664.3684090003371 666.0320640001446 737.4665529998019
Open search router TTI (CPU) Baseline
Mean: 135.500 %
Stdev: 3.236 % (2.4%)
Runs: 129.3701542097158 129.40776008979026 129.54087195576543 129.7304348247243 129.84218859738257 130.33961658230402 130.350376311339 130.6609690568834 131.60029923920274 132.17876286613156 132.37565607405287 132.95009919478912 133.1941380585084 133.7672348701323 133.77644710578846 133.83816293637213 133.89716653771688 133.92688417846415 134.10168352403028 134.11698675988671 134.23959250345536 134.47833580377576 134.72514611728417 134.7425829615313 134.8249203251251 135.1861496806765 135.21868402931236 135.26947100263936 135.45125753572276 135.6084532354792 135.8971053414095 136.40345825684642 136.4987440625706 136.49898679913386 136.53225421497748 136.53382815165796 136.59135979232505 136.76429858190002 137.25396825396825 137.30159410987443 137.5790403994713 137.59757789054063 137.66974038424843 137.70367343588885 137.74634955599217 137.84346514179026 138.06984253781937 138.39609610175083 138.47268120167777 139.01611497338064 139.71896114523645 139.9429618030364 140.0497166746395 140.09237336799643 140.14158419318122 140.39387221013482 140.7056160720009 142.8722272542802

Current
Mean: 135.084 %
Stdev: 2.942 % (2.2%)
Runs: 127.68229923312893 128.9192081880081 129.54292560045846 130.9823543175751 131.44510045615854 131.52103245141768 131.72663817657028 132.28212693413568 132.29036228311907 132.57228366175607 132.7366324830117 132.80020199762077 132.89551032816533 132.90259252128862 132.9712204440539 133.0438054106739 133.20610414176323 133.61234427369888 133.64766726437978 133.81555405866027 133.823829712714 133.83083083857144 133.90227181851287 133.91666436978025 134.094343203655 134.2586307082256 134.31237524950103 134.32553220252726 134.4017931571859 134.78183589414522 135.0212119398672 135.2014315917008 135.22954091816376 135.26255698648302 135.51534274383292 136.00434407867974 136.02236592119831 136.09926060079826 136.20724431499033 136.29733865215533 136.78617452751638 136.89137902939345 137.04112773557853 137.20085104497483 137.20764201296365 137.21600719736216 137.26753994250143 137.7385792151519 138.12726696400023 138.1468847905269 138.237492752265 138.5391278498508 139.097951246351 139.25762556243896 139.327033329745 139.65694144243156 139.74341787068758 141.35138574156875 142.04336853132702
Open search router TTI (FPS) Baseline
Mean: 59.500 FPS
Stdev: 0.520 FPS (0.9%)
Runs: 58.171686397241636 58.20243629505668 58.23362043363707 58.499522835523706 58.515479579826426 58.8281884635716 58.947279168733914 59.01861820203691 59.04196626580846 59.07799274797469 59.11497956941085 59.12953326778531 59.15189325201722 59.158155490643935 59.18349753912208 59.20143280851943 59.2190427948143 59.22642249418589 59.31822319340022 59.32650838106936 59.34605575081449 59.37482645564731 59.470465824251235 59.47627112493317 59.54386543446485 59.58309165361651 59.66867865352659 59.66944296421987 59.68383655795113 59.72962830055565 59.73471997645963 59.77411030545961 59.78874082152918 59.81014689135738 59.84676877064558 59.94837424833634 59.96049250886566 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.930 FPS
Stdev: 0.142 FPS (0.2%)
Runs: 59.38324717441948 59.39500231433249 59.588293027092426 59.73567370038133 59.75302089065162 59.79797569609676 59.82729876908303 59.836482805275615 59.865133825083554 59.88808338082161 59.8921184355208 59.90801825992849 59.92963161173978 59.934279884616615 59.95367795394556 59.96495201282842 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Open search router TTI (RAM) Baseline
Mean: 370.085 MB
Stdev: 3.163 MB (0.9%)
Runs: 363.63671875 363.724609375 364.712890625 365.3056640625 365.5419921875 366.2021484375 366.501953125 366.619140625 366.8759765625 366.892578125 367.0546875 367.1044921875 367.1396484375 367.54296875 367.61328125 367.89453125 368.1923828125 368.3173828125 368.3251953125 368.4375 368.4892578125 368.5810546875 368.673828125 368.677734375 369.037109375 369.126953125 369.375 369.6806640625 370.1884765625 370.30078125 370.5078125 370.5458984375 370.8486328125 371.185546875 371.2255859375 371.24609375 371.271484375 371.353515625 371.392578125 371.3984375 371.4736328125 371.798828125 371.892578125 372.0361328125 372.0537109375 372.091796875 372.7275390625 372.8578125 373.2763671875 373.2890625 373.333984375 373.349609375 373.70703125 373.8115234375 374.53515625 374.88203125 375.3212890625 377.68046875 378.1484375

Current
Mean: 369.486 MB
Stdev: 2.714 MB (0.7%)
Runs: 362.505859375 364.69140625 365.208984375 365.625 365.6806640625 365.9228515625 366.0634765625 366.404296875 366.8583984375 367.20703125 367.2216796875 367.439453125 367.533203125 367.587890625 367.646484375 367.6708984375 367.7587890625 367.7822265625 368.4755859375 368.5625 368.576171875 369.029296875 369.0302734375 369.0498046875 369.0849609375 369.1767578125 369.283203125 369.3173828125 369.33203125 369.3466796875 369.36328125 369.365234375 369.400390625 369.458984375 369.5048828125 369.798828125 369.8271484375 369.9453125 369.998046875 370.0947265625 370.17578125 370.18359375 370.38671875 370.6875 370.88046875 371.2900390625 371.40625 371.7060546875 372.03515625 372.3837890625 372.5986328125 372.662109375 372.775390625 373.6728515625 374.2421875 374.244140625 374.4873046875 375.79921875 376.19765625
Open search router TTI (CPU/JS) Baseline
Mean: 68.363 %
Stdev: 2.183 % (3.2%)
Runs: 62.7 64.4 64.9 64.9 64.9 65.3 65.9 66 66.1 66.2 66.4 66.4 66.7 66.8 66.8 67 67 67.1 67.2 67.2 67.5 67.7 67.8 67.8 67.8 67.8 67.9 67.9 68 68 68.2 68.2 68.3 68.6 68.6 68.8 69 69.1 69.2 69.3 69.3 69.5 69.6 69.7 69.7 70.1 70.3 70.3 70.4 70.6 70.7 71 71.1 71.4 71.5 71.7 71.9 72.3 72.4 72.9

Current
Mean: 69.089 %
Stdev: 1.839 % (2.7%)
Runs: 65.2 65.3 65.4 66.4 66.5 66.7 66.9 66.9 67.4 67.4 67.5 67.5 67.7 67.8 67.9 67.9 68 68.2 68.4 68.4 68.4 68.5 68.7 68.8 68.8 68.8 69 69 69.1 69.2 69.3 69.3 69.4 69.4 69.4 69.5 69.6 69.7 69.8 70 70 70.2 70.4 70.5 70.5 70.6 70.6 70.8 70.8 71.2 71.3 71.4 71.4 71.5 72.9 73.4 73.5
Open search router TTI (CPU/UI) Baseline
Mean: 27.688 %
Stdev: 1.855 % (6.7%)
Runs: 23.3 23.6 24.9 24.9 25 25.4 25.6 25.6 25.9 25.9 25.9 26 26 26 26.4 26.6 26.7 26.7 26.9 26.9 26.9 27 27 27.1 27.1 27.2 27.4 27.4 27.4 27.4 27.8 27.9 27.9 27.9 27.9 28.1 28.2 28.3 28.3 28.3 28.4 28.5 28.5 28.6 28.8 28.8 29 29.1 29.4 29.4 29.5 29.6 30.4 30.4 30.6 30.8 30.9 30.9 30.9 32.1

Current
Mean: 27.334 %
Stdev: 1.572 % (5.8%)
Runs: 24.4 24.7 24.8 24.9 24.9 24.9 25.4 25.4 25.7 25.9 25.9 26 26 26.3 26.3 26.3 26.4 26.4 26.5 26.5 26.6 26.7 26.9 26.9 26.9 26.9 27 27 27.2 27.2 27.3 27.3 27.4 27.4 27.6 27.9 27.9 27.9 28 28.1 28.1 28.2 28.2 28.2 28.3 28.3 28.4 28.4 28.6 28.6 28.9 29.1 29.3 29.6 29.8 30.4 30.5 30.9 31.2
Report typing Composer typing rerender count Baseline
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Report typing Message sent Baseline
Mean: 435.264 ms
Stdev: 31.487 ms (7.2%)
Runs: 379.5180669995025 383.10254000034183 386.14558999985456 388.23795599956065 388.3013110002503 390.8693450000137 394.17061400040984 394.2558590006083 394.37203000020236 398.297038000077 398.9635830000043 398.9982499992475 403.8174639996141 407.5362950004637 410.3209640001878 411.0645759999752 412.3691010000184 414.0317789996043 416.5019530002028 416.6367600001395 416.7647299999371 419.44828299991786 419.67679900024086 419.88635199982673 421.5798749998212 422.5930180000141 423.0724289994687 428.7117919996381 430.4385580001399 433.41670699976385 437.7274169996381 441.077798999846 442.2899580001831 442.29362000059336 445.31542999949306 449.08764600008726 449.62788899987936 453.68994099926203 454.56172800064087 458.2571610007435 458.5858970005065 460.22399900108576 461.1300870012492 463.1131600001827 463.6186120007187 464.2797849997878 464.37605799920857 465.1350100003183 466.0144859999418 466.5504159992561 468.2815749999136 470.3284509982914 473.35961899906397 473.5619709994644 476.85599800013006 477.5619299998507 477.7521569998935 477.985229998827 484.9373379992321 505.14652500115335

Current
Mean: 435.918 ms
Stdev: 27.329 ms (6.3%)
Runs: 380.8771980004385 390.6485590003431 390.7419029995799 390.76261399965733 390.99678600020707 392.7413739999756 400.0855710003525 401.9645189996809 406.0020750006661 407.59875500015914 408.0467929998413 408.28027400001884 408.8207200001925 409.30932600051165 416.46525099966675 417.1322839995846 418.06111699994653 418.36360699962825 418.5712080001831 418.7116700001061 420.0698239998892 422.1418460002169 422.48173000011593 424.1260989997536 424.8907070001587 427.5148109998554 428.78719099983573 428.9066970003769 433.97261600010097 434.5262860003859 435.3867190005258 435.7124029994011 439.63964900001884 441.26090499944985 443.81115799956024 444.88618999999017 445.7797039998695 447.9071049997583 455.2639969997108 456.8299970002845 458.30741300061345 459.73046899959445 460.49617499951273 461.9582109991461 462.72143599949777 463.3931079991162 463.55912300013006 464.5404059998691 464.9209390003234 464.981526998803 467.1789549998939 468.3038739990443 469.21512899920344 470.17529300041497 470.6071779988706 473.8049320001155 474.0397540014237 475.640177000314 475.77986699994653 477.6640630001202
Report typing (CPU) Baseline
Mean: 100.005 %
Stdev: 4.272 % (4.3%)
Runs: 90.90466466364495 90.91680303466273 90.98169794425515 92.4466694238572 93.54566853111108 94.27086405913316 94.30260722453421 95.15535687158868 95.6339445481616 95.94059697129232 95.9511693087479 96.24624828816536 96.6546347100383 96.74310169377533 96.88886342457863 97.15327718332253 97.39920943159774 97.59831950680604 97.73856224489008 97.79744552114968 98.1829231066698 98.28756309552382 98.9008274960202 98.98969752528825 98.99592388267625 99.12397015679865 99.5869797818517 99.5974483158644 99.64455149777797 100.04818618511507 100.35252241462261 100.38982790549565 100.51984193937484 100.69420196647246 100.72258552847687 101.06688782777834 101.10030016144991 101.20920859189559 101.42203566915224 101.4739291365471 101.6031247630535 102.4905511333543 102.69052272844799 102.98420410193384 103.25237414931273 103.27788949091686 103.68003251352361 103.98994876883584 104.84869550196187 104.88464190249049 105.06290323702467 105.54342291969871 105.68725319417663 105.86571663762689 106.2299802239981 106.367304448183 106.39228671869309 106.41360185774465 107.05023744318767 107.42631052764742

Current
Mean: 100.063 %
Stdev: 4.318 % (4.3%)
Runs: 90.46361242597169 91.89517564700918 93.54762761099987 93.78151407450443 93.94677392176165 95.00752979464612 95.12258887663872 95.59048127833435 95.63519936530594 95.65970882360422 96.40049144109243 96.54446074729162 96.62532258132734 96.72899301710575 97.01145141803552 97.02744673240771 97.45270609442429 97.73723708324765 97.76708024816881 97.79748590447645 98.05333527670382 98.09343127184577 98.14608103641123 98.25273413541348 98.55583822037704 98.93255840124493 98.97259546198494 99.0663359762881 99.12602092219751 99.29841161392373 99.30238491784884 99.41825824844976 99.70651288876505 99.73126934569247 99.7624296751052 99.85545275109385 100.73963395335616 101.02742774817085 101.25743468815868 101.68896909874611 101.76079182949174 102.0516663589547 102.47826309377905 102.98625784563453 103.67438299304679 103.80155231369298 103.87742504723576 103.96643658774914 104.43654356792136 104.95647348030111 105.15341463640611 105.57631365246867 105.96801273388253 105.99911122983093 106.03038962676814 106.71645030573376 107.32576619501994 107.85216083646905 107.85217016958588 110.6101033324062
Report typing (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Report typing (RAM) Baseline
Mean: 505.457 MB
Stdev: 4.884 MB (1.0%)
Runs: 491.1501736111111 495.89083059210526 499.03797743055554 499.31684027777777 499.33778782894734 499.3849826388889 499.4609375 499.50513980263156 499.59580592105266 500.400390625 500.4957217261905 500.76439144736844 500.91710069444446 501.1388888888889 501.38671875 501.5425575657895 502.34874131944446 502.4733072916667 503.3376736111111 503.61739309210526 503.69449013157896 503.78207236842104 503.9866365131579 504.02495659722223 504.0673363095238 504.3246299342105 504.3558407738095 504.8180509868421 505.19227430555554 505.54995888157896 505.74013157894734 506.40234375 506.66124131944446 506.876953125 507.10004340277777 507.6879111842105 507.9936266447368 508.1454613095238 508.29769736842104 508.6402138157895 509.2096354166667 509.35069444444446 509.41714638157896 509.4222861842105 509.5322779605263 509.53993055555554 509.6576891447368 509.9697779605263 510.35714285714283 510.50123355263156 511.57298519736844 511.7543174342105 512.1402138157895 512.4340049342105 512.8433388157895 512.9296875 513.1700246710526 514.2671440972222

Current
Mean: 506.531 MB
Stdev: 5.984 MB (1.2%)
Runs: 497.29340277777777 497.32504111842104 497.6901041666667 498.6911892361111 499.3305921052632 499.4990699404762 499.5119357638889 499.8962673611111 500.2411595394737 500.60438368055554 500.86827256944446 501.001953125 501.20386904761904 501.3190104166667 501.3517795138889 501.4036458333333 501.4566200657895 501.61241319444446 501.81661184210526 501.88671875 502.4224917763158 502.88194444444446 503.6373697916667 503.81336805555554 503.98807565789474 504.0834703947368 504.5358072916667 506.0970394736842 506.21175986842104 506.3033854166667 507.11700148809524 507.2248263888889 507.3725818452381 507.54420230263156 507.88980263157896 507.9555921052632 508.4235197368421 508.80345394736844 508.9944490131579 509.09678819444446 509.1640625 509.5631167763158 509.5834703947368 509.796875 509.99629934210526 510.1942845394737 510.32791940789474 510.4438733552632 510.75904605263156 511.14638157894734 511.7748766447368 512.530427631579 512.7037760416666 513.2485608552631 513.2849506578947 517.7556423611111 518.2471788194445 519.8564967105264 521.153166118421 521.9095052083334
Report typing (CPU/JS) Baseline
Mean: 46.960 %
Stdev: 3.429 % (7.3%)
Runs: 39.4 40.9 40.9 41.5 41.8 42 42.5 42.5 42.6 43.2 43.8 44 44 44.3 44.6 44.7 45 45.1 45.1 45.2 45.2 45.2 45.3 45.4 45.8 46 46.5 46.5 46.7 46.7 46.9 47.3 47.4 47.4 47.6 47.6 47.6 47.7 48.1 48.5 49.2 49.3 49.9 50 50 50.2 50.3 50.3 50.4 50.4 51.2 51.3 51.6 51.8 51.9 51.9 52 52.2 52.2 53

Current
Mean: 47.002 %
Stdev: 3.447 % (7.3%)
Runs: 39.7 39.7 42 42 42.2 42.6 42.7 43.1 43.3 43.3 43.3 43.6 43.7 43.7 44.2 44.2 44.4 44.8 44.9 45.2 45.4 45.4 45.6 45.8 46 46.2 46.3 46.5 46.7 46.9 46.9 47.1 47.1 47.1 47.6 47.7 47.8 48.2 48.5 48.6 48.6 48.8 50 50 50.1 50.2 50.5 50.8 50.9 50.9 50.9 50.9 51.5 51.7 51.7 51.8 51.9 52.2 52.4 54.3
Report typing (CPU/UI) Baseline
Mean: 24.936 %
Stdev: 1.128 % (4.5%)
Runs: 22.7 22.7 22.8 22.9 23.1 23.2 23.4 23.4 23.6 23.6 23.6 23.7 23.8 24 24.3 24.3 24.3 24.4 24.5 24.5 24.6 24.6 24.6 24.6 24.7 24.7 24.8 24.9 24.9 24.9 25 25.1 25.1 25.2 25.3 25.3 25.5 25.6 25.6 25.8 25.8 25.9 25.9 25.9 26 26 26 26 26.1 26.2 26.2 26.2 26.3 26.3 26.3 26.4 26.5 26.7 26.9

Current
Mean: 24.972 %
Stdev: 1.028 % (4.1%)
Runs: 22.9 23.1 23.2 23.4 23.5 23.5 23.5 23.6 23.6 23.7 23.8 23.9 24.1 24.2 24.2 24.2 24.2 24.3 24.4 24.5 24.5 24.5 24.6 24.6 24.6 24.7 24.8 24.9 25 25 25 25 25.1 25.2 25.2 25.3 25.3 25.3 25.4 25.5 25.7 25.7 25.7 25.8 25.9 26 26 26.1 26.1 26.1 26.2 26.2 26.2 26.3 26.3 26.4 26.4 26.5 26.5 26.9
Chat opening Chat TTI Baseline
Mean: 544.889 ms
Stdev: 26.660 ms (4.9%)
Runs: 482.6176759991795 482.83976200036705 489.34598799981177 494.2331540007144 501.6335859987885 502.1974700000137 510.3929859995842 511.81852200068533 512.2349440008402 515.5419509988278 523.6244299989194 530.278849998489 531.1743570007384 533.2989910002798 535.562378000468 536.1205249987543 536.6239829994738 536.6447760015726 537.985027000308 539.2556970007718 539.5288900006562 540.613078000024 540.6721190009266 540.9272469989955 542.0524899996817 542.6215419992805 544.1892499998212 544.2999269999564 548.3699549995363 549.0138349998742 549.2214360013604 550.9729820005596 555.9114990010858 557.1483149994165 557.7283529993147 558.4779059998691 558.5187180005014 561.0369060002267 561.1575109995902 562.6079910006374 563.1799320001155 564.8055830001831 566.219278998673 566.7384449988604 567.2997239995748 568.5375979989767 569.7890629991889 571.1337080001831 576.8763429988176 577.3492850009352 577.3984789997339 582.7198890000582 585.0131429992616 587.7167570013553 595.6051429994404

Current
Mean: 526.537 ms
Stdev: 36.813 ms (7.0%)
Runs: 434.23946100100875 434.92769400030375 447.84680199995637 469.45381600037217 471.52722200006247 477.7240800000727 484.1152340006083 489.0796710010618 489.16202800162137 490.91548600047827 491.8773189987987 492.51660099998116 496.4736729990691 501.24580899998546 505.97045899927616 507.7340500000864 510.48026599921286 511.19384800083935 511.50675499998033 511.98872900009155 512.4712729994208 513.003337001428 514.3532720003277 514.5882160011679 516.4390060007572 519.331258000806 521.2546800002456 523.5033369995654 525.5745449997485 525.9807539992034 529.6101890001446 530.3286950010806 532.2945959996432 535.2357580009848 539.1994630005211 542.79695700109 543.0919189993292 545.1337889991701 546.9136549998075 546.9545499999076 550.4268800001591 550.5837809983641 550.782186999917 551.6116140000522 555.4134520012885 557.2106129992753 557.559366999194 560.4964199997485 562.4519040007144 562.7788090016693 564.6180830001831 567.1664230003953 570.722574999556 570.800578000024 573.4360360000283 573.7045489996672 579.4764409996569 589.7197259999812 608.6601560004056
Chat opening (CPU) Baseline
Mean: 141.586 %
Stdev: 4.104 % (2.9%)
Runs: 131.18039718848306 132.60928149265615 132.71125265006756 133.57781736532505 136.33341515091522 136.7200025608164 137.13000120212612 137.54311240352814 137.71631229659815 137.73940158639178 137.76832358030597 137.86079506381398 138.65363108283807 138.73162789652258 139.3451457057721 139.5829728857525 139.58593680132302 139.60515558676892 139.86021041493234 140.00117104048317 140.23701595169936 140.2477282827161 140.33319465683428 140.47873245756548 140.83275574517464 140.9290841921822 141.31407183619547 141.3717693836978 141.50224324249245 141.7546350306637 141.91569290106384 141.9824023827346 142.04444375382366 142.35609900065685 142.85326615511812 142.8786305197734 142.90481030709057 142.92438826560047 143.14133276681704 143.19798688569824 143.93958336974168 144.25032451620865 144.2985889712526 144.330265933108 144.8125740550772 145.1978025270788 145.36829247397662 145.7516838832296 146.33337112051086 146.45651406953465 146.7582389673132 146.8915715354858 146.9676862702815 147.0019257732203 147.0063898422511 148.5637110915631 148.7831246479328 149.81898999538845

Current
Mean: 140.339 %
Stdev: 5.362 % (3.8%)
Runs: 128.2983244494918 129.3852897646311 130.18046158561023 131.51714286835366 132.26524800692263 132.99318530380384 133.16064964792915 133.60359651831513 133.94334690658843 134.07234897493356 134.26222094550408 135.1247416143833 135.26703848763705 136.44101756276862 136.53158888818282 136.73816906813227 136.9453074729637 136.99430302562726 137.1516343495963 137.24389852280024 137.84922753460384 138.52548751645546 138.83250148695737 138.8381329628698 139.05317028403368 139.23771997274864 139.3980576130228 139.63174034514327 139.8255954411582 140.8825574404594 141.20400705278212 141.36853062098658 141.8263938194708 142.0149074834585 142.18163760085653 142.28399855943655 142.5836332267996 143.16710862999537 143.30814358399988 143.68158479284838 143.70052236175616 143.73732162656648 143.78941000347083 143.89904971621752 144.22709163346616 144.25137381741374 145.18223195755607 145.84391528066772 145.84699991784152 146.31217814114288 146.35812094739435 146.58325259881482 146.69068859746622 146.71601427450358 147.20021111263497 147.22067055800144 147.37338290408377 147.7658145565965 148.20312488776452 151.63390143215997
Chat opening (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Chat opening (RAM) Baseline
Mean: 383.460 MB
Stdev: 10.980 MB (2.9%)
Runs: 362.1380208333333 362.9755859375 364.62890625 364.78515625 366.1123046875 366.1263020833333 366.1888020833333 367.0283203125 367.126953125 367.439453125 367.9931640625 368.65234375 369.0302734375 370.5244140625 370.76171875 372.8544921875 373.6276041666667 376.2591145833333 380.103515625 380.4287109375 380.59765625 382.19140625 383.2239583333333 383.8505859375 386.025390625 386.23828125 386.4697265625 387.41796875 388.009765625 388.029296875 388.8095703125 388.845703125 388.884765625 389.3583984375 389.4228515625 389.49609375 389.619140625 389.8583984375 390.4677734375 390.708984375 390.720703125 390.921875 390.9814453125 391.662109375 391.9208984375 392.00390625 392.2197265625 393.2587890625 393.349609375 393.4638671875 393.564453125 393.65234375 393.80859375 394.0234375 395.265625 395.62890625 396.078125 396.8251953125 397.1904296875 398.7763671875

Current
Mean: 382.734 MB
Stdev: 11.155 MB (2.9%)
Runs: 361.8255208333333 363.3385416666667 365.7109375 365.755859375 366.7939453125 366.9208984375 367.0205078125 367.216796875 367.5341796875 368.119140625 368.2431640625 368.8567708333333 369.20703125 369.42578125 369.572265625 369.6181640625 371.052734375 373.7083333333333 375.5924479166667 376.2486979166667 376.6888020833333 377.6966145833333 380.251953125 380.6575520833333 381.65625 383.2626953125 384.548828125 384.6025390625 385.5625 387.3212890625 387.5595703125 388.9365234375 389.1943359375 389.23828125 389.2421875 389.8720703125 390.2216796875 390.37109375 390.5234375 390.7109375 390.9228515625 390.97265625 391.0263671875 391.087890625 391.470703125 391.9453125 392.126953125 392.37890625 392.4326171875 392.4599609375 392.806640625 392.83203125 392.87890625 393.2216796875 393.5390625 394.9326171875 396.4013671875 397.0791015625 398.4052734375 405.24609375
Chat opening (CPU/JS) Baseline
Mean: 71.753 %
Stdev: 2.207 % (3.1%)
Runs: 66.4 67.4 67.4 67.5 68.1 69 69 69.1 69.4 69.5 69.6 69.7 69.8 69.9 70.1 70.3 70.4 70.7 70.8 70.9 71.4 71.4 71.4 71.5 71.5 71.6 71.7 71.8 71.9 71.9 71.9 71.9 72 72.1 72.2 72.4 72.4 72.4 72.5 72.8 72.8 72.9 72.9 72.9 73 73.3 73.4 73.4 73.4 73.4 74 74.2 74.4 74.6 74.9 74.9 74.9 75.6 76 76.6

Current
Mean: 71.653 %
Stdev: 1.919 % (2.7%)
Runs: 66.3 66.4 68.4 68.4 68.6 69.1 69.3 69.4 69.4 69.9 69.9 70 70 70.2 70.3 70.3 70.5 70.6 70.9 70.9 70.9 71.3 71.4 71.4 71.4 71.6 71.7 71.7 71.7 71.8 71.8 71.8 71.9 71.9 72 72.4 72.5 72.6 72.9 72.9 72.9 73 73.1 73.1 73.1 73.3 73.3 73.4 73.4 73.5 73.6 73.6 73.8 73.9 73.9 74 74 74.4 74.6 74.9
Chat opening (CPU/UI) Baseline
Mean: 29.225 %
Stdev: 1.564 % (5.4%)
Runs: 26.3 26.5 26.8 26.9 27.1 27.4 27.7 27.8 27.8 27.8 27.9 27.9 27.9 27.9 27.9 27.9 28 28 28.2 28.3 28.4 28.6 28.7 28.7 28.9 28.9 28.9 28.9 29 29 29 29.2 29.3 29.4 29.5 29.6 29.7 29.8 29.8 29.8 29.9 29.9 29.9 30 30.1 30.2 30.2 30.4 30.5 30.5 30.8 31.3 31.4 31.4 31.6 32.5 32.8 32.9 32.9

Current
Mean: 29.698 %
Stdev: 1.426 % (4.8%)
Runs: 26.9 27 27.3 27.4 27.8 27.9 27.9 28.2 28.2 28.2 28.3 28.4 28.5 28.5 28.8 28.8 28.9 28.9 28.9 29 29 29.1 29.1 29.2 29.3 29.3 29.4 29.4 29.4 29.6 29.7 29.7 29.7 29.7 29.8 29.9 29.9 29.9 29.9 30 30.3 30.4 30.4 30.8 30.8 30.9 30.9 30.9 30.9 30.9 31.2 31.3 31.5 31.9 31.9 32.1 32.2 32.4 32.5 32.9
Linking (CPU) Baseline
Mean: 148.383 %
Stdev: 2.962 % (2.0%)
Runs: 141.3746946572907 142.39960828351346 143.52497683827752 143.96219876030054 144.59371169213162 144.75114061032536 144.84669457798404 145.14010150672814 145.29491284131868 145.4388695593219 145.4758930926755 145.70743440468402 145.8171909591754 145.83489325402374 146.15021570911674 146.31423422422503 146.45526328451666 146.51763856668214 146.5297462976678 146.83462122427505 147.0196433524817 147.20886427239472 147.4337488698097 147.50919339182798 147.5478968758119 147.80284653131224 147.8406017412808 147.90607942478374 148.10086179555356 148.20596198317912 148.26614417716752 148.4753714104693 148.54913309836272 148.55683390777514 148.66176048414303 149.51689112573735 149.71503778815242 149.8684985421779 149.92555822482655 149.95330321499858 150.03000214967793 150.0388514209293 150.1432624827603 150.17083001098112 150.2914525504345 150.33338543304467 150.67478705654557 150.78731859942087 151.0758333172305 151.07737043592923 151.18646701570498 151.2457073007739 151.32667996076304 151.74832989953987 151.87389714809856 152.11307349513737 152.26864051484 154.57275727429607 155.22369041223294 155.77656505692002

Current
Mean: 147.885 %
Stdev: 2.631 % (1.8%)
Runs: 142.33248061610956 143.35630915119742 143.8329009512464 143.83746300735766 143.963643807556 144.1321663017873 144.38450045038226 144.42128504665547 144.66092429330214 144.6614880699311 144.98399306289312 145.41347653457242 145.55186592053525 145.55445458468122 145.74619722756424 145.795303494515 145.9636732076887 146.33698223509134 146.5148678400533 146.87800908078836 146.9224432768606 146.9644342206693 147.0759154371365 147.0977714570485 147.1259218370207 147.2882648562323 147.42295013332236 147.42689028504785 147.45741899797505 147.61769378696545 147.99702132464222 148.0505561949377 148.07856632312956 148.36456710699028 148.44062111534288 148.45884244711044 148.75355716664757 149.09594507033273 149.3435119371262 149.3485361722135 149.4488716404169 149.52524087849878 149.5432390686203 149.5953274070467 149.60448336020104 149.61669657616562 149.73185368708937 149.76623750919822 149.93732290767767 150.9503708272679 151.06962653248024 151.2943170656809 151.41268615691337 151.45140540233373 151.47506458057197 151.62025411814764 151.8520972556393 152.3815035071262 152.72327687411595 153.43631012329175
Linking (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Linking (RAM) Baseline
Mean: 423.567 MB
Stdev: 5.238 MB (1.2%)
Runs: 412.9596354166667 415.5514322916667 415.8359375 416.1041666666667 416.791015625 417.1803385416667 417.2369791666667 417.2389322916667 417.37109375 418.017578125 418.2395833333333 418.3268229166667 419.0716145833333 419.4264322916667 419.6998697916667 420.056640625 420.1712239583333 420.5735677083333 420.5748697916667 420.958984375 421.0729166666667 421.3151041666667 421.55859375 421.6171875 421.671875 421.8580729166667 421.9108072916667 422.2923177083333 422.3860677083333 422.8307291666667 423.1373697916667 423.7779017857143 423.9205729166667 424.4309895833333 424.5403645833333 424.7415364583333 424.9036458333333 425.0423177083333 425.1282552083333 425.6842447916667 425.8990885416667 426.501953125 426.6588541666667 427.0618489583333 427.4772135416667 427.814453125 427.935546875 428.0084635416667 428.974609375 429.2532552083333 429.7395833333333 430.0794270833333 430.2278645833333 430.5475260416667 431.2552083333333 432.1829427083333 433.6048177083333 435.50223214285717 436.52957589285717

Current
Mean: 436.659 MB
Stdev: 8.443 MB (1.9%)
Runs: 423.2075892857143 423.31640625 423.341796875 423.4153645833333 423.7428385416667 424.513671875 425.7239583333333 425.8170572916667 425.8365885416667 428.189453125 428.68359375 428.6861979166667 428.9876302083333 429.2701822916667 430.1399739583333 430.2779947916667 430.4680989583333 430.8111979166667 430.826171875 431.0182291666667 431.1822916666667 431.3404947916667 431.3430989583333 431.751953125 431.9563802083333 432.1497395833333 432.2942708333333 433.6555989583333 435.84598214285717 436.4850260416667 437.51060267857144 437.6919642857143 438.1166294642857 439.07700892857144 439.1796875 439.84486607142856 439.9693080357143 440.2533482142857 440.2689732142857 440.58035714285717 442.65457589285717 443.24888392857144 444.23046875 444.51395089285717 444.53013392857144 444.6177455357143 444.85546875 446.0786830357143 446.17689732142856 446.3677455357143 446.6763392857143 446.7036830357143 446.75502232142856 447.8359375 447.99107142857144 448.3755580357143 449.29464285714283 450.03738839285717 450.41294642857144 451.38169642857144
Linking (CPU/JS) Baseline
Mean: 80.495 %
Stdev: 1.437 % (1.8%)
Runs: 76.8 77.7 77.8 77.9 78.1 78.2 78.2 78.7 78.9 79.2 79.2 79.2 79.6 79.6 79.7 79.7 79.8 79.9 79.9 80 80.1 80.2 80.3 80.3 80.3 80.4 80.4 80.5 80.5 80.5 80.6 80.7 80.7 80.8 80.9 80.9 80.9 80.9 81 81.1 81.1 81.1 81.4 81.6 81.7 81.7 81.7 81.8 81.9 81.9 82.1 82.1 82.2 82.4 82.6 82.7 82.8 83 83.3

Current
Mean: 80.695 %
Stdev: 1.739 % (2.2%)
Runs: 77.5 77.7 78.2 78.2 78.2 78.3 78.3 78.4 78.5 78.5 78.6 78.7 78.8 79.1 79.2 79.3 79.5 79.5 79.6 79.6 79.6 79.8 79.9 80 80 80.3 80.4 80.4 80.5 80.8 81.2 81.2 81.2 81.3 81.4 81.4 81.4 81.5 81.6 81.6 81.6 81.8 81.9 81.9 81.9 82.1 82.1 82.2 82.5 82.5 82.6 82.7 82.7 82.8 83 83 83.7 83.8 83.8 83.9
Linking (CPU/UI) Baseline
Mean: 28.542 %
Stdev: 1.514 % (5.3%)
Runs: 25.3 25.9 25.9 26.2 26.5 26.5 26.7 26.8 27 27.1 27.2 27.2 27.4 27.5 27.6 27.6 27.6 27.6 27.7 27.8 27.8 27.8 27.8 27.9 27.9 28 28.1 28.2 28.2 28.3 28.3 28.5 28.6 28.7 28.8 28.9 29 29 29.2 29.3 29.3 29.4 29.5 29.6 29.6 29.6 29.9 29.9 29.9 29.9 30 30.3 30.4 30.4 30.5 30.6 30.9 31 31.5 32.9

Current
Mean: 28.152 %
Stdev: 1.237 % (4.4%)
Runs: 25.6 25.7 25.7 25.9 25.9 25.9 26.2 26.6 26.8 26.9 27.1 27.2 27.2 27.3 27.5 27.6 27.6 27.6 27.7 27.7 27.7 27.8 27.9 27.9 28.1 28.2 28.2 28.2 28.2 28.3 28.3 28.3 28.5 28.5 28.6 28.7 28.7 28.7 28.8 28.8 28.8 28.9 29 29 29 29 29.2 29.2 29.3 29.4 29.5 29.6 29.6 29.9 29.9 30.2 30.4 30.8

Copy link
Contributor

@Expensify/mobile-deployers 📣 Please look into this performance regression as it's a deploy blocker.

@Julesssss Julesssss added DeployBlockerCash This issue or pull request should block deployment and removed DeployBlockerCash This issue or pull request should block deployment labels Nov 22, 2024
@Julesssss
Copy link
Contributor

This is a large change and I'm going to keep their blocker until we discuss.

My first thought is that these changes lead to OpenApp being called less frequently. Could this be because we're now importing NativeModules in order to make the conditional check?

Copy link
Contributor

🚀 Deployed to staging by https://github.com/Julesssss in version: 9.0.66-0 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 success ✅
🍎🔄 iOS HybridApp 🍎🔄 success ✅

Copy link
Contributor

🚀 Deployed to production by https://github.com/mountiny in version: 9.0.66-8 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 failure ❌
🍎🔄 iOS HybridApp 🍎🔄 failure ❌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
DeployBlockerCash This issue or pull request should block deployment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants