[HOLD for payment 2024-12-17] [HOLD for payment 2024-12-16] [HOLD for payment 2024-10-30] [HOLD for payment 2024-10-29] Benchmark performance bottlenecks when opening chats

[adhorodyski]

Coming from the discussion thread under https://expensify.slack.com/archives/C05LX9D6E07/p1728314452317409

Problem

Lack of solid performance benchmarks across the core app workflows, baselines for proposing performance improvements.

Solution

• Focus on 1 scenario of opening a chat
• Benchmark it in detail to get the granular results (also for each phase) so we have solid numbers for whom specifically it's slow and why. There are also analytics we can use for this to have more datapoints.
• Pinpoint the areas for improvement we see
• Map how the proposal from initial thread/nitro modules/anything other can fit to improve it

cc @hannojg

[adhorodyski]

@mountiny could you please assign this one to me & @hannojg? Thanks!

[hannojg]

Thanks! 👋

[adhorodyski]

Update
Our bottom line is to get super solid on what precisely is slow (have granular measurements) and for whom specifically.

Who
To be able to say how many people something affects (in different percentiles), we need to have something to segment by. We'll extend our performance analytics' metadata (in all envs, including e2e tests) to include the below fields. These will help us group measurements by the types of accounts. (PR: #50881)

• number of reports ✅
• number of reportActions 🔄
• number of personalDetails ✅
• number of policies 🔄
• number of transactions 🔄
• number of transactionViolations 🔄

What
To be able to pinpoint what exactly is slow, we'll implement granular metrics in code, across both App & Onyx. Here's a breakdown of all the phases we decided to focus on.

• APPLYING_UPDATES (coming over https, until we schedule notifying subscribers)
  • DATABASE_WRITE (actual save operations like multiset and multimerge)
• NOTIFYING_SUBSCRIBERS (multiple key(s)Changed triggered by scheduleNotifyCollectionSubscribers)
  • DATABASE_READ
  • REACT_PROVIDER - (useOnyx/withOnyx)
• ONYX_DATA_POSTPROCESSING (from receiving a new update (subscriber got called) until we have the final data)

How
TBC

[adhorodyski]

cc @mountiny we'd like to ask you for any feedback about this 1st batch (please invite others!). Is there an area we're missing? I want to make sure we focus on the right parts when profiling this, the exact tools (like e2e suites) will come next once we fully agree on the who&what.

[melvin-bot]

Reviewing label has been removed, please complete the "BugZero Checklist".

[melvin-bot]

The solution for this issue has been 🚀 deployed to production 🚀 in version 9.0.51-4 and is now subject to a 7-day regression period 📆. Here is the list of pull requests that resolve this issue:

• Extend perf analytics metadata #50881

If no regressions arise, payment will be issued on 2024-10-29. 🎊

For reference, here are some details about the assignees on this issue:

• @hannojg does not require payment (Contractor)
• @adhorodyski does not require payment (Contractor)

[melvin-bot]

⚠️ Looks like this issue was linked to a Deploy Blocker here

If you are the assigned CME please investigate whether the linked PR caused a regression and leave a comment with the results.

If a regression has occurred and you are the assigned CM follow the instructions here.

If this regression could have been avoided please consider also proposing a recommendation to the PR checklist so that we can avoid it in the future.

[adhorodyski]

The extended analytics setup is merged now:

• to be confirmed it's available in Firebase for newly reported events
• to be merged into local-based profiling tools (on top of react-native-performance within the Performance module?) so we can use the same parameters in eg. e2e workflows cc @hannojg, I think this is the last thing we have to do when it comes to the 'segmentation' part

[adhorodyski]

• Next part is to implement the granular metrics as listed above

also cc @hannojg, do you think these should also be reported to Firebase OR we just focus on being able to profile this behind some flag?

[adhorodyski]

After some considerations around ONYX_DATA_POSTPROCESSING I think it'd be the most precise (and easy to follow) to actually wrap all specific computations separately. I'll look for places we know take a bit, wrap them with markStart/markEnd so we are certain which specific parts are slow.

[adhorodyski]

Hey, linking this small one: #53652

[adhorodyski]

I'm now working on the last decorators within Onyx so we can have withOnyx/useOnyx wrapped as well.

[melvin-bot]

Reviewing label has been removed, please complete the "BugZero Checklist".

[melvin-bot]

The solution for this issue has been 🚀 deployed to production 🚀 in version 9.0.72-1 and is now subject to a 7-day regression period 📆. Here is the list of pull requests that resolve this issue:

• [No QA] perf: add performance markers for applying remote updates #53278

If no regressions arise, payment will be issued on 2024-12-16. 🎊

For reference, here are some details about the assignees on this issue:

• @hannojg does not require payment (Contractor)
• @adhorodyski does not require payment (Contractor)

[adhorodyski]

• for withOnyx I don't think we should focus on covering this as it's deprecated
• for useOnyx it's the getSnapshot that needs to be covered, on it

[adhorodyski]

PR to Onyx on decorating useOnyx is there (wip): Expensify/react-native-onyx#607

I'll test it & wrap the checklist on tomorrow.

[adhorodyski]

Just opened the PR for review here: Expensify/react-native-onyx#607

[melvin-bot]

Reviewing label has been removed, please complete the "BugZero Checklist".

[melvin-bot]

The solution for this issue has been 🚀 deployed to production 🚀 in version 9.0.73-8 and is now subject to a 7-day regression period 📆. Here is the list of pull requests that resolve this issue:

• [No QA] feat: mark start/end getOrderedReportIDs #53652

If no regressions arise, payment will be issued on 2024-12-17. 🎊

For reference, here are some details about the assignees on this issue:

• @hannojg does not require payment (Contractor)
• @adhorodyski does not require payment (Contractor)