Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[HOLD for payment 2023-10-10] [$500] Stop storing queued Onyx updates to disk #25612

Closed
marcaaron opened this issue Aug 21, 2023 · 25 comments
Closed
Assignees
Labels
Awaiting Payment Auto-added when associated PR is deployed to production Bug Something is broken. Auto assigns a BugZero manager. Daily KSv2 Help Wanted Apply this label when an issue is open to proposals by contributors Improvement Item broken or needs improvement. Internal Requires API changes or must be handled by Expensify staff

Comments

@marcaaron
Copy link
Contributor

marcaaron commented Aug 21, 2023

Problem

In some cases, the payload of OpenApp is very large and since we save all Onyx responses to disk in queuedOnyxUpdates this leads to double-storing our largest resource. It will be deleted after, but doesn't seem like there is a clear reason why these updates should be persisted instead of just hanging around in memory.

Solution

Let's store the "queued updates" in memory instead.

Upwork Automation - Do Not Edit
  • Upwork Job URL: https://www.upwork.com/jobs/~01451356cead02359a
  • Upwork Job ID: 1702119738769117184
  • Last Price Increase: 2023-09-29
@marcaaron marcaaron self-assigned this Aug 21, 2023
@marcaaron marcaaron added Daily KSv2 Improvement Item broken or needs improvement. labels Aug 21, 2023
@melvin-bot melvin-bot bot added the Overdue label Aug 24, 2023
@marcaaron
Copy link
Contributor Author

Just blocked on testing on all platforms. Will try to get this done today.

@melvin-bot melvin-bot bot added Overdue and removed Overdue labels Aug 24, 2023
@melvin-bot
Copy link

melvin-bot bot commented Aug 28, 2023

@marcaaron Uh oh! This issue is overdue by 2 days. Don't forget to update your issues!

@marcaaron
Copy link
Contributor Author

Focusing on pagination research atm. I will try to run through test steps for this one today.

@melvin-bot melvin-bot bot added Overdue and removed Overdue labels Aug 29, 2023
@marcaaron marcaaron added Weekly KSv2 and removed Daily KSv2 labels Sep 1, 2023
@melvin-bot melvin-bot bot added Reviewing Has a PR in review Weekly KSv2 and removed Overdue Weekly KSv2 labels Sep 1, 2023
@marcaaron marcaaron added the Internal Requires API changes or must be handled by Expensify staff label Sep 14, 2023
@melvin-bot
Copy link

melvin-bot bot commented Sep 14, 2023

Job added to Upwork: https://www.upwork.com/jobs/~01451356cead02359a

@melvin-bot
Copy link

melvin-bot bot commented Sep 14, 2023

Triggered auto assignment to Contributor Plus for review of internal employee PR - @situchan (Internal)

@marcaaron marcaaron added the Bug Something is broken. Auto assigns a BugZero manager. label Sep 14, 2023
@melvin-bot
Copy link

melvin-bot bot commented Sep 14, 2023

Triggered auto assignment to @alexpensify (Bug), see https://stackoverflow.com/c/expensify/questions/14418 for more details.

@melvin-bot melvin-bot bot added Daily KSv2 and removed Weekly KSv2 labels Sep 14, 2023
@melvin-bot

This comment was marked as resolved.

@marcaaron
Copy link
Contributor Author

Hey @alexpensify this is something I am fixing and enlisting the C+ to help with on reviews. There was no bug report or anything as it's more of an improvement, so I checked off everything on the BZ checklist.

@alexpensify
Copy link
Contributor

@marcaaron - when is the payment date for this one?

@alexpensify alexpensify added Weekly KSv2 and removed Daily KSv2 labels Sep 18, 2023
@alexpensify
Copy link
Contributor

It looks like the PR is moving along but there is a lint error to address.

@alexpensify
Copy link
Contributor

@marcaaron can you review the lint error flag? Thanks!

@marcaaron
Copy link
Contributor Author

Yep sorry this one slipped through the cracks - thanks for the bump @alexpensify

@marcaaron
Copy link
Contributor Author

Merged and waiting for deploy

@alexpensify alexpensify added the External Added to denote the issue can be worked on by a contributor label Sep 29, 2023
@melvin-bot melvin-bot bot changed the title Stop storing queued Onyx updates to disk [$500] Stop storing queued Onyx updates to disk Sep 29, 2023
@melvin-bot melvin-bot bot added the Help Wanted Apply this label when an issue is open to proposals by contributors label Sep 29, 2023
@melvin-bot
Copy link

melvin-bot bot commented Sep 29, 2023

Current assignee @situchan is eligible for the External assigner, not assigning anyone new.

@melvin-bot melvin-bot bot added Daily KSv2 and removed Weekly KSv2 labels Sep 29, 2023
@alexpensify alexpensify removed the External Added to denote the issue can be worked on by a contributor label Sep 29, 2023
@alexpensify
Copy link
Contributor

@situchan - it looks like automation might not kick in, so please apply here:

https://www.upwork.com/jobs/~01451356cead02359a

@melvin-bot melvin-bot bot added Weekly KSv2 Awaiting Payment Auto-added when associated PR is deployed to production and removed Daily KSv2 labels Oct 3, 2023
@melvin-bot melvin-bot bot changed the title [$500] Stop storing queued Onyx updates to disk [HOLD for payment 2023-10-10] [$500] Stop storing queued Onyx updates to disk Oct 3, 2023
@melvin-bot melvin-bot bot removed the Reviewing Has a PR in review label Oct 3, 2023
@melvin-bot
Copy link

melvin-bot bot commented Oct 3, 2023

Reviewing label has been removed, please complete the "BugZero Checklist".

@melvin-bot
Copy link

melvin-bot bot commented Oct 3, 2023

The solution for this issue has been 🚀 deployed to production 🚀 in version 1.3.76-6 and is now subject to a 7-day regression period 📆. Here is the list of pull requests that resolve this issue:

If no regressions arise, payment will be issued on 2023-10-10. 🎊

After the hold period is over and BZ checklist items are completed, please complete any of the applicable payments for this issue, and check them off once done.

  • External issue reporter
  • Contributor that fixed the issue
  • Contributor+ that helped on the issue and/or PR

For reference, here are some details about the assignees on this issue:

As a reminder, here are the bonuses/penalties that should be applied for any External issue:

  • Merged PR within 3 business days of assignment - 50% bonus
  • Merged PR more than 9 business days after assignment - 50% penalty

@melvin-bot
Copy link

melvin-bot bot commented Oct 3, 2023

BugZero Checklist: The PR fixing this issue has been merged! The following checklist (instructions) will need to be completed before the issue can be closed:

  • [@situchan] The PR that introduced the bug has been identified. Link to the PR:
  • [@situchan] The offending PR has been commented on, pointing out the bug it caused and why, so the author and reviewers can learn from the mistake. Link to comment:
  • [@situchan] A discussion in #expensify-bugs has been started about whether any other steps should be taken (e.g. updating the PR review checklist) in order to catch this type of bug sooner. Link to discussion:
  • [@situchan] Determine if we should create a regression test for this bug.
  • [@situchan] If we decide to create a regression test for the bug, please propose the regression test steps to ensure the same bug will not reach production again.
  • [@alexpensify] Link the GH issue for creating/updating the regression test once above steps have been agreed upon:

@alexpensify
Copy link
Contributor

@situchan looks like the previous Upwork link was not working, so can you apply to this one --- https://www.upwork.com/jobs/~01a80b6b1d1c2a3260

Thanks!

@situchan
Copy link
Contributor

situchan commented Oct 6, 2023

Applied thanks

@melvin-bot melvin-bot bot added Daily KSv2 and removed Weekly KSv2 labels Oct 10, 2023
@alexpensify
Copy link
Contributor

Here is the payment summary:

  • External issue reporter N/A
  • Contributor that fixed the issue N/A
  • Contributor+ that helped on the issue and/or PR @situchan $500

Upwork Job: https://www.upwork.com/jobs/~01a80b6b1d1c2a3260

*If applicable, the bonuses will be applied on the final payment

Extra Notes regarding payment: Confirmed here that there is no need to complete the BZ -- #25612 (comment)

@alexpensify
Copy link
Contributor

@situchan - I've extended the contract in Upwork, please accept and I can complete he payment process. Thanks!

@alexpensify
Copy link
Contributor

The payment has been sent out. All set here, so closing for now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Awaiting Payment Auto-added when associated PR is deployed to production Bug Something is broken. Auto assigns a BugZero manager. Daily KSv2 Help Wanted Apply this label when an issue is open to proposals by contributors Improvement Item broken or needs improvement. Internal Requires API changes or must be handled by Expensify staff
Projects
None yet
Development

No branches or pull requests

3 participants