Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

compaction seems to cause more-than-expected cache invalidation and leads to poor performance #8052

Closed
Tracked by #7289
lmatz opened this issue Feb 20, 2023 · 2 comments
Assignees
Milestone

Comments

@lmatz
Copy link
Contributor

lmatz commented Feb 20, 2023

SCR-20230220-ich

When benchmarking q101 and also q103, it seems compaction has a large effect on stream processing,
i.e. the CPU usage/throughput when compaction + computation < the CPU usage/throughput when only computation.

Slack history: https://risingwave-labs.slack.com/archives/C03GTKX3C8G/p1676870159661769

the impact of block cache invalidation is bigger than what we saw in other queries

Feel free to reassign, thanks!

@lmatz
Copy link
Contributor Author

lmatz commented Feb 27, 2023

cc: @Little-Wallace
Could you confirm if #8141 intends to fix this?
If so, let's close this one.

@lmatz lmatz closed this as completed Feb 27, 2023
@lmatz
Copy link
Contributor Author

lmatz commented Feb 27, 2023

reopen as there seems to be still large fluctuation, but may not be cache invalidation though

@lmatz lmatz reopened this Feb 27, 2023
@lmatz lmatz closed this as completed Mar 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants