Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](be) Prevent RocksDB from generating many large log files #40035

Merged
merged 2 commits into from
Aug 28, 2024

Conversation

lide-reed
Copy link
Contributor

@lide-reed lide-reed commented Aug 28, 2024

Proposed changes

Prevent RocksDB from generating many large log files.
We have a cluster with doris 1.2.4, in be meta dir, it generated more than 150G LOG file as following:

[root@9 meta]# ls -lht
total 157G
-rw-r--r-- 1 doris doris 4.0M Aug 27 22:48 107324255.sst
-rw-r--r-- 1 doris doris 4.3G Aug 27 22:48 LOG
-rw-r--r-- 1 doris doris 292M Aug 27 22:48 MANIFEST-104377434
-rw-r--r-- 1 doris doris 2.0M Aug 27 22:48 107324254.sst
-rw-r--r-- 1 doris doris 8.4M Aug 27 22:48 107324253.log
-rw-r--r-- 1 doris doris 2.1M Aug 27 22:48 107324252.sst
-rw-r--r-- 1 doris doris 1.7M Aug 27 22:48 107324250.sst
-rw-r--r-- 1 doris doris 1.8M Aug 27 22:48 107324248.sst
-rw-r--r-- 1 doris doris 6.9M Aug 27 22:48 107324246.sst
-rw-r--r-- 1 doris doris 9.5K Aug 14 09:32 OPTIONS-104377438
-rw-r--r-- 1 doris doris 19 Aug 14 09:32 CURRENT
-rw-r--r-- 1 doris doris 152G Aug 14 09:30 LOG.old.1723599084129852
-rw-r--r-- 1 doris doris 9.5K May 15 2023 OPTIONS-000010
-rw-r--r-- 1 doris doris 37 May 15 2023 IDENTITY
-rw-r--r-- 1 doris doris 0 May 15 2023 LOCK

Issue Number: close #xxx

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Aug 28, 2024
Copy link
Contributor

PR approved by anyone and no changes requested.

@lide-reed lide-reed merged commit d3b29a6 into apache:branch-1.2-lts Aug 28, 2024
12 of 13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants