Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduce GKE workload logs #9680

Open
xin-hedera opened this issue Oct 30, 2024 · 0 comments
Open

Reduce GKE workload logs #9680

xin-hedera opened this issue Oct 30, 2024 · 0 comments
Labels
enhancement Type: New feature

Comments

@xin-hedera
Copy link
Collaborator

Problem

All workload logs in our GKE clusters are by default sent to google cloud logging's _Default bucket with 30 days retention period.

While rest api logs may need to be kept so the log-downloader tool can continue to work, we need to fine tuning logs for other workloads to reduce the amount of logs storage and the cost.

Solution

  1. research how to change logs routing sink configuration to only include logs we want and store them in _Default bucket, references 1, 2, and 3
  2. in addition, citus pods logs excessive temporary files creation events mainly due to repartition queries, research if it can be disabled in postgresql config

Alternatives

No response

@xin-hedera xin-hedera added the enhancement Type: New feature label Oct 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Type: New feature
Projects
None yet
Development

No branches or pull requests

1 participant