Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RayService][Refactor] Avoid flooding Kubernetes events #2546

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

kevin85421
Copy link
Member

@kevin85421 kevin85421 commented Nov 17, 2024

Why are these changes needed?

We only file events for the following two cases:

  1. Interactions with the Kubernetes API server: For example, successfully creating Pods or creation failures.
  2. Spec/Status validation failures.

However, before this PR, each reconciliation of a RayService CR would create at least one event in most cases. Although EventCorrelator has a rate limit and aggregates events to prevent scalability issues, it can introduce a significant delay in filing events to the Kubernetes API server if KubeRay manages multiple RayService CRs.

image

Related issue number

Checks

  • I've made sure the tests are passing.
  • Testing Strategy
    • Unit tests
    • Manual tests
    • This PR is not tested :(

Signed-off-by: kaihsun <kaihsun@anyscale.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants