Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

remove certs and simplify telemetry summarize #1750

Merged
merged 13 commits into from
Dec 17, 2024

Conversation

msarahan
Copy link
Contributor

@msarahan msarahan commented Dec 6, 2024

Description

The goal here is to remove the need for certificates. Any worker that is not in our VPC can talk directly to fluentbit, and fluentbit will be configured with certificates to talk to Tempo. The implementation implication is that we need to run telemetry stuff ONLY on nodes in our VPC. To avoid needing to move all jobs to these nodes, we instead temporarily store telemetry data as artifacts, and in one final job, we process and send telemetry info for all jobs from one job.

Part of rapidsai/shared-workflows#269 and rapidsai/shared-actions#28

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

Copy link

copy-pr-bot bot commented Dec 6, 2024

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@msarahan msarahan added 2 - In Progress Currently a work in progress tech debt debt Internal clean up and improvements to reduce maintenance and technical debt in general non-breaking Non-breaking change ci improvement Improvement / enhancement to an existing function labels Dec 6, 2024
@msarahan
Copy link
Contributor Author

msarahan commented Dec 6, 2024

/ok to test

@github-actions github-actions bot removed the ci label Dec 6, 2024
@msarahan
Copy link
Contributor Author

msarahan commented Dec 6, 2024

/ok to test

3 similar comments
@msarahan
Copy link
Contributor Author

msarahan commented Dec 6, 2024

/ok to test

@msarahan
Copy link
Contributor Author

msarahan commented Dec 6, 2024

/ok to test

@msarahan
Copy link
Contributor Author

msarahan commented Dec 9, 2024

/ok to test

@msarahan msarahan force-pushed the telemetry-without-certs branch from 9c55600 to e07b378 Compare December 10, 2024 15:43
@msarahan
Copy link
Contributor Author

/ok to test

@msarahan
Copy link
Contributor Author

AJ has just re-enabled the TELEMETRY_ENABLED configuration variable. The next run here should show telemetry being captured.

@msarahan msarahan closed this Dec 10, 2024
@msarahan msarahan reopened this Dec 10, 2024
@msarahan
Copy link
Contributor Author

/ok to test

@msarahan msarahan closed this Dec 10, 2024
@msarahan msarahan reopened this Dec 10, 2024
@msarahan
Copy link
Contributor Author

/ok to test

1 similar comment
@msarahan
Copy link
Contributor Author

/ok to test

@msarahan msarahan closed this Dec 10, 2024
@msarahan msarahan reopened this Dec 10, 2024
@msarahan
Copy link
Contributor Author

/ok to test

@msarahan msarahan closed this Dec 10, 2024
@msarahan msarahan reopened this Dec 10, 2024
@msarahan
Copy link
Contributor Author

/ok to test

@msarahan msarahan closed this Dec 10, 2024
@msarahan msarahan reopened this Dec 10, 2024
@msarahan
Copy link
Contributor Author

/ok to test

@msarahan msarahan force-pushed the telemetry-without-certs branch from e78a58a to b4db92d Compare December 17, 2024 18:38
@msarahan
Copy link
Contributor Author

/ok to test

@msarahan msarahan marked this pull request as ready for review December 17, 2024 18:44
@msarahan msarahan requested a review from a team as a code owner December 17, 2024 18:44
@msarahan msarahan requested a review from gforsyth December 17, 2024 18:44
@msarahan msarahan added 3 - Ready for review Ready for review by team and removed 2 - In Progress Currently a work in progress labels Dec 17, 2024
@msarahan
Copy link
Contributor Author

/ok to test

@msarahan msarahan force-pushed the telemetry-without-certs branch from e26de8d to a939f09 Compare December 17, 2024 18:48
@msarahan msarahan force-pushed the telemetry-without-certs branch from a939f09 to 1e57c73 Compare December 17, 2024 19:47
.github/workflows/pr.yaml Outdated Show resolved Hide resolved
Co-authored-by: Bradley Dice <bdice@bradleydice.com>
@bdice bdice removed the tech debt debt Internal clean up and improvements to reduce maintenance and technical debt in general label Dec 17, 2024
@msarahan
Copy link
Contributor Author

/merge

@rapids-bot rapids-bot bot merged commit 1af03eb into rapidsai:branch-25.02 Dec 17, 2024
62 checks passed
@msarahan msarahan deleted the telemetry-without-certs branch December 17, 2024 20:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - Ready for review Ready for review by team improvement Improvement / enhancement to an existing function non-breaking Non-breaking change
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

2 participants