-
Notifications
You must be signed in to change notification settings - Fork 1.3k
[usage] Request signed upload URL from content-service
#11493
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
/hold because it's based on #11474 |
started the job as gitpod-build-af-upload-usage-reports.18 because the annotations in the pull request description changed |
3ef8e01
to
68c28fc
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm surprised a network policy was not needed to talk to the content service
@@ -20,6 +21,7 @@ import ( | |||
func configmap(ctx *common.RenderContext) ([]runtime.Object, error) { | |||
cfg := server.Config{ | |||
ControllerSchedule: time.Hour.String(), | |||
ContentServiceUrl: fmt.Sprintf("%s:%d", content_service.Component, content_service.RPCPort), |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
net.JoinHostPort
instead
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks. aed2c3f
@@ -23,6 +23,7 @@ func TestConfigMap_ContainsSchedule(t *testing.T) { | |||
require.JSONEq(t, | |||
`{ | |||
"controllerSchedule": "2m", | |||
"contentServiceUrl": "content-service:8080", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Technically, this is not a URL, just an address
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Renamed (b50982f)
/unhold |
aed2c3f
to
f149203
Compare
/werft run with-preview 👍 started the job as gitpod-build-af-upload-usage-reports.25 |
Add a dependency on the `content-service-api` component. And run `leeway link`.
To handle connecting to the content-service gRPC API, retrieving signed upload URLs and uploading usage reports.
When the usage component starts up.
Populate the usage component's config file with the URL of the in-cluster content-service.
Show that the connection to the content service is up and running by requesting a signed upload URL and logging it.
f149203
to
7d88600
Compare
Yes, that is surprising. The
This should probably be more restrictive. |
Description
#11474 added a new
UsageReportService
tocontent-service
that allowed S3 signed upload URLs to be retrieved for the purpose of uploading usage reports to cloud storage.This PR hooks up the
usage
component with thecontent-service
so that it requests a signed upload URL fromcontent-service
each time it runs.Subsequent PRs will use this signed URL to actually upload usage reports to cloud storage.
Related Issue(s)
Part of #9036
Builds on #11474
How to test
Look at the logs for the
usage
component in the preview environment for this PR. When usage reconciliation runs it successfully requests a signed upload URL from thecontent-service
:Release Notes
Documentation
Werft options: