-
Notifications
You must be signed in to change notification settings - Fork 2.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[receiver/awss3receiver] Initial implementation #32222
[receiver/awss3receiver] Initial implementation #32222
Conversation
unmarshaler = &ptrace.JSONUnmarshaler{} | ||
} | ||
if strings.HasSuffix(key, ".binpb") { | ||
unmarshaler = &ptrace.ProtoUnmarshaler{} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We can maybe do something here in a future PR where the unmarshaler is dictated by config. I appreciate how this works well when you don't know what data to expect though.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Agreed - at this stage just want to get the basics in and then add the ability to use extensions to unmarshall data next.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I didn't get a chance to look through tests yet, just an initial pass over functionality. I don't have much AWS experience, so some questions may be pretty elementary. 👍
@crobert-1 Thanks for the quick review! I'll take a look through those shortly. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I see I've got a couple open comments still, so I'll wait to review tests until after those are responded to 👍
I think I've been through all your original comments and resolved them now. |
Ready to go! |
Hey @adcharre, sorry for the delay with merging. Can you please rebase again? |
Rebased again ... @dmitryax any chance this can go in soon while I just love resolving merge conflicts I would like to see this merged :-) |
@adcharre I tried to help but I don't think I got it right, mind taking a look? |
@dmitryax rebased ready for merging |
Description: This is the initial implementation of the AWS S3 receiver. The receiver can load trace from an S3 bucket starting at the configured time until the stop time. Json and protobuf formats are supported along with gzip compression.
Link to tracking Issue: #30750
Testing: Unit tests added and read real trace from an S3 bucket.
Documentation: None added