Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a headerless jarray parser operator #30643

Closed

Conversation

RoeiDimi
Copy link
Contributor

@RoeiDimi RoeiDimi commented Jan 17, 2024

Description:

We are using otel-collector as an infrastructure and receive many types of data from a client. The client's sent data is always a form of json and in one use case the json is a simple headerless jarray and so we need a way to parse it and match headers to each field (something similar to what csv_parser does but also supports types supported in a json format and nested objects)

Link to tracking Issue:
#30321

Testing:

  • unittests
    All the tests found in csv_parser were copied and adjusted adding test scenarios for different type (number, booleans, null) as well as a test for parsing a nested object as a part of the jarray
  • End to end tests
    Used generated traffic on a running otel collector thats using the parser and verified the data is as expected in the end table

Documentation:

  • generated

@RoeiDimi RoeiDimi requested a review from djaglowski as a code owner January 17, 2024 13:13
@RoeiDimi RoeiDimi requested a review from a team January 17, 2024 13:13
Copy link

CLA Not Signed

@RoeiDimi RoeiDimi closed this Jan 17, 2024
@RoeiDimi RoeiDimi deleted the pkg-stanza-jarray-parser branch January 17, 2024 13:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants