-
Notifications
You must be signed in to change notification settings - Fork 10
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add telemetry completeness tests #3650
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
CI is failing on the new test
@cbeauchesne I've fixed the CI and all failures are now unrelated to the new test. Please re-review 🙏 |
Could you also update your branch? it'll fix php errors |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There are test failures related with this PR
elif isinstance(obj, list): | ||
result.extend(obj) | ||
else: | ||
logger.error(f"Unexpected type in concat: {type(obj).__name__}") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If this occurs, I expect the test to fail due to missing config keys, so not throwing here
5d696a3
to
93a21f1
Compare
# If this script deletes the JSON files in system-tests, it's likely this is no longer valid | ||
SUBDIR="trace/apps/tracer-telemetry-intake/telemetry-payload/static/" | ||
# The "main" branch in dd-go | ||
BRANCH="bm1549/more-missing-configs" # This should ALWAYS be "prod" in master. Please revert changes before merging |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pending (but not blocked by) https://github.com/DataDog/dd-go/pull/161868
BRANCH="bm1549/more-missing-configs" # This should ALWAYS be "prod" in master. Please revert changes before merging | |
BRANCH="prod" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Lats small bit : if a github team exists, add it as the owner for the tests/telemetry_intake
folder
Motivation
Adds a new test for telemetry completeness, ensuring what is specified in dd-go is present in our individual libraries
With the current implementation, this tests for telemetry of an empty configuration which may be lossy in some languages
These tests somewhat eliminate the need for equivalent tests in dd-trace-js and tests in dd-trace-dotnet (missing ref)
Note for reviewer: I'm a bit suspicious about the correctness of this line, but it seems to better match what is on this notebook
Changes
Adds a test across languages
Workflow
codeowners
file quickly.🚀 Once your PR is reviewed, you can merge it!
🛟 #apm-shared-testing 🛟
Reviewer checklist
[<language>]
, double-check that only<language>
is impacted by the changebuild-XXX-image
label is present