Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Airflow] Revert metrics field definition to the format used before i… #7469

Merged
merged 3 commits into from
Aug 22, 2023

Conversation

ritalwar
Copy link
Contributor

@ritalwar ritalwar commented Aug 21, 2023

  • Enhancement

What does this PR do?

Revert airflow metrics field definition to the format used before introducing metric_type.
This is done because of this issue.
Although, Airflow remained unaffected by this issue. However, with the fix now accessible and the necessary changes present in the elastic-package, it's good to revert to the original format.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.

Related issues

Screenshots

Screenshot 2023-08-22 at 12 07 30 PM Screenshot 2023-08-21 at 2 10 11 PM Screenshot 2023-08-21 at 2 04 12 PM Screenshot 2023-08-21 at 2 04 02 PM

@ritalwar ritalwar requested a review from agithomas August 21, 2023 07:44
@elasticmachine
Copy link

elasticmachine commented Aug 21, 2023

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2023-08-22T06:38:42.235+0000

  • Duration: 14 min 2 sec

Test stats 🧪

Test Results
Failed 0
Passed 2
Skipped 0
Total 2

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

  • /test : Re-trigger the build.

@elasticmachine
Copy link

elasticmachine commented Aug 21, 2023

🌐 Coverage report

Name Metrics % (covered/total) Diff
Packages 100.0% (0/0) 💚
Files 100.0% (0/0) 💚 3.371
Classes 100.0% (0/0) 💚 3.371
Methods 25.0% (1/4) 👎 -66.828
Lines 100.0% (0/0) 💚 11.661
Conditionals 100.0% (0/0) 💚

@agithomas
Copy link
Contributor

Why the reverting is done? Can you link to the related issue?

@ritalwar
Copy link
Contributor Author

ritalwar commented Aug 21, 2023

Why the reverting is done? Can you link to the related issue?

This is the issue link
Airflow remained unaffected by this issue. However, with the fix now accessible and the necessary changes present in the elastic-package, it's good to revert to the original format.

Copy link
Contributor

@agithomas agithomas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@ritalwar ritalwar merged commit 17fc9b3 into elastic:main Aug 22, 2023
@elasticmachine
Copy link

Package airflow - 0.3.0 containing this change is available at https://epr.elastic.co/search?package=airflow

@@ -435,7 +435,7 @@
"dataType": "number",
"isBucketed": false,
"label": "Scheduler Heartbeat",
"operationType": "sum",
"operationType": "max",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ritalwar, Was this an aggregation change to fix some issue?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was intended for the dashboard, as the sum aggregator isn't compatible with counters.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

avg() replaced by max() is understandable. But, sum() replaced by a max(), might change what value is shown by the dashboard panel. Can you re-assess the correctness of the dashboard value following this change?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please create an issue for tracking purpose, if needed.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Agree, we can summarise the change in a top level issue (existing Airlfow TSDB issue also works)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Created this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants