Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make elastic search index_pattern more configurable #38423

Merged
merged 4 commits into from
May 22, 2024

Conversation

pankajastro
Copy link
Member

closes: #37999


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@pankajastro pankajastro force-pushed the es_index_pattern_config branch 2 times, most recently from 534e7da to 456f585 Compare April 8, 2024 11:49
@pankajastro pankajastro marked this pull request as ready for review April 10, 2024 05:29
@pankajastro pankajastro force-pushed the es_index_pattern_config branch 3 times, most recently from edf0af0 to aa882fc Compare April 21, 2024 16:54
Copy link
Member

@pankajkoti pankajkoti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Also, @pankajastro and I tested that the existing remote logging setup works fine and is able to fetch logs & show them up in the task logs

@pankajastro pankajastro merged commit 9845e22 into apache:main May 22, 2024
41 checks passed
@pankajastro pankajastro deleted the es_index_pattern_config branch May 22, 2024 19:24
RNHTTR pushed a commit to RNHTTR/airflow that referenced this pull request Jun 1, 2024
* Make elastic search index_pattern more configurable
romsharon98 pushed a commit to romsharon98/airflow that referenced this pull request Jul 26, 2024
* Make elastic search index_pattern more configurable
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

ElasticSearch task_log_handler wide scope index filters causing overload of ES cluster
7 participants