-
Notifications
You must be signed in to change notification settings - Fork 14.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
openlineage: add config to include 'full' task info based on conf setting #40589
Conversation
c8926f5
to
d1295e3
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Left some minor comments. LGTM overall
d1295e3
to
b222f16
Compare
…ting Signed-off-by: Maciej Obuchowski <obuchowski.maciej@gmail.com>
b222f16
to
aa1e41f
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
A few minor nits, feel free to accept or reject them.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Approved in advance assuming Jed's feedback would be addressed
Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com>
Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com>
Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com>
…ting (apache#40589) * openlineage: add config to include 'full' task info based on conf setting Signed-off-by: Maciej Obuchowski <obuchowski.maciej@gmail.com> * Update docs/apache-airflow-providers-openlineage/guides/user.rst Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com> * Update docs/apache-airflow-providers-openlineage/guides/user.rst Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com> * Update docs/apache-airflow-providers-openlineage/guides/user.rst Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com> --------- Signed-off-by: Maciej Obuchowski <obuchowski.maciej@gmail.com> Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com>
After https://github.com/apache/airflow/pull/38264/files we got feedback that some people benefit from additional data - especially operator-specific ones, and aren't concerned with huge event size.
This PR adds way to enable that behavior - turned off by default.