Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add task context logging feature to allow forwarding messages to task logs #32646

Merged
merged 44 commits into from
Nov 17, 2023
Merged

Add task context logging feature to allow forwarding messages to task logs #32646

merged 44 commits into from
Nov 17, 2023

Commits on Jul 19, 2023

  1. Add arbitrary log shipper

    @pankajkoti
    pankajkoti committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    001372b View commit details
    Browse the repository at this point in the history

  2. Address first set of review comments

    @pankajkoti
    pankajkoti committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    bccb93e View commit details
    Browse the repository at this point in the history

  3. Address second set of comments

    @pankajkoti
    pankajkoti committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    a313337 View commit details
    Browse the repository at this point in the history

  4. Add tests

    @pankajkoti
    pankajkoti committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    22d6c33 View commit details
    Browse the repository at this point in the history

  5. Fix mypy failures

    @pankajkoti
    pankajkoti committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    55846d6 View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2023

  1. Merge branch 'main' into arbitrary-log-shipper

    @pankajkoti
    pankajkoti authored Jul 24, 2023
    Configuration menu
    Copy the full SHA
    8425a2d View commit details
    Browse the repository at this point in the history

  2. Update airflow/config_templates/default_airflow.cfg

    @pankajkoti
    pankajkoti authored Jul 24, 2023
    Configuration menu
    Copy the full SHA
    ea13b23 View commit details
    Browse the repository at this point in the history

  3. Address @uranusjr's comments

    @pankajkoti
    pankajkoti committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    24dfadf View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into arbitrary-log-shipper

    @pankajkoti
    pankajkoti authored Jul 24, 2023
    Configuration menu
    Copy the full SHA
    b416abb View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. Address @hussein-awala's comments

    @pankajkoti
    pankajkoti committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    c77d70a View commit details
    Browse the repository at this point in the history

  2. Ignore type override for redis provider log handler's set_context

    @pankajkoti
    pankajkoti committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    828ab5e View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into arbitrary-log-shipper

    @pankajkoti
    pankajkoti authored Jul 25, 2023
    Configuration menu
    Copy the full SHA
    81da99b View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2023

  1. Remove type ignore by accepting **kwargs

    @pankajkoti
    pankajkoti committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    2e02e13 View commit details
    Browse the repository at this point in the history

  2. Expose log like methods

    @pankajkoti
    pankajkoti committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    652ffce View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2023

  1. Update airflow/utils/log/file_task_handler.py 

    Co-authored-by: Niko Oliveira <onikolas@amazon.com>
    @pankajkoti @o-nikolas
    pankajkoti and o-nikolas authored Jul 28, 2023
    Configuration menu
    Copy the full SHA
    abd7c3f View commit details
    Browse the repository at this point in the history

  2. Revert renaming of ti->ti_or_ti_key in _render_filename()

    @pankajkoti
    pankajkoti committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    d58c36c View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into arbitrary-log-shipper

    @pankajkoti
    pankajkoti authored Jul 28, 2023
    Configuration menu
    Copy the full SHA
    0846479 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2023

  1. Address review comments

    @pankajkoti
    pankajkoti committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    04856aa View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2023

  1. Merge branch 'main' into arbitrary-log-shipper

    @pankajkoti
    pankajkoti authored Sep 1, 2023
    Configuration menu
    Copy the full SHA
    2dda898 View commit details
    Browse the repository at this point in the history

  2. Update airflow/utils/log/task_context_logger.py

    @pankajkoti
    pankajkoti authored Sep 1, 2023
    Configuration menu
    Copy the full SHA
    0cef6d0 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2023

  1. Merge branch 'main' into arbitrary-log-shipper

    @pankajkoti
    pankajkoti authored Nov 14, 2023
    Configuration menu
    Copy the full SHA
    6c53958 View commit details
    Browse the repository at this point in the history

  2. make signature of _log consistent with stdlib

    @dstandish
    dstandish committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    aa82275 View commit details
    Browse the repository at this point in the history

  3. don't add class method get_from_key

    @dstandish
    dstandish committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    ad18098 View commit details
    Browse the repository at this point in the history

  4. improve ti not found message

    @dstandish
    dstandish committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    188a606 View commit details
    Browse the repository at this point in the history

  5. simplify

    @dstandish
    dstandish committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    6c74515 View commit details
    Browse the repository at this point in the history

  6. docstring

    @dstandish
    dstandish committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    7b598b8 View commit details
    Browse the repository at this point in the history

  7. config doc

    @dstandish
    dstandish committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    07e14db View commit details
    Browse the repository at this point in the history

  8. fix caller logger ref

    @dstandish
    dstandish committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    98fcd3b View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2023

  1. fix caller logger ref

    @dstandish
    dstandish committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    4aba065 View commit details
    Browse the repository at this point in the history

  2. move call site logger to init

    @dstandish
    dstandish committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    c6adb63 View commit details
    Browse the repository at this point in the history

  3. make signature uniform

    @dstandish
    dstandish committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    12678f2 View commit details
    Browse the repository at this point in the history

  4. Revert "make signature uniform" 

    This reverts commit 12678f2.
    @dstandish
    dstandish committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    e4c0fe6 View commit details
    Browse the repository at this point in the history

  5. Rename method should_log -> should_log_to_task_context

    @pankajkoti
    pankajkoti committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    6bd7d27 View commit details
    Browse the repository at this point in the history

  6. rename should_log_to_task_context to enabled

    @dstandish
    dstandish committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    ab7a644 View commit details
    Browse the repository at this point in the history

  7. fix static check

    @dstandish
    dstandish committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    c7f5463 View commit details
    Browse the repository at this point in the history

  8. fix test

    @dstandish
    dstandish committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    12a086a View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2023

  1. fix test

    @dstandish
    dstandish committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    8ca79f7 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into arbitrary-log-shipper

    @pankajkoti
    pankajkoti authored Nov 16, 2023
    Configuration menu
    Copy the full SHA
    266077a View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into arbitrary-log-shipper

    @pankajkoti
    pankajkoti authored Nov 16, 2023
    Configuration menu
    Copy the full SHA
    594be63 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into arbitrary-log-shipper

    @pankajkoti
    pankajkoti authored Nov 16, 2023
    Configuration menu
    Copy the full SHA
    0ef2acd View commit details
    Browse the repository at this point in the history

  5. fix test

    @dstandish
    dstandish committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    1a6fa7a View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into arbitrary-log-shipper

    @pankajkoti
    pankajkoti authored Nov 16, 2023
    Configuration menu
    Copy the full SHA
    f4cd69e View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2023

  1. Merge branch 'main' into arbitrary-log-shipper

    @dstandish
    dstandish authored Nov 17, 2023
    Configuration menu
    Copy the full SHA
    e356cd1 View commit details
    Browse the repository at this point in the history

  2. Remove test log

    @pankajkoti
    pankajkoti committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    e7ac5d9 View commit details
    Browse the repository at this point in the history