Skip to content

Conversation

@ephraimbuddy
Copy link
Contributor

Ensure removed/historical tasks from selected runs are visible in Grid even if they no longer exist in the current DAG version.

We now:

  • Include synthetic leaf nodes for task_ids present in TIs but missing from the serialized DAG in both grid/structure and grid/ti_summaries.
  • Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.

Screenshot 2025-09-25 at 00 40 03

@boring-cyborg boring-cyborg bot added area:API Airflow's REST/HTTP API area:UI Related to UI/UX. For Frontend Developers. labels Sep 24, 2025
@ephraimbuddy ephraimbuddy force-pushed the fix-grid-removed-ti-visibility branch 2 times, most recently from eddaea7 to 9aa8e19 Compare September 25, 2025 07:38
@ephraimbuddy
Copy link
Contributor Author

Here, the entire tasks were renamed and cleared to rerun. Now UI shows complete story of that in grid too
Screenshot 2025-09-25 at 10 07 16

Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
@ephraimbuddy ephraimbuddy force-pushed the fix-grid-removed-ti-visibility branch from 9aa8e19 to f107472 Compare September 30, 2025 12:45
@dstandish
Copy link
Contributor

Just curious, how do we end up with tasks not in serdag now? In airlfow 3 seems should not really be possible?

@pierrejeambrun
Copy link
Member

pierrejeambrun commented Oct 1, 2025

Just curious, how do we end up with tasks not in serdag now? In airlfow 3 seems should not really be possible?

Synthetic nodes based on TI table for the selected run that are not part of the structure anymore ? (we have an entry in the TI table but nothing in no node in the serialized dag structure to match)

@bbovenzi bbovenzi added this to the Airflow 3.1.1 milestone Oct 1, 2025
@bbovenzi bbovenzi added the backport-to-v3-1-test Mark PR with this label to backport to v3-1-test branch label Oct 1, 2025
@bbovenzi bbovenzi merged commit 77fae41 into apache:main Oct 1, 2025
112 checks passed
@bbovenzi bbovenzi deleted the fix-grid-removed-ti-visibility branch October 1, 2025 14:28
github-actions bot pushed a commit that referenced this pull request Oct 1, 2025
…6085)

Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
(cherry picked from commit 77fae41)

Co-authored-by: Ephraim Anierobi <splendidzigy24@gmail.com>
@github-actions
Copy link

github-actions bot commented Oct 1, 2025

Backport successfully created: v3-1-test

Status Branch Result
v3-1-test PR Link

github-actions bot pushed a commit to aws-mwaa/upstream-to-airflow that referenced this pull request Oct 1, 2025
…ache#56085)

Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
(cherry picked from commit 77fae41)

Co-authored-by: Ephraim Anierobi <splendidzigy24@gmail.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 2, 2025
Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 3, 2025
Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 4, 2025
Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 5, 2025
Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 5, 2025
Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 7, 2025
Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 8, 2025
Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
pierrejeambrun pushed a commit that referenced this pull request Oct 8, 2025
…6085)

Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
(cherry picked from commit 77fae41)

Co-authored-by: Ephraim Anierobi <splendidzigy24@gmail.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 9, 2025
Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 10, 2025
Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 11, 2025
Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 12, 2025
Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
dabla pushed a commit to dabla/airflow that referenced this pull request Oct 12, 2025
Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
potiuk pushed a commit that referenced this pull request Oct 13, 2025
…6085)

Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
(cherry picked from commit 77fae41)

Co-authored-by: Ephraim Anierobi <splendidzigy24@gmail.com>
potiuk pushed a commit that referenced this pull request Oct 13, 2025
…6085)

Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
(cherry picked from commit 77fae41)

Co-authored-by: Ephraim Anierobi <splendidzigy24@gmail.com>
pierrejeambrun pushed a commit that referenced this pull request Oct 13, 2025
…6085)

Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
(cherry picked from commit 77fae41)

Co-authored-by: Ephraim Anierobi <splendidzigy24@gmail.com>
pierrejeambrun pushed a commit that referenced this pull request Oct 13, 2025
…6085) (#56297)

Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
(cherry picked from commit 77fae41)

Co-authored-by: Ephraim Anierobi <splendidzigy24@gmail.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 14, 2025
Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 15, 2025
Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 17, 2025
Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 19, 2025
Ensure removed/historical tasks from selected runs are visible in
Grid even if they no longer exist in the current DAG version.

We now:
- Include synthetic leaf nodes for task_ids present in TIs but
missing from the serialized DAG in both grid/structure and grid/ti_summaries.
- Aggregate TI states for these synthetic nodes

Add tests covering structure and TI summaries for removed tasks.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:API Airflow's REST/HTTP API area:UI Related to UI/UX. For Frontend Developers. backport-to-v3-1-test Mark PR with this label to backport to v3-1-test branch

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants