UI for Human in the loop operators

[Lee-W]

Description

According to AIP-90, we'll need the following pages to enable users to respond through the Airflow UI.

1. An input page that allows users to enter

This involves 4 public API

1. GET /api/v2/hitl-details/{dag_id}/{dag_run_id}/{task_id} and GET /api/v2/hitl-details/{dag_id}/{dag_run_id}/{task_id}/{map_index}: get the details to render on the pages (this API should probably also have the information on whether the input-request has been fulfilled)
2. PATCH /api/v2/hitl-details/{dag_id}/{dag_run_id}/{task_id} and PATCH /api/v2/hitl-details/{dag_id}/{dag_run_id}/{task_id}/{map_index}: after users enter data through the form or click the button, this API should be called, and then it should be disabled as we only accept one input.

2. A page that shows tasks waiting for responses

1. GET /api/v2/hitl-details

Use case/motivation

AIP-90

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[Lee-W]

Hey @pierrejeambrun @bbovenzi , would love to know your thoughts on this one. Whether the high-level idea makes sense, and whether there are other backend things missed. Thanks!

[bbovenzi]

I would like to extend our Dashboard and Overview pages for this. One of the first things on our home page dashboard should show the number of tasks that require human input across the whole UI. On a Dag Overview page, it will show the ones just for that dag.

I do like adding the red notification circle on the nav bar though!

Clicking on one should open a modal with a dynamically generated form, exactly how the dag trigger params works today.

Where does the information that a task needs input or had manual input live? Can we easily find it by filtering the list tasks or task instances endpoints?

[Lee-W]

Clicking on one should open a modal with a dynamically generated form, exactly how the dag trigger params works today.

Let me try to play with it. Thanks!

Where does the information that a task needs input or had manual input live? Can we easily find it by filtering the list tasks or task instances endpoints?

It's not yet clear at the moment, but I'll try a bit and get back to you. I think it should be doable 🤔

[guan404ming]

Hi @Lee-W, I've took a look about this AIP and really interested about this new feature. Could I help with building POC of UI part? Thanks!