Flaky models/test_cleartasks.py::TestClearTasks::test_dags_clear

[potiuk]

We started to experience a flaky test recently:

FAILED airflow-core/tests/unit/models/test_cleartasks.py::TestClearTasks::test_dags_clear - Failed: Timeout >60.0s

for example https://github.com/apache/airflow/actions/runs/20194148497/job/57975964412#step:8:2640

================================================================================================ FAILURES ================================================================================================
_____________________________________________________________________________________ TestClearTasks.test_dags_clear _____________________________________________________________________________________
airflow-core/tests/unit/models/test_cleartasks.py:646: in test_dags_clear
    ti.run(session=session)
airflow-core/src/airflow/utils/session.py:98: in wrapper
    return func(*args, **kwargs)
airflow-core/src/airflow/models/taskinstance.py:1523: in run
    self._run_raw_task(mark_success=mark_success)
airflow-core/src/airflow/utils/session.py:100: in wrapper
    return func(*args, session=session, **kwargs)  # type: ignore[arg-type]
airflow-core/src/airflow/models/taskinstance.py:1301: in _run_raw_task
    taskrun_result = _run_task(ti=self, task=self.task)  # type: ignore[arg-type]
task-sdk/src/airflow/sdk/definitions/dag.py:1423: in _run_task
    taskrun_result = run_task_in_process(ti=task_sdk_ti, task=task)
task-sdk/src/airflow/sdk/execution_time/supervisor.py:1745: in run_task_in_process
    return InProcessTestSupervisor.start(what=ti, task=task)
task-sdk/src/airflow/sdk/execution_time/supervisor.py:1620: in start
    ti_context = supervisor.client.task_instances.start(supervisor.id, supervisor.pid, start_date)
task-sdk/src/airflow/sdk/api/client.py:217: in start
    resp = self.client.patch(f"task-instances/{id}/run", content=body.model_dump_json())
/usr/python/lib/python3.10/site-packages/httpx/_client.py:1218: in patch
    return self.request(
task-sdk/src/airflow/sdk/execution_time/supervisor.py:1538: in request
    return super().request.__wrapped__(self, *args, **kwargs)  # type: ignore[attr-defined]
task-sdk/src/airflow/sdk/api/client.py:920: in request
    return super().request(*args, **kwargs)
/usr/python/lib/python3.10/site-packages/httpx/_client.py:825: in request
    return self.send(request, auth=auth, follow_redirects=follow_redirects)
/usr/python/lib/python3.10/site-packages/httpx/_client.py:914: in send
    response = self._send_handling_auth(
/usr/python/lib/python3.10/site-packages/httpx/_client.py:942: in _send_handling_auth
    response = self._send_handling_redirects(
/usr/python/lib/python3.10/site-packages/httpx/_client.py:979: in _send_handling_redirects
    response = self._send_single_request(request)
/usr/python/lib/python3.10/site-packages/httpx/_client.py:1014: in _send_single_request
    response = transport.handle_request(request)
/usr/python/lib/python3.10/site-packages/httpx/_transports/wsgi.py:136: in handle_request
    stream = WSGIByteStream(result)
/usr/python/lib/python3.10/site-packages/httpx/_transports/wsgi.py:33: in __init__
    self._result = _skip_leading_empty_chunks(result)
/usr/python/lib/python3.10/site-packages/httpx/_transports/wsgi.py:24: in _skip_leading_empty_chunks
    for chunk in body:
/usr/python/lib/python3.10/site-packages/a2wsgi/asgi.py:225: in __call__
    asgi_task = self.execute_in_loop(self.start_asgi_app(environ))
/usr/python/lib/python3.10/site-packages/a2wsgi/asgi.py:214: in execute_in_loop
    return asyncio.run_coroutine_threadsafe(coro, self.loop).result()
/usr/python/lib/python3.10/concurrent/futures/_base.py:453: in result
    self._condition.wait(timeout)
/usr/python/lib/python3.10/threading.py:320: in wait
    waiter.acquire()
E   Failed: Timeout >60.0s

[henry3260]

I am happy to work on this :).

[potiuk]

Looks like this is still there. in the form of timeouts on the whole run.

[potiuk]

This was likely simply coincidence with aiosqlite 0.22.0 release -> see #59406