Skip to content

Commit

Permalink
Much smaller CI output for paralell tests
Browse files Browse the repository at this point in the history
The output of parallel tests especially for lowest-direct tests
is very long because we are printing state every 10 seconds and there
are many paralell test types (90+ for lowest direct). We do not need
to print progress that often, and it has already been added in apache#39946
but one place to add it was missing - context manager still had
the default 10 seconds refresh time.

After this change the output will be printed every 20 seconds in
the regular tests and every 2 minutes in "lowest-direct" tests
(controlled by env variable) so the output should be much easier
to find reasons for issues.
  • Loading branch information
potiuk committed Jun 12, 2024
1 parent 89b32e6 commit f07d1b2
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion dev/breeze/src/airflow_breeze/utils/parallel.py
Original file line number Diff line number Diff line change
Expand Up @@ -463,7 +463,7 @@ def run_with_pool(
parallelism: int,
all_params: list[str],
initial_time_in_seconds: int = 2,
time_in_seconds: int = 10,
time_in_seconds: int = int(os.environ.get("AIRFLOW_MONITOR_DELAY_TIME_IN_SECONDS", "20")),
debug_resources: bool = False,
progress_matcher: AbstractProgressInfoMatcher | None = None,
) -> Generator[tuple[Pool, list[Output]], None, None]:
Expand Down

0 comments on commit f07d1b2

Please sign in to comment.