Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add hatch_build.py to k8s test venv cache calculation #39473

Merged
merged 1 commit into from
May 7, 2024

Conversation

potiuk
Copy link
Member

@potiuk potiuk commented May 7, 2024

With dynamic project depdencies, the requirements for airlfow are calculated dymamically from hatch_build.py, however cache invalidation key for k8s tests only included pyproject.toml so when colorlog has been bumped in @39453, main build continued to use cache from old colorlog.

This PR adds also hatch_build.py to cache id calculation


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@potiuk potiuk requested review from ashb and kaxil as code owners May 7, 2024 20:36
@potiuk potiuk added the full tests needed We need to run full set of tests for this PR to merge label May 7, 2024
@potiuk potiuk force-pushed the fix-caching-hash-for-k8s-tests branch from 85ae01a to b56d323 Compare May 7, 2024 20:59
@potiuk potiuk requested a review from jedcunningham as a code owner May 7, 2024 20:59
@potiuk
Copy link
Member Author

potiuk commented May 7, 2024

Also added it to breeze check whether to recreate the env or not (it has only consideded k8s_requirements.txt so far).

@potiuk potiuk force-pushed the fix-caching-hash-for-k8s-tests branch from b56d323 to 5c0b058 Compare May 7, 2024 21:15
@potiuk
Copy link
Member Author

potiuk commented May 7, 2024

Actuallly ... we can safely remove pyproject.toml since all our dependencies and extras are dynamic and coming from hatch_build.py

@potiuk
Copy link
Member Author

potiuk commented May 7, 2024

(will avoid unnecessary recreation of envs when only some tool options chane - like ruff rules)

With dynamic project depdencies, the requirements for airlfow are
calculated dymamically from hatch_build.py, however cache invalidation
key for k8s tests only included pyproject.toml so when colorlog has
been bumped in @39453, main build continued to use cache from old
colorlog.

This PR adds also hatch_build.py to cache id calculation
@potiuk potiuk force-pushed the fix-caching-hash-for-k8s-tests branch from 5c0b058 to e5272c2 Compare May 7, 2024 21:20
@potiuk potiuk merged commit f5c86ed into apache:main May 7, 2024
64 checks passed
@potiuk potiuk deleted the fix-caching-hash-for-k8s-tests branch May 7, 2024 22:09
pateash pushed a commit to pateash/airflow that referenced this pull request May 13, 2024
With dynamic project depdencies, the requirements for airlfow are
calculated dymamically from hatch_build.py, however cache invalidation
key for k8s tests only included pyproject.toml so when colorlog has
been bumped in @39453, main build continued to use cache from old
colorlog.

This PR adds also hatch_build.py to cache id calculation
ephraimbuddy pushed a commit that referenced this pull request Jun 5, 2024
With dynamic project depdencies, the requirements for airlfow are
calculated dymamically from hatch_build.py, however cache invalidation
key for k8s tests only included pyproject.toml so when colorlog has
been bumped in @39453, main build continued to use cache from old
colorlog.

This PR adds also hatch_build.py to cache id calculation

(cherry picked from commit f5c86ed)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:dev-tools full tests needed We need to run full set of tests for this PR to merge
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants