Skip to content

Conversation

@potiuk
Copy link
Member

@potiuk potiuk commented Aug 8, 2025


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@boring-cyborg boring-cyborg bot added area:airflow-ctl area:dev-tools area:production-image Production image improvements and fixes backport-to-v3-1-test Mark PR with this label to backport to v3-1-test branch kind:documentation labels Aug 8, 2025
@potiuk potiuk force-pushed the switch-pre-commit-to-prefligit branch from e4992b0 to d0eef21 Compare August 8, 2025 06:59
@gopidesupavan
Copy link
Member

👀 cool :)

@potiuk potiuk force-pushed the switch-pre-commit-to-prefligit branch 2 times, most recently from 8e3d557 to 19f73a8 Compare August 8, 2025 08:29
@potiuk potiuk changed the title Switch pre-commit to prefligit Switch pre-commit to prek Aug 10, 2025
@potiuk potiuk force-pushed the switch-pre-commit-to-prefligit branch 4 times, most recently from 17a5f34 to 5080dfb Compare August 10, 2025 20:39
@potiuk potiuk force-pushed the switch-pre-commit-to-prefligit branch from 5080dfb to b33b234 Compare August 10, 2025 21:33
@potiuk potiuk mentioned this pull request Aug 12, 2025
@potiuk potiuk force-pushed the switch-pre-commit-to-prefligit branch 2 times, most recently from 8a252cb to ed86d67 Compare August 12, 2025 08:45
@ashb
Copy link
Member

ashb commented Aug 12, 2025

j178/prek#440

@potiuk potiuk force-pushed the switch-pre-commit-to-prefligit branch from ed86d67 to 9329928 Compare August 13, 2025 12:00
@potiuk potiuk marked this pull request as ready for review August 13, 2025 12:01
@potiuk potiuk deleted the switch-pre-commit-to-prefligit branch August 17, 2025 07:00
@github-actions
Copy link

Backport failed to create: v3-0-test. View the failure log Run details

Status Branch Result
v3-0-test Commit Link

You can attempt to backport this manually by running:

cherry_picker 3442d81 v3-0-test

This should apply the commit to the v3-0-test branch and leave the commit in conflict state marking
the files that need manual conflict resolution.

After you have resolved the conflicts, you can continue the backport process by running:

cherry_picker --continue

@potiuk
Copy link
Member Author

potiuk commented Aug 17, 2025

Wooohooo.. Merged! ...

potiuk added a commit to potiuk/airflow that referenced this pull request Aug 17, 2025
After switching to prek in apache#54258 there are still few small things
thet were only discovered in our canary builds:

* installation of prek hooks does not necessarily create
  uv cache
* autoupgrade is not yet implemented in prek
potiuk added a commit to potiuk/airflow that referenced this pull request Aug 17, 2025
After switching to prek in apache#54258 there are still few small things
thet were only discovered in our canary builds:

* installation of prek hooks does not necessarily create
  uv cache
* autoupgrade is not yet implemented in prek
potiuk added a commit to potiuk/airflow that referenced this pull request Aug 17, 2025
After switching to prek in apache#54258 there are still few small things
thet were only discovered in our canary builds:

* installation of prek hooks does not necessarily create
  uv cache
* autoupgrade is not yet implemented in prek
potiuk added a commit to potiuk/airflow that referenced this pull request Aug 17, 2025
The pre-commit is a fantastic tool, and we heavily used it for years,
but generally the tool stagnated and is not showing a sign of adapting
to our needs. For years we tried to convince pre-commit maintainers that
things like autocomplete are necessary - but it met with pretty much
resistance (if not hostility) from the maintainer. Also there was no
chance for them to accept expectations of bigger projects like ours,
where we have a huge monorepo and not only multiple needs but also
different parts of the repo needing different language support (golang,
typescript soon) - and apparenty the maintainer of pre-commit does not
think monorepo is a good thing at all. Similarly - they did not recognize
the raise of `uv` and the only way to use `uv` with pre-commit is to patch
it by installing `pre-comit-uv` that essentialy patches pre-commit with
uv support. This is not really sustainable and the tool lags behind many
of our needs.

Luckily - we have new project in town - prek - which rewrites pre-commit
that is 100% compatible (now), 10x faster (because rust), uses `uv`
natively, supports auto-complete already and they have very friendly
maintainer who is not only supporting us but also very happily works
on improving `prek` to close all the gaps, and plans to implement (with
our support of course and cooperation) monorepo support - that will
allow us to modularise our pre-commits.

This PR switches our pre-commit support to use prek exclusively:

* breeze static checks command is completely removed
* custom auto-complete code in breeze as well
* instructions are updated to setup prek instead of precommit
* CI is updated to run prek instead of pre-commmit
* documentation for static checks is reviewed and new features that
  prek enables are added

(cherry picked from commit 3442d81)
potiuk added a commit to potiuk/airflow that referenced this pull request Aug 17, 2025
The pre-commit is a fantastic tool, and we heavily used it for years,
but generally the tool stagnated and is not showing a sign of adapting
to our needs. For years we tried to convince pre-commit maintainers that
things like autocomplete are necessary - but it met with pretty much
resistance (if not hostility) from the maintainer. Also there was no
chance for them to accept expectations of bigger projects like ours,
where we have a huge monorepo and not only multiple needs but also
different parts of the repo needing different language support (golang,
typescript soon) - and apparenty the maintainer of pre-commit does not
think monorepo is a good thing at all. Similarly - they did not recognize
the raise of `uv` and the only way to use `uv` with pre-commit is to patch
it by installing `pre-comit-uv` that essentialy patches pre-commit with
uv support. This is not really sustainable and the tool lags behind many
of our needs.

Luckily - we have new project in town - prek - which rewrites pre-commit
that is 100% compatible (now), 10x faster (because rust), uses `uv`
natively, supports auto-complete already and they have very friendly
maintainer who is not only supporting us but also very happily works
on improving `prek` to close all the gaps, and plans to implement (with
our support of course and cooperation) monorepo support - that will
allow us to modularise our pre-commits.

This PR switches our pre-commit support to use prek exclusively:

* breeze static checks command is completely removed
* custom auto-complete code in breeze as well
* instructions are updated to setup prek instead of precommit
* CI is updated to run prek instead of pre-commmit
* documentation for static checks is reviewed and new features that
  prek enables are added

(cherry picked from commit 3442d81)
potiuk added a commit to potiuk/airflow that referenced this pull request Aug 17, 2025
After switching to prek in apache#54258 there are still few small things
thet were only discovered in our canary builds:

* installation of prek hooks does not necessarily create
  uv cache
* autoupgrade is not yet implemented in prek
potiuk added a commit to potiuk/airflow that referenced this pull request Aug 17, 2025
The pre-commit is a fantastic tool, and we heavily used it for years,
but generally the tool stagnated and is not showing a sign of adapting
to our needs. For years we tried to convince pre-commit maintainers that
things like autocomplete are necessary - but it met with pretty much
resistance (if not hostility) from the maintainer. Also there was no
chance for them to accept expectations of bigger projects like ours,
where we have a huge monorepo and not only multiple needs but also
different parts of the repo needing different language support (golang,
typescript soon) - and apparenty the maintainer of pre-commit does not
think monorepo is a good thing at all. Similarly - they did not recognize
the raise of `uv` and the only way to use `uv` with pre-commit is to patch
it by installing `pre-comit-uv` that essentialy patches pre-commit with
uv support. This is not really sustainable and the tool lags behind many
of our needs.

Luckily - we have new project in town - prek - which rewrites pre-commit
that is 100% compatible (now), 10x faster (because rust), uses `uv`
natively, supports auto-complete already and they have very friendly
maintainer who is not only supporting us but also very happily works
on improving `prek` to close all the gaps, and plans to implement (with
our support of course and cooperation) monorepo support - that will
allow us to modularise our pre-commits.

This PR switches our pre-commit support to use prek exclusively:

* breeze static checks command is completely removed
* custom auto-complete code in breeze as well
* instructions are updated to setup prek instead of precommit
* CI is updated to run prek instead of pre-commmit
* documentation for static checks is reviewed and new features that
  prek enables are added

(cherry picked from commit 3442d81)
potiuk added a commit that referenced this pull request Aug 17, 2025
After switching to prek in #54258 there are still few small things
thet were only discovered in our canary builds:

* installation of prek hooks does not necessarily create
  uv cache
* autoupgrade is not yet implemented in prek
potiuk added a commit that referenced this pull request Aug 17, 2025
The pre-commit is a fantastic tool, and we heavily used it for years,
but generally the tool stagnated and is not showing a sign of adapting
to our needs. For years we tried to convince pre-commit maintainers that
things like autocomplete are necessary - but it met with pretty much
resistance (if not hostility) from the maintainer. Also there was no
chance for them to accept expectations of bigger projects like ours,
where we have a huge monorepo and not only multiple needs but also
different parts of the repo needing different language support (golang,
typescript soon) - and apparenty the maintainer of pre-commit does not
think monorepo is a good thing at all. Similarly - they did not recognize
the raise of `uv` and the only way to use `uv` with pre-commit is to patch
it by installing `pre-comit-uv` that essentialy patches pre-commit with
uv support. This is not really sustainable and the tool lags behind many
of our needs.

Luckily - we have new project in town - prek - which rewrites pre-commit
that is 100% compatible (now), 10x faster (because rust), uses `uv`
natively, supports auto-complete already and they have very friendly
maintainer who is not only supporting us but also very happily works
on improving `prek` to close all the gaps, and plans to implement (with
our support of course and cooperation) monorepo support - that will
allow us to modularise our pre-commits.

This PR switches our pre-commit support to use prek exclusively:

* breeze static checks command is completely removed
* custom auto-complete code in breeze as well
* instructions are updated to setup prek instead of precommit
* CI is updated to run prek instead of pre-commmit
* documentation for static checks is reviewed and new features that
  prek enables are added

(cherry picked from commit 3442d81)
potiuk added a commit to potiuk/airflow that referenced this pull request Aug 17, 2025
After switching to prek in apache#54258 there are still few small things
thet were only discovered in our canary builds:

* installation of prek hooks does not necessarily create
  uv cache
* autoupgrade is not yet implemented in prek
(cherry picked from commit 703af5e)

Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
potiuk added a commit that referenced this pull request Aug 17, 2025
After switching to prek in #54258 there are still few small things
thet were only discovered in our canary builds:

* installation of prek hooks does not necessarily create
  uv cache
* autoupgrade is not yet implemented in prek
(cherry picked from commit 703af5e)
kaxil pushed a commit that referenced this pull request Aug 18, 2025
The pre-commit is a fantastic tool, and we heavily used it for years,
but generally the tool stagnated and is not showing a sign of adapting
to our needs. For years we tried to convince pre-commit maintainers that
things like autocomplete are necessary - but it met with pretty much
resistance (if not hostility) from the maintainer. Also there was no
chance for them to accept expectations of bigger projects like ours,
where we have a huge monorepo and not only multiple needs but also
different parts of the repo needing different language support (golang,
typescript soon) - and apparenty the maintainer of pre-commit does not
think monorepo is a good thing at all. Similarly - they did not recognize
the raise of `uv` and the only way to use `uv` with pre-commit is to patch
it by installing `pre-comit-uv` that essentialy patches pre-commit with
uv support. This is not really sustainable and the tool lags behind many
of our needs.

Luckily - we have new project in town - prek - which rewrites pre-commit
that is 100% compatible (now), 10x faster (because rust), uses `uv`
natively, supports auto-complete already and they have very friendly
maintainer who is not only supporting us but also very happily works
on improving `prek` to close all the gaps, and plans to implement (with
our support of course and cooperation) monorepo support - that will
allow us to modularise our pre-commits.

This PR switches our pre-commit support to use prek exclusively:

* breeze static checks command is completely removed
* custom auto-complete code in breeze as well
* instructions are updated to setup prek instead of precommit
* CI is updated to run prek instead of pre-commmit
* documentation for static checks is reviewed and new features that
  prek enables are added
kaxil pushed a commit that referenced this pull request Aug 18, 2025
After switching to prek in #54258 there are still few small things
thet were only discovered in our canary builds:

* installation of prek hooks does not necessarily create
  uv cache
* autoupgrade is not yet implemented in prek
(cherry picked from commit 703af5e)
potiuk added a commit to potiuk/airflow that referenced this pull request Jan 7, 2026
When we switched to prek in apache#54258, we accidentally missed the
`^` after from ref - which turned the basic checks to do checks on
empty set of changes.
potiuk added a commit that referenced this pull request Jan 7, 2026
When we switched to prek in #54258, we accidentally missed the
`^` after from ref - which turned the basic checks to do checks on
empty set of changes.
potiuk added a commit to potiuk/airflow that referenced this pull request Jan 7, 2026
…che#60202)

When we switched to prek in apache#54258, we accidentally missed the
`^` after from ref - which turned the basic checks to do checks on
empty set of changes.
(cherry picked from commit 898045f)

Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
potiuk added a commit that referenced this pull request Jan 7, 2026
) (#60213)

When we switched to prek in #54258, we accidentally missed the
`^` after from ref - which turned the basic checks to do checks on
empty set of changes.
(cherry picked from commit 898045f)
chirodip98 pushed a commit to chirodip98/airflow-contrib that referenced this pull request Jan 9, 2026
When we switched to prek in apache#54258, we accidentally missed the
`^` after from ref - which turned the basic checks to do checks on
empty set of changes.
stegololz pushed a commit to stegololz/airflow that referenced this pull request Jan 9, 2026
When we switched to prek in apache#54258, we accidentally missed the
`^` after from ref - which turned the basic checks to do checks on
empty set of changes.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:airflow-ctl area:dev-tools area:production-image Production image improvements and fixes backport-to-v3-1-test Mark PR with this label to backport to v3-1-test branch kind:documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants