Install python from source again #53150
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Builds python from source, also installs golang from official distribution. Does both of these for the ci image only.
Adds support for using the airflow api to fetch the newest python patch version available for specific major_minor pair
Updated python fetch request during upgrade to use github token and fixed the regex
Adds python version from global consts into build args now for the docker ci.
aritra24
requested review from
amoghrajesh,
ashb,
gopidesupavan,
jedcunningham and
potiuk
as code owners
boring-cyborg
bot
added
area:dev-tools
backport-to-v3-1-test
potiuk
added
all versions
Member
|
added labels - you can rebase it now to rebuild. |
Collaborator
Author
|
There's some build failure. Looks like some dependency might be missing. I'll look into it later today |
Member
|
Yeah. 3.11 seems to needs "more" to be built :) |
Collaborator
Author
|
@potiuk I think we'll need to increase the time to build the images by a little bit. I think they took about 13 minutes for the longest one... We can increase it to about 14 or 15 minutes as the limit? What do you think? |
Member
Oh absolutely - 15 minutes should be fine. This test is mostly to check if we are not getting into "backtracking" issue. |
potiuk
approved these changes
Jul 11, 2025
Member
|
Just a small mypy issue (fixed in #53191) . But it looks really cool. I tested it locally and got different python versions images. All looks perfect! |
Backport failed to create: v3-0-test. View the failure log Run details
You can attempt to backport this manually by running: cherry_picker 5aec2d5 v3-0-testThis should apply the commit to the v3-0-test branch and leave the commit in conflict state marking After you have resolved the conflicts, you can continue the backport process by running: cherry_picker --continue |
ashb
reviewed
Jul 11, 2025
potiuk
pushed a commit
to potiuk/airflow
that referenced
this pull request
Jul 11, 2025
* Draft: Build python from source Builds python from source, also installs golang from official distribution. Does both of these for the ci image only. * Updates path * Adds version upgrade check for python version Adds support for using the airflow api to fetch the newest python patch version available for specific major_minor pair * Updated to use args in dockerfile for python * Added support for golang upgrade * Fixed go version sorting in pre_commit install * Added github token usage and fixed version regex Updated python fetch request during upgrade to use github token and fixed the regex * Updated dockerfile.ci file * Added support for multiple python versions Adds python version from global consts into build args now for the docker ci. * Updated python install * Increases timeout for ci image build (cherry picked from commit 5aec2d5)
potiuk
pushed a commit
to potiuk/airflow
that referenced
this pull request
Jul 11, 2025
* Draft: Build python from source Builds python from source, also installs golang from official distribution. Does both of these for the ci image only. * Updates path * Adds version upgrade check for python version Adds support for using the airflow api to fetch the newest python patch version available for specific major_minor pair * Updated to use args in dockerfile for python * Added support for golang upgrade * Fixed go version sorting in pre_commit install * Added github token usage and fixed version regex Updated python fetch request during upgrade to use github token and fixed the regex * Updated dockerfile.ci file * Added support for multiple python versions Adds python version from global consts into build args now for the docker ci. * Updated python install * Increases timeout for ci image build (cherry picked from commit 5aec2d5)
potiuk
added a commit
that referenced
this pull request
Jul 12, 2025
* Draft: Build python from source Builds python from source, also installs golang from official distribution. Does both of these for the ci image only. * Updates path * Adds version upgrade check for python version Adds support for using the airflow api to fetch the newest python patch version available for specific major_minor pair * Updated to use args in dockerfile for python * Added support for golang upgrade * Fixed go version sorting in pre_commit install * Added github token usage and fixed version regex Updated python fetch request during upgrade to use github token and fixed the regex * Updated dockerfile.ci file * Added support for multiple python versions Adds python version from global consts into build args now for the docker ci. * Updated python install * Increases timeout for ci image build (cherry picked from commit 5aec2d5) Co-authored-by: Aritra Basu <24430013+aritra24@users.noreply.github.com>
stephen-bracken
pushed a commit
to stephen-bracken/airflow
that referenced
this pull request
Jul 15, 2025
* Draft: Build python from source Builds python from source, also installs golang from official distribution. Does both of these for the ci image only. * Updates path * Adds version upgrade check for python version Adds support for using the airflow api to fetch the newest python patch version available for specific major_minor pair * Updated to use args in dockerfile for python * Added support for golang upgrade * Fixed go version sorting in pre_commit install * Added github token usage and fixed version regex Updated python fetch request during upgrade to use github token and fixed the regex * Updated dockerfile.ci file * Added support for multiple python versions Adds python version from global consts into build args now for the docker ci. * Updated python install * Increases timeout for ci image build
2 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
closes: #52106
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named
{pr_number}.significant.rstor{issue_number}.significant.rst, in airflow-core/newsfragments.