Skip to content

Conversation

@jscheffl
Copy link
Contributor

As of failed canary in https://github.com/apache/airflow/actions/runs/15233855670 and https://github.com/apache/airflow/actions/runs/15235553931 it seems Pypi.org is blocking requests w/o proper user agent.

This PR adds a user agent to all Python script calls. With this you get HTTP 200, else if this is missing HTTP 406.

@jscheffl jscheffl requested a review from potiuk as a code owner May 25, 2025 08:35
@jscheffl jscheffl added the full tests needed We need to run full set of tests for this PR to merge label May 25, 2025
@jscheffl jscheffl added the all versions If set, the CI build will be forced to use all versions of Python/K8S/DBs label May 25, 2025
@boring-cyborg boring-cyborg bot added area:dev-tools area:docker-tests area:production-image Production image improvements and fixes labels May 25, 2025
@jscheffl jscheffl added backport-to-v3-1-test Mark PR with this label to backport to v3-1-test branch backport-to-v2-11-test Mark PR with this label to backport to v2-11-test branch labels May 25, 2025
Copy link
Member

@gopidesupavan gopidesupavan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks..

@jscheffl jscheffl mentioned this pull request May 25, 2025
@jscheffl jscheffl merged commit eb7c346 into apache:main May 25, 2025
177 checks passed
@github-actions
Copy link

Backport failed to create: v3-0-test. View the failure log Run details

Status Branch Result
v3-0-test Commit Link

You can attempt to backport this manually by running:

cherry_picker eb7c346 v3-0-test

This should apply the commit to the v3-0-test branch and leave the commit in conflict state marking
the files that need manual conflict resolution.

After you have resolved the conflicts, you can continue the backport process by running:

cherry_picker --continue

@github-actions
Copy link

Backport failed to create: v2-11-test. View the failure log Run details

Status Branch Result
v2-11-test Commit Link

You can attempt to backport this manually by running:

cherry_picker eb7c346 v2-11-test

This should apply the commit to the v2-11-test branch and leave the commit in conflict state marking
the files that need manual conflict resolution.

After you have resolved the conflicts, you can continue the backport process by running:

cherry_picker --continue

jscheffl added a commit to jscheffl/airflow that referenced this pull request May 25, 2025
* Fix version check from Pypi, requires user agent else raises HTTP 406

* Fix version check from Pypi, requires user agent else raises HTTP 406, also other cases in codebase
(cherry picked from commit eb7c346)

Co-authored-by: Jens Scheffler <95105677+jscheffl@users.noreply.github.com>
jscheffl added a commit to jscheffl/airflow that referenced this pull request May 25, 2025
… Fix version check from Pypi, requires user agent else raises HTTP 406\n\n* Fix version check from Pypi, requires user agent else raises HTTP 406, also other cases in codebase\n(cherry picked from commit eb7c346)\n\nCo-authored-by: Jens Scheffler <95105677+jscheffl@users.noreply.github.com>
jscheffl added a commit that referenced this pull request May 25, 2025
* Fix version check from Pypi, requires user agent else raises HTTP 406

* Fix version check from Pypi, requires user agent else raises HTTP 406, also other cases in codebase
(cherry picked from commit eb7c346)
jscheffl added a commit that referenced this pull request May 25, 2025
…ersion check from Pypi, requires user agent else raises HTTP 406\n\n* Fix version check from Pypi, requires user agent else raises HTTP 406, also other cases in codebase\n(cherry picked from commit eb7c346)\n\nCo-authored-by: Jens Scheffler <95105677+jscheffl@users.noreply.github.com> (#51045)
dadonnelly316 pushed a commit to dadonnelly316/airflow that referenced this pull request May 26, 2025
* Fix version check from Pypi, requires user agent else raises HTTP 406

* Fix version check from Pypi, requires user agent else raises HTTP 406, also other cases in codebase
kaxil pushed a commit that referenced this pull request Jun 3, 2025
* Fix version check from Pypi, requires user agent else raises HTTP 406

* Fix version check from Pypi, requires user agent else raises HTTP 406, also other cases in codebase
(cherry picked from commit eb7c346)
sanederchik pushed a commit to sanederchik/airflow that referenced this pull request Jun 7, 2025
* Fix version check from Pypi, requires user agent else raises HTTP 406

* Fix version check from Pypi, requires user agent else raises HTTP 406, also other cases in codebase
@jscheffl jscheffl deleted the bugfix/fix-latest-pypi-version-check branch October 5, 2025 07:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

all versions If set, the CI build will be forced to use all versions of Python/K8S/DBs area:dev-tools area:docker-tests area:production-image Production image improvements and fixes backport-to-v2-11-test Mark PR with this label to backport to v2-11-test branch backport-to-v3-1-test Mark PR with this label to backport to v3-1-test branch full tests needed We need to run full set of tests for this PR to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants