Kubernetes version bump

[dirrao]

close: #36678
extension: #36684

[dirrao]

@potiuk
Prod image build failing due to user constraints. How to update the user constraints file and test?

#52 25.79 The conflict is caused by: [7496](https://github.com/apache/airflow/actions/runs/7676485430/job/20924456098?pr=37040#step:7:7567) #52 25.79 apache-airflow-providers-cncf-kubernetes 7.14.0.dev0 depends on kubernetes<=29.0.0 and >=28.1.0 [7497](https://github.com/apache/airflow/actions/runs/7676485430/job/20924456098?pr=37040#step:7:7568) #52 25.79 The user requested (constraint) kubernetes==23.6.0

[hussein-awala]

Close and reopen to run all the tests

[dirrao]

#52 25.79 The conflict is caused by: [7496](https://github.com/apache/airflow/actions/runs/7676485430/job/20924456098?pr=37040#step:7:7567) #52 25.79 apache-airflow-providers-cncf-kubernetes 7.14.0.dev0 depends on kubernetes<=29.0.0 and >=28.1.0 [7497](https://github.com/apache/airflow/actions/runs/7676485430/job/20924456098?pr=37040#step:7:7568) #52 25.79 The user requested (constraint) kubernetes==23.6.0

I am still seeing the same issue.

[potiuk]

The problem was that you manually modified the provider_dependencies.json file and did not modify pyproject.toml (they are both generated from provider.yaml being the single source of truth).

Generally you shoudl only generate provider.yaml and all the rest should be automatically updated via pre-commit (so when you update provider.yaml, both generated/provider_dependencies.json and pyproject.toml are regenerated automatically).

I will add some protection against someone making similar mistake.

[potiuk]

Protection against such manual updates here: #37052

[potiuk]

Seems there are some errors to fix though

[potiuk]

Looks like output of some tests is different than expected with the upgraded client (which is somewhat expected) - either the tests should be fixed or some of the "real" code updated.

FYI @dirrao -> the way how to run k8s tests locally is described here https://github.com/apache/airflow/blob/main/contributing-docs/testing/k8s_tests.rst step-by-step

[potiuk]

You need to rebase and regenerate the deps @dirrao 👍

There is a need to regenerate /home/runner/work/airflow/airflow/generated/provider_dependencies.json
You need to run the following command locally and commit generated generated/provider_dependencies.json file:

breeze static-checks --type update-providers-dependencies --all-files

[potiuk]

Main reason being this:

[dirrao]

@potiuk
I have fixed rest of the issues. Thank you.

[potiuk]

Oh. Fantastic ! Thank you !