Cannot upgrade pip on Fedora 38

[akrause2014]

In Fedora, Python packages are packaged in RPMs without RECORD, with rpm in INSTALLER. If a new package is installed via pip and requires a different version from the RPM installed package, pip tries to uninstall the package but this fails.

This is described here: pypa/pip#11631

In Fedora, we currently patch pip to always skip the uninstallation on upgrades when the to-be-unisntalled packages are installed in the /usr prefix. This solves the problem but is utterly Fedora-specific and cannot be upstreamed. The problem is when users use pip to upgrade pip, they lose this patch.

This means that we cannot run pip upgrade because we lose the patch and the packages that are required for the Gaia DMP Zeppelin deployment fail to install.

[Zarquan]

If I'm reading this right, then it is OK to use the fedora package manager to install and update pip

dnf install pip
dnf update pip

using pip to install and update our Python libraries is fine,

gaia-dmp/deployments/hadoop-yarn/ansible/29-install-pip-libs.yml

Lines 77 to 80 in f978640

	- name: Install the required Python packages
	become: true
	pip:
	requirements: "/tmp/requirements.txt"

but we should not use pip to update itself

gaia-dmp/deployments/hadoop-yarn/ansible/29-install-pip-libs.yml

Lines 67 to 69 in f978640

	- name: "Upgrade pip"
	become: true
	command: "pip install --upgrade pip"

all of which is covered by your pending PR #1240 👍 .