Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Packaging][Release] Use Debian/RPM type Artifactory repositories instead of General type Artifactory repository #37350

Open
kou opened this issue Aug 24, 2023 · 3 comments

Comments

@kou
Copy link
Member

kou commented Aug 24, 2023

Describe the enhancement requested

Background

We're using a "General" type Artifactory repository to provide APT/Yum repositories. We generate metadata for APT/Yum repositories' by ourself. Recently, we sometimes get 403 Forbidden errors when we use APT repository in the "general" type Artifactory repository. See also #35292.

INFRA asked JFrog this. See also https://issues.apache.org/jira/browse/INFRA-24569 .
JFrog recommended to migrate to a "Debian" type Artifactory repository. INFRA (not JFrog) also said that "Generic" type Artifactory repository isn't suitable for APT repository.

Compatibility

I already created https://apache.jfrog.io/ui/repos/tree/General/arrow-debian?projectKey=arrow and https://apache.jfrog.io/ui/repos/tree/General/arrow-rpm?projectKey=arrow repositories but I don't do anything yet.

If we use "Debian"/"RPM" type repositories instead of the current "General" type repository, users need to change their configuration. I want to avoid it as much as possible. We're providing apache-arrow-apt-source package for APT repository and apache-arrow-release package for Yum repository. I hope that we can implement a safe migration (users don't need to change anything. users just need to run apt update/dnf update as usual.) by using them.

See also

Component(s)

Packaging, Release

kou added a commit that referenced this issue Aug 25, 2023
### Rationale for this change

If we remove them, users can't use Yum repositories for unsupported distributions such as Amazon Linux 2.

### What changes are included in this PR?

This keeps garbage in repodata/* but we can accept it because we'll migrate to Debian/RPM type repositories eventually. We don't manage repodata/* by ourselves after we migrate to Debian/RPM type repositories.

See also: GH-37350

### Are these changes tested?

No. I hope that this works.

### Are there any user-facing changes?

Yes.
* Closes: #37334

Authored-by: Sutou Kouhei <kou@clear-code.com>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
loicalleyne pushed a commit to loicalleyne/arrow that referenced this issue Nov 13, 2023
…apache#37351)

### Rationale for this change

If we remove them, users can't use Yum repositories for unsupported distributions such as Amazon Linux 2.

### What changes are included in this PR?

This keeps garbage in repodata/* but we can accept it because we'll migrate to Debian/RPM type repositories eventually. We don't manage repodata/* by ourselves after we migrate to Debian/RPM type repositories.

See also: apacheGH-37350

### Are these changes tested?

No. I hope that this works.

### Are there any user-facing changes?

Yes.
* Closes: apache#37334

Authored-by: Sutou Kouhei <kou@clear-code.com>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
@kou
Copy link
Member Author

kou commented Nov 29, 2023

The automated release signing guideline: https://infra.apache.org/release-signing.html#automated-release-signing

@kou
Copy link
Member Author

kou commented Nov 29, 2023

Can we use the default signing key for Debian/RPM Package Type repositories to release "official" artifacts?
https://issues.apache.org/jira/browse/INFRA-25217

@kou
Copy link
Member Author

kou commented Dec 15, 2023

Our build process must be reproducible build. It must be verified by the Apache Security Team.
We need to contact to security@apache.org what we need to do for it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant