Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert "Add org.osbuild.dmverity stage patch" #3844

Merged
merged 2 commits into from
Aug 13, 2024

Conversation

jlebon
Copy link
Member

@jlebon jlebon commented Aug 12, 2024

This reverts commit 180be1b.

That patch is in the latest osbuild in Fedora now.

This reverts commit 180be1b.

That patch is in the latest osbuild in Fedora now.
@jlebon
Copy link
Member Author

jlebon commented Aug 12, 2024

This should fix CI on this repo.

gursewak1997
gursewak1997 previously approved these changes Aug 12, 2024
Copy link
Member

@gursewak1997 gursewak1997 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

marmijo
marmijo previously approved these changes Aug 12, 2024
@mike-nguyen
Copy link
Member

LGTM!

We will need a backport to rhcos-4.17 since I cut the branch before I saw this PR and it failed building.

@jlebon
Copy link
Member Author

jlebon commented Aug 13, 2024

OK, there's something going on in CI; cosa build seems to be hanging.

@jlebon jlebon dismissed stale reviews from marmijo and gursewak1997 via 6af7e07 August 13, 2024 14:54
@jlebon
Copy link
Member Author

jlebon commented Aug 13, 2024

Added a commit there which hopefully should fix CI.

@jlebon jlebon marked this pull request as draft August 13, 2024 15:30
auto-merge was automatically disabled August 13, 2024 15:30

Pull request was converted to draft

@jlebon
Copy link
Member Author

jlebon commented Aug 13, 2024

Hmm, looks like rpm-ostree is leaking a bunch of rofiles-fuse processes.

This started happening in CI:

```
+ mount -o remount,ro /srv/cache
mount: /srv/cache: mount point is busy.
       dmesg(1) may have more information after failed mount system call.
[  321.026584] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00002000
```

Digging into it, it seems to be due to leftover rofiles-fuse mounts:

```
+ ps aux
...
root       306  0.0  0.1 401092  3972 ?        Ssl  15:46   0:00 rofiles-fuse --copyup usr /tmp/rpmostree-rofiles-fuse0QroLi
root       311  0.0  0.1 251564  2488 ?        Ssl  15:46   0:00 rofiles-fuse --copyup etc /tmp/rpmostree-rofiles-fuseANAAgx
root       330  0.0  0.2 474828  4120 ?        Ssl  15:46   0:00 rofiles-fuse --copyup usr /tmp/rpmostree-rofiles-fuseioSZ7r
root       334  0.0  0.1 251564  2712 ?        Ssl  15:46   0:00 rofiles-fuse --copyup etc /tmp/rpmostree-rofiles-fusePPGBR9
...
```

For some reason, rpm-ostree is not able to unmount those.

We should dig into this but as a brutal workaround, just kill them
manually. There's no data loss concerns here; the commit has already
been written and shipped out via virtiofs.

The issue remains tracked at
coreos#3848.
@jlebon jlebon marked this pull request as ready for review August 13, 2024 19:42
@jlebon
Copy link
Member Author

jlebon commented Aug 13, 2024

OK, added a brutal workaround for this for now to unblock CI.

Copy link
Member

@gursewak1997 gursewak1997 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Workaround looks sane with the attempt to kill all rofiles-fuse processes while ensuring that the script doesn't fail if there are no such processes to kill.
Tentative lgtm as I probably don't know all possible implications of it:)

@jlebon jlebon enabled auto-merge (rebase) August 13, 2024 20:59
@jlebon jlebon merged commit ba45b29 into coreos:main Aug 13, 2024
5 checks passed
@jlebon jlebon deleted the pr/unpatch-osbuild branch August 13, 2024 21:54
@mike-nguyen
Copy link
Member

/cherrypick rhcos-4.17

@openshift-cherrypick-robot

@mike-nguyen: new pull request created: #3849

In response to this:

/cherrypick rhcos-4.17

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants