Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: staging-test-with-rebase timeout at "Perform safe upgrade" stage #4901

Open
eloquence opened this issue Oct 10, 2019 · 2 comments
Open

Comments

@eloquence
Copy link
Member

Example:
https://circleci.com/gh/freedomofpress/securedrop/35421#build-timing

Related:
#4740

Output excerpt:


    TASK [common : Check whether tor will be upgraded.] ****************************
    ok: [app-staging]
    ok: [mon-staging]
    
    TASK [common : Perform safe upgrade to ensure all the packages are updated.] ***
    changed: [mon-staging]
make: *** [ci-go] Terminated
Warning: Permanently added '35.247.62.205' (ECDSA) to the list of known hosts.

Too long with no output (exceeded 35m0s)
@emkll
Copy link
Contributor

emkll commented Oct 10, 2019

Also related to #4743

@conorsch
Copy link
Contributor

conorsch commented Jul 7, 2020

We have several CI issues reporting "Too long with no output" (see yet another report in #5224 (comment)). First let's get the new CI image in #5360 merged. While I don't expect that to address the root cause of whatever's causing output to break here, the newer package versions may stabilize the runs somewhat.

Regarding the "no output" timeouts, would allocating a tty help? We could add-tt to the call at

SSH_OPTS=(-i "$SSH_PRIVKEY" -o "StrictHostKeyChecking=no" -o "UserKnownHostsFile=/dev/null")
That should prevent the ssh output from buffering, which potentially is one reason why we see the timeouts. Why it only happens sometimes, though, I can't say.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants