Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Build a custom EE for faster code deploys #4744

Draft
wants to merge 39 commits into
base: main
Choose a base branch
from
Draft

Build a custom EE for faster code deploys #4744

wants to merge 39 commits into from

Conversation

acozine
Copy link
Contributor

@acozine acozine commented Mar 8, 2024

The EE now builds and a test template runs on it. However, cap deploy still fails, and the problem is with SSH keys. Not sure of the details.

We also need to move the installation of the Capistrano dependencies out of the playbook and into the EE build - this will speed things up too.

@acozine
Copy link
Contributor Author

acozine commented Mar 8, 2024

See https://ansible-tower.princeton.edu/#/jobs/playbook/579/output for more details. If you click on the error message of the failing task, you can see in the Output tab that the connection is not using SSH keys. It's prompting for a password instead: deploy@abid-staging2.princeton.edu's password:.
Note that the pre-existing deploy template still exists and still succeeds - we are only using this custom EE and the playbook changes in a new template.

acozine and others added 22 commits March 11, 2024 11:45
@acozine
use file module instead of shell
fc2d641
@acozine
move installing cap dependencies to the EE
cb6a135
@acozine @kayiwa @VickieKarasic
with a pulsys user maybe we can use the Tower SSH key?
4ce0ca8 
Co-authored-by: Francis Kayiwa <kayiwa@users.noreply.github.com>
Co-authored-by: Vickie Karasic <vickiekarasic@users.noreply.github.com>
@acozine
try specifying the pulsys user
e9290a0
@acozine
add debugging
5f9a229
@acozine
maybe it needs to be the deploy user?
59197d2
@acozine @carolyncole
@christinach @sandbergja @regineheberlein @leefaisonr @maxkadel
trying it without specifying a user
07fb332 
Co-authored-by: Carolyn Cole <carolyncole@users.noreply.github.com>
Co-authored-by: Christina Chortaria <christinach@users.noreply.github.com>
Co-authored-by: Jane Sandberg <sandbergja@users.noreply.github.com>
Co-authored-by: regineheberlein <regineheberlein@users.noreply.github.com>
Co-authored-by: Robert-Anthony Lee-Faison <leefaisonr@users.noreply.github.com>
Co-authored-by: Max Kadel <maxkadel@users.noreply.github.com>
@acozine
try generating SSH keys at runtime
84893a8
@acozine
use the deploy user in the EE and the playbook
1e9b582
@acozine
set owner and group for keypair
761ebd5
@acozine
unix paths, not mac paths
8204541
@acozine @sandbergja
trying to use existing vars to propagate keys
59de7fa 
Co-authored-by: Jane Sandberg <sandbergja@users.noreply.github.com>
@acozine @sandbergja
need the princeton.edu extension
f2bf551 
Co-authored-by: Jane Sandberg <sandbergja@users.noreply.github.com>
@acozine @sandbergja
use the group instead
fa7e51c 
Co-authored-by: Jane Sandberg <sandbergja@users.noreply.github.com>
@acozine @sandbergja
syntax not quite right
8a1e740 
Co-authored-by: Jane Sandberg <sandbergja@users.noreply.github.com>
@acozine @sandbergja
trying multiple plays
b704a8a 
Co-authored-by: Jane Sandberg <sandbergja@users.noreply.github.com>
@acozine @sandbergja
maybe with the pulsys user?
f225866 
Co-authored-by: Jane Sandberg <sandbergja@users.noreply.github.com>
@acozine @sandbergja
hm, missed a bit
7ebd88c 
Co-authored-by: Jane Sandberg <sandbergja@users.noreply.github.com>
@acozine
make the file findable in tmp
112e536
@acozine
move the file, maybe then we can find it?
ae32c7b
@acozine
cap deploy still fails, trying again with become_user deploy
5f78c89
@acozine
still fails, says sudo not found, trying with connection user set to …
8fd9129 
…root
acozine and others added 10 commits June 18, 2024 16:31
@acozine
RHEL uses su not sudo, trying setting the become_method
99c5534
@acozine
fix 'too many args' error by passing the 'cd' part as an ansible param
c4a3048
@acozine
fix 'no such file or directory' by using shell instead of command
dbd0a20
@acozine
move all git and cap stuff into last play, explicitly create a log file
4772284
@acozine
file module does not accept present
7d8bba6
@acozine
Francis knows the file module well
9f798be
@acozine @dphillips-39
@Beck-Davis @kayiwa @VickieKarasic
set mode for the private key
6e9d109 
Co-authored-by: Denzil Phillips <dphillips-39@users.noreply.github.com>
Co-authored-by: Beck Davis <beck-davis@users.noreply.github.com>
Co-authored-by: Francis Kayiwa <kayiwa@users.noreply.github.com>
Co-authored-by: Vickie Karasic <vickiekarasic@users.noreply.github.com>
@acozine @dphillips-39
@Beck-Davis @kayiwa @VickieKarasic
still fails the cap deploy, try ed25519
936db38 
Co-authored-by: Denzil Phillips <dphillips-39@users.noreply.github.com>
Co-authored-by: Beck Davis <beck-davis@users.noreply.github.com>
Co-authored-by: Francis Kayiwa <kayiwa@users.noreply.github.com>
Co-authored-by: Vickie Karasic <vickiekarasic@users.noreply.github.com>
@acozine @dphillips-39
@Beck-Davis @kayiwa @VickieKarasic
try doing the entire play as deploy user
86fe820 
Co-authored-by: Denzil Phillips <dphillips-39@users.noreply.github.com>
Co-authored-by: Beck Davis <beck-davis@users.noreply.github.com>
Co-authored-by: Francis Kayiwa <kayiwa@users.noreply.github.com>
Co-authored-by: Vickie Karasic <vickiekarasic@users.noreply.github.com>
@acozine
maybe I need both remote_user and become_user?
a0684ca
@acozine acozine mentioned this pull request Jul 8, 2024
Closed
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@acozine