Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates to ssh howto guide #61

Closed
sfmig opened this issue Jun 26, 2024 · 4 comments · Fixed by #64
Closed

Updates to ssh howto guide #61

sfmig opened this issue Jun 26, 2024 · 4 comments · Fixed by #64
Labels
enhancement New feature or request

Comments

@sfmig
Copy link
Collaborator

sfmig commented Jun 26, 2024

Is your feature request related to a problem? Please describe.
@niksirbi advised on some improvements to the ssh guide, quotes below:

  1. I think we should advice people to skip the bastion node if they are within the SWC network already (e.g.. they have managed machines).
  2. We should also urge people to always start an interactive job, even for "small" tasks, like creating conda environments.
  3. Lastly, maybe we should get rid of the section on VSCode remote access? I think that may cause more harm than good.

Also potentially update the guide to take into account Richard's message:

We have found that the Remote SSH function of Visual Studio is causing these problems by
creating huge server-side loads. This has been affecting many HPC sites across the world
particularly in the last few months.

If you are using Visual Studio, please be sure to disable all extensions which are not
required on the server side. In particular, you must disable TypeScript and Javascript
Language Services in Visual Studio Code:
• Extensions button in VS Code (left toolbar)
• Search for ‘@Builtin TypeScript’.
• Disable the TypeScript and Javascript Language Features extension
• Reload
Further documentation :- https://code.visualstudio.com/docs/remote/ssh

Describe the solution you'd like
\

Describe alternatives you've considered
\

Additional context
\

@sfmig sfmig added the enhancement New feature or request label Jun 26, 2024
@lauraporta
Copy link
Member

lauraporta commented Jul 1, 2024

Thanks both Niko and Sofia for rising this issue.
Commenting on the improvements proposed:

  1. Agree
  2. Makes total sense. Maybe we could have a simple template for a environment creation job.
  3. Seems reasonable, although reinforcing the requirement of disabling the extensions (as Richard suggested) could be enough. How much are we (and other people in swc) ssh-ing with vscode for development necessities? It might be that this functionality solves common troubleshooting problems. I am using OOD virtual desktop on a dedicated node whenever I have similar needs.

@niksirbi
Copy link
Member

niksirbi commented Jul 9, 2024

2. Makes total sense. Maybe we could have a simple template for a environment creation job.

good idea, we could include the example commands for that.

3. Seems reasonable, although reinforcing the requirement of disabling the extensions (as Richard suggested) could be enough. How much are we (and other people in swc) ssh-ing with vscode for development necessities? It might be that this functionality solves common troubleshooting problems. I am using OOD virtual desktop on a dedicated node whenever I have similar needs.

I think the problem is that our current instructions lead to running jobs on bastion/gateway nodes, as noted by Pierre here: #62. Even if people have the correct VSCode settings, it's not a practice we should encourage. I think OOD is probably a much better solution for remote development.

@sfmig
Copy link
Collaborator Author

sfmig commented Jul 9, 2024

Should we discard VSCode altogether?

My common way of working lately is to ssh to the cluster (hpc-gw1) via VScode and submit batch jobs or request interactive nodes from there. What is wrong with this approach?

Compared to a regular terminal, I find it very convenient for submitting jobs (interactive or batch) to have a terminal and a view of the file tree at the same time. Also many people are familiar with VSCode already, which lowers the entry barriers to the cluster.

Isn't it a bit excessive to actively discourage VScode because of the risk of someone sshing to a compute node? Shouldn't that be prevented in some other way? Or am I missing something?

@niksirbi
Copy link
Member

niksirbi commented Jul 9, 2024

I agree with you that developing exactly in the way you describe is very useful, and I've used the same workflow several times. I'd like to preserve that way of working for me and others, but we have to make sure that our guide reflects best practice and we don't inadvertently over-burden hpc-gw1.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants