Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for CryoSPARC #1416

Open
wants to merge 17 commits into
base: main
Choose a base branch
from
Open

Add support for CryoSPARC #1416

wants to merge 17 commits into from

Conversation

vanzod
Copy link
Contributor

@vanzod vanzod commented Mar 10, 2023

Provide option in config.yml to install and setup CryoSPARC on top of Slurm cluster.

CryoSPARC master/worker architecture is implemented by deploying the master node as cluster login node and workload submitted to CycleCloud Slurm scheduler. CryoSPARC installation and configuration is performed via dedicated CycleCloud project. Multiple Slurm partitions can be configured as CryoSPARC lanes with the applications.target_queues variable.

Due to hardcoded absolute paths in CryoSPARC code the portal is not reachable through the OOD proxy. Until a suitable OOD feature is available (OSC/ondemand#2311), CryoSPARC portal is accessible in Az-HOP from a Linux interactive session. An XFCE application menu shortcut is added in Education -> CryoSPARC.

// MariaDB
AllowMariaDBIn : ['700', 'Inbound', 'Allow', 'Tcp', 'MariaDB', 'asg', 'asg-mariadb-client', 'subnet', 'admin']

// Cluster applications
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would try to make this generic.

{% endfor %}

{% if cryosparc_enabled %}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This for me is too application specific and we can't do this for every app. This could be solved by having single node definition, on which we could specify which cluster-init project to add

@samkleeman1
Copy link

Hi - what is the status of this. We would be interested to use az-hop for cryosparc deployment

line 138 has an extra `{% endif % }` that causes failure during configuration
* Update slurm_cluster_info.json

updated `worker_bin_path` to match install path

* Update 03-install_cryosparc.sh.j2

added section to connect worker nodes to the master
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants