Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Task/DES-3065: Use cloud.data system for HPC work directories #1423

Merged
merged 19 commits into from
Sep 18, 2024

Conversation

jarosenb
Copy link
Member

Overview:

Replace the tg-owned HPC works system with cloud.data and users' personal home directories

PR Status:

  • Ready.
  • Work in Progress.
  • Hold.

Related Jira tickets:

Summary of Changes:

  • Replace designsafe.storage.frontera.work with user-owned HPC work directories
  • Update the user profile model to pull and cache their homedir from TAS so it is available in the frontend.

Testing Steps:

  1. Click on "HPC Work" in the data files sidebar and check that your personal $WORK directory is listed.
  2. Copy a file into your Work directory from My Data.

UI Photos:

Notes:

  • Does not make cloud.data selectable for file inputs. More work needs to be done to add notes/metadata to the system.

@@ -103,7 +104,7 @@ export const DatafilesToolbar: React.FC<{ searchInput?: React.ReactNode }> = ({
// Disable downloads from frontera.work until we have a non-flaky mount on ds-download.
canDownload:
selectedFiles.length >= 1 &&
system !== 'designsafe.storage.frontera.work' &&
system !== USER_WORK_SYSTEM &&
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I didn't realize this was set - great, so user the Work tapis download feature can be done later and no current functionality is lost 👍

const systemRoot = isUserHomeSystem(system) ? '/' + user?.username : '';
let systemRoot = '';
if (system === USER_MYDATA_SYSTEM) systemRoot = '/' + user?.username;
if (system === USER_WORK_SYSTEM) systemRoot = '/work/' + user?.homedir;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This might need to specify that the existing path starts with /work as well, otherwise we get this:
Screenshot 2024-09-03 at 1 55 32 PM

jarosenb and others added 15 commits September 12, 2024 15:46
* commit to main

* prevent blank or null values from causing metrics page to crash

* remove those type coercions and fix the type errors

* Refactor MetricsModalBody component to improve readability and maintainability

* remove docker compose changes

---------

Co-authored-by: Jake Rosenberg <jrosenberg@tacc.utexas.edu>
…1432)

* Log DOIs for each file when multiple are selected, even if there are duplicates

* Unset file selections when changing the selected publication version
…ation listing (#1425)

* Directories in Publication Preview open in the Curation listing

* fix links inside the publication pipeline

* revert link _target change
…he root dir (#1433)

* log views of non-Other type projects as listings on the root dir

* fix hook dependencies
* handle error in revoke method

* handle cloud.data work system in workspace select modal
@jarosenb jarosenb merged commit bd913be into main Sep 18, 2024
5 checks passed
@jarosenb jarosenb deleted the task/DES-3065--cloud-data-work branch September 18, 2024 20:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants