Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Globus section update #51

Merged
merged 5 commits into from
Mar 27, 2024
Merged

Globus section update #51

Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
eb19f5e
Update file_mgmt.rst initial content fill
lhelms2 Feb 20, 2024
b1f121b
Update file_mgmt.rst editorial change
lhelms2 Feb 21, 2024
2f165ed
Update file_mgmt.rst updates to Globus section
lhelms2 Mar 11, 2024
dcbc27c
Update file_mgmt.rst
lhelms2 Mar 11, 2024
9c17072
Merge pull request #50 from ncsa/globus-hub-update
lhelms2 Mar 14, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
59 changes: 7 additions & 52 deletions docs/source/user_guide/file_mgmt.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -158,65 +158,20 @@ Any method that can transfer data onto Nightingale can also be used to transfer

Before transferring data off of Nightingale, please read about :ref:`protected data <protected>`. Data transfers off of Nightingale are audited and must be accounted for.

File Transfers with Globus
-----------------------------
.. _transfer-globus:

Transferring Files with Globus
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

.. warning::

As of January 2023, Globus is available for use on Nightingale. However, we have not finished the final contracts and setup for specifically HIPAA-data certified variant of Globus, so **do not transfer HIPAA data over Globus** at this time. When HIPAA-certified Globus is installed, this warning will be removed. If you have any questions about data movement, please don't hesitate to :ref:`submit a ticket <help>`.

Globus is a web-based file transfer system that works in the background to move files between systems with "Globus Endpoints". Nightingale will have a permanent Globus Endpoint (with a name announced at that time). To transfer files to and from your directories using Globus, you will have to authenticate that endpoint, using your already-existing NCSA username, password, and NCSA Duo account.

One-Time Setup
~~~~~~~~~~~~~~~~

You will need to set up a separate account on globus.org, that will have a username and a separate password. To use Globus to transfer files to and from Nightingale, you will need to "link" your new Globus account with your NCSA identity.

#. Log into globus.org.
#. Click on **Account** in the left sidebar.
#. Click on the **Identities** tab. If your NCSA username and email address is not in that list, then click **Link Another Identity** in the upper right to link it.

Using Globus to Transfer Files
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Once your identity is linked (above), then do the following to transfer files using Globus.

#. Navigate to globus.org and click **Log In** in the upper right corner

We recommend that you use an independent password for your Globus account. If you are doing that, on the **Log in to use Globus Web App** screen, click on **Globus ID to sign in** at the very bottom, and sign in with your Globus password.

#. If prompted click **Allow** when asked to authorized the Globus Web App.

.. image:: images/file_mgmt/Screen-Shot-2021-01-19-at-9.22.30-PM-768x506.png
:alt: Globus Web App authorization prompt.

#. Once logged in, you should be taken to the **File Manager** section. On one side, search for "ngale" and click on the **ncsa#ngale** endpoint from the resulting list.

.. image:: images/file_mgmt/ngale_globus_ngale_endpoint.png
:alt: Globus file manager "nagle" search results.

#. The system will prompt you to Authenticate to the endpoint, click **Continue**.

.. image:: images/file_mgmt/Screen-Shot-2021-01-19-at-9.23.26-PM-768x299.png
:alt: Globus authentication/consent required prompt.

#. If Globus prompts you to link your **\<netid>@illinois.edu** identity, go ahead and do so. You will need to provide your NCSA Duo authority here.

.. image:: images/file_mgmt/Screen-Shot-2021-01-19-at-9.51.47-PM-768x280.png
:alt: Globus link your @illinois.edu identity prompt.

.. image:: images/file_mgmt/Screen-Shot-2021-01-19-at-9.52.00-PM-768x657.png
:alt: Globus Web App authorization prompt

#. You should then be returned to the **File Manger** view. You can navigate from there to your home directory, under **/u**, or to your project directory, under **/projects**.

.. image:: images/file_mgmt/ng_globus_system_dir.png
:alt: Globus file manager view showing home and project directories.
Use Globus for large data transfers. Globus is a web-based file transfer system that works in the background to move files between systems with Globus `endpoints <https://docs.globus.org/faq/globus-connect-endpoints/#what_is_an_endpoint>`_.

#. In a similar manner (in the right half of the **File Manger** view), search for and authenticate to the collection you are planning to transfer data to/from. Then use the GUI to transfer the data; you can choose transfer settings. You can click on the **Activity* button on the left to view your current transfer activity.
Go to `Transferring Files - Globus <https://docs.ncsa.illinois.edu/en/latest/common/transfer.html#globus>`_ for complete instructions on using Globus with NCSA computing resources.

.. image:: images/file_mgmt/Screen-Shot-2021-01-19-at-9.39.22-PM-1024x141.png
:alt: Globus file manager tansfer window.
The **Nightingale endpoint collection** name is: "ncsa#ngale"

Creating and Editing Files
---------------------------
Expand Down