Use the IU Globus Web App to transfer data to and from your accounts on IU's research computing and storage systems

• Overview
• Before you begin
• Access the IU Globus Web App
• Activate your collections
• Transfer files
• Add your personal computer as a collection
• Add your Google at IU My Drive or Microsoft OneDrive at IU space as a collection
• Get help

Overview

You can use the IU Globus Web App to transfer data between your accounts on Indiana University's research supercomputers and research storage systems. You also can use it to transfer data between IU's research supercomputers and research storage systems and your personal computer, or to transfer data between your space in Google at IU My Drive or Microsoft OneDrive at IU and your accounts on IU's research supercomputers and research storage systems.

For example, you can use the IU Globus Web App to:

• Transfer data from your personal computer to your Slate account, Slate-Project space, or Slate-Scratch directory for use with an application running on an IU research supercomputer.
• Transfer output data from an application running on an IU research supercomputer to your archival storage space on the Scholarly Data Archive (SDA).
• Access your home directory space or any Geode-Project space you are permitted to access.
• Transfer data from your Google at IU My Drive or Microsoft OneDrive at IU space to your Slate account, Slate-Project space, or Slate-Scratch directory for use with an application running on an IU research supercomputer.
  Important:

  Before storing data on any of Indiana University's research computing or storage systems, make sure you understand the information in Types of sensitive institutional data appropriate for UITS Research Technologies services.

  Make sure you do not include sensitive institutional data as part of a file's filename or pathname.

The IU Globus Web App is based on Globus Online, a high performance GridFTP service designed to provide researchers a tool for secure data movement between networked hosts (collections). The IU Globus Web App automates many of the tasks associated with managing large data transfers, saving you time and delivering better performance than other transfer methods, such as SCP.

Before you begin

• To use a UITS Research Technologies system as a collection, you must have an account on that system. For eligibility and account creation information, see the Research system accounts (all campuses) section of Computing accounts at IU.

Access the IU Globus Web App

To access the IU Globus Web App:

1. In your web browser, go to the IU Globus Web App.
2. Under "Use your existing organizational login", use the drop-down list to find and select Indiana University.
3. Select Continue.

4. Log in with your IU username and passphrase, and then confirm your identity with Two-Step Login (Duo).

Activate your collections

To set up a data transfer in the IU Globus Web App, select and activate the source and destination collections.

1. From File Manager, click in the text field next to "Collection" and begin typing a collection name; for example, enter IU to automatically reveal a list of available IU collections.
2. Scroll through the list to find the desired collection; for example:

   Resource	Collection name
   Scholarly Data Archive (SDA)	IURT - Scholarly Data Archive
   Slate, Slate-Project, or Slate-Scratch	IURT - Slate
   Home directory or Geode-Project space	IURT - Geode

3. When you find the desired collection, select its name to activate it.
   • Activating the collection places you in the home directory of your account on the SDA.
   • Activating the IURT - Slate collection may produce a "permission" denied" error at first. The error will resolve when you click in the "Path" field, enter the appropriate path, as follows, and press Enter or Return:
     • Slate: To activate your Slate account, enter the following path (replace username with the IU username associated with your Slate account):

       /slate/username

     • Slate-Project: To activate your Slate-Project space, enter the following path (replace project_name with the project name associated with your Slate-Project space):

       /project/project_name

     • Slate-Scratch: To activate your Slate-Scratch directory, enter the following path (replace username) with the IU username associated with your Slate-Scratch directory):

       /scratch/username

   • Activating the IURT - Geode collection may produce a "permission" denied" error at first. The error will resolve when you click in the "Path" field, enter the appropriate path, as follows, and press Enter or Return:
     • Home directory: To access your home directory space, enter the following path (replace username with your IU username):

       /geode/home/username

       This places you in your home directory on Geode, which is equivalent to /N/u/username on the IU research supercomputers (where username is your IU username).

       The directory path, including file name, of any stored object may not exceed 4,096 bytes in length.

       Note:

       Although you can use the Home folder within the IURT - Geode collection's root directory to navigate to your home directory space, the IU Globus Web App will most likely time out while listing the contents of that folder due to the large number of home directory spaces. For best results, enter the appropriate path, as described above, and then create a bookmark (see below) that you can use as a shortcut back to your space in future sessions.
     • Geode-Project space: Depending on the security settings of a Geode-Project, you may be able to find the top-level directory in one of the directories under /geode/projects. Alternatively, you may have to know the exact path to enter into the "Path" field. Some examples:
       • /geode/projects/project_name/G1
       • /geode/projects/project_name/share
       • /geode/projects/project_name

       If you think you should have access to a Geode-Project that's not available to you, contact your department's local UITS support person.

4. Click in the Transfer or sync to... field, and then find and activate your second collection.

With two collections activated, you can start transferring files between them.

Transfer files

To transfer files between collections:

1. Use the source collection's file browser to find and select one or more files and/or folders to transfer, and then select Transfer or Sync to....
2. To reveal optional transfer settings, select Transfer & Timer Options, and then (optionally):
   • Next to "Label This Transfer", in the text box, enter a short description to be displayed in the log of transfer activity.
   • Next to "Transfer Settings", check the boxes to select preferred settings:
     • sync - only transfer new or changed files
     • delete files on destination that do not exist on source
     • preserve source file modification times
     • do NOT verify file integrity after transfer
     • Skip files on source with errors
     • Fail on quota errors
     Note:

     The encrypt transfer option is enabled and cannot be changed.
   • Next to "Notification Settings", check the boxes to select preferred settings:
     • Disable success notification
     • Disable failure notification
     • Disable inactive notification
   • To schedule your transfer to run on a specific date and time, next to "Schedule Start", use the pop-up calendar and text box to enter a valid date and time to indicate when your transfer should start.
   • To set up a recurring transfer, next to Repeat, use the drop-down to select days, hours, or minutes, and then:
     • Next to "every", use the up and down arrows to set the frequency.
     • Next to "end", use the drop-down to indicate when the recurrence should end; select never, after (a set number of times), or by date (a set date and time).
3. Use the destination collection's file browser to select the destination directory for the selected files and/or folders.
4. To start the transfer, select Start. You should see a "Transfer request submitted successfully" message; optionally, select View details to see an overview of your transfer and monitor its progress.

Add your personal computer as a collection

To use your personal computer as a collection:

1. In the IU Globus Web App, select File Manager, and then, near the top of the screen, click in the "Collection" field.
2. Under the "Collection" field, on the Recent tab, select Install Globus Connect Personal.
3. Download the Globus Connect Personal version that's compatible with your workstation's operating system (Windows, macOS, or Linux), install it, and then launch it.
4. When Globus Connect Personal runs, it will take you through the process of setting up your computer as a collection. Make sure to remember the name you give your collection; UITS recommends combining your IU username with an informal name for your computer, for example:

   username#my_laptop

5. When you finish creating your collection, you can return to the IU Globus Web App and search for your collection by entering its name into the "Collection" field on the File Manager tab.

Add your Google at IU My Drive or Microsoft OneDrive at IU space as a collection

The UITS Research Storage team provides Globus collections for Google at IU My Drive and Microsoft OneDrive at IU as an individualized custom service. To request additional information, email the UITS Research Storage team (store-admin@iu.edu).

Once you are provided access, you can follow the instructions above to search for and activate your collections, and transfer data between Google at IU My Drive, Microsoft OneDrive at IU, and your accounts on IU's research supercomputers and research storage systems.

Create a bookmark

To return to the same space in future sessions, create a bookmark within the IU Globus Web App. To do so, use the instructions above to activate the appropriate collection and path, and then:

1. To the right of the "Path" field, select Bookmark (the ribbon icon).
2. Give the bookmark a name, and then select Create Bookmark.

Your bookmarks are saved under the Bookmarks icon in the menubar on the left side of the IU Globus Web App.

Get help

Geode is operated by the Research Storage team within the Research Technologies division of UITS. If you have questions about Geode, home directory space on the IU research supercomputers, or Geode-Project space, email the Research Storage team (store-admin@iu.edu).