Globus
Globus is a data management service that allows you to easily transfer data (including fast transfers of extremely large datasets) between machines and share data with others. You logon and specify the transfer to be made, and Globus takes care of it in a robust manner without you having to monitor the transfer or worry about the connection between the machines being lost.
The easiest thing you can do is transfer files between machines/systems that are already registered with Globus as Globus endpoints. Some endpoints that may be useful for Berkeley affiliates include Berkeley Research Computing’s Savio campus cluster and NERSC:
Endpoint | Display Name |
---|---|
ucb#economics | UC Berkeley Economics Department |
ucb#statistics | UC Berkeley Statistics Department |
ucb#brc | UC Berkeley Savio campus Linux cluster |
nersc#perlmutter | NERSC Perlmutter |
nersc#hpss | NERSC HPSS |
Visit the Globus Web App to transfer files. You should be able to authenticate with your Berkeley credentials. Enter the name of the endpoint and authenticate to the resource by following the directions given. Once both endpoints are authenticated, it’s straightforward to drag and drop to transfer files. Globus will email you when the transfer is complete.
You can also transfer to/from your own machine. To do so, first get the Globus Connect Personal client for your machine (see the lower right of the webpage to download the client for your operating system). Your machine will then be registered as one of your personal endpoints. When selecting an endpoint, you should be able to click on the box labelled “Endpoint” and select the resource from the list in “My Endpoints”. To transfer to an external drive, see these instructions.