Skip to content

Commit

Permalink
Merge branch 'main' into mrg/more_gpu
Browse files Browse the repository at this point in the history
  • Loading branch information
atombaby authored Nov 22, 2024
2 parents ebea5cd + b6b6acd commit c98db7a
Show file tree
Hide file tree
Showing 2 changed files with 13 additions and 6 deletions.
3 changes: 3 additions & 0 deletions _scicomputing/hutchgo_overview.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,9 @@ HutchGO- Hutch Globus Online- is a deployment of the Globus data transfer servic

Globus is a non-profit service of the University of Chicago. It is a combination of software (the Globus server and client tools) and services (the Globus control services) providing a number of different functions useful in research- data transfer, compute, and automation.

Globus is the preferred way to transfer sensitive data, but it is essential that you are confident that transferring data with Globus won't violate any terms of use - contact `[email protected]` for advice regarding your data transfer.
{: .notice--warning}

## Key Concepts

### Account and Identity
Expand Down
16 changes: 10 additions & 6 deletions _scicomputing/store_collaboration.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,25 +3,27 @@ title: Data Transfer and Storage Tools for Collaborating
primary_reviewers: vortexing
---

## Data Transfer Tools
Before transferring data, please make sure you have appropriate protections in place- make sure you are allowed to share data via your desired mechanism, that agreements are in place or won't be violated by transferring data. Contact `[email protected]` if you have questions or need assistance evaluating your transfer needs.
{: .notice--warning}

In collaborative settings, often data transfer and sharing can pose significant challenges. Access management, authentication, and data-use agreements all affect how you share data both within the Hutch and with external collaborators.

In collaborative settings, often data transfer and sharing can pose significant challenges. For specific guidance about data transfer, access or copying for your particular collaboration, please file a ticket including a basic description of the data access sitaution by emailing `scicomp`. There are often suitable strategies for collaborative project support that do not require data duplication (and thus increased data storage costs), or use of expensive data storage or transfer tools. Two useful data transfer tools at use at the Hutch include `Motuz` and `Aspera`.
## Data Transfer Tools

### HutchGO

[HutchGO (Hutch Globus Online)](/scicomputing/hutchgo_overview) is an instance of Globus maintained by SciComp for sharing and moving data. HutchGO enables secure and high performance transfers of data internally and externally.

### Motuz

[Motuz](https://motuz.fredhutch.org) is a tool that facilitates the transfer of small or large data between Fred Hutch storage locations (such as `Scratch` and `Fast`) and cloud storage locations such as AWS S3 buckets among others. You can find some basic how-to guidance to get started with Motuz in our [Resource Library](/compdemos/motuz/).
HutchGO allows transfers of data in-place from common Hutch storage locations (fast, working, temp). It isn't necessary to copy data into another location prior to sharing.

### Aspera

#### Faspex

Aspera Faspex is a web based data transfer tool that enables fast transfer of large data between it and a host using the Aspera client. The primary method of operation is to upload the data to the Aspera server, then use the web interface to create an email with a link you would then send to those outside the Hutch network.

> Note: space is limited. Because of this, data stored here is deleted after a short period of time and not backed up making the Aspera inappropriate for primary storage. Moving data to their final, secure, backed up locations as soon as possible is important when using Aspera.
Storage space in Aspera is limited. Because of this, data stored here is deleted after a short period of time and not backed up making the Aspera inappropriate for primary storage. Moving data to their final, secure, backed up locations as soon as possible is important when using Aspera.
{: .notice--info}

Visit [the Aspera Faspex information page](/scicomputing/store_aspera/) for more details and information on using this storage service.

Expand All @@ -32,9 +34,11 @@ Aspera Shares is similar to the web interface used by Faspex but additionally of
## Data Storage for Collaboration

### AWS S3

AWS S3 storage has a variety of useful features that make it an ideal way to securely share data with collaborators, or leverage a resource as a common storage location for users at and outside of the Hutch. You can read more about how S3 can help support your collaborations using especially large data sets [in our AWS S3 storage documentation](/scicomputing/store_objectstore/).

### OneDrive

OneDrive is a cloud service that securely stores your files and folders in one place, share them with others, and update your files from any device. OneDrive is a benefit available individual users at the Fred Hutch that allows for private storage of files with the ability to share those files with others for collaboration. With OneDrive you can:

- Create documents on your computer and edit on your laptop, phone, or tablet
Expand Down

0 comments on commit c98db7a

Please sign in to comment.