The Open Storage Network (OSN) is a distributed data sharing and transfer service intended to facilitate exchanges of active scientific data sets between research organizations, communities and projects, providing easy access and high bandwidth delivery of large data sets to researchers.
The OSN serves two principal purposes: (1) enable the smooth flow of large data sets between resources such as instruments, campus data centers, national supercomputing centers, and cloud providers; and (2) facilitate access to long tail data sets by the scientific community. Examples of data currently available on the OSN include synthetic data from ocean models; the widely used Extracted Features Set from the Hathi Trust Digital Library; open access earth sciences data from Pangeo; and Geophysical Data from BCO-DMO. These data sets are being used by researchers to machine learning models, validate simulations, and perform statistical analysis of live data.
Ask.CI Recent Topics
|Storage options for researchers with large data sets||04/14/23|
|Transfer of large datasets files||03/16/23|
|Directory or file-level permissions on OSN s3 buckets||09/30/22|
|Protecting files on an s3 bucket from deletion||05/19/22|
|Datasets with a leading "/" in the name do not show up in all s3 file programs||03/16/22|