Difference between revisions of "Large File Transfer"

From Dryad wiki
Jump to: navigation, search
(Splitting large files)
(Recombining files that have been split)
Line 14: Line 14:
 
On Windows machines, you may split files with [http://www.hjsplit.org/ HJsplit].
 
On Windows machines, you may split files with [http://www.hjsplit.org/ HJsplit].
  
== Recombining files that have been split ==  
+
== Recombining files that have been split ==
  
 
On Unix, Linux, or Mac OSX, you may recombine files with the "cat" command, like this:
 
On Unix, Linux, or Mac OSX, you may recombine files with the "cat" command, like this:
 
  cat partaa partab partac > dataFile.txt
 
  cat partaa partab partac > dataFile.txt
 +
 +
On Windows, you may recombine files with the "copy" command, like this:
 +
copy /B partaa+partab+partac dataFile.txt
  
 
== Uploading files through WeTransfer ==
 
== Uploading files through WeTransfer ==

Revision as of 11:17, 21 February 2012

This page contains instructions for Dryad users who want to deposit very large files. Files larger than 100MB may not work with the normal Dryad submission system. Uploading these files may fail due to unstable internet connections or web browser timeouts. In these situations, Dryad can accept content uploaded through alternate mechanisms.

What to do if your files are large

If you have files larger than 100MB and receive an error when using the the Dryad submission system, please contact the Dryad staff at help@datadryad.org. The staff will analyze your situation and make recommendations for how to proceed.

Splitting large files

To ensure easy downloads, Dryad limits the size of each individual file to 1GB. If you need to submit a file larger than this, it must first be broken into pieces that are 1GB or smaller.

On Unix, Linux, or Mac OSX, you may use the "split" command, like this:

split -b 999m myVeryLargeFile.txt

On Windows machines, you may split files with HJsplit.

Recombining files that have been split

On Unix, Linux, or Mac OSX, you may recombine files with the "cat" command, like this:

cat partaa partab partac > dataFile.txt

On Windows, you may recombine files with the "copy" command, like this:

copy /B partaa+partab+partac dataFile.txt

Uploading files through WeTransfer

The curator may ask you to upload your files through WeTransfer. WeTransfer is a free service for transferring large files between locations. When you send files via WeTransfer, please send the notifications to curator@datadryad.org.