Difference between revisions of "Large File Transfer"

From Dryad wiki
Jump to: navigation, search
(FTP)
(HTTP)
Line 3: Line 3:
 
== HTTP ==
 
== HTTP ==
  
Some institutions use HTTP
+
Some institutions use HTTP for large transfers. Perhaps we can reconfigure our servers to work better over HTTP?
  
Pro:  
+
Pro:
 
* can be built into the submission system easily
 
* can be built into the submission system easily
  
Con:  
+
Con:
 
* times out easily, especially on low-quality Internet connections
 
* times out easily, especially on low-quality Internet connections
  

Revision as of 13:46, 16 June 2011

Dryad needs to accept uploads of large files. These files must be transferred outside the normal submission system unless/until a better transfer mechanism is built into the submission system.

HTTP

Some institutions use HTTP for large transfers. Perhaps we can reconfigure our servers to work better over HTTP?

Pro:

  • can be built into the submission system easily

Con:

  • times out easily, especially on low-quality Internet connections

FTP

We are currently testing file transfers via ftp2.nescent.org. When a transfer is needed, NESCent IT must turn on the service, and they should be notified to shut down the service after a transfer is complete.

Pro:

  • simple and well understood

Con:

  • security issues

SCP

Mailed USB key

Pro:

  • can transfer very large files without worrying about size and bandwidth concerns

Con:

  • doesn't seem "professional"
  • may take a long time for international authors

BioTorrents

Pro:

  • can transfer large files efficiently

Con:

  • The process of creating a torrent file is too complex for a typical Dryad user.