🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: bionet.software
Article #2510

GridFTP/UDT is fast, free data transport at GridFTP.Bio-Mirror.net

#2510
From: Don Gilbert
Date: Tue, 17 Aug 2010 16:46
50 lines
4080 bytes
Dear Bio-data Movers,

GridFTP with UDT, from the Globus project, speeds long distance
file transfer by 4 to 10 times over standard FTP. The commercial
Aspera UDP software that NCBI and EBI use may be better in
value, but is way out of my price range.

I've been testing GridFTP for use with Bio-mirror.net, to sites in
USA, and China Bio-mirror (hoping to add Australia, etc).
This looks like a good idea for biology data transfer. GridFTP is
well developed for a science informatics project. 

Here are some docs on this GridFTP server for Bio-mirror data
  http://gridftp.bio-mirror.net/biomirror/

This is early in testing stage. There are basic documents at this
web page, and I've more testing to do with it, but it seems to be
working well.   

If you may be interested in testing this, especially those outside
North America, please contact me or follow directions above and
let me know how it works for you.

-- Don Gilbert

   GridFTP TCP and UDT times for 113 GB transfer 
   from gridftp.bio-mirror.net/pub/biomirror/blast/ (Indiana USA)

       Ping  Time(min)  TCP/  Distance
Site    RTT  TCP   UDT  UDT    Km      Network Route
--------------------------------------------------------------
ORNL    25   361   120   3   1200  In. - Chi. - Nashv., Tennesee - ORNL
              5.3  16              MB/s
TACC    37   616   120   5   2000  In. - Chi. - Houston, Texas - TACC
              3.1  16              MB/s
CSTNET 274  3722*  304  12  12000  In. - Internet2 - Korea - Beijing, China
              0.5   6.3            MB/s; *est. from partial TCP w/ failures
--------------------------------------------------------------
  Transfer times (minutes), and below speed in Megabytes/second,
  for TCP and UDT, and the TCP/UDT ratio.
  NCSA, Purdue, ORNL, TACC, SDSC are Teragrid.org sites in USA.  
  RTT is network distance as average round trip ping time in ms.

See also http://www.mcs.anl.gov/~kettimut/publications/PFLDNeT09.pdf
   UDT as an Alternative Transport Protocol for GridFTP
   John Bresnahan, Michael Link, Rajkumar Kettimuthu, and Ian Foster 
   Mathematics and Computer Science Division, Argonne National Laboratory 
-- d.gilbert--bioinformatics--indiana-u--bloomington-in-47405
-- gilbertd@indiana.edu--http://marmot.bio.indiana.edu/
Technical Details
Message-ID: <mailman.9.1282064075.1545.bio-soft@net.bio.net>
Path: arc1-ca.pugleaf.net!g2news1.google.com!news1.google.com!Xl.tags.giganews.com!border1.nntp.dca.giganews.com!nntp.giganews.com!local2.nntp.dca.giganews.com!news.giganews.com.POSTED!not-for-mail

Show Full Headers
Complete Article Headers
X-Google-Thread: fa6b6,32614370ef6f90b3,start
X-Google-NewGroupId: yes
X-Google-Attributes: gid6710630482,domainid0,public,usenet
X-Google-Language: ENGLISH,ASCII-7-bit
Path: arc1-ca.pugleaf.net!g2news1.google.com!news1.google.com!Xl.tags.giganews.com!border1.nntp.dca.giganews.com!nntp.giganews.com!local2.nntp.dca.giganews.com!news.giganews.com.POSTED!not-for-mail
NNTP-Posting-Date: Tue, 17 Aug 2010 11:55:02 -0500
Date: Tue, 17 Aug 2010 11:46:45 -0500 (EST)
From: Don Gilbert <gilbertd@net.bio.net>
X-Envelope-From: gilbertd
To: bio-soft@magpie.bio.indiana.edu
X-Mailman-Approved-At: Tue, 17 Aug 2010 11:54:33 -0500
X-BeenThere: bio-soft@net.bio.net
X-Mailman-Version: 2.1.4
Precedence: list
Organization: BIOSCI/IUBio, Biology Dept., Indiana University
subject: GridFTP/UDT is fast, free data transport at GridFTP.Bio-Mirror.net
Newsgroups: bionet.software
Message-ID: <mailman.9.1282064075.1545.bio-soft@net.bio.net>
Approved: BIOSCI Approval Key <biosci-approval-key@net.bio.net>
X-Auth: PGPMoose V1.1 PGP bionet.software
 iQCVAwUBTGq+y6CIqsWvyF5FAQHKfgP/ZVRjZUa89m56WJJYb07cbh6AEVS4jYRZ
 qRbNOd8/AVscsY4heZ4xvMa9WEgBy9ZbNod0JwlKa/lkZAaBwWszDUP1allrd8h9
 24Mcrocb6U7xQzABsNeVum2xQcEzQloM5umNNiTPaAhWj/FReoEgi51xlqX0rz9L
 N0bOINhN6YM= =p6sD
Lines: 51
X-Usenet-Provider: http://www.giganews.com
X-Trace: sv3-1hwmT8oLjRTAUqSh3CTPL+yALACMJLcu+8wEzYjSRuVCx5CXW2xjd4pTVI/S919KJReOqxXEBe//B/P!KU52gPYXUB6w9d87exnPymCSwPC3iA+geSC0p2Nq/x/zmZ1JEaliX2by+gRUukF+klONso7u1Zid
X-Complaints-To: abuse@giganews.com
X-DMCA-Notifications: http://www.giganews.com/info/dmca.html
X-Abuse-and-DMCA-Info: Please be sure to forward a copy of ALL headers
X-Abuse-and-DMCA-Info: Otherwise we will be unable to process your complaint properly
X-Postfilter: 1.3.40