Article View: comp.arch.storage
Article #517Re: 1000GB http Caching Proxy for ISP
From: Scott Hess
Date: Thu, 05 Dec 1996 00:00
Date: Thu, 05 Dec 1996 00:00
45 lines
2974 bytes
2974 bytes
In article <57p80g$qiu@news.ibm.net.il> ifaa1@ibm.net.il (Yossi Cohen) writes: ISPs in Europe or Asia pay, as far as I know, about $250K/Year for a T1 line to the U.S. (for the line only, not for the internet connection). On the other hand, traffic could have been reduced by a significant factor by using a large cache in the proxy http and ftp server. I know that the academic network in the UK has a cache of 6 machines with 16GB each and they reach 60% hit rate. It is my guess that by using a huge cache, say 1TB (1000GB), it is possible to get 90% hit rate, i.e. to save 90% of the international lines cost. The cost of 1TB may be about $200k, so it seems a very good investment. Where am I wrong ? I expect that if they ran a smarter protocol across the water, it would gain them alot right there. HTTP is _not_ a very smart protocol for WAN access. One page might initiate ten seperate TCP connections, each of which requires seperate setup/teardown overhead, and the sliding window will always start out small, so large objects will require many round trips. Instead, it would make sense to run HTTP to the local proxy, Hyper-G or other single-connection protocol from the local proxy across the water, and then convert back to HTTP on this side. Basically, you'd multiplex the individual requests into a single large pipe which stays connected all the time. That right there would probably save a goodly chunk of bandwidth and decrease the wall clock time required to download data, all without any cache-update concerns. If you did run a cache, I'd want something like Harvest, which I think can arrange to keep things in sync. You'd want the US end of the proxy to keep track what's in the European side of the proxy, and then send notices to invalidate pages as it sees them change. Sigh. It's pretty amazing that the network works as it is. Who says that Anarchy _can't_ work :-). Later, -- scott hess <shess@one.net> (606) 578-0412 http://w3.one.net/~shess/ <I plan to become so famous that people buy tapes of me reading source code>
Technical Details
Message-ID:
<SHESS.96Dec5084031@slave.one.net>Path:
arc1-ca.pugleaf.net!unknown!not-for-mailReferences:
<57p80g$qiu@news.ibm.net.il>Show Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII-7-bit X-Google-Thread: 10e1c8,cc5e592735d7a45c X-Google-Attributes: gid10e1c8,public X-Google-Thread: 11552e,cc5e592735d7a45c X-Google-Attributes: gid11552e,public X-Google-Thread: f6ea9,cc5e592735d7a45c X-Google-Attributes: gidf6ea9,public X-Google-Thread: fe74c,cc5e592735d7a45c X-Google-Attributes: gidfe74c,public X-Google-Thread: 11319d,cc5e592735d7a45c X-Google-Attributes: gid11319d,public From: shess@one.net (Scott Hess) Subject: Re: 1000GB http Caching Proxy for ISP Date: 1996/12/05 Message-ID: <SHESS.96Dec5084031@slave.one.net> X-Deja-AN: 202532580 references: <57p80g$qiu@news.ibm.net.il> organization: Is a sign of weakness newsgroups: comp.arch.storage,comp.infosystems.www.misc,comp.org.isoc.interest,israel.lists.il-board,israel.lists.il-talk