🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: demon.ip.developers
Article #795

Re: Ka9q/TextWin web file grabber (was: ... is it *truly* possible to flush locally?)

#795
From: John Washington
Date: Thu, 15 Aug 1996 00:00
55 lines
2752 bytes
On Wednesday, in article
     <Snews.960814.195625.chris.1268@keris.demon.co.uk>
     chris@keris.demon.co.uk "Chris Croughton" wrote:

CC> In article <839979287snz@wash.demon.co.uk>
CC>            ka9qwww@wash.demon.co.uk "John Washington" wrote:
CC> 
CC> >It's a tad over 2K now, that's the trouble with 'development'.  :-)
CC> 
CC> I can never remember, is a 'tad' bigger or smaller than a 'smidgeon'
CC> <g>?

Tads keep getting bigger.  And I think our cat's just brought in
a 'smigeon' so that's for tonight's casserole.

CC> 
CC> >Phwaar!  Yeah, if you promise to send back the fixes^H^H^H^H^H
CC> >enhancements you add!
CC> 
CC> Enhancements, me?  Oh, you mean the fully-scripted version with block
CC> structured conditionals and recursion <g>.  Just minor things, really, I
CC> don't do major changes like altering variable names <g>...

Well, don't feel you have to implement the 'depth=n' option right away,
provided you can code up the 'grab-whole-site' feature.

And while we're exploring FantasyLand, should the site be copied
into a directory tree, with link names trimmed to 8.3, or shall
we toss around some ideas of how the heck it could all be stuffed
into a NetScape cache?

I haven't a clue about details of the cache, except that I'd like
to shoot the guy who decided to call .html AND .gif files both .moz.
If something were feasible with the cache, I guess I'd opt for ka9q
creating a single http-batch.txt file while online, and then
processing it with another program offline to avoid memory
constraints.

[ducks to avoid barrage of whinges about sudden NetScape-centric
nature of discussion]

OK, maybe there are better, less browser-specific ways of doing
this.  Any ideas?

Query for HTML gurus: I want to add a line into incoming html
files, something like <! This file came from www.xyz and was
called lengthy.name.html>.  Is it ok to put that right at
the start, even before <html>?  If not, can it go before
<head> or where?

--
John Washington
Ka9q HTTP client source available from http://www.wash.demon.co.uk/tw/
TinyTW.exe will be uploaded tonight, throughput permitting.
Technical Details
Message-ID: <840118246snz@wash.demon.co.uk>
Path: arc1-ca.pugleaf.net!unknown!not-for-mail
References: <838060435snz@dsl.co.uk> <838306928snz.4895@grempc.demon.co.uk> <Snews.960814.195625.chris.1268@keris.demon.co.uk>

Show Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII-7-bit
X-Google-Thread: 10bb05,467f920bc280412f
X-Google-Attributes: gid10bb05,public
From: John Washington <john@wash.demon.co.uk>
Subject: Re: Ka9q/TextWin web file grabber (was: ... is it *truly* possible to flush locally?)
Date: 1996/08/15
Message-ID: <840118246snz@wash.demon.co.uk>
X-Deja-AN: 174540813
x-mail2news-path: wash.demon.co.uk
x-nntp-posting-host: wash.demon.co.uk
references: <838060435snz@dsl.co.uk> <838306928snz.4895@grempc.demon.co.uk> <Snews.960814.195625.chris.1268@keris.demon.co.uk>
newsgroups: demon.ip.developers