🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: demon.ip.developers
Article #796

Re: Ka9q/TextWin web file grabber (was: ... is it *truly* possible to flush locally?)

#796
From: Robert Mortimer
Date: Fri, 16 Aug 1996 00:00
67 lines
3604 bytes
Previously John Washington <john@wash.demon.co.uk> said:
>On Wednesday, in article
>     <Snews.960814.195625.chris.1268@keris.demon.co.uk>
>     chris@keris.demon.co.uk "Chris Croughton" wrote:
>CC> In article <839979287snz@wash.demon.co.uk>
>CC>            ka9qwww@wash.demon.co.uk "John Washington" wrote:
>CC> >It's a tad over 2K now, that's the trouble with 'development'.  :-)
>CC> I can never remember, is a 'tad' bigger or smaller than a 'smidgeon'
>CC> <g>?
>Tads keep getting bigger.  And I think our cat's just brought in
>a 'smigeon' so that's for tonight's casserole.

Programming smigeons in the park??
/* the coffee machine's been worked on no coffee yet :-( */

>CC> Enhancements, me?  Oh, you mean the fully-scripted version with block
>CC> structured conditionals and recursion <g>.  Just minor things, really, I
>CC> don't do major changes like altering variable names <g>...
>Well, don't feel you have to implement the 'depth=n' option right away,
>provided you can code up the 'grab-whole-site' feature.

As an interesting point, there's a fun dos utility called snipper
, I think, which allows you to copy bit's of screen to a buffer and
then write them back to prompt. If you where to load this tsr before
KA9Q, you could use the url grabber and then snip links...
Basic web browsing but....and no I haven't tried this yet.

>And while we're exploring FantasyLand, should the site be copied
>into a directory tree, with link names trimmed to 8.3, or shall
>we toss around some ideas of how the heck it could all be stuffed
>into a NetScape cache?

No not the net scape cache please....
Trimming to 8.3 would be good.

>I haven't a clue about details of the cache, except that I'd like
>to shoot the guy who decided to call .html AND .gif files both .moz.
>If something were feasible with the cache, I guess I'd opt for ka9q
>creating a single http-batch.txt file while online, and then
>processing it with another program offline to avoid memory
>constraints.

Sounds good, it would also be a way to avoid it getting too browser
specific, as you could use different unbatch options.
Anyone know how MSIE3 caches, as this is now Demon's windoze
grazer of choice??

>[ducks to avoid barrage of whinges about sudden NetScape-centric
>nature of discussion]
>OK, maybe there are better, less browser-specific ways of doing
>this.  Any ideas?
>Query for HTML gurus: I want to add a line into incoming html
>files, something like <! This file came from www.xyz and was
>called lengthy.name.html>.  Is it ok to put that right at
>the start, even before <html>?  If not, can it go before
><head> or where?

AFAIR you can put anything you like before the <html>
and sensible browsers ignore anything they don't understand
anyway. But I thing the comment tag is:
<!--your comment here--!>

--
RobertM
Demon Internet Ltd
         "Trust the computer, the computer is your fiend"
Technical Details
Message-ID: <32143a24.3868200@news.demon.co.uk>
Path: arc1-ca.pugleaf.net!unknown!not-for-mail
References: <838060435snz@dsl.co.uk> <838306928snz.4895@grempc.demon.co.uk> <Snews.960814.195625.chris.1268@keris.demon.co.uk> <840118246snz@wash.demon.co.uk>

Show Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII-7-bit
X-Google-Thread: 10bb05,467f920bc280412f
X-Google-Attributes: gid10bb05,public
From: robm@demon.net (Robert Mortimer)
Subject: Re: Ka9q/TextWin web file grabber (was: ... is it *truly* possible to flush locally?)
Date: 1996/08/16
Message-ID: <32143a24.3868200@news.demon.co.uk>
X-Deja-AN: 174510143
x-nntp-posting-host: bob1.support.demon.net
references: <838060435snz@dsl.co.uk> <838306928snz.4895@grempc.demon.co.uk> <Snews.960814.195625.chris.1268@keris.demon.co.uk> <840118246snz@wash.demon.co.uk>
organization: Demon Internet Ltd
reply-to: robm@demon.net
newsgroups: demon.ip.developers