🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Thread View: comp.bbs.waffle
5 messages
5 total messages Started by Steve Frampton Sun, 13 Feb 1994 22:29
Pagesat & DOS - an oxymoron?
#3558
Author: Steve Frampton
Date: Sun, 13 Feb 1994 22:29
46 lines
2903 bytes
Hello:

Is it possible to interface the Pagesat system with DOS Waffle?  I am 
still vague at this point on the finer points of the Pagesat system, but 
the following is how I envision it to work.  I would appreciate pointers 
from existing PageSat DOS users, especially if you use Waffle.

Bare-bones slow 386 (16MhZ) with about an 80MB drive handles the sat 
feed.  I assume the feed is always coming in, so I don't expect this 
machine to do much else.

The above machine is connected via 2 Mb/s Lantastic network to a faster 
386 with a huge hard drive (250MB for now, but hopefully a 450MB to 1GB 
soon).  This faster machine will be running Waffle.  Once every set 
interval (say, 15 minutes or 1/2 hour), Waffle will simply copy the files 
from the Pagesat computer via LAN and then delete them over there.  
Waffle will then perform batching for other sites, expiration, etc.

Thoughts:

- The Pagesat computer will be a perpetual data machine.  Since data will 
be retrieved and deleted from it's hard drive on a frequent basis, I 
assume the 80MB drive will meet my needs.

- I am concerned with duplicate news-items.  Not so much with Waffle 
storing a crossposted article in different locations, but with what I 
assume will happen with multiple feeding of groups (eg. this post, 
cross-posted to comp.bbs.waffle & biz.pagesat, would arrive in the c.b.w. 
feed and be copied to /comp/bbs/waffle and /biz/pagesat, and then would 
arrive in the b.p. feed and be copied to /comp/bbs/waffle and 
/biz/pagesat -- leaving 4 articles where only 1 was intended).

- Is it a simple matter to configure the Pagesat computer to only receive 
a selection of groups, or must all newsgroups be retrieved and then the 
ones not in a system file immediately deleted?

- This should be a DOS-based solution.  Linux is fine but I don't think 
it offers Lantastic support(?).

I am a bit concerned -- though excited -- about the prospect of dealing 
with a continuous stream of news!  :-)

Your thoughts appreciated.  Thanks in advance.

---< MAKE MONEY FAST!  Contact Dave Rhodes for details. >---
Steve Frampton        E-mail: <frampton@vicuna.ocunix.on.ca>
Re: Pagesat & DOS - an oxymoron?
#3559
Author: Eric Poole
Date: Mon, 14 Feb 1994 17:46
41 lines
2620 bytes
In article <0ZiPHc1w165w@vicuna.ocunix.on.ca> frampton@vicuna.ocunix.on.ca writes:

> The above machine is connected via 2 Mb/s Lantastic network to a faster 
> 386 with a huge hard drive (250MB for now, but hopefully a 450MB to 1GB 
> soon).  This faster machine will be running Waffle.  Once every set 
> interval (say, 15 minutes or 1/2 hour), Waffle will simply copy the files 
> from the Pagesat computer via LAN and then delete them over there.  
> Waffle will then perform batching for other sites, expiration, etc.

No reason I can think of why this should not work.

However ...

To do this, you will have to configure the Pagesat machine as a
LANtastic server.  In my experience (I run LANtastic/AI here), a
LANtastic server will give priority to external accesses over local
accesses, so that if external accesses are heavy, speed of
locally-running applications slows to a crawl.  So, if you are in the
process of copying a bunch of the latest news over to the Waffle
machine, the Pagesat machine may well slow down to the point that it
might start getting data overruns.

Also, LANTastic Server uses a lot of memory.  You may or may not be
able to load it high.

I think you will be better off if you can configure things so that the
Pagesat machine is a workstation and not a server, and let the Pagesat
machine take care of copying things over to the Waffle machine.  If
you can do that.  In any case, it's something to make a note of and
keep in mind.

Hope this helps ...

 . . . . . ep

. <-------------------------------------------------------->
. > Eric Poole                      epoole@leotech.mv.com  <
. > NETIS Public Access Internet    603-432-2517   (data)  <
. > Londonderry, New Hampshire      14.4Kbps V32bis  8-N-1 <
. <-------------------------------------------------------->
Re: Pagesat & DOS - an oxymoron?
#3560
Author: Steve Frampton
Date: Tue, 15 Feb 1994 00:32
15 lines
1418 bytes
epoole@leotech.mv.com (Eric Poole) writes:

>I think you will be better off if you can configure things so that the
>Pagesat machine is a workstation and not a server, and let the Pagesat
>machine take care of copying things over to the Waffle machine.  If
>you can do that.  In any case, it's something to make a note of and
>keep in mind.

Nice tip...how long do you have between sat batches to do this?  How long 
does a pagesat dump take for the entire newsfeed?

Thanks...

--< Anybody know a site where I can FTP the Pelican Brief? >--
Steve Frampton          E-mail: <frampton@vicuna.ocunix.on.ca>
Re: Pagesat & DOS - an oxymoron?
#3561
Author: Jack Kilday
Date: Tue, 15 Feb 1994 01:26
83 lines
5293 bytes
In article <0ZiPHc1w165w@vicuna.ocunix.on.ca> frampton@vicuna.ocunix.on.ca writes:

> Is it possible to interface the Pagesat system with DOS Waffle?  I am
> still vague at this point on the finer points of the Pagesat system, but
> the following is how I envision it to work.  I would appreciate pointers
> from existing PageSat DOS users, especially if you use Waffle.

It's a cinch.  The PageSat comm program creates standard uncompressed news
files with the extension of .BAG --- news0001.bag, news0002.bag, etc.
You need only pick each of these up with RNEWS, e.g., RNEWS < news0001.bag.

I've written a free utility I call PageNews which waits for a .bag
file to be created (or will process all if invoked on a directory full
of 'em) and invokes RNEWS on each.  When there is nothing to do, it
simply sits there giving back CPU cycles to DESQview.

> Bare-bones slow 386 (16MhZ) with about an 80MB drive handles the sat
> feed.  I assume the feed is always coming in, so I don't expect this
> machine to do much else.

I run the receiver program on a 5th comm port added to my BBS machine a
486/33 running a 4-node PCBoard system (with Waffle and ZipNews as
doors).  The current PageSat news feed runs at approximately 1200
characters per second, so the comm port is opened at 19,200.  We're
keeping only about 180 news groups of the total feed, so a small JUNK
directory located on a RAM drive keeps the load on the machine quite
light.  (This may change if I order the planned 3-gig Micropolis SCSI-2
soon.  <g>)

> interval (say, 15 minutes or 1/2 hour), Waffle will simply copy the files
> from the Pagesat computer via LAN and then delete them over there.
> Waffle will then perform batching for other sites, expiration, etc.

I have a 2nd, back-up machine, a 386/16 to which I sometimes switch the
feed (via several A-B switch boxes) such that the feed piles up on that
box if the BBS machine is down for whatever reason -- disk backups, or
if it's pressed into other service temporarily.  I also can leave things
in the 2-machine configuration when both are operating, in which case
the finished news files are shipped across to the BBS machine
(continuously) via null modem cable.  The back-up machine also runs
under DESQview and normally has one DV window dedicated to PageSat
receiving and a second for pre-processing the news and shipping it over
via the null modem.  Other DV windows are used for various odd jobs I
may do from time to time, without impacting the feed, or losing
interrupts, etc.  (16550 UARTs are required, however.)  I suspect anyone
could get away with a fast '286 as such a "back-up" machine.

> - The Pagesat computer will be a perpetual data machine.  Since data will
> be retrieved and deleted from it's hard drive on a frequent basis, I
> assume the 80MB drive will meet my needs.

More than enough.

> - Is it a simple matter to configure the Pagesat computer to only receive
> a selection of groups, or must all newsgroups be retrieved and then the
> ones not in a system file immediately deleted?

Yes, you can do this.  The pre-processing I mentioned above essentially
does this.  I use a FIDO utility called Dovemail to use a listing of
newsgroups (separate from your USENET file) as the basis for discarding
unwanted newsgroups.  So, when running in the 2-machine configuration,
I can send across for processing by RNEWS news files that contain only
only articles for the groups that I carry.

> - This should be a DOS-based solution.  Linux is fine but I don't think
> it offers Lantastic support(?).

As you've noticed, not even LAN support is needed to do the job.

> I am a bit concerned -- though excited -- about the prospect of dealing
> with a continuous stream of news!  :-)

I still marvel at my PageSat system being paid off so rapidly.  I formerly
averaged over $125 per month for just the UUCP news portion of my long
distance phone bill.  And now, when I see a 225K file come thru from some
newbie on comp.bbs.misc, etc., posting his latest find to the world, I can
sit back and grin (no more elevated blood pressure) as I imagine the flames
about to be directed his way from the long distance UUCP sites.  :)

--
Jack Kilday                |             jkilday@nlbbs.com
The Northern Lights BBS    |                    -=-
207-761-4782 (v.32bis/HST) | 4-Nodes, 700 Megs * Internet: UUCP, FTP, Telnet
Re: Pagesat & DOS - an oxymoron?
#3556
Author: Keith Smith
Date: Thu, 17 Feb 1994 01:43
24 lines
2019 bytes
In article <frampton.311.761272369@vicuna.ocunix.on.ca>,
Steve Frampton <frampton@vicuna.ocunix.on.ca> wrote:
>epoole@leotech.mv.com (Eric Poole) writes:
>
>>I think you will be better off if you can configure things so that the
>>Pagesat machine is a workstation and not a server, and let the Pagesat
>>machine take care of copying things over to the Waffle machine.  If
>>you can do that.  In any case, it's something to make a note of and
>>keep in mind.
>
>Nice tip...how long do you have between sat batches to do this?  How long 
>does a pagesat dump take for the entire newsfeed?

The stuff comes in continously all day and all night long.  It rarely
stops for over a minute or two.  IMHO the best way to run this thing is
from the likes of a Linux type freeware box with minimal hardware doing
SAT + NEWS and only that.  C-News by itself on a full feed is pretty
intense.  I think people lose concept at times at how much stuff is in a
FULL newsfeed plunking 60+ MB a day at you.  You can fill up a Gig disk
in a very short time span if you don't expire regularly.
-- 
Keith Smith          keith@ksmith.com              5719 Archer Rd.
Digital Designs      BBS 1-910-423-4216            Hope Mills, NC 28348-2201
Somewhere in the Styx of North Carolina ...
Thread Navigation

This is a paginated view of messages in the thread with full content displayed inline.

Messages are displayed in chronological order, with the original post highlighted in green.

Use pagination controls to navigate through all messages in large threads.

Back to All Threads