🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Thread View: comp.protocols.tcp-ip
2 messages
2 total messages Started by Doug Taylor Tue, 28 Dec 1999 00:00
IP address list or domain name list for new search engine
#15578
Author: Doug Taylor
Date: Tue, 28 Dec 1999 00:00
11 lines
1428 bytes
I would like to develop a new search engine but am somewhat daunted by
the thought of using the 'brute-force' method of checking all 4 billion
possible IP addresses for web servers from which to collect data. Is
there any way of getting a complete list of IP addresses or registered
domain names to start my search? I have made the request of Network
Solutions and am awaiting their response. I have refered to
www.ipindex.net in the past, but it seems to be (down?).

TIA
Doug Taylor
djtaylor@home.nospam.com
Re: IP address list or domain name list for new search engine
#15577
Author: Thor Kottelin
Date: Tue, 28 Dec 1999 00:00
26 lines
1557 bytes

Doug Taylor wrote:
> 
> I would like to develop a new search engine but am somewhat daunted by
> the thought of using the 'brute-force' method of checking all 4 billion
> possible IP addresses for web servers from which to collect data.

This wouldn't even be enough (keywords: Host header).

> Is
> there any way of getting a complete list of IP addresses or registered
> domain names to start my search? I have made the request of Network
> Solutions and am awaiting their response.

Network Solutions registers domain names in a few TLDs; they do not
register web sites.

Why not simply spider instead?

Thor

-- 
My PGP public key is available on key servers - please use it!

Powerful, automated web hosting: <http://www.virtualis.com/vr/tkotteli/>
Thread Navigation

This is a paginated view of messages in the thread with full content displayed inline.

Messages are displayed in chronological order, with the original post highlighted in green.

Use pagination controls to navigate through all messages in large threads.

Back to All Threads