Re: HTTP directory listing

Article View: borland.public.cppbuilder.nativeapi

Article #12925

Back to borland.public.cppbuilder.nativeapi Previous Next

#12925

From: Alan Bellingham
Date: Thu, 06 Nov 2003 16:40

10 lines
1475 bytes

Fernando  <frr@easyjob.net> wrote:

>Then how does google or other robots fetch the files to index?

They ask for the default page (usually index.html or similar). They then
follow the links.

Alan Bellingham
-- 
alanb@episys.com

Technical Details

Message-ID: <raukqvoosgdpdfs9pjor1a2f0r3gc3n44r@4ax.com>

Path:

arc1-ca.pugleaf.net!archiver1.google.com!news2.google.com!news.maxwell.syr.edu!newsfeed00.sul.t-online.de!newsfeed01.sul.t-online.de!t-online.de!newsgroups.borland.com!not-for-mail

References:

<3fa2a041@newsgroups.borland.com> <3fa2b389@newsgroups.borland.com> <3fa2b5e1$3@newsgroups.borland.com> <3fa2eb96$2@newsgroups.borland.com> <3fa2f69b$1@newsgroups.borland.com> <3fa2fd5c@newsgroups.borland.com> <3fa36b7d$2@newsgroups.borland.com> <3fa3a088@newsgroups.borland.com> <3faa1444$1@newsgroups.borland.com> <ae7kqvk22psl3sbr25qqg28kftob0aie09@4ax.com>

Show Full Headers

Complete Article Headers

X-Google-Language: ENGLISH,ASCII-7-bit
X-Google-Thread: 10cc67,af8b744a5697d84d
X-Google-Attributes: gid10cc67,public
X-Google-ArrivalTime: 2003-11-06 09:11:08 PST
From: Alan Bellingham <alanb@episys.com>
Newsgroups: borland.public.cppbuilder.nativeapi
Subject: Re: HTTP directory listing
Date: Thu, 06 Nov 2003 16:40:53 +0000
Reply-To: alanb@episys.com
Message-ID: <raukqvoosgdpdfs9pjor1a2f0r3gc3n44r@4ax.com>
References: <3fa2a041@newsgroups.borland.com> <3fa2b389@newsgroups.borland.com> <3fa2b5e1$3@newsgroups.borland.com> <3fa2eb96$2@newsgroups.borland.com> <3fa2f69b$1@newsgroups.borland.com> <3fa2fd5c@newsgroups.borland.com> <3fa36b7d$2@newsgroups.borland.com> <3fa3a088@newsgroups.borland.com> <3faa1444$1@newsgroups.borland.com> <ae7kqvk22psl3sbr25qqg28kftob0aie09@4ax.com>
X-Newsreader: Forte Agent 1.92/32.572
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
NNTP-Posting-Host: 193.129.251.130
X-Trace: newsgroups.borland.com 1068136851 193.129.251.130 (6 Nov 2003 08:40:51 -0700)
Lines: 10
Path: arc1-ca.pugleaf.net!archiver1.google.com!news2.google.com!news.maxwell.syr.edu!newsfeed00.sul.t-online.de!newsfeed01.sul.t-online.de!t-online.de!newsgroups.borland.com!not-for-mail

Reply to Parent Message