Re: HTTP directory listing

Article View: borland.public.cppbuilder.nativeapi

Article #12922

Back to borland.public.cppbuilder.nativeapi Previous Next

#12922

From: Fernando
Date: Thu, 06 Nov 2003 10:09

17 lines
1826 bytes

On Thu, 6 Nov 2003 01:31:45 -0800, "Remy Lebeau \(TeamB\)"
<gambit47.no.spam@no.spam.yahoo.com> wrote:

>
>"CS" <chs104@hotmail.com> wrote in message
>news:3fa3a088@newsgroups.borland.com...
>
>> I want to download all the available HTML-files in a certain directory on
>a
>> HTTP-server (the address is www.svt.se/texttv).
>
>For the specific address that you have mentioned, what you ask for is NOT
>possible!  The server does not produce directory listing information for
>that URL, thus you do not have the necessary information available to
>determine the number of files or the filenames.

Then how does google or other robots fetch the files to index?

Technical Details

Message-ID: <ae7kqvk22psl3sbr25qqg28kftob0aie09@4ax.com>

Path:

arc1-ca.pugleaf.net!archiver1.google.com!news2.google.com!news.maxwell.syr.edu!newsfeed00.sul.t-online.de!newsfeed01.sul.t-online.de!t-online.de!newsgroups.borland.com!not-for-mail

References:

<3fa2a041@newsgroups.borland.com> <3fa2b389@newsgroups.borland.com> <3fa2b5e1$3@newsgroups.borland.com> <3fa2eb96$2@newsgroups.borland.com> <3fa2f69b$1@newsgroups.borland.com> <3fa2fd5c@newsgroups.borland.com> <3fa36b7d$2@newsgroups.borland.com> <3fa3a088@newsgroups.borland.com> <3faa1444$1@newsgroups.borland.com>

Show Full Headers

Complete Article Headers

X-Google-Language: ENGLISH,ASCII-7-bit
X-Google-Thread: 10cc67,af8b744a5697d84d
X-Google-Attributes: gid10cc67,public
X-Google-ArrivalTime: 2003-11-06 02:39:16 PST
From: Fernando  <frr@easyjob.net>
Newsgroups: borland.public.cppbuilder.nativeapi
Subject: Re: HTTP directory listing
Date: Thu, 06 Nov 2003 11:09:38 +0100
Message-ID: <ae7kqvk22psl3sbr25qqg28kftob0aie09@4ax.com>
References: <3fa2a041@newsgroups.borland.com> <3fa2b389@newsgroups.borland.com> <3fa2b5e1$3@newsgroups.borland.com> <3fa2eb96$2@newsgroups.borland.com> <3fa2f69b$1@newsgroups.borland.com> <3fa2fd5c@newsgroups.borland.com> <3fa36b7d$2@newsgroups.borland.com> <3fa3a088@newsgroups.borland.com> <3faa1444$1@newsgroups.borland.com>
X-Newsreader: Forte Agent 1.9/32.560
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
NNTP-Posting-Host: 217.127.66.80
X-Trace: newsgroups.borland.com 1068113377 217.127.66.80 (6 Nov 2003 02:09:37 -0700)
Lines: 17
Path: arc1-ca.pugleaf.net!archiver1.google.com!news2.google.com!news.maxwell.syr.edu!newsfeed00.sul.t-online.de!newsfeed01.sul.t-online.de!t-online.de!newsgroups.borland.com!not-for-mail

Reply to Parent Message