Article View: dk.admin.netmisbrug
Article #144statistico.dk
From: Anders Wegge Keller
Date: Mon, 07 May 2012 06:32
Date: Mon, 07 May 2012 06:32
59 lines
3878 bytes
3878 bytes
Jeg har fået besøg af en crawler fra statistico.dk. Angiveligt er det
en crawler der samler information om danske domæner. Det lyder jo
vældigt fornuftigt, men den har godt nok ikke en pæn adfærd:
46.4.130.28 - - [07/May/2012:08:18:56 +0200] "GET / HTTP/1.1" 200 1921
"-" "Statastico DK bot - Learn more at: statastico.dk/bot"
46.4.130.28 - - [07/May/2012:08:18:56 +0200] "GET /ucp.php?mode=login
HTTP/1.1" 404 205 "-" "Mozilla/5.0 (X11; U; Linux i686; ru;
rv:1.9.2.24) Gecko/20111107 Ubuntu/10.04 (lucid)
Firefox/3.6.24"
46.4.130.28 - - [07/May/2012:08:18:56 +0200] "GET
/3rdparty/speller/spellChecker.js HTTP/1.1" 404 230 "-"
"Mozilla/5.0 (X11; U; Linux i686; ru; rv:1.9.2.24)
Gecko/20111107 Ubuntu/10.04 (lucid) Firefox/3.6.24"
46.4.130.28 - - [07/May/2012:08:18:56 +0200] "GET /admin/login.asp
HTTP/1.1" 404 213 "-" "Mozilla/5.0 (X11; U; Linux i686; ru;
rv:1.9.2.24) Gecko/20111107 Ubuntu/10.04 (lucid)
Firefox/3.6.24"
46.4.130.28 - - [07/May/2012:08:18:56 +0200] "GET /index.php/admin/
HTTP/1.1" 404 214 "-" "Mozilla/5.0 (X11; U; Linux i686; ru;
rv:1.9.2.24) Gecko/20111107 Ubuntu/10.04 (lucid)
Firefox/3.6.24"
46.4.130.28 - - [07/May/2012:08:18:56 +0200] "GET /umbraco/login.aspx
HTTP/1.1" 404 216 "-" "Mozilla/5.0 (X11; U; Linux i686; ru;
rv:1.9.2.24) Gecko/20111107 Ubuntu/10.04 (lucid)
Firefox/3.6.24"
46.4.130.28 - - [07/May/2012:08:18:56 +0200] "GET /admincp/ HTTP/1.1"
404 206 "-" "Mozilla/5.0 (X11; U; Linux i686; ru;
rv:1.9.2.24) Gecko/20111107 Ubuntu/10.04 (lucid)
Firefox/3.6.24"
46.4.130.28 - - [07/May/2012:08:18:56 +0200] "GET
/wp-content/plugins/wp-e-commerce/ HTTP/1.1" 404 231 "-"
"Mozilla/5.0 (X11; U; Linux i686; ru; rv:1.9.2.24)
Gecko/20111107 Ubuntu/10.04 (lucid) Firefox/3.6.24"
46.4.130.28 - - [07/May/2012:08:18:56 +0200] "GET /typo3/ HTTP/1.1"
404 204 "-" "Mozilla/5.0 (X11; U; Linux i686; ru;
rv:1.9.2.24) Gecko/20111107 Ubuntu/10.04 (lucid)
Firefox/3.6.24"
46.4.130.28 - - [07/May/2012:08:18:56 +0200] "GET /admin/Systemfiles/
HTTP/1.1" 404 216 "-" "Mozilla/5.0 (X11; U; Linux i686; ru;
rv:1.9.2.24) Gecko/20111107 Ubuntu/10.04 (lucid)
Firefox/3.6.24"
Jeg har følgende anker:
1) Kigger ikke efter robots.txt
2) Sløret UA
3) Uregulerede requests
4) )Og det er den værste) aktiv proben efter administrative interfaces.
Har i andre set noget tilsvarende, og i givet fald, har i fundet ud
af om det er et joe-job, eller en decideret skummel crawler?
--
/Wegge
Leder efter redundant peering af dk.*,linux.debian.*
Technical Details
Message-ID:
<87lil45wn7.fsf@huddi.jernurt.dk>Path:
arc1-ca.pugleaf.net!pr3ni13413pbb.0!nntp.google.com!news1.google.com!goblin1!goblin.stu.neva.ru!eweka.nl!hq-usenetpeers.eweka.nl!newsfeed101.telia.com!starscream.dk.telia.net!news.corell.dk!news.jernurt.dk!.POSTED!not-for-mailShow Full Headers
Complete Article Headers
X-Google-Thread: 10b38b,15f4ce3217114965,start
X-Google-NewGroupId: yes
X-Google-Attributes: gid6c8e56c067,domainid0,public,usenet
X-Google-Language: DANISH,UTF8
Received: by 10.68.239.134 with SMTP id vs6mr8909984pbc.4.1336372350246;
Sun, 06 May 2012 23:32:30 -0700 (PDT)
Path: arc1-ca.pugleaf.net!pr3ni13413pbb.0!nntp.google.com!news1.google.com!goblin1!goblin.stu.neva.ru!eweka.nl!hq-usenetpeers.eweka.nl!newsfeed101.telia.com!starscream.dk.telia.net!news.corell.dk!news.jernurt.dk!.POSTED!not-for-mail
From: Anders Wegge Keller <wegge@wegge.dk>
Newsgroups: dk.admin.netmisbrug
Subject: statistico.dk
Date: 07 May 2012 08:32:28 +0200
Organization: Not very much
Lines: 59
Sender: wegge@huddi.jernurt.dk
Message-ID: <87lil45wn7.fsf@huddi.jernurt.dk>
NNTP-Posting-Host: localhost
Mime-Version: 1.0
X-Trace: huddi.jernurt.dk 1336372349 26326 127.0.0.1 (7 May 2012 06:32:29 GMT)
X-Complaints-To: usenet@jernurt.dk
NNTP-Posting-Date: Mon, 7 May 2012 06:32:29 +0000 (UTC)
User-Agent: Gnus/5.09 (Gnus v5.9.0) Emacs/21.4
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit