🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: comp.os.ms-windows.programmer.networks
Article #36

Generate Report from different LOG-Files

#36
From: Michael Ruck
Date: Thu, 28 Nov 2002 14:48
62 lines
4244 bytes
Hi @all!

I have a really special problem and I hope one of you can help me very
quickly.

I have do search for or develop a tool, that can generate one report out of
different kinds of LOG-files.

hese kind of LOG-files are:
    MS Exchange SMTP-log or sendmail log
    squid log
    nacctd log
    IIS NCSA log

The tool I'm searching for has to analyse these log-files and generate one
report out of it, if possible in HTML or PDF.


A few words, why I need such a tool:

We operate here at the location a computing centre for our parent
company. At this computing centre further subsidiaries are attached.
In order to make now an exact account over the developed traffic, we
need the analysis of these different log files, because the account has to
be
for each company, arranged according to user and service (Web, email,
VPN etc..).

The different log files are in addition also still on different
servers distributed. Everyone the log file types specified above is on
another server.

The different information, which service which user used and how much
traffic it produced thereby, are also only in the different log files
to find.

My target is it now to summarize all these data either in only one
report or in a database (esp. MySQL).

Now does one of you know a tool, which can complete this work for me? Or
does one of you have an idea, how one can implement relatively simply such a
tool? Perhaps one of you wrote already a similar Tool and can help me.

Or is it possible to install one sniffing-tool on the firewall, which logs
all the information I need (user (or internal host) -> service (web, email,
vpn) -> bytes send/recieved). At the moment the nacctd is running on our
firewall to report the vpn-traffic, but it is not possible to report the
other services, because only the internal host of our squid is showing in
these log-files.

Maybe I can modify the squid to send the users host to the firewall. In the
nacctd-log the ports of the connection is logged and so I can see, what
service is used.


Please help me, it is really important. Post your answer here in the
Newsgroup or send me a mail.


Thanks for all your help.

Michael Ruck
Technical Details
Message-ID: <as5ac8$cb2$1@nathan.regio.net>
Path: arc1-ca.pugleaf.net!archiver1.google.com!news1.google.com!sn-xit-02!sn-xit-06!sn-xit-01!sn-xit-04!supernews.com!news.maxwell.syr.edu!newsfeed.icl.net!newsfeed.fjserv.net!newsfeed.freenet.de!news-lei1.dfn.de!news-fra1.dfn.de!news.regio.net!not-for-mail

Show Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII-7-bit
X-Google-Thread: f922c,18caa3bfe0f2c867,start
X-Google-Attributes: gidf922c,public
X-Google-Thread: fb1f5,18caa3bfe0f2c867,start
X-Google-Attributes: gidfb1f5,public
X-Google-Thread: 1124cf,18caa3bfe0f2c867,start
X-Google-Attributes: gid1124cf,public
X-Google-Thread: f77ed,18caa3bfe0f2c867,start
X-Google-Attributes: gidf77ed,public
X-Google-Thread: f9325,18caa3bfe0f2c867,start
X-Google-Attributes: gidf9325,public
X-Google-Thread: 11100c,18caa3bfe0f2c867,start
X-Google-Attributes: gid11100c,public
X-Google-Thread: fa91f,18caa3bfe0f2c867,start
X-Google-Attributes: gidfa91f,public
X-Google-Thread: 115b46,18caa3bfe0f2c867,start
X-Google-Attributes: gid115b46,public
X-Google-ArrivalTime: 2002-11-28 06:51:52 PST
Path: arc1-ca.pugleaf.net!archiver1.google.com!news1.google.com!sn-xit-02!sn-xit-06!sn-xit-01!sn-xit-04!supernews.com!news.maxwell.syr.edu!newsfeed.icl.net!newsfeed.fjserv.net!newsfeed.freenet.de!news-lei1.dfn.de!news-fra1.dfn.de!news.regio.net!not-for-mail
From: "Michael Ruck" <m.ruck@itnovum.de>
Newsgroups: comp.os.ms-windows.programmer.networks,comp.os.ms-windows.programmer.tools.misc,comp.protocols.snmp,comp.protocols.tcp-ip,comp.security.firewalls,de.comp.os.ms-windows.nt,de.comp.os.ms-windows.programmer,hannover.uni.comp.linux,microsoft.public.de
Subject: Generate Report from different LOG-Files
Date: Thu, 28 Nov 2002 15:48:43 +0100
Organization: Creative Work Studios
Lines: 64
Message-ID: <as5ac8$cb2$1@nathan.regio.net>
Reply-To: "Michael Ruck" <cws@gmx.com>
NNTP-Posting-Host: mx.mehler-ag.de
Mime-Version: 1.0
Content-Type: text/plain;
 charset="iso-8859-1"
Content-Transfer-Encoding: 7bit
X-Trace: nathan.regio.net 1038494920 12642 195.158.56.2 (28 Nov 2002 14:48:40 GMT)
X-Complaints-To: usenet@news.regio.net
NNTP-Posting-Date: Thu, 28 Nov 2002 14:48:40 +0000 (UTC)
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2600.0000
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2600.0000