Best Way to Keep Up on Linux Log Files

Question

I run multiple Linux (Ubuntu) web servers and am looking for a convenient way to keep tabs on important log files. I'd like to monitor pertinent LAMP logs as well as server accesses/logins.

Are there any convenient tools/utilities that will (a) rotate log files, (b) compress them, and (c) email or archive them for later viewing?

Not as an answer to your question, but you should look at centralizing your logs off-machine. Having all of your logs spooled into the same server assists with finding patterns which can act as precursors to critical errors. — Matt Simmons, Jan 08 '12 at 19:03

user9517 · Accepted Answer · 2012-01-08T18:58:44.730

4

Logrotate will do everything you list above and more e.g.

"/var/log/httpd/access.log" /var/log/httpd/error.log {
    compress
    rotate 5
    mail logs@your.address.example.com
    size 1M
    sharedscripts
    postrotate
        /usr/bin/killall -HUP httpd
    endscript
}

Would mail you the logs that are about to be deleted etc

edited Jan 08 '12 at 18:58

answered Jan 08 '12 at 18:53

user9517

115,471
20
215
297

1

Combine with logwatch and it will break out useful information in easily readable format too, plus its easy to extend. – Mattias Ahnberg Jan 08 '12 at 19:37
1

Combine with Logstash and you get off-server centralised storage and indexing – Tom O'Connor Jan 08 '12 at 20:22
logstash looks pretty nice. – LVLAaron Jan 08 '12 at 23:01

score 2 · Answer 2 · answered Jan 08 '12 at 18:54

2

How about something like Splunk? I collect 10gb of data per day with it..... :)

answered Jan 08 '12 at 18:54

LVLAaron

436
6
13

1

Its only free up to 500Mbyte per day though, above that it starts to be quite heavily priced. :/ – Mattias Ahnberg Jan 08 '12 at 19:36

Best Way to Keep Up on Linux Log Files

2 Answers2