Questions tagged [log-files]

A log file is a file, often in clear text, which is generated by a software process to record some specific details about the workings of this process.

A log file is a file which is generated by a software process to record some specific details (events) about the workings of this process. Most logfiles are plain, human-readable text files, some however are using a binary format to conserve space and need specific treatment for post-processing. (Example: Unix login history in utmp/wtmp format)

A log file can be categorized into several types:

  1. Access log which records information related to the usage of the service provided by this process.
  2. Error log which records error conditions.
  3. Info/Debug log which records more detailed information as compared with other logs.
  4. Transaction log to document a chain of events, this often is required to be immutable to avoid later tampering.
  5. redo logs, containing the complete information to replay a chain of actions, often used where incomplete data transactions would lead to inconsistent data, for example in file systems or databases.

The main two goals of creating and maintaining log files are:

  1. Finding and debugging problems.
  2. Gathering usage information.

Depending on the frequence of events and the level of detail, logfiles may be growing very quickly, and usually require a strategy for managing their growth.

Depending on special reqirements, log-files may go to specialized devices to meet criteria of speed or immutability.

1103 questions
11
votes
2 answers

Strange Bittorrent Log On My Server

I don't know if the following log has something to do with my site being down sometime. I have lot of websites on my server and they don't have any logs like the following: 117.169.1.85 - - [03/Jan/2015:23:21:37 +0800] "GET…
jaypabs
  • 823
  • 2
  • 10
  • 15
11
votes
3 answers

What is the source of thousands of 4625 Logon Failure errors with Logon Type 8 (NetworkCleartext)?

I have a Windows Server 2008 R2 system that's showing thousands of 4625 Logon Failure errors with Logon Type 8 (NetworkCleartext) in the Security section of the Windows Logs every single day. There are no IP addresses of the systems trying to gain…
11
votes
4 answers

Which logs to track regularly

I run my own server at home for my personal website running Ubuntu Server with Apache, Bind9 and Django. What logs would you suggest are best to keep track of on a regular basis? (rather than on a basis of reading when something goes wrong). I'm…
Elliot Hughes
  • 253
  • 1
  • 2
  • 7
11
votes
6 answers

Failed Request Tracing XML fails to display in Internet Explorer (IIS 7.5)

I have installed the Tracing feature and enabled failed request tracing for a website, to debug a Classic ASP website. The XML logs are created upon occurring errors, however when I open them in IE, instead of getting the nice blue interface I get a…
pilau
  • 281
  • 1
  • 3
  • 8
11
votes
1 answer

Newsyslog wildcards - rotate all logs in a directory

I am running FreeBSD 8.1. I am trying to make newsyslog rotate logs defined by a dynamic path: # logfilename [owner:group] mode count size when flags [/pid_file] [sig_num] /path/logs/*.log 644 7 100 $D0 J /path/logs/*/*.log …
Richard Knop
  • 1,149
  • 2
  • 20
  • 34
11
votes
4 answers

In unix, what's the best way to reduce the size of a massive log file that is actively being written to?

On a linux server, I want to reduce the size of a log file which is several GB big. Cutting off the top half, or maybe the first million lines would work.
Phil
  • 113
  • 1
  • 1
  • 4
11
votes
2 answers

What to do if wget's progress:mega doen't cut it anymore?

I have script for downloading large files in a queue. Now I would really appreciate it, if I had a decent log. Specifying the -o or -a option is apparently specially made for that, however as of the time I am writing this "very large files", as the…
niklasfi
  • 459
  • 1
  • 8
  • 16
11
votes
6 answers

Tips on efficiently storing 25TB+ worth million files in filesystem

Say you are confronted with 25 TB worth uncompressed log files and you have at your disposal an array of 20 commodity boxes with collective free storage capacity of 25 TB. How would you store these ?. a) Which distributed file system to use ? b)…
Ankur Gupta
  • 230
  • 2
  • 8
10
votes
2 answers

Can I delete access log files in nginx. Will it cause an issue

My access log file takeing more than 100 Go can i delete safely the access log file Could i delete it as root ? Can other users access to this file after recreating it ?
ben teber
  • 103
  • 1
  • 1
  • 4
10
votes
4 answers

NGINX Access Log by Location

Hello so I have two platforms where one operates as a subdirectory. I would like to be able to have an access and error log for each application; however it is not working as I intended :( Here is what I have: server { listen 80 default; …
Ray
  • 153
  • 1
  • 1
  • 7
10
votes
2 answers

Interpreting DHCP related message from rsyslog

In /var/log/messages from an EC2 instance there are a lot of lines such as: ip- ec2net: [get_meta] Trying to get http://169.254.169.254/latest/meta-data/network/interfaces/macs/MAC_ADDR/local-ipv4s
ChristianF
  • 175
  • 1
  • 1
  • 8
10
votes
1 answer

iis 7 log file directory

under my log directory I have a list of subdirectories: W3SVC1, W3SVC2, W3SVC3, etc, etc. How do I match those folders with each website on IIS?
Jonas Stawski
  • 479
  • 2
  • 8
  • 18
10
votes
2 answers

Where are the Google Health check logs

I am running a GCE instance and on it I have a Kubernetes cluster running. An HTTP Load Balancer is also configured to probe the health of the a Kubernetes service running on this instance. But I constantly get this error: Error: Server Error The…
10
votes
1 answer

Different permissions per log file when using rsyslog

Is it feasible to define different permissions per log file, using rsyslog? $FileCreateMode applies to all, but I want different permissions for a specific file.
yannisf
  • 577
  • 2
  • 6
  • 15
10
votes
7 answers

Send email when anyone logs on

My CentOS/RHEL system may have been hacked, I'm not sure. But I'm playing it safe by creating a new slice from scratch. I've installed tripwire, but I'd also like to be emailed when anyone logs in. I don't want to wait for the daily logwatch report,…
LarryK
  • 336
  • 1
  • 3
  • 15