Questions tagged [log-files]

A log file is a file, often in clear text, which is generated by a software process to record some specific details about the workings of this process.

A log file is a file which is generated by a software process to record some specific details (events) about the workings of this process. Most logfiles are plain, human-readable text files, some however are using a binary format to conserve space and need specific treatment for post-processing. (Example: Unix login history in utmp/wtmp format)

A log file can be categorized into several types:

  1. Access log which records information related to the usage of the service provided by this process.
  2. Error log which records error conditions.
  3. Info/Debug log which records more detailed information as compared with other logs.
  4. Transaction log to document a chain of events, this often is required to be immutable to avoid later tampering.
  5. redo logs, containing the complete information to replay a chain of actions, often used where incomplete data transactions would lead to inconsistent data, for example in file systems or databases.

The main two goals of creating and maintaining log files are:

  1. Finding and debugging problems.
  2. Gathering usage information.

Depending on the frequence of events and the level of detail, logfiles may be growing very quickly, and usually require a strategy for managing their growth.

Depending on special reqirements, log-files may go to specialized devices to meet criteria of speed or immutability.

1103 questions
0
votes
1 answer

OpenVPN server log - what is the "us=" identifier following the timestamp?

I use OpenVPN 2.3.10 in server mode, with logging set to verb 4. In the log, every line begins by a timestamp (Mon May 11 10:40:10 2020) and then us=, followed by a 5- or 6-digit number. What is this us identifier? Is it the microsecond (μs) part of…
zire
  • 23
  • 2
0
votes
1 answer

Awstats + Postfix logs - no senders/recipients?

I am trying to configure awstats (v7.6 from repo on Ubuntu 18.04) to process postfix log files. But I don't have much log data to work with. Awstats is reporting that it has processed the data and the summary shows the expected number of messages…
symcbean
  • 21,009
  • 1
  • 31
  • 52
0
votes
2 answers

How to Distinguish "Pre-Fetched" Page Requests From Ordinary Requests?

"Pre-Fetching" might not be the most widely-used term, but in any event, i'm referring to browser plugins that request pages prior to an actual request from the user. (For instance, when a new page loads and you begin reading it, the Browser will…
doug
  • 245
  • 2
  • 10
0
votes
0 answers

UFW activated, but still failed connections in auth.log

I activated the ufw on my ubuntu 18 server. After resetting to defaults, deny all incomming, I opened port 22, 80 and 443 and enabled the logging. In the ufw log, I can see a lot of blocked request. But I don't understand, that I can find failed…
0
votes
1 answer

How to analyse vsftpd log files with goaccess

I'm trying to use goaccess log analysis tool, to analyse vsftpd FTP server's logs. I'm aware that being a web server log analyser, goaccess is not the best tool for this. That being said, it's flexible enough with the log format and we're already…
hayalci
  • 3,631
  • 3
  • 27
  • 37
0
votes
1 answer

Guaranteed rename logfile AFTER logfile is no longer being written to

I have the following set up. In a remote machine I have a process continuously running which subscribes to some data and writes it to stdout (lets call the process the subscriber). I call the subscriber from a .sh script which redirects stdout into…
0
votes
1 answer

can logstash package individual log types into packages an scp them over to a central node?

I am curious whether logstash only processes logs and streams them at the event/line level or can it package all apache access logs for example and send them over zipped up to a central node?
Dan
  • 173
  • 1
  • 1
  • 7
0
votes
1 answer

Apache Access Log

I use fail2ban to detect malcious requests to any of my hosted domains, which is working very well, with one exception. If a requests is sent to the IP instead of a fqdn or a subdomain, it gets catched and written into other_vhosts_access.log since…
Tim Altgeld
  • 49
  • 1
  • 7
-1
votes
1 answer

(Linux) /var/log organisation using logrotate and rsyslog without breaking important systems

This is likely to elicit calls to close as it's asking for opinions, but I don't know how or where to ask in a more appropriate manner. Apologies in advance if this offends - it's not intended that way, and there is an actual question, which is…
Graham Nicholls
  • 291
  • 2
  • 5
  • 13
-1
votes
1 answer

bash + how to avoid specific messages in the log file

when I run the bash script on my Linux machine we get the following errors in my log , note - we set in the script: exec > $log 2>&1 , ( in order to send all standard error/output to $log ) the errors messages: tput: No value for $TERM and no…
jango
  • 59
  • 2
  • 3
  • 12
-1
votes
1 answer

What changes have been made to my cpanel?

What is the most easily accessible way to track changes made to cPanel? Ideally I would like to create a script which gathers information from the cPanel logs, but are there any scripts already created to do this?
Jon
  • 171
  • 1
  • 9
-1
votes
1 answer

rsyslog with elasticsearch and forwarding custom logs

I have configured rsyslogd Log Server With Elasticsearch and Kibana. I am able to forward the /var/log/messages from the client Linux servers (CentOS 7, RHEL 6) to the central Linux Log server (CentOS 7). However, I have a custom log file…
Arun Krishnan
  • 379
  • 2
  • 3
  • 13
-1
votes
1 answer

Log analyzer for statistics (referring sites, referrers URLs) per day

The main task of the analyzer - referring sites, referrers URLs. Logs are collected in one place from 3 nginx server. I install awstats with a specific parameter LogFormat - all working fine, but the customer was not enough, we need statistics…
-1
votes
1 answer

azenv2.php ,what is in the error log view?

we check in log in DirectAdmin,view many unknow log : [Thu Aug 11 07:59:21.892544 2016] [:error] [pid 17914] [client 117.1.247.114:57814] script '/var/www/html/judge.php' not found or unable to stat [Thu Aug 11 08:17:57.803557 2016] [:error] [pid…
-1
votes
1 answer

Logrotate is not working centos 6.6

I have the following configuration for logrotating the app logs. /opt/tomcat/logs/app-web.txt { copytruncate daily size 500M compress delaycompress rotate 0 missingok notifempty } /opt/tomcat/logs has a lot of…
Vikash
  • 141
  • 4