Recording activity on the system (or of a particular program) for later reporting and analysis. Logins, logouts, web server page requests, etc might all be logged.
Questions tagged [logging]
2851 questions
7
votes
4 answers
nginx error log Grok pattern
I am having trouble getting the following nginx error log message to parse in the grok debugger. I have a feeling there is a stupid trick that I should use but can't figure out what it may be.
2015/03/20 23:35:52 [error] 8#0: *10241823 testing…

jmreicha
- 790
- 1
- 16
- 29
7
votes
3 answers
How can I suppress Postfix anvil statistics from system logs?
After every email sent through my mail server, postfix/anvil appends something like the following:
Nov 9 15:09:11 keutenberg postfix/anvil[30006]: statistics: max connection rate 1/60s for (smtp:103.28.42.75) at Nov 9 15:02:42
Nov 9 15:09:11…

squircle
- 524
- 6
- 14
7
votes
2 answers
When cron is completed How to get email notification and log in a file (both)
I am a Newbie to linux. I'm trying to figure out things. Can someone kindly help me how to combine these two commands?
(1) Normally cron can results can be directed to a log file by editing crontab in the below manner
*/10 * * * * /scripts/mysc.sh…

Aravinda
- 1,101
- 5
- 12
- 30
7
votes
4 answers
Ubuntu 14.04 System Logging
I've set up an Ubuntu 14.04 Server (from an Ubuntu 12.04 Server) but today I wanted to look in the auth.log but this file is not used. It seems that ´syslog´ was deleted.
How does Ubuntu 14.04 log? I need this for a server.
Thank you.
user219962
7
votes
2 answers
Parseable NGINX accesslog files with delimiters
The default NGINX format is this:
log_format combined '$remote_addr - $remote_user [$time_local] '
'"$request" $status $body_bytes_sent '
'"$http_referer" "$http_user_agent"';
Which is a bit hard to parse. I am…

Kasper Grubbe
- 311
- 4
- 9
7
votes
1 answer
rsyslog udp forwarding truncates at 2048 characters
Rsyslog on a RHEL 6 server is receiving messages locally on port 514 UDP. These messages are sometimes much larger than normal syslog message sizes. I am seeing rsyslog handle all of the messages just fine, it writes to the local files without…

nictrix
- 173
- 1
- 7
7
votes
1 answer
How do I increase the logging level for Puma?
Currently I am only getting ActiveRecord and view-rendering output in my Rails application log file, since I switched to Puma from WEBrick. I haven't been able to find where I can modify the output level of Puma's logging. Thoughts?

Ernie
- 191
- 1
- 2
- 4
7
votes
1 answer
How does logrotate handle concurrency?
In the case that logrotate runs the same time as the log file is being updated, what will happen?
Will the new log be rotated into a historical log file? Or it will stay in the current log file?

johnsam
- 235
- 1
- 6
7
votes
2 answers
iptables SSH connection logging
Is it possible to only write a log-entry when a connection is established ?
I have tried:
iptables -I OUTPUT -p tcp --dport 22 -j LOG --log-level notice --log-prefix "outgoing ssh connection"
to log outgoing SSH connections but this logs every…

phenom135
- 107
- 1
- 4
- 13
7
votes
1 answer
Is there a tool that can top-ify an input stream?
I come across quite a few use cases where it would be very useful to take input from a (usually newline-delimited) stream and summarise it in a top-like fashion (see top, iotop, etc). A kind of on-the-fly pivot table.
e.g. Take the log-esque…

tudor -Reinstate Monica-
- 1,805
- 18
- 36
7
votes
3 answers
Secure logstash and elasticsearch
I'm considering running logstash on my prod server (simple install. http://logstash.net/docs/1.1.13/tutorials/getting-started-simple) and set kibana to access logs.
My concern is: how to secure my prod logs (especially elasticsearch which is run by…

CoBaLt2760
- 193
- 1
- 7
7
votes
3 answers
nginx with real_ip -- log both client remote_addr and proxies address
I have an nginx instance set up behind multiple load balancing proxies, and I am using real_ip to get the clients IP address in remote_addr for processing by my Python application.
However in my logs I would like to log the proxy server that…

X-Istence
- 752
- 1
- 8
- 18
7
votes
3 answers
F5 Big-IP, X-Forwarded-For and IIS Logs
I've got an F5 Big-IP that is mangaged by our hosting provider. It's dedicated to our private VLAN, etc. Works great :)
We requested them to add in an X-Forwarded-For HTTP-Header field. They've done that and we can now access that in the code.…

Pure.Krome
- 6,508
- 18
- 73
- 87
7
votes
1 answer
How to count unique visitors in an nginx access.log?
I tried this, but it always returns 1.
grep "\[10/Nov/2012" /path/to/access.log | cut -d" " -f1 | sort | uniq | wc -l

Diego Prates
- 73
- 1
- 1
- 3
7
votes
3 answers
Could this server log mean my server is being used as a proxy?
I came across the following entry in my access.log:
58.218.199.147 - - [05/Jun/2012:12:56:04 +1000] "GET http://proxyproxys.com/ HTTP/1.1" 200 183 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)"
Normally when I see a full URL entry in my…

So Over It
- 173
- 1
- 4