Questions tagged [logging]

Recording activity on the system (or of a particular program) for later reporting and analysis. Logins, logouts, web server page requests, etc might all be logged.

2851 questions
7
votes
4 answers

nginx error log Grok pattern

I am having trouble getting the following nginx error log message to parse in the grok debugger. I have a feeling there is a stupid trick that I should use but can't figure out what it may be. 2015/03/20 23:35:52 [error] 8#0: *10241823 testing…
jmreicha
  • 790
  • 1
  • 16
  • 29
7
votes
3 answers

How can I suppress Postfix anvil statistics from system logs?

After every email sent through my mail server, postfix/anvil appends something like the following: Nov 9 15:09:11 keutenberg postfix/anvil[30006]: statistics: max connection rate 1/60s for (smtp:103.28.42.75) at Nov 9 15:02:42 Nov 9 15:09:11…
squircle
  • 524
  • 6
  • 14
7
votes
2 answers

When cron is completed How to get email notification and log in a file (both)

I am a Newbie to linux. I'm trying to figure out things. Can someone kindly help me how to combine these two commands? (1) Normally cron can results can be directed to a log file by editing crontab in the below manner */10 * * * * /scripts/mysc.sh…
Aravinda
  • 1,101
  • 5
  • 12
  • 30
7
votes
4 answers

Ubuntu 14.04 System Logging

I've set up an Ubuntu 14.04 Server (from an Ubuntu 12.04 Server) but today I wanted to look in the auth.log but this file is not used. It seems that ´syslog´ was deleted. How does Ubuntu 14.04 log? I need this for a server. Thank you.
user219962
7
votes
2 answers

Parseable NGINX accesslog files with delimiters

The default NGINX format is this: log_format combined '$remote_addr - $remote_user [$time_local] ' '"$request" $status $body_bytes_sent ' '"$http_referer" "$http_user_agent"'; Which is a bit hard to parse. I am…
Kasper Grubbe
  • 311
  • 4
  • 9
7
votes
1 answer

rsyslog udp forwarding truncates at 2048 characters

Rsyslog on a RHEL 6 server is receiving messages locally on port 514 UDP. These messages are sometimes much larger than normal syslog message sizes. I am seeing rsyslog handle all of the messages just fine, it writes to the local files without…
nictrix
  • 173
  • 1
  • 7
7
votes
1 answer

How do I increase the logging level for Puma?

Currently I am only getting ActiveRecord and view-rendering output in my Rails application log file, since I switched to Puma from WEBrick. I haven't been able to find where I can modify the output level of Puma's logging. Thoughts?
Ernie
  • 191
  • 1
  • 2
  • 4
7
votes
1 answer

How does logrotate handle concurrency?

In the case that logrotate runs the same time as the log file is being updated, what will happen? Will the new log be rotated into a historical log file? Or it will stay in the current log file?
johnsam
  • 235
  • 1
  • 6
7
votes
2 answers

iptables SSH connection logging

Is it possible to only write a log-entry when a connection is established ? I have tried: iptables -I OUTPUT -p tcp --dport 22 -j LOG --log-level notice --log-prefix "outgoing ssh connection" to log outgoing SSH connections but this logs every…
phenom135
  • 107
  • 1
  • 4
  • 13
7
votes
1 answer

Is there a tool that can top-ify an input stream?

I come across quite a few use cases where it would be very useful to take input from a (usually newline-delimited) stream and summarise it in a top-like fashion (see top, iotop, etc). A kind of on-the-fly pivot table. e.g. Take the log-esque…
7
votes
3 answers

Secure logstash and elasticsearch

I'm considering running logstash on my prod server (simple install. http://logstash.net/docs/1.1.13/tutorials/getting-started-simple) and set kibana to access logs. My concern is: how to secure my prod logs (especially elasticsearch which is run by…
CoBaLt2760
  • 193
  • 1
  • 7
7
votes
3 answers

nginx with real_ip -- log both client remote_addr and proxies address

I have an nginx instance set up behind multiple load balancing proxies, and I am using real_ip to get the clients IP address in remote_addr for processing by my Python application. However in my logs I would like to log the proxy server that…
X-Istence
  • 752
  • 1
  • 8
  • 18
7
votes
3 answers

F5 Big-IP, X-Forwarded-For and IIS Logs

I've got an F5 Big-IP that is mangaged by our hosting provider. It's dedicated to our private VLAN, etc. Works great :) We requested them to add in an X-Forwarded-For HTTP-Header field. They've done that and we can now access that in the code.…
Pure.Krome
  • 6,508
  • 18
  • 73
  • 87
7
votes
1 answer

How to count unique visitors in an nginx access.log?

I tried this, but it always returns 1. grep "\[10/Nov/2012" /path/to/access.log | cut -d" " -f1 | sort | uniq | wc -l
Diego Prates
  • 73
  • 1
  • 1
  • 3
7
votes
3 answers

Could this server log mean my server is being used as a proxy?

I came across the following entry in my access.log: 58.218.199.147 - - [05/Jun/2012:12:56:04 +1000] "GET http://proxyproxys.com/ HTTP/1.1" 200 183 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)" Normally when I see a full URL entry in my…
So Over It
  • 173
  • 1
  • 4