Questions tagged [nxlog]

NXLOG is a universal log collector and forwarder supporting different platforms, log sources and protocols.

NXLog can work in a heterogenous environment collecting event logs from thousands of different sources in many formats. NXLog can accept event logs from TCP, UDP, file-based logs, database and various other sources in different formats such as Syslog, Windows Event Log, DNS debug log etc.

It can perform log rewrite, correlation, alerting, pattern matching, execute scheduled jobs, log rotation and log conversion in other formats such as to JSON. It was designed to be able to fully utilize today's multi-core CPU systems. Its multi-threaded architecture enables input, log processing and output tasks to be executed in parallel. Using a high-performance I/O layer, it is capable of handling thousands of simultaneous client connections and process log volumes above the 100.000 EPS range.

NXLog tries hard to minimize losing log messages. It does not drop any unless instructed to. It can process input sources in a prioritized order, meaning that a higher priority source will be always processed before others. This can further help avoiding UDP message loss (as an example). In case of network congestion or other log transmission problems, NXLog can buffer messages on the disk or in memory. Using loadable modules it supports different input sources and log formats, not only limited to Syslog but Windows Event Log, audit logs or even custom binary application logs.

It is possible to further extend its functionality by using custom loadable modules similarly to the Apache Web server. In addition to the online log processing mode, it can be used to process logs in batch mode in an offline fashion. A powerful configuration language with an Apache style configuration file syntax enables it to rewrite logs, send alerts, execute external scripts or do virtually anything based on any criteria specified using the NXLog configuration language.

Please see the NXLog User Guide for more information.

91 questions
0
votes
1 answer

NXLog TCP Module Not Working

I am trying to use NXLog to forward logs from a file on one computer to a file on another computer. I am new to NXLog but feel like I now have a good handle on it after consulting the documentation. Below is my configuration file for first the…
frankgreco
  • 1,426
  • 1
  • 18
  • 31
0
votes
1 answer

Windows nxlog - Wildcard Directories in Config File

I have the following folder structure: -job-folders -1 -log.txt -2 -log.txt -3 -log.txt I want to do watch log.txt in all of the above job folders. I am currently using: Module im_file …
Lloyd Banks
  • 35,740
  • 58
  • 156
  • 248
0
votes
1 answer

Issue selecting specific levels of windows application logs in NXLog

I'm trying to pass only Warning / Error / Critical level Application Logs through NXLog to my ELK stack. When I have this configuration Module im_msvistalog # this kinda works for me, put * to get everything …
pcort
  • 419
  • 1
  • 6
  • 19
0
votes
1 answer

NXlog ignores multiline tomcat stacktraces while sending to Papertrail

I am able get the stacktrace[exceptions] from rsyslog (v-8.13.0) to a common nxlog server which sends the logs to a papertrail server. But the nxlog server ignores these multiline logs to papertrail. I know there is a module (xm_multiline) in nxlog…
Nishant Singh
  • 3,055
  • 11
  • 36
  • 74
0
votes
1 answer

nxlog and elasticsearch parsing issue

I'm running an ELK stack and passing all my windows logs to it from nxlog, and am having an issue specifically with IIS logs. In nxlog I'm running this in the nxlog.conf file Module xm_csv Fields $date, $time, $s-ip,…
pcort
  • 419
  • 1
  • 6
  • 19
0
votes
1 answer

NXLog and old Windows events

It is possible to configure NXLog to send old Windows event so Syslog (ELK)? So, if my machine is offline (any reason to lose network) I want to know what is happened in offline mode. Maybe someone attack my machine, or whatever, and I want to get…
Kolesar
  • 1,265
  • 3
  • 19
  • 41
0
votes
2 answers

Can't get nxlog to logstash with SSL working

I've bought a certificate from DigiCert. So I got the files; DigiCertCA.crt, mydomain_com.crt mydomain_com.key I changed my logstash config to this; tcp { type => "AppLog" port => 5656 host => "mydomain.com" ssl_cacert =>…
hayer
  • 1
  • 2
0
votes
1 answer

Forward windows event logs using nxlog to logstash

I am trying to set up a central logging server. I am using nxlog to send window's security events to a ubuntu server running elasticsearch logstash and kibana, but the log files that nxlog outputs dont look right because logstash can't pase any of…
user3324343
  • 177
  • 1
  • 3
  • 9
0
votes
2 answers

NXLog to Read File, Logging from Bottom to Top

I'm using NXLog to read log files and send to to Logstash. Normally this works fine, but I'm now trying to send logs from a file, where the new events gets added at the top of the file, not the bottom. Now it's not sending anything. This is from…
RVZ
  • 13
  • 6
0
votes
1 answer

Drop duplicate lines with NXLog

I'm using NXLog to read a log file and send it to Logstash. This works fine, but the some of the log items are duplicates. They're in separate lines, but the content is exactly the same. I can't change the way the logs are written to the log…
RVZ
  • 13
  • 6
0
votes
1 answer

Problems with multiline extension in nxlog

I have following logformat: -- New Entry ------------------------- 08:03:10 01.04.15 ncjhdnbchjbdc 08:03:10 jnkjsdncksjdnc xd1: ndkjewnckjdwcndw xd2: jncxkjdsnkjcndsqckjnc c cw djkcdnc cnd kj nc 08:03:10 dscsdcdsc -- New Entry…
Giuseppe
  • 1
  • 4
0
votes
1 answer

nxlog data (gelf) to graylog2 server

I'm using a graylog2 vm to get my firewall syslogs and it runs quite well. Now I'd like to get some windows logs using nxlog and that doesn't work at all. My guess is that my xml code in the conf file is wrong, but I've been wrong before.. Note :…
Antoine
  • 1
  • 1
  • 2
0
votes
2 answers

How to set a fault tolerante channel between nlog and nxlog?

My application uses nlog. It needs to send logs to a nxlog process running in the same host (which I also have control over). I thought of sending json lines using TCP or UDP from nlog to nxlog. That's a straightforward design but it is not fault…
Igor Gatis
  • 4,648
  • 10
  • 43
  • 66
0
votes
1 answer

IIS usernames in ELK stack

I am having an issue that I am trying to resolve with IIS logs and Elasticsearch. What is happening is that my usernames in the IIS logs have a backslash () in them and not a forward slash (/). When Elasticsearch returns names it no longer has the \…
DanielJay
  • 292
  • 3
  • 13
0
votes
2 answers

nxlog querylist doesn't work as expected

nxlog.conf The above link is to a copy of my nxlog.conf. I couldn't find any documentation about how to use multiple blocks within a querylist block, but based on the name I assumed that I would be able to do this. My ELK server is receiving ALL…
bravosierra99
  • 1,331
  • 11
  • 23