Questions tagged [nxlog]

NXLOG is a universal log collector and forwarder supporting different platforms, log sources and protocols.

NXLog can work in a heterogenous environment collecting event logs from thousands of different sources in many formats. NXLog can accept event logs from TCP, UDP, file-based logs, database and various other sources in different formats such as Syslog, Windows Event Log, DNS debug log etc.

It can perform log rewrite, correlation, alerting, pattern matching, execute scheduled jobs, log rotation and log conversion in other formats such as to JSON. It was designed to be able to fully utilize today's multi-core CPU systems. Its multi-threaded architecture enables input, log processing and output tasks to be executed in parallel. Using a high-performance I/O layer, it is capable of handling thousands of simultaneous client connections and process log volumes above the 100.000 EPS range.

NXLog tries hard to minimize losing log messages. It does not drop any unless instructed to. It can process input sources in a prioritized order, meaning that a higher priority source will be always processed before others. This can further help avoiding UDP message loss (as an example). In case of network congestion or other log transmission problems, NXLog can buffer messages on the disk or in memory. Using loadable modules it supports different input sources and log formats, not only limited to Syslog but Windows Event Log, audit logs or even custom binary application logs.

It is possible to further extend its functionality by using custom loadable modules similarly to the Apache Web server. In addition to the online log processing mode, it can be used to process logs in batch mode in an offline fashion. A powerful configuration language with an Apache style configuration file syntax enables it to rewrite logs, send alerts, execute external scripts or do virtually anything based on any criteria specified using the NXLog configuration language.

Please see the NXLog User Guide for more information.

91 questions
0
votes
2 answers

IIS Logs and Event Logs

First off thank you for any advice and your time. I recently setup an Elk stack for the company I just started working for. (This is my first experience using Logstash and Nxlog.) What I would like to do is send both IIS logs and EventLogs from the…
Paul Shwag
  • 3
  • 1
  • 4
0
votes
1 answer

Installing nxlog on centos5 (dependencies)

I am trying to install nxLog on centOs5. When running "rpm -ivh nxlog-ce-2.8.1248-1.x86_64.rpm" I get the following error: error: Failed dependencies: libcap.so.2()(64bit) is needed by nxlog-ce-2.8.1248-1.x86_64 libcrypto.so.10()(64bit) is…
Dax Durax
  • 1,607
  • 5
  • 23
  • 31
0
votes
1 answer

nxlog & logstash - dropping messages that dont match a given EventID

I am using Nxlog to forward my Windows Server logs to LogStash and trying to remove messages from LogStash that are not equal to a given windows eventId. What is the correct syntax for this? Here is what i have tried: if [type] == "WindowsLog" { …
CBE
  • 11
  • 1
0
votes
1 answer

How to re-format a date-time string in nxlog or how to set up date-time format for python logging file

Whilst it's a two question post, the answer to either one will fix my single problem, so I only need a response to one of the two questions. I'm using an app called dynamic-dynamodb do scale our dynamo tables. The next thing is to get the logs from…
Thermatix
  • 2,757
  • 21
  • 51
0
votes
1 answer

How do I add timezone to date/time formatted by strftime?

I need to format date/time with a correct time zone and using this format string: %Y-%m-%dT%H:%M:%S. However, it's using local time. How can I make it format time including time zone, or using UTC time?
user626528
  • 13,999
  • 30
  • 78
  • 146
0
votes
1 answer

NXLOG logs are in unicode characters

I have write the code like as following, Module xm_charconv AutodetectCharsets utf-8, euc-jp, utf-16, utf-32, iso8859-2 And, Module im_file File 'C:\Program Files\Microsoft…
Gunaseelan
  • 14,415
  • 11
  • 80
  • 128
0
votes
2 answers

Message missing in NXLOG log shipping

I have following SQL logs in ERRORLOG file, 2014-12-19 14:27:21.76 spid52 Starting up database 'MyDatabase'. 2014-12-19 14:27:22.06 spid52 Setting database option COMPATIBILITY_LEVEL to 110 for database 'MyDatabase'. 2014-12-19 14:27:22.06…
Gunaseelan
  • 14,415
  • 11
  • 80
  • 128
0
votes
0 answers

Parse sql log from log file using logstash

I want to read MSSQL logs from log file, Written the NXLOG code as following, Module im_file File 'C:\Program Files\Microsoft SQL Server\MSSQL11.MSSQLSERVER\MSSQL\Log\ERRORLOG*' ReadFromLast TRUE Exec if…
Gunaseelan
  • 14,415
  • 11
  • 80
  • 128
0
votes
1 answer

Parse SQL logs using NXLog, Logstash

I want to send all logs from Database [Table creation, row insertion, data deletion, data selection etc.. ] to Logstash using NXLog, I have read the following blogs, Nxlog im_dbi is not…
Gunaseelan
  • 14,415
  • 11
  • 80
  • 128
0
votes
1 answer

Nxlog unable to send eventlog after certain time

I'm using ElasticSearch / Logstash / Kibana to centralize my logs. On the servers I'm running NXlog to send eventlogs. It's been running fine for a couple of days, but while troubleshooting something it stopped receiving any logs. From my NXlog…
thejas
  • 1
  • 1
  • 3
0
votes
1 answer

Using SSL to ship from NXlog to Logstash

I have NXLog shipping my Windows Events to another Logstash machine working fine in just TCP. But I want to encrypt the traffic using a self signed certificate. I think I have a basic understanding of SSL but confused by the NXLog docs. The NXLog…
cybergoof
  • 1,407
  • 3
  • 16
  • 25
0
votes
1 answer

nxlog parse_xml() with attributes

I'm learning nxlog but there aren't may examples of parsing xml input in the current docs. My input lines look like this:
Andy Arismendi
  • 50,577
  • 16
  • 107
  • 124
0
votes
2 answers

How to use nxLog

How to use nxLog? I installed it on my windows 7 and unix box, but not able to use it. My Conf File(not sure its correct or not): define ROOT C:\Program Files\nxlog Moduledir %ROOT%\modules CacheDir %ROOT%\data Pidfile %ROOT%\data\nxlog.pid SpoolDir…
-1
votes
1 answer

Error while using Perl with xm_perl module

I'm using nxlog and its Perl module xm_perl (https://nxlog.co/documentation/nxlog-user-guide/xm_perl.html). I have written a Perl code with regular expressions which works perfectly with data I want. My nxlog looks like this: User nxlog Group…
french_fries
  • 1,149
  • 6
  • 22
-1
votes
2 answers

Regex: select the XML messages and time stamp from the log

I am going to streaming the logs in to nxlog, i need to push xml messages in to nexlog server, To select the XML message: (\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}.\d{3})(.*)(my sentence 1....|my sentence 2 : [\S+\s+]*>\n)(\d{4}-\d{2}-\d{2}…
user881703
  • 1,111
  • 3
  • 19
  • 38