Questions tagged [nxlog]

NXLOG is a universal log collector and forwarder supporting different platforms, log sources and protocols.

NXLog can work in a heterogenous environment collecting event logs from thousands of different sources in many formats. NXLog can accept event logs from TCP, UDP, file-based logs, database and various other sources in different formats such as Syslog, Windows Event Log, DNS debug log etc.

It can perform log rewrite, correlation, alerting, pattern matching, execute scheduled jobs, log rotation and log conversion in other formats such as to JSON. It was designed to be able to fully utilize today's multi-core CPU systems. Its multi-threaded architecture enables input, log processing and output tasks to be executed in parallel. Using a high-performance I/O layer, it is capable of handling thousands of simultaneous client connections and process log volumes above the 100.000 EPS range.

NXLog tries hard to minimize losing log messages. It does not drop any unless instructed to. It can process input sources in a prioritized order, meaning that a higher priority source will be always processed before others. This can further help avoiding UDP message loss (as an example). In case of network congestion or other log transmission problems, NXLog can buffer messages on the disk or in memory. Using loadable modules it supports different input sources and log formats, not only limited to Syslog but Windows Event Log, audit logs or even custom binary application logs.

It is possible to further extend its functionality by using custom loadable modules similarly to the Apache Web server. In addition to the online log processing mode, it can be used to process logs in batch mode in an offline fashion. A powerful configuration language with an Apache style configuration file syntax enables it to rewrite logs, send alerts, execute external scripts or do virtually anything based on any criteria specified using the NXLog configuration language.

Please see the NXLog User Guide for more information.

91 questions
0
votes
1 answer

Send log to a specific Graylog Index via Nxlog configuration

I am currently using nxlog to send the server logs to a graylog2 server and all the messages are going to the default index in Graylog. I am trying to send the messages to a particular index which should be configurable from the nxlog conf file.
Ankur
  • 61
  • 5
0
votes
2 answers

NXlog will not start - AlienVault Config

I am trying to configure NXlog to work with AlienVault based on the guide here I installed the custom config file from AlienVault and modified the destination IP only. When I did this I could not get the NXlog service to start - Then I reinstalled…
Joe
  • 2,641
  • 5
  • 22
  • 43
0
votes
1 answer

NXlog Input Filter

I wanna drop a certain dnslog line from forwarding to my SIEM server.. the logline i wish to drop is the one with "sophosxl" query.. I try the the nxlog config below but its not working.. Pls help... Thanks My Sample Logs File: 3/2/2018 6:47:04…
Karl
  • 3
  • 2
0
votes
1 answer

How to get rid of N/A from logs forwarded by nxlog?

I have enabled debug mode in windows DNS server and the logfile is located at c:\logs\dns.log <181>Jan 2 11:41:40 DC-SE-01 MSWinEventLog 1 N/A 1011398786 Tue Jan 2 11:41:40 2018 N/A N/A N/A …
sherpaurgen
  • 3,028
  • 6
  • 32
  • 45
0
votes
1 answer

sysmon to nxlog logs nothing to file nor tcp

been trying to set up a windows host logfile with sysmon. This is succesful. Logging occurs in eventlogfile windows sysmon operational. Step two is to get nxlog to read it and send it to a remote syslog server. But nothing happens. For…
user2672938
0
votes
1 answer

NXLog and long messages

Forwarding windows events using NXLog to JSON format. The problem is that now and then, the JSON message becomes too large/long for the receiving system. Is there a way to limit/truncate the JSON outputted from NXLog without breaking the JSON? I…
Tessem
  • 149
  • 1
  • 9
0
votes
1 answer

nxlog.conf filtering windows event log issues

I'm trying to pull specific windows event logs using nxlog and displaying them in graylog. It is retrieving the logs just fine, however, my problem is that: Even with a query, it still seems to pull a lot of data that is not specified in the query…
Harry
  • 105
  • 2
0
votes
1 answer

How does nxlog track the line number?

In nxlog config I have these params set: SavePos True ReadFromLast True When removing lines from a log file (this should never happen) nxlog ships the entire log file. Is this related to how nxlog tracks the line number? To recreate: I stop the…
red888
  • 27,709
  • 55
  • 204
  • 392
0
votes
2 answers

NXLog - Input txt file with date on the end

I am currently trying to send a log file with NXLog to a remote server. I have this working correctly. My next challange is that the date changes on the log file daily. For example on day one it would say log.20170110 and the day after it would say…
user3290171
  • 121
  • 1
  • 3
  • 19
0
votes
0 answers

client nxlog file is not getting create on nxlog server

I have a windows nxlog client and ubuntu nxlog server. however my windows nxlog client logs is not getting poppulated on nxlog server. On checking the wire via tshark, I does see my client is sending logs on nxlog server however they are not getting…
Ruchir Bharadwaj
  • 1,132
  • 4
  • 15
  • 31
0
votes
2 answers

Redirecting Azure logs to a particular log service

I have some VMs running on Azure Service. I'd like to redirect logs from them (Windows Event Logs and MS SQL server logs) to a specific log concentrator (like Graylog). For Windows logs, I'm using Nxlog…
Emanuel
  • 1
  • 3
0
votes
1 answer

Connect NXLog to Graylog2

I have already sent logs via NXlog to Graylog2 successfully. But both, NXlog and Graylog2 run on the same Server. Now i want to send logs from another Server via NXlog to Graylog2, but ist not working at all. Can you help me out pls? This is my…
Emre Sahin
  • 21
  • 1
0
votes
1 answer

NXLog shipping Windows Events and SeverityValue

I have NXLog shipping windows event logs to my logstash server. However, I'm finding that the original severity level in the windows event log, , is being replaced with "SeverityValue" and "Severity". And what is the mapping? If Level is 4 for…
cybergoof
  • 1,407
  • 3
  • 16
  • 25
0
votes
1 answer

Where is EventLog coming from, why is it wrong?

I have Windows eventlogs being sent from nxlog to logstash. My windows box and my receiving server is in UTC. NXlog appears to be adding EventTime to the log it ships, and the datetime is 7 hours behind UTC. No explaination, I'm not setting it,…
cybergoof
  • 1,407
  • 3
  • 16
  • 25
0
votes
1 answer

nxlog process logs files based on filename

I have lots of log files in C:\Logs. I have IIS logs in each individual site folder (W3SVCXX, where XX is site id from IIS) but inside this same C:\Logs\ folder I have other log files from those same websites but logged via Log4Net as part of the…