Questions tagged [logfile-analysis]

The act of analyzing `logfiles` using methods such as, but not limited to: `parsing` and `deciphering`, etc.

The act of analyzing logfiles using methods such as, but not limited to: parsing and deciphering, etc.

79 questions
1
vote
1 answer

access json body parameters in custom formatter of lnav log file navigator

I'm using lnav to filter and query on top of the custom log file we have created. As this is a custom log file, I need to create a custom format file and install it using below command to define the structure of the log entries. lanv -i…
1
vote
3 answers

Android device's log file

using logcat I can see the log messages generated by my app in the emulator. How can I read/retrieve the same log file but this time from the device the app is running on ? The device is not attached to any computer and the log file has to be sent…
xain
  • 13,159
  • 17
  • 75
  • 119
1
vote
3 answers

PostgreSQL Database Log Transaction

I'm a last year college student and I'm doing my thesis right now. My title is "Index Suggestion based on Log Analysis". This project will analyze the PostgreSQL transaction log to give index recommendation to the database that will be tested. This…
1
vote
1 answer

Fetch the particular columns in Postfix /var/log/maillog

I'm using Postfix in my local.I'm writing a script to fetch the deferred/bounced mail report for daily basis.If I'm correct,usually logs are printed like columns in log file. My proposal is I want to grep the previous day's "to","status","said" and…
Narasimman
  • 11
  • 3
1
vote
3 answers

Parsing custom log files

I have a log file (*.log) I wish to parse and query as below: Line 33043: 17/07/2016;13:26:45;GetMasterOrderNo;Master Order No is : 1117103907 for SoSupplierOrderNo, 1117103907 Line 33048: 17/07/2016;13:26:45;AddAutoPurchHdr;Could not save PurchHdr…
TOGEEK
  • 711
  • 4
  • 15
  • 34
1
vote
2 answers

Regex how to return two strings from log file

I have a large log file I'm trying to extract two pieces of information from using powershell regex onto one line. The log contains all kinds of data, but the blocks I'm interested in I've given examples below. I'm trying to find the users who are…
Steve J
  • 11
  • 1
1
vote
2 answers

How do I handle large amounts of logfile data for display in dynamic charts?

I have a lot of logfile data that I want to display dynamic graphs from, for basically arbitrary time periods, optionally filtered or aggregated by different columns (that I could pregenerate). I'm wondering about the best way to store the data in a…
moeffju
  • 4,363
  • 2
  • 23
  • 22
1
vote
2 answers

Space delimited, except inside braces in a log file - Python

I'm a long time reader, first time asker (please be gentle). I've been doing this with a pretty messy WHILE READ in Unix Bash, but I'm learning python and would like to try to make a more effective parser routine. So I have a bunch of log files…
1
vote
1 answer

Apache Log Format: What does "%{c}a" mean?

I've been tasked with parsing Apache web log files to extract data into another format. The customer provided me with the format line which includes the directive "%{c}a". While I can find a definition for "%a" (the remote IP address), I cannot find…
NestorDRod
  • 166
  • 1
  • 14
1
vote
5 answers

Loop within loop python

I have a log file with several hundred thousand lines. I am looping through these lines to find any line with some specific text, for example: !!event!!. Then, once an !!event!! line is found, I need to continue looping after this !!event!! line…
0
votes
1 answer

How to short in excel by name and date

I'm trying to make an automatic way to short an excel file field by name and date. I will explain what I'm trying to do: I have an excel file where there is the log text of many users that have logged in the system during the last days. What I want…
Iker
  • 2,018
  • 2
  • 29
  • 52
0
votes
3 answers

Tool to count stacktraces in a logfile

Is there a tool that is able to collect and count (Java) stacktraces in a large logfile, such that you get an overview which errors occur most often?
Dr. Hans-Peter Störr
  • 25,298
  • 30
  • 102
  • 139
0
votes
1 answer

DNN Site Traffic

We recently launched a web site developed with DNN. Analyzing the log files, I see files with .axd extension as resources accessed together with pages. The problem is that I see a heavy traffic on these .axd files. By heavy traffic, I mean hits,…
Amira Kamel
  • 93
  • 1
  • 5
0
votes
2 answers

Filtering Log File with RegEx

Hi I can't seem to work out how to extract the Date and PID from a log file. I'm trying to display the date and then the pid as shown below. But it will not show the PID only the date. Please see my code: def show_time_of_pid(line): pattern =…
Mark
  • 3
  • 2
0
votes
1 answer

Can I use Zabbix for monitoring JSON log files generated by my application?

We have Zabbix server and Zabbix agent installed on different machines and we are able to monitor the infrastructure, but we also want to monitor the JSON log files generated by our application and to get notify if there is any error in logs and…