Stack Overflow
Stack Overflow

Questions tagged [logfile-analysis]

The act of analyzing `logfiles` using methods such as, but not limited to: `parsing` and `deciphering`, etc.

The act of analyzing logfiles using methods such as, but not limited to: parsing and deciphering, etc.

79 questions
0
votes
1 answer

Read log file from last read position

This is my working code, I have a filewatcher monitoring my log file, when the file updates (it updates a lot) it reads the log and outputs the lines that comply with the regex to a textbox. The problem with it is that it reads the file from the…
Manvaril
  • 160
  • 3
  • 15
0
votes
4 answers

Read a Log file and pull out lines with specific text

I have a log that is constantly being added to (like 1-5 lines a second or more) and the files can get rather large 20MB+ Example Log File: [Wed Aug 26 00:01:48 2015] You try to kick a snake, but miss! [Wed Aug 26 00:01:50 2015] A snake hits YOU for…
Manvaril
  • 160
  • 3
  • 15
0
votes
1 answer

Hadoop MapReduce job completes successfully but doesn't write anything to DB

I'm writing a MR job to mine webserver logs. The input for the job is from text files, output goes to a MySQL database. Problem is, the job completes successfully but doesn't write anything to the DB. I've not done MR programming for a while so it…
Abhijit Sarkar
  • 21,927
  • 20
  • 110
  • 219
0
votes
1 answer

amazon s3 access log files incorrect value »bytes sent«

analyzing our S3 access log files I have noticed that the value of the »data transfer out per month« in the S3 access log files (S3stat and own log file analysis) is strongly different from the values in your bills. Now I have made a test…
Peter Klarl
  • 1
0
votes
3 answers

How to count requests per hour?

I have access log file with data only per 1 day like: 10.2.21.120 "-" - [26/Jan/2013:19:15:11 +0000] "GET /server/ad?uid=abc&type=PST HTTP/1.1" 202 14 10 10.2.21.120 "-" - [26/Jan/2013:19:17:22 +0000] "GET /server/ad?uid=abc&type=PST HTTP/1.1" 204…
user4278332
0
votes
2 answers

Powershell - how to handle non timestamped log file entries, including blank lines

I asked a question about how to extract data from a log file based on a start and end timestamp, recently which I got a great and quick answer for, see this question / post for details. Powershell - How to select a block of text from a text based…
Andy Carroll
  • 65
  • 1
  • 6
0
votes
0 answers

Can I give customized inputs to my mapper in mapreduce job?

if you want to process a text file or log file with mapreduce by default the mapper input value ll b a line up to new line character but i want to process a log file A (18:18:43,703 [ERROR] AccStmtGeneratorImpl - Statement not generated…
Sumeet
  • 43
  • 5
0
votes
1 answer

LogParser query to grab only external IP addresses from IIS logs?

I tried this question over at ServerFault and didn't have any luck, so I thought I'd try here. I'm working on a public website that is used by both external visitors and internal employees. I'm after the external visitor hits, but I can't think of…
Josh
  • 2,740
  • 3
  • 27
  • 41
0
votes
1 answer

SQL check who deleted rows and recover them

I have primary keys for a table of my database for the deleted records, I want to check who deleted those records. My application uses asp.net membership for user authentication. no one logs on SQL server except me. I'm not a DBA so this is…
Ali Umair
  • 1,386
  • 1
  • 21
  • 42
0
votes
1 answer

Tool to work with log file produced by parallel workers (e.g. by build system)

We have a build system that does write logs from parallel workers to the same file. I'm looking for the tool to simplify life with this type of logs. Each line in this log file is arbitrary text sting, starting with worker id. E.g.: 11> compiling…
Alexey L.-V.
  • 1
  • 1
0
votes
0 answers

Search a String and send mail if found in Shell Script

I have to serch for an error like " Socket not open" in a log file named q2.log and I have to send a mail if i find the string. This process should happen at regular time intervel that i can schedule a chronjob, But problem is for my first job lets…
Be Positive
  • 17
  • 7
0
votes
2 answers

How to read log-files over network real fast?

I'm using Delphi 2007 and have an application that read log-files from several places over an internal network and display exceptions. Those directories sometimes contains thousands of log-files. The application have an option to read only log-files…
Roland Bengtsson
  • 5,058
  • 9
  • 58
  • 99
-1
votes
1 answer

How to convert spark log files into one CSV File

I have a collection of spark Apps Log files, I want Each file App Name, Submission Time, Completion Time, and Accumulables metrics to be added as a single line in one CSV file. using SPARK/SCALA Edit: I am sorry but one Spark application log file…
Mohammed Alrudaini
  • 11
  • 1
-1
votes
1 answer

How to read DNS query log file

I got a DNS internal query log file and I would like to do analysis on it, so onw record looks like this: 18-Jun-2017 04:00:10.139 client @XXXXXXXXXXXX ip-address#number (ip-address): view internal: query: ip-address IN AAAA + (ip-address in the…
starry1990
  • 121
  • 1
  • 6
-1
votes
2 answers

Regex a file with names and numbers/hexes alternated

Have a logfile my_file.txt which I know has the following structure: milk marta 1231 joe 1223 ralph 7C3D cookie jam milk marta 163 joe 23 ralph 7FFF And what I want to do is extract with the help of regex in perl all the values of lines that start…
titus.andronicus
  • 517
  • 1
  • 7
  • 19
1 2 3 4
5
6