Stack Overflow
Stack Overflow

Questions tagged [logfile-analysis]

The act of analyzing `logfiles` using methods such as, but not limited to: `parsing` and `deciphering`, etc.

The act of analyzing logfiles using methods such as, but not limited to: parsing and deciphering, etc.

79 questions
0
votes
1 answer

Fix severity and facility in log message

I'm new to syslog-ng. I have included my logFile.log in the syslog configuration file and the server successfully received the log message. Now I would like to correct the log message syntax by adding severity and priority. For example, using this…
init
  • 55
  • 8
0
votes
3 answers

Regex to match certain lines, except when they have certain words (limited regex vocab available)

I'm using a log tailing app (BareTailPro) that highlights rows which match regular expressions. I currently have the filter set to just error (ignore case on) which returns, for example: 25/07/2011 00:09:43.384 [Error] Timeout elapsed 25/07/2011…
Skrealin
  • 1,114
  • 6
  • 16
  • 32
0
votes
2 answers

logstash Grok to extract different data from log file containing different log

My log file contains data from different process writing data on same file. The log file is something like as shown below. I am writing to write the Grok filter pattern to extract different data and use it in Kibana board. I tried one pattern but it…
Rajendra V
  • 43
  • 6
0
votes
1 answer

Looking for a powershell script that takes latest txt file in directory and searches for keyword "RequriedString"

$dir = "C:\temp" $latest = Get-ChildItem -Recurse -Filter filename*.txt -Path $dir | Sort-Object LastAccessTime -Descending | Select-Object -First 1 $SEL = get-content $latest if( $SEL -imatch "error" ) { Write-Host 'Errors found in the log…
Kinshu
  • 13
  • 2
0
votes
1 answer

Extract the unpredictable data that have its own timestamp in a log file using a Shell script

log.txt will be as below, which are the ID data with its own timestamp (detection_time) that will continuously update in this log.txt file. The ID data will be unpredictable number. It could be from 0000-9999 and the same ID could be appeared in the…
vgags
  • 3
  • 2
0
votes
0 answers

High CPU Load on a web hosting

I experienced extraordinary CPU load on my hosting plan (a shared hosting plan with several websites hosted) and I found that many of the process came from one e-commerce website. I turned the website off and CPU load went down (was again in the…
Laki
  • 99
  • 1
  • 3
  • 15
0
votes
0 answers

Page hit analysis with a cleaned csv log python

Below is the code to try and clean my csv log, when i run the code i am getting an error; ** Traceback (most recent call last): File "page_hit_analysis.py", line 12, in line = parser(line) ** import apache_log_parser from collections…
user9056985
  • 1
  • 2
0
votes
0 answers

Using Bash Less and Grep together

I have been trying to follow and filter an log file using less +F +G /var/log/messages | grep -v -f ignoredwords.txt | grep -f words.txt but it seems the file is not continoulsy read and the operation stops once the whole file is read i have…
Saadi381
  • 55
  • 1
  • 2
  • 9
0
votes
1 answer

shell script not running but command line running

I have a Error Log file with contents as - 2017/11/06 13:17:05 [notice] 18164#18164: signal process started . . . I have command that will extract the date and notice,warn message cat whole_error.log | cut -d" " -f1,3,5-20 | sort -nr | grep…
Shivam Srivastava
  • 72
  • 1
  • 11
0
votes
1 answer

watch/track logfile for changes and email for results

i am trying to write a script in python to watch a logfile and search specific keywords in the new lines , if found email to specific address else ignore is there any python module which could help ? Regards
Saadi381
  • 55
  • 1
  • 2
  • 9
0
votes
1 answer

How to read continuous log file from last read line | Linux Shell

Platform: RHEL7 Situation: A JMeter report file is being appended with new results every 5 minutes by crontab script Another awk script looks for response time greater than 500ms and sends email alerts Problem Statement: The requirement is to…
Jony Hu
  • 13
  • 2
0
votes
1 answer

What kind of setup I need for - Storing/Aggregating/Reporting Log files in the cloud

I have about 1000 sites on multiple windows clusters. The IIS log files(text documents) are available for each site in a set location on the server. The solution what I am looking at should be able to do following things. 1) Push the log files into…
sam
  • 347
  • 2
  • 10
  • 26
0
votes
1 answer

Web log file analysis software to measure search crawlers

I need to analyze the search engine crawling going on in my site. Is there a good tool for this? I've tried AWStats and Sawmill. But both of those give me very limited insight into the crawling. I need to know information like how many…
at.
  • 50,922
  • 104
  • 292
  • 461
0
votes
2 answers

Search and group from logfile

I have a logfile with many entries. Some of them begin with a date, some others not. I want to search for all entries from this/last month with "UpgradeResource] part: 3-V12345678-12-" in the line and count the results grouped by box. Actually…
marchusar
  • 3
  • 3
0
votes
1 answer

How to find the difference of time (Time taken to process a file) in R?

I have Log data, it records the Start datetime and end datetime stamp. Data from the log file look as below Preapred data in excel Start_Date1 Start_Time1 Start_Millisecond1 Start_Date2 Start_Time2 Start_Millisecond2 29-11-2015 18:25:04 671…
sandeep
  • 31
  • 2
  • 9
1 2 3
4
5 6