Stack Overflow
Stack Overflow

Questions tagged [log-analysis]

Log-analysis is the process of parsing log file, created from any logging service or application.

126 questions
0
votes
1 answer

How to check result of Resource Removal Operation for Azure Resource

Using Resource Management API I can remove Azure resource (https://learn.microsoft.com/en-us/rest/api/resources/resources#Resources_DeleteById). This API returns 202 that removal is accepted - the resource is not removed right away though. The…
serg.salo
  • 580
  • 1
  • 8
  • 14
0
votes
2 answers

combine keys of hashes for output (outer join of hashes)

I'm analysing a log file with Perl 5.8.8.[1] I'm searching for days that expose some of two trigger patterns, maybe one of it, maybe both (I changed the actual patterns in the code snippet shown below). I'm interested in the count of occurrences per…
Wolf
  • 9,679
  • 7
  • 62
  • 108
0
votes
0 answers

How to identify source of log message in a simple log analyzer application

I am trying to create a centralize log repository project for my final year project. Following will be the flow of my project:- 1. Receive the logs from different sources like syslog, java apps, logstash etc. 2. These logs can be received over…
Rahul khandelwal
  • 331
  • 3
  • 14
0
votes
1 answer

What the right ETL tool to use for collect custom data from log information

I need to collect and store a large quantity data from different kinds of log files, but before is necessary filter certain fields for extract only the necessary information. So I'm thinking about of the possibility to use a ETL tool to do the dirt…
Bera
  • 1,272
  • 4
  • 23
  • 49
0
votes
1 answer

Why are Solr's logs time series stored in different collections based on time instead of different shards based on time

If you see Lucidworks Time Based Partitioning or Large Scale Log Analytics with Solr, multiple solr "collections" are created partitioned on time. My question is Why not in such cases just create multiple shards based on time ? In case of…
Shishir Choudhary
  • 33
  • 6
0
votes
2 answers

Are there good open-source libraries for parsing search terms from URLs?

I'm looking for a library which parses log files (or incoming requests) and extracts out the search-terms if/when the request came from a search engine. Are there any good libraries which provide this function? Any language will do.
Dave Viner
  • 529
  • 7
  • 14
0
votes
0 answers

How to store Azure app services diagnostic logs to Azure Table Storage?

I want to store my api's (hosted on app services) logs to Azure Table storage using Azure Diagnostics. Currently I can store the logs on blob container I am unable to find a option to store on the Table storage. After some google searching I found…
user1814131
  • 259
  • 4
  • 16
0
votes
2 answers

Program to generate sample log to feed to logstash?

I have written a small java program which generates some dummy logs (writes stuff to a txt file basically). Now I want to feed this data to the ELK stack. Basically logstash should read this data from the txt file and I want to visualize these…
Karup
  • 2,024
  • 3
  • 22
  • 48
0
votes
1 answer

can someone please suggest best way of doing log analysis using spark streaming

I am completely new to Big Data, from last few weeks i am try to build log analysis application. I read many articles and i found Kafka + spark streaming is the most reliable configuration. Now, I am able to process data sent from my simple kafka…
chowdary pothula
  • 1
  • 2
0
votes
2 answers

How to enable, work with and analyse with Slow Query Log in MySQL?

The following questions will be answered. How to enable slow query log in MySQL How to set slow query time How to read the logs generated by MySQL Log analysis is becoming a menace day-by-day. Most tech companies have started using ELK stack or…
MontyPython
  • 2,906
  • 11
  • 37
  • 58
0
votes
1 answer

Please help me for nginx custom log format issue with goacccess

Please find my log output for nginx (access.log) 182.69.143.120 - - [31/Mar/2016:03:10:51 +0530] "GET /api/check_delivery.php?authkey=9450AW2qTKYe453be757c&requestid=36626f6a3530323439383831 HTTP/1.1" control.msg91.com 404 39 "-" "-" "-"…
Mitesh Jaiswal
  • 21
  • 1
  • 1
  • 3
0
votes
1 answer

Web or console UI for filtering loglines on multiple dimensions?

I'm writing a tool to help with analysis of small-ish logfiles (e.g. 1-2 MB, in rare cases up to 50 MB). The logfiles come from a file-syncing application, and contain a variety of different loglines: 2016-02-22 21:18:03,872 +0200 INFO pid=670…
victorhooi
  • 16,775
  • 22
  • 90
  • 113
0
votes
2 answers

Trigger action realtime based on keyword in Logs

I have a requirement for which I want to trigger an action (like calling a REST-ful service) in the event a keyword is found in the logs. The trigger would have to be fairly real time. I was evaluating open source solutions like GrayLog2, ELK stack…
Arnab Biswas
  • 29
  • 4
0
votes
1 answer

Programming language to manage and automate telnet session and log analysis?

I find myself at a crossroad. I want to automate some processes that include mainly: telnet session with a Linux OS and to interpret(autonomously)the log files from the Linux machine. I admit that it is a question about experience rather than a…
J.E
  • 35
  • 7
0
votes
1 answer

Log analysis using hadoop to find error scenarios and frequent repeatative transactions

I have a business scenario wherein I want have my application server logs and I want to accomplish below tasks - Find out the error scenarios captured in log to find error code [in log], exception caused, time. repeatative transactions done by some…
AngryJS
  • 955
  • 5
  • 23
  • 47
1 2 3
…
8 9