Stack Overflow
Stack Overflow

Questions tagged [log-analysis]

Log-analysis is the process of parsing log file, created from any logging service or application.

126 questions
2
votes
1 answer

Log analysis (top URLs accessed) with Python

I'm a total newbie trying to use Python to analyze my company's log files. They have a different format so online log analyzers don't work well on them. The format is as follows: localtime time-taken x-cs-dns c-ip sc-status s-action…
Adrienne
  • 465
  • 1
  • 4
  • 6
2
votes
3 answers

What's the simplest way to count the number of requests to /foo/ that Apache has served?

I'm looking to retroactively parse the logs and count the number of /foo/* requests that have occurred to have a baseline benchmark for a new feature that we're pushing. A simple command line script would be fine -- with an added bonus for being…
andrew
  • 1,173
  • 2
  • 18
  • 28
2
votes
1 answer

Baselining internal network traffic (corporate)

We are collecting network traffic from switches using Zeek in the form of ‘connection logs’. The connection logs are then stored in Elasticsearch indices via filebeat. Each connection log is a tuple with the following fields: (source_ip,…
Ned_the_Dolphin
  • 154
  • 2
  • 10
2
votes
1 answer

Visualizing Fluentd logs

We have open source tech stack in our firm. We use fluentd as log collector. How can I visualize my fluentd logs? Which are good open source tools for log analysis and visualization. I have researched many but none seems to fit in. I am not…
Arun.D
  • 406
  • 1
  • 5
  • 17
2
votes
1 answer

How to configure the log analytics for single database and server?

I configured log analytics with Azure SQL Analytics (Preview) solution for monitoring the databases, servers and elastic pools. For that, I followed the below links Monitor Azure SQL Database using Azure SQL Analytics (Preview) in Log…
Pradeep
  • 5,101
  • 14
  • 68
  • 140
2
votes
3 answers

Bluemix Monitoring and Analytics: Resource Monitoring - JsonSender request error

I am having problems with the Bluemix Monitoring and Analytics service. I have 2 applications with bindings to a single Monitoring and Analytics service. Every ~1 minute I get the following log line in both apps: ERR [Resource Monitoring][ERROR]: …
Oren
  • 2,767
  • 3
  • 25
  • 37
2
votes
1 answer

database for log analysis application in java - 2014

I want to create a java application for the purpose of handling and analyzing live streaming logs. I have to implement some complex filter functionality also. I was doing a research on finding the best suited database for the same. I came across…
Arun Paul
  • 167
  • 2
  • 10
2
votes
1 answer

How to log messages in Java web app and view logs by session, request, in a tree?

Currently, in my web app logs, I have big text files full of messages. They are difficult to use in debugging and analysis. I'm imagining the following, and I'm wondering, does it already exist, or do I need to build it? I want to have log messages…
Rob N
  • 15,024
  • 17
  • 92
  • 165
2
votes
4 answers

Proper disposal of SharePoint objects?

I hope there's a SharePoint expert here on SO who can help with this. Here's the problem. My SharePoint logs contain this line, several times: An SPRequest object was not disposed before the end of this thread. To avoid wasting system resources,…
Robert S.
  • 25,266
  • 14
  • 84
  • 116
2
votes
2 answers

Error in OtrosLogViewer

i'm using OtrosLogViewer to analyze my glassfish log file. But it seems the software not working. I think my pattern is…
Trieu Le Hai
  • 57
  • 7
2
votes
1 answer

piwik log import invalid log lines

I'm new to piwik and trying to import a bunch of logs. I need help with the log-format-regex. A sample line from the log is: "1.1.1.1" 2.2.2.2 - myuser [09/Dec/2012:04:03:29 -0500] "GET /signon.html HTTP/1.1" 304 "http://www.example.com/example"…
Cabal
  • 47
  • 7
2
votes
1 answer

Multiline log file processing with sed and regex

I have a log file that looks like this: 11-Sep-2012 00:00:00 clojure.contrib.logging$fn__43$impl_write_BANG___51 invoke INFO: creditAcc(args=[1506112834429596390 7080851004 4500]) 11-Sep-2012 00:00:00…
170730350
  • 590
  • 1
  • 8
  • 22
1
vote
2 answers

How to use or transform product availability logs?

I have product availability logs which contain date, new / old value (as below) . I would like to use them in the analysis, checking whether the product was available or not on a given day. I was thinking about transforming the log table into a…
kamil
  • 43
  • 4
1
vote
1 answer

Is there a linux command that can cut and pick columns that match string patterns?

I need to analyze logs and my end user has to be able to see them in a formatted way, as mentioned below, and my nature of logs is the key variables will be in different position, rather than at fixed columns based on the application, as these log…
demi365
  • 35
  • 7
1
vote
1 answer

How to monitor new warnings in code generated by error checking tools?

Do generic tools exist for keeping track of warnings in code? Some static-analysis tools generate a large number of false-positive warnings, so changing the code isn't desirable. Disabling individual warnings isn't always a practical option either…
ideasman42
  • 42,413
  • 44
  • 197
  • 320
1
2
3
…
8 9