Questions tagged [log-analysis]

Log-analysis is the process of parsing log file, created from any logging service or application.

126 questions
0
votes
2 answers

Custom field name not showing in Filebeat

Below is how im trying to add a custom fiels name in my filebeat 7.2.0 filebeat.inputs: - type: log enabled: true paths: - D:\Oasis\Logs\Admin_Log\* - D:\Oasis\Logs\ERA_Log\* - D:\OasisServices\Logs\* processors: - add_fields: …
AlisonGrey
  • 497
  • 1
  • 7
  • 23
0
votes
1 answer

Log Pipeline Activity to Database after execution

Currently, we are monitoring DataFlow Taks using Visual Link How to implement the log analysis and operations management to get desired Monitor pipeline runs and Monitor activity runs Using ADF- Need Activity Runs information Inserted into a…
0
votes
1 answer

Using LogDNA in IBM Cloud

I was reading this page on using LogDNA in IBM Cloud https://cloud.ibm.com/docs/services/Log-Analysis-with-LogDNA?topic=LogDNA-about#about It mentions that "Log data is sent to a third party". What exactly does it mean by sent to third party? Does…
0
votes
1 answer

Learning the basics to query in Splunk

I am just starting to learn how to work on Splunk. Where can I find the tutorials to learn from the basics for real-time log analysis and generating reports. I tried looking up on google and youtube but, It is somewhat complex for me. Is there a…
0
votes
0 answers

ELK , Filebeat Setup on Local Machine , Logstash is not working, lumberjack protocal error

I'm trying to learn ELK stack and as per recommendation, I have downloaded the latest ELK stack ( 6.4.2 version ) and running all the application on my local machine along with Filebeat. When, I'm pointing filbeat directly to Elastic Search, I'm…
Learner
  • 1,544
  • 8
  • 29
  • 55
0
votes
0 answers

Apache log analysis: I need to report the initial URI accessed in redirect chains

An Apache log includes a line for each URI accessed, regardless of whether it is the first access in a redirect chain, just one of several along a redirect chain, or the URI finally served up with a status 200. How can I generate a report showing…
Jon Hill
  • 26
  • 2
0
votes
3 answers

Pattern Matching in Python - Extract and Store strings from file

I have the following log file: *** 2018-09-14T12:36:39.560671+02:00 (DB_NAME) *** SESSION ID:(12345) 2018-09-14T12:36:39.560750+02:00 *** CLIENT ID:() 2018-09-14T12:36:39.560774+02:00 *** SERVICE NAME:(DB_NAME) 2018-09-14T12:36:39.560798+02:00 ***…
0
votes
0 answers

How to send log data into the Log Analysis service on IBM Cloud

I found these is guide for Ubuntu OS. But how about other Linux OS(Don't support apt-get) and Windows OS ?
Sericloud
  • 1
  • 1
0
votes
1 answer

How to sum same countries in a csv file using pandas

I have a csv file and there are Count and Country columns. There are many Count and Country columns but this is the example I will write below. Country Count Country Count Japan 654 Japan 566 US 90 …
Angeline
  • 109
  • 10
0
votes
1 answer

How to sum same number in a csv file using pandas

I have a csv file and there are Date, count, and service column. There are many date,count and service columns but this is the example I will write below. Number Count Service Number Count service 0 13 NO SERVICE 0 …
Angeline
  • 109
  • 10
0
votes
1 answer

In log file, how to detect if ports are dangerous?

I know basic python and I have a log file, also I have print the output of ports from the log file which there are so many ports in the output. I want to know how to take only the dangerous ports from the printed ports Also I need to take the…
Angeline
  • 109
  • 10
0
votes
2 answers

Log analysis in Pig

I have a .txt file which looks like : 2017-06-22 23:19:05,758 use database stocks 2017-06-22 23:21:27,056 CREATE TABLE stocksdata ( stock_exchange string, stock_symbol string, date TIMESTAMP, The regex I wrote is…
0
votes
1 answer

how to send metrics/ diagnostics logs of azure cosmos db to azure log analytics?

I used Azure Cosmos DB right now, but I want to send diagnostics logs or metrics of cosmos db to log analytics. I searched in google from two days onwards but there is no related information for that. Can you please tell me how to send metrics/…
Pradeep
  • 5,101
  • 14
  • 68
  • 140
0
votes
2 answers

MongoDB convert timezone for Loganalyzer

I have installed rsyslog-8.26.0, loganalyzer-4.1.5 and MongoDB 3.4.4 on CentOS7. MongoDB stores all dates and times in UTC and I can see data on Loganalyzer also UTC. any idea to change this for local timezone? either change MongoDB default…
0
votes
0 answers

Matching line with dictionary values

I have a dictionary that consists of 3 keys IP, Session_ID, Session_Length, the values are coming from multiple regexs like this: regex_IP =…
Ridah
  • 39
  • 8
1 2 3
8 9