Questions tagged [elk]

a.k.a. Elasticsearch, Logstash, Kibana ; refer to elastic.co

61 questions
0
votes
1 answer

Elasticsearch index created with fieldtype mapping integer, recognized as "string" in Kibana 4

I have created an index in elasticsearch 1.7 like this: curl -XPUT 'http://localhost:9200/test' -d ' { "test" : { "properties" : { "user" : {"type" : "string", "index" : "not_analyzed"}, "message" : {"type" :…
scaarup
  • 3
  • 3
0
votes
1 answer

ESX performance stats in Logstash

Dose anyone know if it is possible to collect ESX Performance Stats in LogStash/ELK stack? looking to see if I can collect ESXTOP data for use in the ELK stack.
TechGuyTJ
  • 792
  • 1
  • 13
  • 26
0
votes
1 answer

Stop filebeat sending copius metadata

I am sending data from local log files with filebeat to graylog and I am getting a 20x storage overhead compared to the original files. There are a large amount of metadata fields however I can't seem to get rid of them. I have tried many variations…
0
votes
0 answers

Logstash cloudwatch plugin behavior

We have an ELK stack set up on an ec2 instance that stopped working a month ago and I just got it working again (the problem was credentials with the cloudwatch logstash plugin). What is strange is that it seems to be ingesting logs from over two…
0
votes
0 answers

How does rsyslog accept remote logs to be written to the specified file path?

I want to write remote logs to the /data directory # cat /etc/rsyslog.d/default.conf #### GLOBAL DIRECTIVES #### $ActionFileDefaultTemplate RSYSLOG_TraditionalFileFormat $template myFormat,"%timestamp% %fromhost-ip% %syslogtag%…
0
votes
0 answers

How to fetch Individual output of different match_phrase inside one request

I am able to run below query which is giving response as total of two match_phrase. Inserting dummy data as below. POST /mod1/_bulk { "index" : { } } { "msg": "BA1" } { "index" : { } } { "msg": "BA2" } { "index" : { } } { "msg": "BA2" } { "index" :…
abc
  • 11
  • 4
0
votes
1 answer

How to pass values to query externally

I have below similar logs. I have created dummy index and created mapping like below in dev-tools PUT new { "mappings": { "properties": { "@timestamp": { "type": "date", "format": "yyyy-MM-dd HH:mm:ss.SSS" } …
abc
  • 11
  • 4
0
votes
1 answer

filebeat log status 30 every sec

I'm learning to use ELK and have a debian PC that runs as a test client. every 30 sec it logs a message : 021-01-18T08:29:59.656-0500#011INFO#011[monitoring]#011log/log.go:145#011Non-zero metrics in the last 30s#011{"monitoring": {"metrics":…
Peter
  • 115
  • 1
  • 8
0
votes
1 answer

How to display the logs of a VM on ELK stack which is running on another VM?

-ELK is running on localhost & successfully getting logs. -Both VM's are on same server. -OS on both VM'S is Ubuntu 18-04 LTS.
Baqir kazmi
  • 13
  • 1
  • 5
0
votes
1 answer

I used elk+redis+filebeat to build the logging platform, and now after redis is replaced by codis, logstash reports???

I used elk+redis+filebeat to build the logging platform, and now after redis is replaced by codis, logstash reports: # [2020-06-18T11:20:54,146][WARN ][logstash.inputs.redis] Redis connection problem {:exception=>#
0
votes
1 answer

Ship Logs from application server to ELK server with beats

I am building log analyzer for production environment. My scenario is, i need to setupelasticsearch,Logstash and kibana on one centos7 server which is going to use ELK server another one is apache server(remote server). I have configured following…
Kumar
  • 3
  • 2
0
votes
1 answer

Export Google Cloud SQL slow logs to ELK stack

I stumbled upon an issue and decided to ask for advice and eventually find someone with the same business need (and problem). Summary - we’ve recently migrated the SQL service of one of our clients from a self-hosted MySQL to the Google CloudSQL…
0
votes
1 answer

Can't access Kibana remotely - Can curl successfully on machine

I've installed Kibana on rhel and am I'm trying to access remotely on http://server-url:5601. I've installed elasticsearch and am able to access that remotely on http://server-url:9200 I've added server.host 0.0.0.0 in the kibana.yml. I've made…
0
votes
0 answers

Adding context paths to ELK log analytics?

I'm looking to install the ELK stack on my application server by following the instructions here: I can see you can then access the various ELK services on localhost via certain ports. Is there a way for me add context paths for the services. Then I…
-1
votes
1 answer

How to display filebeat logs as a single file in kibana?

I have used ELK for displaying my middleware logs in kibana. for that I am using multiline patterns which mentioned below, after those logs displaying seperatly like separate expandable. How to display those logs as a single file ? as a single…
Shankar
  • 219
  • 1
  • 4
  • 14