Questions tagged [elastic-stack]

Elastic Stack combines the Elasticsearch, Logstash, Kibana, and the Beats Framework to provide real-time insights of any type of structured or unstructured data.

Elastic Stack combines the , , , and the Beats Framework to provide real-time insights of any type of structured or unstructured data.

In 2015, Elastic introduced the Beats framework (,,) into their stack and decided to rename the ELK Stack to the Elastic Stack

3683 questions
1
vote
1 answer

Bad indexing performance of elasticsearch

Currently, I'm using elastic search to store and query some logs. We set up a five node elastic search cluster. Among them two indexing nodes and three query nodes. In the indexing node, we have redis, logstash and elasticsearch on both two servers.…
1
vote
0 answers

How to create a Kibana Vertical bar chart with 2 fields

I have successfully integrated ELK stack which gets application log data from several sites and could create some Pie charts and Vertical bar charts. Now I am going to create a new Vertical bar chart but can't create according to my requirement. I…
Vish
  • 148
  • 2
  • 6
1
vote
0 answers

REDIS used memory trending upwards

So I have implemented ELK using REDIS as a caching layer. I am using REDIS 3.0.4 from an RPM I found for Redhat EL6. I am also running jemalloc 3.6.0. I believe the configuration for REDIS is largely vanilla with the exception of a max memory cap…
1
vote
2 answers

Elasticsearch, how many clusters, indexes do I need for 8 applications

I have an ELK Stack set up and accepting log data from 2 of my applications and everything is working ok. Its been running for 25 days and I have nearly 4GB of Data/Documents on a 25GB server. My question I have 8 applications in total that I would…
Gman
  • 2,433
  • 3
  • 26
  • 36
1
vote
1 answer

kibana - logstash as window service in window 7

I installed and configured kibana in my local machine and I am getting event log from 3 different machine. As log forwarder I am using nxlog which is lightweight so nice to install on production without affecting performance. One thing I need is…
jjj
  • 1,136
  • 3
  • 18
  • 28
1
vote
0 answers

Pathetic Logstash performance using UDP input and Redis output

We are working on a Logstash configuration, which receive syslog events from various sources and the events are forwarded to Redis for queuing (without any processing or filters). Below is the configuration used. input { udp { port => 514 …
1
vote
2 answers

How to read /var/log/wtmp logs in elasticsearch

I am trying to read the access log s from /var/log/wtmp in elasticsearch I can read the file when logged into the box by using last -F /var/log/wtmp I have logstash running and sending logs to elasticsearch, here is logstash conf file. input { …
Gman
  • 2,433
  • 3
  • 26
  • 36
1
vote
1 answer

Making strings not_analyzed for Kibana

I want my strings to be not_analyzed both for search and for visualizations in Kibana. I created a custom elasticsearch-template.json to set the default for strings to be not_analyzed, and I pointed to this in my logstash-log4j.conf file. Here is…
PurpleVermont
  • 1,179
  • 4
  • 18
  • 46
1
vote
0 answers

Elasticsearch Data too large

I can't see the data in the dashboard. It always appears No results found, but there is data with te filters applied. I have seen in the Response tab and I…
billy6
  • 103
  • 3
  • 10
1
vote
0 answers

How to install a logstash-forwarder package on Mac

I have installed a logstash server on CentOs machine. I want to install a logstash-forwarder on my Mac. I downloaded the logstash-forwarderv0.4.0 but some textED file got downloaded. How can I configure 'logstash-forwarder' on my Mac ?
1
vote
0 answers

self healing in centralized logging

So I have my centralized logging system setup. But the thing I am currently working on is the self healing in my system. So suppose some error comes up through logs that this service is down. So I need a mechanism/open source tool using which I can…
1
vote
1 answer

ServiceNow integration with Elasticsearch

We are using ELK to monitor the system performance and our application logs. If there is an error in the logs, we want to create an issue in ServiceNow from ELK. Is there a way to do this? Any pointers would help.
1
vote
1 answer

Mapping Cityname to GeoPoint from Logstash to Elasticsearch

I got some log like: 2015-09-25 12:07:55.441 INFO 17328 --- [][][][] XXX.YYY.SomeClass : Someone request in CityX! And I import it to Elasticsearch: { "_index": "logstash-2015.09.25", "_type": "redis-input", "_id":…
Sayakiss
  • 6,878
  • 8
  • 61
  • 107
1
vote
0 answers

ELK switch field to not_analyzed

I generate the hash field in Logstash similar to this: {components: ["foo", "bar", "foo bar"]} I pass it to Elasticsearch and when I want to get the count of occurencies of each string I have only foo and bar in Kibana as they foo bar is splitted.…
Dawid Gosławski
  • 2,028
  • 1
  • 18
  • 25
1
vote
1 answer

How to make Logstash multiline filter merge lines based on some dynamic field value?

I am new to logstash and desparate to setup ELK for one of the usecase. I have found this question relevent to mine Why won't Logstash multiline merge lines based on grok'd field? If multiline filter do not merge lines on grok fields then how do I…