Questions tagged [elastic-stack]

Elastic Stack combines the Elasticsearch, Logstash, Kibana, and the Beats Framework to provide real-time insights of any type of structured or unstructured data.

Elastic Stack combines the , , , and the Beats Framework to provide real-time insights of any type of structured or unstructured data.

In 2015, Elastic introduced the Beats framework (,,) into their stack and decided to rename the ELK Stack to the Elastic Stack

3683 questions
7
votes
1 answer

Why install logstash if I can just send the data through REST to elasticsearch?

I installed elasticsearch and kibana, and I'm following the tutorial. https://www.elastic.co/guide/en/elasticsearch/reference/current/_index_and_query_a_document.html And I'm perfectly inserting and reading data, e.g.: PUT…
Gabriel Rodriguez
  • 1,163
  • 10
  • 23
7
votes
4 answers

How to define seperated indexes for different logs in Filebeat/ELK?

I am wondering how to create separated indexes for different logs fetched into logstash (which were later passed onto elasticsearch), so that in kibana, I can define two indexes for them and discover them. In my case, I have a few client servers…
daiyue
  • 7,196
  • 25
  • 82
  • 149
7
votes
2 answers

Good setup on AWS for ELK

We are looking into getting an ELK stack setup on Amazon but we don't really know what we need of machines to handle it smoothly. Now I know that it will become obvious if it doesn't run smooth but still we hoped to get an idea on what we would need…
darkownage
  • 938
  • 16
  • 38
7
votes
1 answer

Use filebeat or logstash to open gzip files

I might be asking for too much here and I think it's just not implemented yet but I have ELK stack setup similar (almost identical) to how this tutorial does…
Swikrit
  • 352
  • 1
  • 5
  • 21
7
votes
1 answer

ELK process multiline logs from multiple docker images

I am running ELK (Elasticsearch, Logstash, Kibana) in cluster where docker containers are running. Those containers sends logs to Logstash via GELF endpoint. docker run --log-driver=gelf --log-opt gelf-address=udp://somehost:12201 -ti …
jiri463
  • 859
  • 1
  • 8
  • 21
6
votes
2 answers

OpenTelemetry Export to Elastic Search without Elastic APM

I'd like to export trace/metrics data to Elastic Search using OpenTelemetry, but I'd prefer to avoid Elastic APM. Is it possible? The opentelemetry contrib repo apparently suggests it is possible, however, I did not find anything on elastic.co…
sa-mustafa
  • 283
  • 4
  • 10
6
votes
4 answers

Received plaintext http traffic on an https channel, closing connection

I have deployed ECK (using helm) on my k8s cluster and i am attempting to install elasticsearch following the docs. https://www.elastic.co/guide/en/cloud-on-k8s/current/k8s-deploy-elasticsearch.html I have externally exposed…
Kay
  • 17,906
  • 63
  • 162
  • 270
6
votes
2 answers

How to Create Elasticsearch Point in Time (PIT)?

I'm trying to use the search_after parameter with a point in time (PIT) to paginate search results. This is the documentation section I'm consulting. I'm making a POST to /my-index/_pit?keep_alive=1m. The /_pit endpoint only accepts the POST method…
ChiefMcFrank
  • 721
  • 4
  • 18
6
votes
1 answer

Difference between Zipkin and Elastic Stack(ELK)?

Spring Cloud Sleuth is used for creating traceIds (Unique to request across services) and spanId (Same for one unit for work). My idea is that Zipkin server is used to get collective visualization of these logs across service. But I know and have…
6
votes
2 answers

Config number_of_shards and number_of_replicas in ELK

I keep studying about ELK Stack and ran into a little problem. I have been reading all the documentation possible and it makes great emphasis on the importance of shards and replicas. But nowhere does it say how to configure the number of each one.…
6
votes
1 answer

Elastic Search Geo Spatial search implementation

I am trying to understand how elastic search supports Geo Spatial search internally. For the basic search, it uses the inverted index; but how does it combine with the additional search criteria like searching for a particular text within a certain…
java_geek
  • 17,585
  • 30
  • 91
  • 113
6
votes
0 answers

Keep getting socket hang out on ElasticSearch

I am new to ElasticSearch.I am reindexing some indexes in my ElasticSearch Cluster. While I am trying to reindex an index that has a large amount of data I am getting Socket hang up error. const elasticsearch = require('elasticsearch'); const…
6
votes
0 answers

How to fix '400 Bad request' in half of my request to Elastic search?

I'm using elastic search cloud with a single index that has a single document. I'm using @elastic/elasticsearch latest version. I'm calling elastic search from Firebase cloud functions. Here is how my elastic client is initialized in cloud…
6
votes
1 answer

Are there any lightweight alternatives to ELK-stack?

I have a VPS with 1GB RAM. I want to find an alternative for ELK, because my vps server is too weak. I just need to get logs from logstash and visualize its on the some web gui.
mystdeim
  • 4,802
  • 11
  • 49
  • 77
6
votes
2 answers

How can I dynamically (by env variable) activate/deactivate logback or logback appender?

is there a way to choose if I want to have a logback appender or not, via environment variable? I have a dockerized spring boot Microservice and added now the ELK stack. That works fine so far. But now if I want to start my service without ELK…
m1well
  • 716
  • 4
  • 15
  • 28