Questions tagged [elastic-stack]

Elastic Stack combines the Elasticsearch, Logstash, Kibana, and the Beats Framework to provide real-time insights of any type of structured or unstructured data.

Elastic Stack combines the , , , and the Beats Framework to provide real-time insights of any type of structured or unstructured data.

In 2015, Elastic introduced the Beats framework (,,) into their stack and decided to rename the ELK Stack to the Elastic Stack

3683 questions
8
votes
1 answer

How to download ElasticSearch snapshot from repository to local machine?

I'm using a small elasticsearch cluster from the elastic cloud. I need to: download one of the indices from elasticsearch to my local machine for analysis set up elasticsearch node locally and restore this index into it. In Kibana UI in section…
Viacheslav Shalamov
  • 4,149
  • 6
  • 44
  • 66
8
votes
2 answers

Simple term query not working with elastic while match works

I have a JSON object like below in Elastic. { "_source" : { "version" : 1, "object_id" : "f1dcae27-7a6f-4fea-b540-901c09b60a15", "object_name" : "testFileName_for_TestSweepAndPrune", "object_type" : "", …
joe
  • 1,136
  • 9
  • 17
8
votes
3 answers

LogStash - Failed to instantiate type net.logstash.logback.appender.LogstashTcpSocketAppender

I am working on Springboot Microservcies & for monitoring Im using ELK Stack. I am using docker containers for running ELK as per this guide. ELK is up and running, I am starting my Logstash by, docker run -d -it --name logstash -p 5000:5000…
John Seen
  • 701
  • 4
  • 15
  • 31
8
votes
2 answers

Amazon elasticsearch interpretation of FreeStorageSpace metrics

I have 6 instances of type m3.large.elasticsearch and storage type instance. I don't really get what does Average, Minimum, Maximum ..mean here? I am not getting any logs into my cluster right now although it shows FreeStorageSpace as 14.95GB…
8
votes
2 answers

Feeding logstash from azure web app. How?

I have a web app hosted on the azure platform and an ELK stack hosted on a virtual machine also in azure (same subscription) and am struggling to find a way to ship the logs from the app to logstash. A web app stores all its files on a storage…
Sheff
  • 3,474
  • 3
  • 33
  • 35
8
votes
3 answers

Best Docker logging architecture using ELK stack

Recently I am trying to find out best Docker logging mechanism using ELK stack. I am having some questions regarding the best work flow that companies use in production. Our system has typical software stack including Tomcat, PostgreSQL, MongoDB,…
cucucool
  • 3,777
  • 8
  • 48
  • 63
7
votes
1 answer

How to check progress of ElasticSearch's Reindex API

I'm trying to execute a reindex operation from remote ES 2.4 cluster via Reindex API. Which job is to transfer more then 100 million docs of an index to latest version of elasticsearch. For the test case i'm trying it on small data set but i'm…
Waqas Afzal
  • 113
  • 1
  • 5
7
votes
3 answers

Elastic Search Getting Version Conflict even while updating document sequentially using update_by_query

I am trying to update a document's nested type field using update_by_query. I am using the following script query: POST test/_update_by_query { "script": { "source": "ctx._source.address = params.address", "params": { …
Suraj Dalvi
  • 988
  • 1
  • 20
  • 34
7
votes
2 answers

Logstash error : Failed to publish events caused by: write tcp YY.YY.YY.YY:40912->XX.XX.XX.XX:5044: write: connection reset by peer

I am using filebeat to push my logs to elasticsearch using logstash and the set up was working fine for me before. I am getting Failed to publish events error now. filebeat | 2020-06-20T06:26:03.832969730Z 2020-06-20T06:26:03.832Z INFO …
aqel
  • 415
  • 1
  • 5
  • 11
7
votes
3 answers

com.mysql.jdbc.Driver not loaded. Are you sure you've included the correct jdbc driver in :jdbc_driver_library

I am getting java version and mysql-connect-java.jar compatibility issue with logstash. can any one tell me which version of mysql-connect-java.jar is compatible with which version of java? Error: com.mysql.cj.jdbc.Driver not loaded. Are you sure…
Juned Ansari
  • 5,035
  • 7
  • 56
  • 89
7
votes
2 answers

Consider defining a bean named 'elasticsearchTemplate' in your configuration

I have just started springboot and tried to implement elastic search with spring-boot but I am getting this type of error while running spring-boot app Consider defining a bean named 'elasticsearchTemplate' in your configuration. POM.XML …
Tirth Timaniya
  • 184
  • 1
  • 1
  • 16
7
votes
6 answers

default username in Elastic cloud (kibana) and how to find a password

I'm trying out the Elastic Cloud 14 days free trial. I deployed Elastic cloud following the video tutorial. I set my password. However, I don't remember putting in my username. I tried my email account, which I used to confirm. I tried my IP…
Jin Lee
  • 3,194
  • 12
  • 46
  • 86
7
votes
1 answer

How to configure FluentD (EFK) with Filebeat?

I have configured ELK-stack (Elasticsearch, Logstash, and Kibana) cluster for centralized logging system with Filebeat. Now I have been asked to reconfigure to EFK (Elasticsearch, FluentD, and Kibana) with Filebeat. I have disabled the Logstash and…
rolz
  • 591
  • 2
  • 11
  • 23
7
votes
1 answer

error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

ELK with salesforce URL:http://localhost:9200/>, :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused…
Jain
  • 71
  • 1
  • 1
  • 3
7
votes
3 answers

"Message":"Your request: '/_cluster/allocation/reroute' is not allowed."}

Am working on AWS cluster re-assigning the replica shard in an AWS ES cluster of node 1. Where i want both primary and replica shards to be reside. But when a run the below command am getting an error curl -XPOST…