Questions tagged [elastic-stack]

Elastic Stack combines the Elasticsearch, Logstash, Kibana, and the Beats Framework to provide real-time insights of any type of structured or unstructured data.

Elastic Stack combines the , , , and the Beats Framework to provide real-time insights of any type of structured or unstructured data.

In 2015, Elastic introduced the Beats framework (,,) into their stack and decided to rename the ELK Stack to the Elastic Stack

3683 questions
14
votes
2 answers

application insights vs elastic (ELK)

Or I am really bad at searching or there is no detailed comparison between App Insights and ELK stack ? All monitoring is going to be used for simple Web API, there going to be tons of end points but user traffic should not be too high. So my…
DevyDev
  • 846
  • 3
  • 14
  • 37
14
votes
4 answers

Django server not sending logs to Logstash

I am using ELK stack for centralised logging from my Django server. My ELK stack is on a remote server and logstash.conf looks like this: input { tcp { port => 5959 codec => json } } output { elasticsearch { hosts =>…
Arpit Solanki
  • 9,567
  • 3
  • 41
  • 57
14
votes
1 answer

Log4j 2 JSON pattern layout + Logging JSON payload

I am using ELK stack along with log4j 2 via sl4j with json pattern layout to log messages. All my logs are logged as json messages.Also in one of my logs I am trying to log the json response received from the third party service. But this response…
Amila Iddamalgoda
  • 4,166
  • 11
  • 46
  • 85
14
votes
1 answer

Elasticsearch: No handler for type [keyword] declared on field [hostname]

I get above Mapper Parsing Error on Elasticsearch when indexing log from filebeat. I tried both Filebeat -> Elasticserach and Filebeat -> Logstash -> Elasticsearch approach. I have followed their own documentations, I installed filebeat template as…
rayhan
  • 636
  • 3
  • 9
  • 26
13
votes
4 answers

Elasticsearch query not giving exact match

Am searching elasticsearch with the below match query, which is not giving me the exact match instead its giving some more irrevalant match also. am using elasticsearch 6.2.3 Please find my query below get items/_search { "query" : { …
Karthikeyan
  • 1,927
  • 6
  • 44
  • 109
13
votes
3 answers

AWS - subscribe multiple lambda logs to one elasticsearch service

I have two log groups generated by two different lambda. When I subscribe one log group to my elasticsearch service, it is working. However, when I add the other log group I have the following error in the log generated by cloudwatch :…
13
votes
1 answer

Size parameter in elastic search

It may be a beginner question, but I have some doubts related to size. As per elastic search specs, the maximum value of size can be 10000, I want to validate my understandings below: Sample Query: GET testindex-2016.04.14/_search { "size":…
pbajpai
  • 1,303
  • 1
  • 9
  • 24
13
votes
1 answer

Kibana equivalent for MongoDB

We've fed up with instability and unpredictability of ELK stack but still in love with the Kibana dashboards. Hence I'm looking for some potential migration paths. MongoDB looks very promising: huge track record, lots of docs, ability to cope with…
god
  • 306
  • 1
  • 2
  • 12
12
votes
4 answers

Difference between using Filebeat and Logstash to push log file to Elasticsearch

I am trying out the ELK to visualise my log file. I have tried different setups: Logstash file input plugin https://www.elastic.co/guide/en/logstash/current/plugins-inputs-file.html Logstash Beats input plugin…
user1589188
  • 5,316
  • 17
  • 67
  • 130
12
votes
2 answers

how to setup kibana user credentials with docker elk stack

How to setup login credentials for kibana gui with docker elk stack containers. What arguments and environmental variables must be passed in docker-compose.yaml file to get this working.
12
votes
1 answer

Change type and reindex in Elasticsearch

I recently upgraded my ELK stack (logstash 2.3.4 using redis 3.2.3, Elasticsearch 2.3.5 and Kibana 4.5.4) from (logstash 1.4.1/1.4.2 using redis 2.8.24, Elasticsearch 1.2.2 and Kibana 3.1.1). The upgrade went well but after the upgrade I had some…
Mike
  • 121
  • 1
  • 6
12
votes
1 answer

What is the point of REDIS in ELK stack?

I currently have architecture with filebeat as the log shipper, which sends logs to log stash indexer instance and then to managed elastic search in AWS. Due to persistent TCP connections, I cannot load balance using AWS ELB multiple log stash…
alexfvolk
  • 1,810
  • 4
  • 20
  • 40
12
votes
5 answers

Connect two instances of docker-compose

I have a dockerized application with a few services running using docker-compose. I'd like to connect this application with ElasticSearch/Logstash/Kibana (ELK) using another docker-compose application, docker-elk. Both of them are running in the…
Dag Høidahl
  • 7,873
  • 8
  • 53
  • 66
11
votes
1 answer

ERROR Unable to process event: 'java.time.Instant ch.qos.logback.classic.spi.ILoggingEvent.getInstant()'

I tried to use logstash-logback-encoder with spring boot for sending logs to the ELK. but unfortunately I get this error. |-ERROR in net.logstash.logback.appender.LogstashTcpSocketAppender[LOGSTASH] - Unable to process event: 'java.time.Instant…
11
votes
3 answers

Elasticsearch - Want to sort by field in all indices where that particular field available or not if not then avoid it

Currently, Getting result based on scoring but what i want to do is i want a result based on scoring + Field Status with value true/false. If value is true then needed that results in priority but there is possibility that status field is not exist…
jilesh
  • 436
  • 1
  • 3
  • 13