Questions tagged [elastic-stack]

Elastic Stack combines the Elasticsearch, Logstash, Kibana, and the Beats Framework to provide real-time insights of any type of structured or unstructured data.

Elastic Stack combines the , , , and the Beats Framework to provide real-time insights of any type of structured or unstructured data.

In 2015, Elastic introduced the Beats framework (,,) into their stack and decided to rename the ELK Stack to the Elastic Stack

3683 questions
6
votes
1 answer

Completion Suggester with additional conditions in Elastic Search

I have a index that returns jobs in different languages. I need to search similar jobs as per a single text that to a single language. So let's say, I have set 1 as LanguageId for English. And I want to search jobs matching with account. So if I…
6
votes
0 answers

Elasticsearch randomly returns empty results for a query which have entries in index

We are using Elastic 6.0 and Nest with 1 primary and 3 replicas. Sometimes when we run a query it would return empty results and when we immediately run it again it would return the appropriate results. This happens randomly and I couldn't see any…
user3861992
  • 289
  • 3
  • 13
6
votes
1 answer

ElasticSearch 6, copy_to with dynamic index mappings

Maybe I'm missing something simple, but still could not figure out the following thing: As of ES 6.x the _all field is deprecated, and instead it's suggested to use the copy_to instruction…
Vyacheslav
  • 1,186
  • 2
  • 15
  • 29
6
votes
1 answer

Connect kibana to elasticsearch in kubernetes cluster

I have a running elasticsearch cluster and I am trying to connect kibana to this cluster (same node). Currently the page hangs when I try to open the service in my browser using :. . In my kibana pod logs, the last few log messages in the pod…
appdap1
  • 521
  • 1
  • 6
  • 17
6
votes
1 answer

Stackdriver vs ELK for app engine

Im a little confused about this because the docs say I can use stackdriver for "Request logs and application logs for App Engine applications" so does that mean like web requests? Does that mean like millions of web requests? Stackdriver's pricing…
red888
  • 27,709
  • 55
  • 204
  • 392
6
votes
2 answers

How do I refer to a regex group inside a custom grok pattern?

I want to add fields for specific URI params in my log lines here is an example log line: 2017-03-12 21:34:36 W3SVC1 webserver 1.1.1.1 GET /webpage.html param1=11111¶m2=22222¶m3=¶m4=4444444 80 - 2.2.2.2 HTTP/1.1 Java/1.8.0_121 - -…
red888
  • 27,709
  • 55
  • 204
  • 392
6
votes
1 answer

Unable to install Search Guard plugin for Elasticsearch-5.x

Due to the restrictions, I was not allowed to install any packages from internet. So, This command is not useful for me inorder to install search-guard. bin/elasticsearch-plugin install -b com.floragunn:search-guard-ssl: However, I am…
6
votes
2 answers

Elastic search query on indices with some date range

I have below scenario: I have following indices in elastic search. index-2016.04.10 index-2016.04.11 index-2016.04.12 index-2016.04.15 index-2016.04.16 index-2016.04.18 Now suppose , I want to search some data in elastic search between dates -…
pbajpai
  • 1,303
  • 1
  • 9
  • 24
6
votes
1 answer

Application logging with ELK stack

Using NLog with Elasticsearch target to forward logs to AWS Elasticsearch as a Service cluster for visualisations in Kibana. This works fine but I am concerned about using this in production due to ES cluster availability and the impact a cluster…
thedev
  • 2,816
  • 8
  • 34
  • 47
6
votes
3 answers

Root user in Elasticsearch 2.4.0 in Docker container

I am running ELK stack with Docker for log management with current configuration of ES 1.7, Logstash 1.5.4 and Kibana 4.1.4. Now I am trying to upgrade Elasticsearch to 2.4.0, found at…
vvs14
  • 720
  • 8
  • 19
6
votes
1 answer

Convert all fields ending with "id" to integer using convert in mutate?

Currently I am doing something like this in my logstash config file : filter { ... mutate { ... convert => { "blahId" => "integer" "blahblahId" => "integer" ... ... …
Karup
  • 2,024
  • 3
  • 22
  • 48
6
votes
2 answers

Logstash not working with multiple files wildcard path

Logstash doesn't seem to read path with wildcard here is my config file input { file { path => "C:\logs\app*.log" type => "MyType" } } filter { } output { elasticsearch { } }
Amir Katz
  • 1,027
  • 1
  • 10
  • 24
5
votes
1 answer

open distro for elastic search 'source alias does not point to a write index'

I'm using open distro for elasticsearch v7.7.0, I want to manage index life cycle automatically so when a new indice is created it gets automatically attached to an ISM policy. but I'm getting this error 'source alias does not point to a write…
Amine Bouzid
  • 302
  • 3
  • 11
5
votes
1 answer

Elasticsearch search API not returning all the results

I have three indexes, all three of them share a particular key-value pair. When I do a blanket search with the api "http://localhost:9200/_search" using the request body {"query":{ "query_string": { "query":"city*" } …
David
  • 535
  • 8
  • 13
5
votes
0 answers

Ways to export log-data from Azure Application Insights to the Elastic Stack?

is there a way to export Log-Data from Application Insights to Elasticsearch? Application Insights is monitoring my Elastic-Cluster. I want to be able to export those logs to Elasticsearch. I was thinking that setting up a continuous export to sql…