Stack Overflow
Stack Overflow

Questions tagged [elastic-stack]

Elastic Stack combines the Elasticsearch, Logstash, Kibana, and the Beats Framework to provide real-time insights of any type of structured or unstructured data.

Elastic Stack combines the , , , and the Beats Framework to provide real-time insights of any type of structured or unstructured data.

In 2015, Elastic introduced the Beats framework (,,) into their stack and decided to rename the ELK Stack to the Elastic Stack

3683 questions
0
votes
0 answers

How to create an analyzed Elastic Search ingested data in both String and Numeric format for searching?

I have incoming data with a field called "PhoneNumber". It is a String and can have numeric and special chars - ex: 123-456-7890, +123-456-7890. I have the current requirement for searching: RangeQuery - ex: 123456-99999999 will return all…
shaselai
  • 19
  • 2
0
votes
0 answers

What are valid methods of archiving EFK-stack data from a Kubernetes cluster automatically?

My indices take up a lot of memory in my Kubernetes cluster after a few days. What would be the preferred method to export and archive these automatically? Apologies if this is a rather simple and general question, but I can only find information on…
Jens Voorpyl
  • 30
  • 6
0
votes
1 answer

ELK logging index best practices - index per "log type"?

My team wants to use the ELK stack to monitor logs. We suppose we should have an index per microservice, per date. E.g. "service1-30/05/2023". Is it considered good practice to have an index per "log type"? E.g. "service1-usercreated-30/05/2023",…
BladesV
  • 51
  • 3
0
votes
0 answers

Forwarding logs from F5 Big-ip asm to ELK stack

I am new to f5 Bigip asm and elk stack, could you give me any ressources to forward logs from the big ip asm to elk stack ? I didn’t found any clear ressource for step by step I need help please ! Im using ubuntu for elastic search
Lord
  • 1
0
votes
0 answers

Elasticsearch - Is it possible to filter per specific term?

Is it possible to filter for specific terms? For example, I have an index with items (item 1, item 2, item 3, etc) and each item has a value (value 1, value 2, value 3, etc). What I want to do is for each item, retrieve a specific value and do…
Mathijs
  • 177
  • 3
  • 18
0
votes
0 answers

Trouble with has_parent query containing scripted

parent index : candidate , type: profile; child index : candidate , type: application I have parent data like this in elasticserch { "took": 1, "timed_out": false, "_shards": { "total": 5, "successful": 5, …
ZhuXJun
  • 25
  • 5
0
votes
1 answer

Best field type to store http request/response logs in Elasticsearch

I need to log http requests and responses from various end points. requests and responses are in json format but the payloads could be completely different. There will be millions of logs and will be queried very sparsely. Cost is more important…
hevi
  • 2,432
  • 1
  • 32
  • 51
0
votes
0 answers

Does increasing the number of nodes in elastic increase heap size?

I use hosted elastic and I currently have 2 zones active. At the moment I keep getting parent circuit breaker exceptions, which means my cluster doesn't have enough memory. By adding a zone and going to 3 zones with the same cpu and ram. Will this…
Mathijs
  • 177
  • 3
  • 18
0
votes
0 answers

How to pass the keyword argument to es.indices.exists_alias() in elastic search using python

enter code herewhen i try using below code got errors Like: if es_client.indices.exists_alias(index_alias): print("#########################################") current_index = list(es_client.indices.get(index_alias).keys())[0] …
Madhu
  • 13
  • 5
0
votes
0 answers

Feasibility Of Entity Centric Indexing for my use case

We're collecting all the events in our application and storing them along with a session identifier. I've an use case where i want to find the sessions where users navigate from say login page to product page to cart page . We're consolidating all…
Murugappan Vr
  • 175
  • 1
  • 6
0
votes
0 answers

Setup Filebeat Log Monitoring - only specify multiline once for all inputs

I am setting up Elastic Filebeat Log monitoring for an application. My filebeat.yml contains 9 inputs covering 9 different log files. For each input, I am having to put the multiline properties (type, pattern, negate, match), which makes the file…
Faheem Ebrahim
  • 11
  • 1
0
votes
0 answers

Elastalert2 WARNING:apscheduler.scheduler skipped: maximum number of running instances reached

I am trying to run elastalert2 on my Centos 8 machine, and I get this error while doing so WARNING:apscheduler.scheduler:Execution of job "Rule: Testing Email Alert (trigger: interval[0:00:05], next run at: 2023-07-10 15:31:11 IST)" skipped:…
Atharva Sachin Tilak
  • 11
  • 2
0
votes
1 answer

how to find distinct document value from coresponding search element in elasticsearch

{ "stage_video_clip_646f4c0fb780630373dfffdb" : { "mappings" : { "date_detection" : false, "properties" : { "@class" : { "type" : "keyword" }, "additionalProperties" : { "properties" : { …
lovedeep sangha
  • 18
  • 5
0
votes
0 answers

filebeat utilization is very high

my filebeat consumtipn is very high and using more than 4GB of RAM, only log files which I am pushing are some app logs , /var/log/messages and /var/log/secure. Not sure why this happening. Please help. [root@ip-10-1-16-7 ~]# service filebeat…
sunny
  • 17
  • 2
0
votes
1 answer

Unable to add size field for Elasticsearch request using Python

I am using a Python client to search an index on Elasticsearch and by default, it is returning only the first 10 hits. I want the first 200 hits instead. It was my understanding that by adding the "size" field in the input query, we can specify how…
SpamsterHamster
  • 21
  • 3
1 2 3
…
99 100