Questions tagged [elastic-stack]

Elastic Stack combines the Elasticsearch, Logstash, Kibana, and the Beats Framework to provide real-time insights of any type of structured or unstructured data.

Elastic Stack combines the , , , and the Beats Framework to provide real-time insights of any type of structured or unstructured data.

In 2015, Elastic introduced the Beats framework (,,) into their stack and decided to rename the ELK Stack to the Elastic Stack

3683 questions
0
votes
0 answers

Logstash- How to parse formatted JSON arrays in log files

Logstash version: 7.17.10 Elasticsearch version:7.17.10 The logs are located in /var/logs directory and the format is as below: [ { "t": "SYS", "dt": "2023-04-17 19:46:40.147 GMT-04:00", "c": "MenuSectionsViewController", "cpu":…
fisherhe
  • 1
  • 2
0
votes
0 answers

Trying to build a lens graph which counts how many times another lens reachs certain values

We are building some environmental measures graphs on a ElasticSearch + Kibana dashboard using lens. We have an index where values of certain contaminants, measured by several environmental stations, are stored. Using those data, we've builded some…
Bardo
  • 2,470
  • 2
  • 24
  • 42
0
votes
0 answers

Why logstash gives filebeat metadata for kafka input plugin?

I'm running a logstash pipeline using kafka input plugin with following configuration kafka { bootstrap_servers => "xxxx" topics => ['topic1', 'topic2', 'topic3' ... , 'topic50'] auto_offset_reset => 'latest' group_id =>…
0
votes
0 answers

Logstash "Cannot determine timezone from nil" Error When Using JDBC Input Plugin and elasticsearch

I am facing an issue while running Logstash with a configuration that uses the JDBC input plugin to synchronize data from a MySQL database to Elasticsearch. Here are the details of the problem: Following is my elastic_mysql_sample.conf…
0
votes
0 answers

how to draw a custom data flow in elastic kibana based on logs data

I want to create some kibana visualization that I am not sure is possible... it goes like this : so all my documents have a property called sessionId (the purpose is to group some documents based on the sessionId) i want to create a visualization…
David Munsa
  • 885
  • 1
  • 16
  • 30
0
votes
0 answers

How to remove fields data and mapping from "indexes", they are for mutiple tenants without re-indexing documents in Elasticsearch

{ "mappings" : { "date_detection" : false, "properties" : { "@class" : { "type" : "keyword" }, "additionalProperties" : { "properties" : { "@class" : { "type" :…
0
votes
0 answers

Get records by First Character Elastic search

{ "settings": { "analysis": { "tokenizer": { "ngram_tokenizer": { "type": "ngram", "min_gram": 1, "max_gram": 2 } }, "analyzer": { "ngram_analyzer": { "type": "custom", "tokenizer": "ngram_tokenizer" } } } }, "mappings": { "properties": { "ItemID":…
0
votes
0 answers

Elasticsearch: how to get fields based on exact match of other fields?

I am very new to elasticsearch, and I am trying to write a query. I have this sample data: { firstName:”x”, lastName: “y”, latitude: “18”, longitude: “19”, address: { addressLine1: “abcd”, addressLine2: “wasd”, city:…
shasha0607
  • 123
  • 1
  • 9
0
votes
1 answer

Index fail cause in Elastic Search

I am working on the Elastic Search (v7.10) and see that the statistic metric "indexing.index_failed" has increased. But I want to know the reasons why it failed. In my application, I used the Rest High-level Client and have caught the exception. But…
0
votes
1 answer

Is there anyway to skip `Reindexing in Elastic Search with database

Currently working with a large database that typically takes 2-3 days to reindex completely, and I only need to add a new field to the mapping for a specific table. What could be a possible solution to skip reindexing? What is the possible way to…
0
votes
0 answers

Starting ELK through docker-compose doesn´t work error mounting

I am trying to run ELK through docker-compose with TLS enabled , but I am getting the same error still when typing docker-compose up -d : Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime…
0
votes
1 answer

Elasticsearch error when trying to run bin/elasticsearch-setup-passwords

I am setting up Elasticsearch version 7.17.11 on Ubuntu 20.04. It will be a single instance of Elasticsearch but I will have separate instances for Kibana and Logstash. I am trying to recreate our setup in another cloud project without using a…
0
votes
1 answer

Can you change the values of a field, like {1,2,3} to {red, blue, green} in kibana?

I have a field that varies 1,2,3. I'd like to have the visualization show red, blue, green instead of the int (i.e. int to string). Is this possible to do without redoing the index? For example, I have a bar chart with 1,2,3 on the horizontal axis.…
0
votes
0 answers

ELK Monitoring deploy roles with index unavailibvility

I deployed ELK Monitoring Cluster (ELK with feature of monitoring enabled ) and I have couple of other clusters with metricbeat connecting to elasticsearch on it. I would like to implement rule that when in index thereis no recent data - it will…
dominbdg
  • 13
  • 1
  • 4
0
votes
0 answers

Monitor several GCP projects using Elastic stack

I have several GCP projects, belonging to different people. I have all accesses on them. None of them have an Organization set. I would like to monitor those projects (metrics from VM, logs etc) and display a centralized dashboard with relevant…