Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [elasticsearch]

Elasticsearch is a flexible and powerful open source, distributed, real-time search and analytics engine.

Elasticsearch is a flexible and powerful open source, distributed, real-time search and analytics engine. Architected from the ground up for use in distributed environments where reliability and scalability are must haves, Elasticsearch gives you the ability to move easily beyond simple full-text search. Through its robust set of APIs and query DSLs, plus clients for the most popular programming languages, Elasticsearch delivers on the near limitless promises of search technology.

http://www.elasticsearch.org

378 questions
0
votes
0 answers

ElasticSearch Cluster fails 5 minutes after starting on Azure

I am trying to build an ElasticSearch cluster on Azure. I have done it successfully for testing purposes with 3 VM's under the same virtual network. It functioned very good. Because of my subscription limits, I distrubuted those 3 VM into 3…
iboware
  • 111
  • 3
0
votes
1 answer

How to use influxdb as a datasource for elasticsearch?

I have a usecase where I would like to store conversation (chat) history in influxdb but I would like to have search capability of this textual conversation history, for which I would like to use elasticsearch. How should I use influxdb as a…
andthereitgoes
  • 125
  • 1
  • 8
0
votes
1 answer

ElasticSearch enforce master shard allocation & Improve cross DC write speed

I currently run three Elasticsearch nodes. Each one in a different data center (EU, US, AP) as an AWS EC2 instance. There are 2 replicas per each shard for each index. Writes go only to the EU node. When you write to the EU, your write might take: ~…
Tom Raganowicz
  • 183
  • 1
  • 1
  • 9
0
votes
1 answer

Logstash Grok Filter

I'm sure there is a simple solution to this but I'm new to working Logstash. The filter I'm trying to apply is for some firewall logs and I have a field that will either have a single or two values separated by a…
CCoombes83
  • 11
  • 3
0
votes
1 answer

Can I setup logstash with windows generated certs instead of openssl?

Going through this tutorial. They use openssl to generate certs to use with logstash ie this command: sudo openssl req -subj '/CN=ELK_server_fqdn/' -x509 -days 3650 -batch -nodes -newkey rsa:2048 -keyout private/logstash-forwarder.key -out…
red888
  • 4,183
  • 18
  • 64
  • 111
0
votes
1 answer

Unassigned shards in elasticsearch

We have a 0.90 cluster with two elasticsearch nodes. For a while now their status was going yellow often then coming back to green, but now it's red and seems to stay that way. The health is this : { "cluster_name" : "name", "status" : "red", …
Ulrar
  • 387
  • 6
  • 23
0
votes
2 answers

ELK stack on AWS and web app on Digital Ocean, how and can I grab logs from the later?

I have a python website hosted on digital ocean and ELK stack - Elastic Search, Kibana, Logstash - on AWS. I'm trying to understand how to feed the logs files from my python web app on digital ocean to the ELK stack on AWS: Is it possible to feed…
Dett
  • 53
  • 1
  • 4
0
votes
0 answers

Best practice/way to manage Elasticsearch cluster nodes in EC2 cloud with Ansible

I have to deploy cluster for production environment in EC2 cloud and want to be able to: 1. Remove/Add nodes from/to cluster 2. Assign roles to nodes (dedicated master node, data node, and client node) What are best way to manage it: - use…
antonbormotov
  • 123
  • 4
0
votes
1 answer

Field type not being honor in Kibana/Elasticsearch

I'm using a logstash plug-in for a Java app using logback to forward logs on to my logstash server. I've setup a filter definition as follows: input { tcp { port => 2856 codec => json_lines } } filter { mutate { convert => { …
John S
  • 135
  • 7
0
votes
2 answers

Collectd --> Elasticsearch if remote-host can't connect to central elasticsearch

Goal Central storage and way to analyze performance numbers: cpu load ram usage ... Current strategy I would like to implement a setup like this: collectd logstash elasticsearch kibana Like explained…
guettli
  • 3,591
  • 17
  • 72
  • 123
0
votes
2 answers

ElasticSearch cluster move to new node type

I have a cluster of 8 nodes in ec2. 4 per AZ with cluster.routing.allocation.awareness.attributes: aws_availability_zone I want to migrate all the shards to a different node type. So I set up to new nodes and added them to the cluster. Some shards…
Dmytro Leonenko
  • 456
  • 1
  • 7
  • 24
0
votes
0 answers

F5 High Speed Logging and Logstash GROK

Im trying to format logs straight from our F5 using HSL and Logstash. I've copied the example configuration exactly from the site as it contains the majority of the information I wanted logstash example My F5 is now outputting logs to my…
Dan
  • 138
  • 2
  • 11
0
votes
0 answers

Sending PostGreSQL log data to Logstash using Packetbeat

I am trying to configure sending pgsql log data to elasticsearch. The architecture is like this: packetbeat -> logstash -> elasticsearch. After running packetbeat, logstash log says: :message "Beats Input: Remote connection closed",…
Kadir
  • 126
  • 1
  • 8
0
votes
1 answer

elasticsearch nodes not joining cluster

i have three nodes which should autoconfig into a cluster but for some reason they dont seem to want to cluster up. The 3 Hyper-V VM Servers are CENTOS 7 installed as compute with just the tool packages installed. the servers have consecutive IP's…
Dan
  • 138
  • 2
  • 11
0
votes
1 answer

How to add Elasticsearch as a service in Ambari

I was wondering to know how can I add Elasticsearch as a service to Ambari portal and monitor it through that portal? ... I know it's doable via Ambari Stacks, but I don't know how doing it. I found an RPM plugin, but since the host operating system…
Ryan
  • 31
  • 3
1 2 3
…
25 26