Questions tagged [elasticsearch]

Elasticsearch is a flexible and powerful open source, distributed, real-time search and analytics engine.

Elasticsearch is a flexible and powerful open source, distributed, real-time search and analytics engine. Architected from the ground up for use in distributed environments where reliability and scalability are must haves, Elasticsearch gives you the ability to move easily beyond simple full-text search. Through its robust set of APIs and query DSLs, plus clients for the most popular programming languages, Elasticsearch delivers on the near limitless promises of search technology.

http://www.elasticsearch.org

378 questions
0
votes
2 answers

Kibana: No Living connections

I have ES 1.5.2 cluster with Kibana 4.0.1. This consists of 4 data/master nodes along with 4 client nodes. When I'm trying to load kibana sometimes it takes longer time to load or sometimes I need to restart the ES client node which kibana is…
Lakal Malimage
  • 486
  • 1
  • 4
  • 10
0
votes
1 answer

ElasticSearch Delayed Indexing

I currently have the following setup: syslog-ng servers --> Logstash --> ElasticSearch The syslog-ng servers are load balanced and write to a SAN location where Logstash just tails the files and sends them to ES. I'm currently receiving around 1,300…
Eric
  • 1,383
  • 3
  • 17
  • 34
0
votes
2 answers

Logstash filtering syslog by host group?

I've got an Elasticsearch/Logstash/Kibana instance running, which I'm merrily stuffing with syslogs from a variety of hosts. Having built it to scale - with multiple logstash syslogd listeners, and multiple ES nodes - it's doing quite nicely for…
Sobrique
  • 3,747
  • 2
  • 15
  • 36
0
votes
1 answer

ELK: LogStash to read log files from remote Samba-mapped network drives

I'm new to ELK, and I would like to set up a solution to index Microsoft IIS and applicative .NET logs with ES. I'm aware about different approaches: 1) [app servers: log files ➔ Logstash] ➔ [collecting server: Redis ➔ Logstash] ➔ [ES cluster: ES ➔…
0
votes
1 answer

Elasticsearch Cluster Configuration

Brand new to Elasticsearch. I've been doing tons of reading, but I am hoping that the experts on SO might be able to weigh in on my cluster configuration to see if there is something that I am missing. Currently I am using ES (1.7.3) to index some…
0
votes
1 answer

Best practice of adding node(s) to elasticsearch cluster

I'm using Zen Discovery module to connect all nodes together, but when I want to add a new node to the cluster, I have to change every node's discovery.zen.ping.unicast config to add the new node's ip, and then restart all nodes. When the cluster's…
leo108
  • 113
  • 2
  • 6
0
votes
1 answer

Cassandra JMX doc pointers

Any good starting URL/pointers for reading up on what could be monitored through JMX on cassandra 2.0? Think off pull data into an existing ELK stack from JMX on new Cassandra clusters, but never really dealt with JMX before.
0
votes
0 answers

Minimum hardware requirements for ElasticSearch in docker

I am developing a search application using elasticsearch and I would like to keep the development cost as low as possible. What are the minimum requirements for elasticsearch to run properly inside a docker container? I am especially interested in…
Automatico
  • 183
  • 3
  • 8
0
votes
1 answer

elasticsearch not creating replica shards

I am banging my head for the past two days on this one. I have setup an elasticsearch cluster of two nodes. The configuration of each node is pretty simple: node.name: "server1" discovery.zen.ping.multicast.enabled:…
giomanda
  • 1,754
  • 4
  • 21
  • 30
0
votes
1 answer

Backing Up Old Indices in Elasticsearch

We have a ELK (ElasticSearch-Logstash-Kibana) deployment in which we ship logs via logstash to Elasticsearch Cluster. Indices are created daily. We close indices which are more than 3 days old and take a snapshot of indices which are more than 7…
tuk
  • 333
  • 5
  • 18
0
votes
1 answer

elasticsearch: how to see that warnings are in logs / breakers are being tripped

ES 1.7.x on CentOS Our production ES cluster went down hard. We lost the entire index. Turns out, this had been in the logs for a day or more: New used memory from field ### would be larger than configured breaker OK. What url on ES can I hit to…
Jonesome Reinstate Monica
  • 5,445
  • 10
  • 56
  • 82
0
votes
1 answer

Opserver Alerting that ElasticSearch Indexes and Shards are in Trouble

We're using Opserver to monitor our ElasticSearch nodes. Recently it began alerting "1 Indexes in trouble" and "3 Shards in trouble". I can't seem to find any other information on these warnings. Searching on the involved indexes seems to be working…
jdehlin
  • 103
  • 3
0
votes
1 answer

Elasticsearch index created with fieldtype mapping integer, recognized as "string" in Kibana 4

I have created an index in elasticsearch 1.7 like this: curl -XPUT 'http://localhost:9200/test' -d ' { "test" : { "properties" : { "user" : {"type" : "string", "index" : "not_analyzed"}, "message" : {"type" :…
scaarup
  • 3
  • 3
0
votes
1 answer

Elasticsearch ec2 discovery getting wrong IP?

I am running elasticsearch 1.4.3 as a worker-node/client (master=false, data=false) on AWS and I'm trying to get it to join a cluster. My elasticsearch.yml looks like this: cluster-name: elastisearch node.master:false node.data:…
user305333
0
votes
1 answer

Central Logging Options - need flat file as well as elastic search

I would like to have ephemeral ec2 instances push logs to a central flat-file store for archiving and manual perusing, as well has have that data pushed to elastic search. Is there a single agent that can tail local log files and both push them to a…