Stack Overflow
Stack Overflow

Questions tagged [elasticsearch-performance]

22 questions
3
votes
1 answer

How can I subset or restrict an Elasticsearch query by a large number of potential values?

We're using Elasticsearch to store much of our data, but we're running into issues where we have to subset the search by a large number of potential values, for instance due to permission controls we want to have take effect. When you're building an…
josephkibe
  • 1,281
  • 14
  • 28
3
votes
0 answers

Elasticsearch aggregation time complexity

I want to aggregate N(= 10 million) data by percentile_rank. And I want to call this query lively (more than 100 times per second). As far as I know, Elasticsearch uses t-digest algorithm on percentile. So total time complexity is O(NlogN). My…
isbee
  • 161
  • 1
  • 8
2
votes
2 answers

Elasticsearch "_cat/indices" api update delayed until search?

Elasticsearch (v7.9.2) got an api _cat/indices to show index status, the last change made to docs.count seems not visiable, until a search or another update is made. Is this behaior for the purpose of performance improvement? And, is there any way…
Eric
  • 22,183
  • 20
  • 145
  • 196
1
vote
0 answers

ElasticSearch High Search response times on new Machine

I have 4 EC2 machines in ElasticSearch Cluster. Configuration: c5d.large, Memory: 3.5G, Data Disk: 50GB NVME instance storage. ElasticSearch Version: 6.8.21 I added the 5th machine with the same configuration c5d.large, Memory: 3.5G, Data Disk: 50GB…
dnsh
  • 3,516
  • 2
  • 22
  • 47
1
vote
1 answer

recommended max number of tokens? (scalability)

I'm using the following ngram tokenizer to process 15000 documents (and expect it to grow to up to a million documents), each with up to 6000 characters (avg 100-200) of text. 2-8 ngram is what I use for a catch-all approach because it needs to…
Morrowless
  • 6,856
  • 11
  • 51
  • 81
1
vote
0 answers

how to load balance ES cluster nodes

Having an issue wherein the load on ES nodes in terms of load factor, CPU usage or indexing rate is not uniform and some nodes are having higher load than others. This is causing poor performance (high latency) on writes/reads even as overall…
user236215
  • 7,278
  • 23
  • 59
  • 87
1
vote
1 answer

Performance in Elasticsearch

I am now beginning with elasticsearch. I have two cases of data in a relational database, but in both cases I want to find the records from the first table as quickly as possible. Case 1: binding tables 1: n (example Invoice - Items of…
Jaroslav Zeman
  • 17
  • 3
1
vote
1 answer

ElasticSearch BulkShardRequest failed due to org.elasticsearch.common.util.concurrent.EsThreadPoolExecutor

I am storing logs into elastic search from my reactive spring application. I am getting the following error in elastic search: Elasticsearch exception [type=es_rejected_execution_exception, reason=rejected execution of processing of…
Abdul Basith
  • 83
  • 1
  • 11
1
vote
1 answer

Elasticsearch, why "SELECT * FROM my_index LIMIT 1" takes so long?

I've a decently sized ES index (10TB) with 50 split on 50 machines (1 shard each), close to 10B rows. Machines are top-tier (the largest you can get on AWS). RAM per ES instance is set to 30 GB. Whenever I run a very simple query such as : POST…
M4rk
  • 2,172
  • 5
  • 36
  • 70
1
vote
1 answer

Data Model for Blog Post with comments in Elastic Search

What's the best way to structure a post/comment system using elasticsearch? I'm using elasticsearch as a secondary database. There would be a post with a multithreaded commenting system, maybe two levels deep. Each post can have up to 500-1000…
UTKARSH RAI
  • 11
  • 3
1
vote
1 answer

Using stored_fields for retrieving a subset of the fields in Elastic Search

The documentation and recommendation for using stored_fields feature in ElasticSearch has been changing. In the latest version (7.9), stored_fields is not recommended -…
Arjun
  • 385
  • 5
  • 17
1
vote
0 answers

Elasticsearch index of 1TB of data and growing

I would like to know what is the best thing to do to move forward with a 1TB elasticsearch index (The recommendation from elasticsearch is 50 GB). Should we reindex this information into different indexes? How should we do the migration taking into…
Alex M
  • 471
  • 4
  • 22
1
vote
1 answer

Impact of settings size on performance

I want to add synonyms to my index and was wondering whether to go the synonym_path route vs the synonyms route. I could not if there is a performance difference between so wanted to make sure. My synonyms file is pretty big, so I was thinking of…
Belphegor21
  • 454
  • 1
  • 5
  • 24
1
vote
1 answer

Elastic Search - Joins best practises

I come across the following as part of docuementation In Elasticsearch the key to good performance is to de-normalize your data into documents And also, the restriction about, where both the child and parent documents must be on the same…
Nag
  • 1,818
  • 3
  • 24
  • 41
1
vote
1 answer

what value to be used for max_num_segments for Eslastic search 7.9 while doing forcemerge?

I am upgrading ES 1.4.2 to ES 7.9. For that I had to do remote indexing by re-indexing API to get all the data from old cluster to new cluster. But after re-indexning the search query performance of ES 7.9 got decreased a lot. So I am planning to do…
GauriA
  • 21
  • 2
1
2