Questions tagged [amazon-opensearch]

242 questions
0
votes
1 answer

Logstash warning Opensearch unreachable

I have deployed Logstash 8.6.1 with the logstash-output-opensearch plugin. This is the config related to pushing the logs to OpenSearch: output { if [type]=="logback" { opensearch { hosts => […
Eugene
  • 1,013
  • 1
  • 22
  • 43
0
votes
0 answers

OpenSearch bulk query vs AWS Kinesis Firehose OpenSearch destination

Premise: I already noticed this similar question, but it doesn't exactly cover what I would like to understand. Problem As part of a project to build a scalable and reliable search solution, I am exploring different ways to bulk load data into…
0
votes
0 answers

Elastic search 7.10 forcemerge doesn't merge the segments which are larger than 5GB

Hi I have a Elastic search cluster which is having 11 shards. Each of the shard has around 70 segments each, and many of the segments are larger than 5 GB (max_merged_segment). They also have lot of deleted documents in them which is causing a lot…
Invictus
  • 2,653
  • 8
  • 31
  • 50
0
votes
0 answers

OpenSearch Nodes Info API doesn't show http metrics on AWS

I'm running an OpenSearch Domain on AWS and when I'm sending a request to the Nodes Info API endpoint, I don't get the http metric in the response body. The endpoint is described here Request: GET /_nodes/http Response: { "_nodes" : { "total"…
Peter Lustig
  • 1,585
  • 1
  • 18
  • 34
0
votes
0 answers

Incorrect query rewriting when a clause contains invalid symbols

I have an OpenSearch query that contains two clauses. The first one should match a field to a mix of symbols, while the second is fully valid. It appears that the first clause is completely ignored and the results are the values that match only the…
Andrei
  • 4,880
  • 23
  • 30
0
votes
1 answer

Elastic Search Aggregate not tied to Top level Query

I have an ElasticSearch/OpenSearch query that returns data and 2 aggregates that give a count and max value, however I need ANOTHER aggregate that is not tied to the top level query. Is that possible w/o a 2nd query that just filters by the…
M Akin
  • 446
  • 6
  • 18
0
votes
0 answers

Opensearch client, search without using a model

i'm using Opensearch Client .NET implementation. The only way to use the search method is to map the response to a model like in this way await client.SearchAsync(e => e .Index("index") …
0
votes
0 answers

What is better for Reports, DataAnalytics and BI: AWS Redshift or AWS ElasticSearch?

We have 4 applications: A, B, C, and D. Applications are scaping different social-network data from different sources. Each application has its own database. Application A scrapes eg. Instagram accounts, Instagram posts, Instagram stories - from…
0
votes
1 answer

Cannot find # in OpenSearch query

I have an index that includes a field and when a '#' is input, I cannot get the query to find the #. Field Data: "#3213939" Query: GET /invoices/_search { "query": { "bool": { "should": [ { "match": { …
M Akin
  • 446
  • 6
  • 18
0
votes
1 answer

Get specific template from elasticsearch via python

I'm trying to get a template from AWS OpenSearch via python. Now I know that from the Kibana it's: GET _template/ and from python, I have the function "search_template()" but it's forcing me to use the "body" parameter which I…
0
votes
1 answer

OpenSearch index change not reflected in search

When we delete an item form the cache and then immediate do a search the search does not reflect the recent deletion.   The search happens immediately after the index deletion or update. How can I fix this? I don't see an aws configuration setting…
M Akin
  • 446
  • 6
  • 18
0
votes
0 answers

Copy between Elastices | REQUEST_ENTITY_TOO_LARGE

I'm trying to copy indexes between AWS Opensearch(Elastic engine v6.8) to AWS Opensearch (Opensearch engine v2.3). I'm using elasticdump to copy the indexes. I got the foloowing error while in one of the indexes: Error Emitted => {"Message":"Request…
0
votes
1 answer

AWS bulk indexing using gives 'illegal_argument_exception', 'explicit index in bulk is not allowed')

While I am trying to bulk index on AWS Opensearch Service (ElasticSearch V 10.1) using opensearch-py, I am getting below error RequestError: RequestError(400, 'illegal_argument_exception', 'explicit index in bulk is not allowed') from…
Shijith
  • 4,602
  • 2
  • 20
  • 34
0
votes
1 answer

OpenSearch Indexes and Data streams

I have recently started to use OpenSearch and having a few newbie questions. What is the difference between Index, Index Pattern and Index template? (Some examples would be really helpful to visualize and differentiate these terminologies). I have…
0
votes
1 answer

How can I correctly mock opensearch indices.exist with jest

I am using OpenSearch client and I would like to test the indices.exists, however when I run jest test, I get the error openSearchClient.indices.exists is not a function. How can I access the exists property using jest? I understand the below code…