Questions tagged [amazon-opensearch]

242 questions
2
votes
1 answer

janusgraph encounters `PermanentBackendException` while interacting with AWS opensearch version 7 and above

We are trying to run Janusgraph version 0.6.2 using AWS opensearch(elasticsearch) version 7.10 as the indexing backend. Things work fine with version 6.x but when we try to connect to version 7.x we encounter the following…
2
votes
1 answer

OpenSearch: how to define parent/child relationship between documents?

Due to AWS migration I have to migrate from ElasticSearch to OpenSearch. The OpenSearch will be provisioned by AWS OpenSearch Service. The existing documents in ES index has parent/child relationship created using join field type. I don't see such…
Hutsul
  • 1,535
  • 4
  • 31
  • 51
2
votes
1 answer

AWS OpenSearch python client raises a 403 on client.indices.exists() - what permissions are required?

I am trying to test whether a particular OpenSearch Index exists via opensearch-py. I am receiving a 403 error and can't for the life of me establish the correct permissions: 2022-07-04 14:11:11,535 - WARNING | L258 log_request_fail (): HEAD…
jtlz2
  • 7,700
  • 9
  • 64
  • 114
2
votes
1 answer

How to insert own data by using OpenSearch dashboard in opensearch

I am very new to opensearch. In kibana we have option called Upload a file by which we can upload our own data set, I just switched to opensearch and trying to add data using opensearch dashboard to querying it in opensearch. Please let me know how…
2
votes
1 answer

which nodejs library is for AWS opensearch client?

I am planning to use opensearch hosted by AWS. I found there are two libraries @aws-sdk/client-opensearch and @opensearch-project/opensearch. I wonder which one I should use. Are there meant to be very different?
Joey Yi Zhao
  • 37,514
  • 71
  • 268
  • 523
2
votes
1 answer

Use SQL Access in AWS Opensearch python client

I'd love to use SQL in AWS OpenSearch. Is there a way how to achieve this using opensearchpy driver? Similar to this SO question. My attempts: es = OpenSearch( hosts=[{'host': config.es_host, 'port': 443}], http_auth=aws_auth, …
Ikar Pohorský
  • 4,617
  • 6
  • 39
  • 56
1
vote
1 answer

Clear scroll in OpenSearch/ElasticSearch with read only permission

I want to fetch documents form an opensearch index with read_only permissions using the Scroll API. I tried these permissions for my role indices:data/read/scroll/clear indices:data/read/scroll read and read But when I run (using the python…
1
vote
1 answer

Sort ElasticSearch children by field in the parent

I have two entities in my application: tasks and users. Each task is assigned to a user. I may have tens of thousands of tasks per application instance but only tens or hundreds of users per application instance. I’d like to sort my tasks by the…
Calebmer
  • 2,972
  • 6
  • 29
  • 36
1
vote
1 answer

ConnectionError ECONNREFUSED connecting to OpenSearch on localhost from asp.net core app

I have an OpenSearch domain on Amazon OpenSearch Service. I use it for my asp.net core app. I now want to start using localhost by running the default docker-compose file from the quickstart docs, instead of using the Amazon OpenSearch Service…
BeniaminoBaggins
  • 11,202
  • 41
  • 152
  • 287
1
vote
0 answers

AWS Kinesis Firehose, Transformation Lambda and OpenSearch log processing

I'm having some issues publishing the logs from CloudWatch -> Kinesis Stream -> Kinesis Delivery Stream -> Transformation Lambda -> AWS OpenSearch. While the documentation is straightforward i struggle with the transformation lambda and insertion to…
1
vote
1 answer

How to execute raw SQL query in OpenSearch .Net Client

I know that we can write DSL queries to search OpenSearch. But for some reason, I need to execute some raw SQL queries to get the result using the dotNet client. I can execute the raw query on DevTool in the OpenSearch Dashboard but I need to…
1
vote
1 answer

Adding IP address using cloudformation or Lambda

I have this configuration for opensearch service and it is working as expected. { "Version": "2008-10-17", "Statement": [ { "Effect": "Allow", "Principal": { "AWS": "*" }, "Action": "es:*", "Resource":…
shantanuo
  • 31,689
  • 78
  • 245
  • 403
1
vote
2 answers

How can I ingest data from an AWS S3 bucket to AWS OpenSearch Serverless using AWS Lambda?

I've been trying to ingest data from an AWS S3 bucket to AWS OpenSearch Serverless using AWS Lambda but I can't find any documentation on how to do it, any ideas? I've seen plenty of AWS OpenSearch Service examples but would they work the same way…
A A
  • 11
  • 1
1
vote
0 answers

Amazon OpenSearch Service: Expected total copies Error

I create a domain and when create Index or Vector in it. It error like that [illegal_argument_exception] Validation Failed: 1: expected total copies needs to be a multiple of total awareness attributes [3]; How can I fix it? import { Client }…
Seok Loi
  • 15
  • 3
1
vote
1 answer

Is it possible to change/ set filter value on kibana via query

I got multiple visualizations that filtered on same field and value, value=x. { "query": { "bool": { "should": [ { "match_phrase": { "value.keyword": "x" } } ], …
Ziv M
  • 409
  • 6
  • 18
1
2
3
16 17