Questions tagged [amazon-opensearch]

242 questions
1
vote
0 answers

OpenSearch Anomaly Detector - Cannot preview historical data

I have roughly 1400 logs in my OpenSearch index. Roughly 835 are historical, and now I am continuously ingesting using Kinesis Firehose. Rows in my index When I am creating a detector I am not able to preview this data, I get the following…
1
vote
1 answer

Evaluating access policies can impact resource usage in case of multiple requests? (AWS Opensearch)

I couldn't find any confirmation or explanation of where AWS (specifically in the OpenSearch/Elasticsearch service) evaluates IAM access policies. Is policy evaluation, in the case of non-serverless services, done with the allocated system…
1
vote
1 answer

Create delivery stream (Firehose) from data stream (Kinesis) to OpenSearch AWS

I am trying to create a Delivery Stream (Firehose) in AWS Console, with these options: Source: Amazon Kinesis Data Streams Destination: Amazon OpenSearch Service The Amazon OpenSearch Service's Domain is an OpenSearch 2.3 version, with these…
1
vote
0 answers

Liquibase for opensearch/ elasticsearch

I have been using Liquibase for maintaining postgreSQL changes.Is there a way I can use it in the same manner with Opensearch/ Elasticsearch? Is there any existing plugin, or any future plan to support another noSQL database such as opensearch? I…
1
vote
0 answers

Move from Elasticsearch (beyond version 7.10.2) to AWS OpenSearch

The migration from Elasticsearch up to version 7.10.2 seems easy, basically we have to upload the snapshot to S3 and restore snapshot on Opensearch, following the steps described in this article The problem is that I am using Elasticsearch version…
1
vote
0 answers

Caused by: org.elasticsearch.hadoop.rest.EsHadoopInvalidRequest:[GET]on[]failed;server[https://*****es.amazonaws.com:443] returned [401|Unauthorized:]

I am trying to integrate Spark-EMR with Amazon OpenSearch by trying to read a OpenSearch document into a Spark Dataframe and using the below mentioned simple code snippet. from pyspark.sql import * spark = (SparkSession.builder …
1
vote
1 answer

AWS OpenSearch Index and Domain Limits

I'm doing research on the capabilities of OpenSearch and I was having trouble finding certain information. Here is the information I had trouble finding or figuring out. Any help or answers to any of these would be greatly appreciated. What is the…
1
vote
1 answer

While doing Cross Cluster Replication between OpenSearch domains Getting Error transport_exception [][[x.x.x.x]:9300] general node connection failure

"error" "root_cause" "type" : "transport_exception", "reason" : "handshake failed because connection reset" "type" : "connect_transport_exception", "reason" : "[][[x.x.x.x]:9300] general node connection failure", "caused_by" : { "type" :…
swetha
  • 11
  • 2
1
vote
0 answers

How the dead nodes are handled in AWS OpenSearch?

Trying to understand what is the right approach to connect to AWS OpenSearch (single cluster, multiple data nodes). To my understanding, as long as data nodes are behind the load balancer (according to this and other AWS docs:…
Giedrius
  • 8,430
  • 6
  • 50
  • 91
1
vote
1 answer

AWS Opensearch two service domains for multiregion read / write application

I want to use AWS OpenSearch for multi-region read / write application to achieve low latency/performance. In Opensearch I have found that we can create two service domains. So please let me know, Whether AWS OpenSearch supports multi-region writes…
Sunrise
  • 29
  • 2
1
vote
2 answers

Export opentelemetry metrics to open search

I am trying to export opentelemetry metrics to open search. My configurations are as mentioned below metrics-pipeline: source: otel_metrics_source:: processor: - otel_metrics_raw_processor: sink: - opensearch: hosts:…
1
vote
1 answer

Index documents to opensearch date format problems

I am reading some data from a pandas Dataframe and trying to index them to aws opensearch ,but I am getting this error elasticsearch.helpers.errors.BulkIndexError: ('3 document(s) failed to index.', [{'index': {'_index': 'document', '_type': '_doc',…
1
vote
0 answers

.opendistro-alerting-* - ALLOCATION_FAILED - UNASSIGNED

I am running OpenSearch 1.2 R20220323-P4 on AWS and my cluster is in a yellow status. After some investigating, I found the following indices in an UNASSIGNED state with a reason of ALLOCATION_FAILED. index …
RudiK
  • 11
  • 1
1
vote
1 answer

AWS Opensearch (Elasticsearch 7.10) - Refuses to assume Cognito group role

So, I have two Elasticsearch 7.10 clusters. I have a Cognito user pool, with an admin group. This admin group a role attached to it from IAM, call it the AdminRole. It's precedence is 1. Now, I have configured both of the aforementioned…
1
vote
0 answers

Services empty in Opensearch Trace Analytics

I'm using Amazon OpenSearch with the engine OpenSearch 1.2. I was working on setting up APM with the following details Service 1 - Tomcat Application running on an EC2 server that accesses an RDS database. The server is behind a load balancer with…
RVKarmani
  • 43
  • 7