Stack Overflow
Stack Overflow

Questions tagged [amazon-dynamodb-streams]

Use this tag for questions related to DynamoDB Streams, which provides a time ordered sequence of item level changes in any DynamoDB table. The changes are de-duplicated and stored for 24 hours. This capability enables you to extend the power of DynamoDB with cross-region replication, continuous analytics with Redshift integration, change notifications, and many other scenarios.

Useful links:

  1. Documentation
  2. Use cases
393 questions
3
votes
1 answer

I do not see any records in my dynamodb stream

I have problems implementing dynamodbstreams. We want to get records of changes right at the time the dynamodb table is changed. We've used the java example from…
David
  • 33
  • 3
3
votes
1 answer

Can DynamoDB reads on GSI with badly chosen partition key affect the read/write for the table

I have a DynamoDB table with a good partition key (PK=uuid) but there is a GSI (PK=type, SK=created) where type has only 6 unique values and created is epoch time. My question is if I start to do a lot of reads with this GSI, will that affect the…
Sumitk
  • 1,485
  • 6
  • 19
  • 31
3
votes
1 answer

Does a lambda function IAM role require an IAM permission to invoke itself?

Question Does the IAM role of a lambda function require an IAM permission to invoke itself? Background Reading Tutorial: Process New Items with DynamoDB Streams and Lambda. It looks the IAM role of the lambda function to process DynamoDB stream…
mon
  • 18,789
  • 22
  • 112
  • 205
3
votes
0 answers

Is it possible to set a static arn for DynamoDB stream arn?

Is is possible to override the timestamp part of the Dynamodb stream arn when the streaming is enabled to set to some static value? The pattern for the dynamodb stream arn is: arn:aws:dynamodb:region:accountID:table/TableName/stream/timestamp Can…
codingforfun
  • 31
  • 3
3
votes
2 answers

How to serialize and deserialize DynamoDB Stream Record object

We are planning to use DynamoDB Stream, part of stream processing we need com.amazonaws.services.dynamodbv2.model.Record object to be serialized and deserialized. I know we can do java ObjectOutputStream and ObjectInputStream, but this does not…
Gajendra Naidu
  • 395
  • 3
  • 16
3
votes
2 answers

DynamoDBStreams GetRecords with --limit returns empty records

I'm trying to run DynamoDBStreams GetRecords command with --limit option but nothing is returned... $ aws --version aws-cli/1.16.266 Python/3.5.2 Linux/5.3.0-28-generic botocore/1.13.2 $ aws dynamodbstreams --profile my-profile --region my-region…
Brah0um
  • 315
  • 2
  • 15
3
votes
2 answers

Is it possible to listen for changes in DynamoDB without polling?

I have a service (deployed on ECS) that needs to listen and react to inserts on DynamoDB table. Currently I am reading the table every second, but I would like to lower the latency. Is there a way I can subscribe to changes in DynamoDB and be…
johndodo
  • 17,247
  • 15
  • 96
  • 113
3
votes
1 answer

AWS Amplify get Stream ARN from a DynamoDB Table created with api category

I´m trying to get the ARN from a DynmoDB table created with @model from the api category. The ARN is an output from the autogenerated cloudformation template under /amplify/backend/api/{api-name}/build/stacks. I tried to import the ARN with the…
Florian Fuchs
  • 133
  • 10
3
votes
0 answers

AWS Lambda skipping records from dynamo DB streams after enabling trigger

I'm processing dynamo DB stream records using lambda, the configuration I used for Dynamo DB trigger is as follows: Batch size: 100 Batch window: 0 Starting position: Latest When I enable the trigger after some time a considerable amount of records…
Archit
  • 172
  • 10
3
votes
1 answer

Cannot access stream arn:aws:dynamodb:us-east-2:144091332251:table/users/stream/2019-06-05T08:00:51.428

I want to trigger lambda function as soon as new records are inserted into dynamodb or existing record is updated. For the same, I'm using aws dynamodb stream features. I trying to do so but it throws me below error. Cannot access stream…
Sagar
  • 4,473
  • 3
  • 32
  • 37
3
votes
1 answer

Is there a good way to close mongo connections when a lambda container expires?

I am using AWS-lambda handler to write a dynamoDB stream to mongoDB. I want to define the db connection outside of the handler so that the requests reuse the same connections, based on our expected throughput volume. The problem with the lambda…
yo conway
  • 207
  • 1
  • 5
3
votes
1 answer

Monitoring table changes in DynamoDB

I am using AWS DynamoDB in order to store information. I have two machines running separate codes, that accessing the information in the database. One of the machines is writing into the database and the second one is reading. Since the second one…
Dan
  • 195
  • 2
  • 14
3
votes
1 answer

DynamoDB Stream to Lambda slow/unsuable

I've connected a lambda to a DyDB table via a stream. When a record is written to the table, it triggers the lambda. The traffic is very bursty, so nothing might happen for a while, then I'll write several thousand records. What I'm seeing is a few…
DJ Spiess
  • 983
  • 2
  • 9
  • 26
3
votes
1 answer

How to control idempotency of messages in an event-driven architecture?

I'm working on a project where DynamoDB is being used as database and every use case of the application is triggered by a message published after an item has been created/updated in DB. Currently the code follows this…
Juan Vega
  • 1,030
  • 1
  • 16
  • 32
3
votes
2 answers

Defining multiple ARNs which can trigger a Lambda function

Here's the sample CloudFormation syntax I am seeing in the AWS documentations for AWS::Lambda::EventSourceMapping: Type: "AWS::Lambda::EventSourceMapping" Properties: BatchSize: Integer Enabled: Boolean EventSourceArn: String FunctionName:…
Yar
  • 7,020
  • 11
  • 49
  • 69
1 2 3
…
26 27