Questions tagged [amazon-dynamodb-streams]

Use this tag for questions related to DynamoDB Streams, which provides a time ordered sequence of item level changes in any DynamoDB table. The changes are de-duplicated and stored for 24 hours. This capability enables you to extend the power of DynamoDB with cross-region replication, continuous analytics with Redshift integration, change notifications, and many other scenarios.

Useful links:

  1. Documentation
  2. Use cases
393 questions
0
votes
0 answers

Calling external API from Lambda function on listensing dynamoDB stream event not working

I have tried in many ways. The code works when I test from the AWS console but when I try with Postman it does not run. exports.main = async function handler(event) { event.Records.filter( async (record) => { if…
Ben Jonson
  • 565
  • 7
  • 22
0
votes
2 answers

How to trigger a specific AWS Lambda version from AWS Dynamodb Streams

I have a dynamodb table that triggers a lambda function by enabling the Dynamodb streams. This was setup from the Dynamodb console. I would however like to be able to point the trigger to a specific version/alias of the lambda function. Most other…
0
votes
1 answer

Efficient way to get and store count of items in dynamo db

I have a dynamo db table with following structure partitionKey - userId+keyName sortKey - keyName+itemId itemData - any object createdAt - long value updatedAt - long value In this table I want to save list of items lets say all unique eatable…
0
votes
1 answer

How to track which user or arn has done DynamoDB data-plane operations on a specific table?

I have an AWS dynamodb table. I'm able to use DynamoDB streams to track changes to the records but I'm not able to see any information about the user that has updated the records in my table (not the table)? Need to know the details like logged-in…
0
votes
1 answer

Change Retires for invoking dynamoDB triggered lambda

My lambda function is triggered from dynamoDB table and such invocations are done synchronously. from docs Lambda reads records from the stream and invokes your function synchronously with an event that contains stream records. Lambda reads records…
0
votes
2 answers

What is the best way to backup data from DynamoDB to S3 buckets?

I am working on a solution to send DynamoDB data to an S3 bucket for multiple teams to consume. I need 2 separate solutions: Initial data dumb of the table (~ 3 TB) Continuous updates of the add/modify/delete operations (but not the schema) also…
0
votes
3 answers

AWS - Identify data read by Lambda from DynamoDB Streams

I have a DynamoDB table that has TTL and DynamoDB Streams enabled/configured. I want to implement a lambda function that will read the TTL deleted data from DynamoDB Streams and forward it to maybe Kinesis Firehose or S3 (this I need to decide which…
0
votes
1 answer

Automating dynamodb scripts

Like we used to do with rdbms sql scripts. I wanted to do a similar thing with my dynamodb table. Currently its very difficult to track changes from environment to environment(dev - qa -prod). We are directly making changes via the console. What I…
0
votes
1 answer

AWS Lambda destination not triggering with DynamoDB Streams

I'm using AWS Dynamo Streams to trigger an AWS Lambda function. If the lambda function successfully invoked, I want a child lambda function to be invoked via the async invocation destination feature provided by Lambda. Even though I've configured…
0
votes
1 answer

Stream on DynamoDB table

I have a DynamoDB table. When I check the Overview tab for the table on AWS Web Console, I see two options to enable streams. Manage Streams to Kinesis Manage DynamoDB Stream. How these two streams are different from one another?
Akhil
  • 75
  • 2
  • 8
0
votes
1 answer

how can I prevent dynamoDB Stream handler from infinitely processing a record when I use batchItemFailures

I have a dynamoDB stream which is triggering a lambda handler that looks like this: let failedRequestId: string await asyncForEachSerial(event.Records, async (record) => { try { await handle(record.dynamodb.OldImage,…
0
votes
1 answer

DynamoDB doesn't show updated item data in stream

I have a DynamoDB table with a stream of type: NEW_IMAGE, but i only get new added items to the db in the stream. I don't get the data of when an existing item was modified. Is there a way to do this in streams? To send the data of the updated…
user13468285
0
votes
1 answer

Reading data from a dynamodb table in real time

I am currently building a serverless solution and run into a corner, basically i have a table and i want to be able to read data from that table in real-time as new entities are saved in the table from my client(front end react application). I have…
0
votes
1 answer

Millisecond precise timestamp field in DynamoDB stream

I have a DynamoDB table where I enabled DynamoDB stream. I also have a trigger which invokes Lambda function when item is changed. Is there any millisecond-precise timestamp field in DynamoDB stream I can rely on? I'd like to rely on it in…
Patrik Mihalčin
  • 3,341
  • 7
  • 33
  • 68
0
votes
0 answers

DynamoDB New Image has default Message and Id values

I noticed the NEW IMAGE in dynamodb stream always has these two fields: "Message":"New item!" "Id":"101" These values are always there UNLESS my record itself has a Id and a Message field, in which case the default values are overridden. But since…
Ahmed
  • 121
  • 6
  • 18