Questions tagged [amazon-dynamodb-streams]

Use this tag for questions related to DynamoDB Streams, which provides a time ordered sequence of item level changes in any DynamoDB table. The changes are de-duplicated and stored for 24 hours. This capability enables you to extend the power of DynamoDB with cross-region replication, continuous analytics with Redshift integration, change notifications, and many other scenarios.

Useful links:

  1. Documentation
  2. Use cases
393 questions
0
votes
1 answer

Update React front end when DynamoDb item attribute is updated

I am building a react app with a node.js serverless backend through AWS that needs to sync real time results from my Dynamo DB table. My app lists the items and if the items attribute "status" === "new" it will show the list item. If the "status"…
0
votes
1 answer

How to maintain order and avoid duplicate records when copying from DynamoDB streams to KinesisData Streams?

I currently have a use case to copy data from DDB Streams to Kinesis Data Streams (just to increase data retention period). With DDB Streams, its just 24 hour retention versus with Kinesis Data Streams is upto 7 days. So, I was thinking a of a…
0
votes
0 answers

using dynamodb streams with spring-cloud-stream-binder-aws-kinesis

When using spring-cloud-stream-binder-aws-kinesis V2.0.0.RELEASE with dynamodb streams, I am getting the following error test-dynamo-stream is the name of my dynamodb table and I have enabled stream for…
0
votes
1 answer

Create tables in Spanner using DynamoDB tables

Related to the post: Migration from DynamoDB to Spanner/BigTable I have another challenge here. How to create the schema for all 'N' tables in Spanner? Is there any utility available for this? There are TBs worth of data in DynamoDB. Not sure how to…
0
votes
1 answer

can't update the item of the dynamoDB table that has only partition key

The goal is to update one of the attributes in the DynamoDB table. Here is the schema: { 'job_id': {S: jobInfo.job_id} (partition_key), 'company': {S: jobInfo.company}, 'title': {S: jobInfo.title}, 'posted_on': {S: jobInfo.posted_on}, …
0
votes
1 answer

Lambda function synchronously invoked using dynamoDB stream trigger understanding

I am using Lambda function to read data from dyanmoDB streams. Lambda read items from stream and invokes lambda function once for each batch. Lambda invokes lambda function synchronously using event source mapping. From what i understand from aws…
0
votes
1 answer

How to transfer input to lambda which is triggered by change in DynamoDB

I have two lambdas. One makes a change in DynamoDb and the second one is triggered when any change in DynamoDb table is made. It works perfectly. My question is how to give input to the second lambda. I execute first lambda from AWS Console so I…
0
votes
1 answer

DynamoDB partition splitting for high throughput table

I am trying to understand DynamoDB partitioning behaviour in a specific circumstance. I'd like to know what will happen to my partitions if my read/write throughput exceeds 3000 RCU or 1000 WCU for a single partition (assuming I have very popular…
thebighoncho
  • 385
  • 2
  • 6
  • 20
0
votes
2 answers

Lambda Called Automatically With Same Event If Timeout Occurs

I'm using AWS lambda (Java Runtime) to process some files when there urls are inserted in DynamoDB via another API. When the lamda dies due to timeout. The lambda is triggered back with the same event and the same process starts again. The process…
0
votes
3 answers

How to wire a DynamoDB stream to a kinesis stream?

I was assuming I create a table and enable stream and I now have an ARN create a kinesis stream configure somewhere to tell the dynamoDb stream to write to kinesis stream I was looking at working with https://github.com/harlow/kinesis-consumer but…
Dean Hiller
  • 19,235
  • 25
  • 129
  • 212
0
votes
1 answer

DynamoDB Streams billing twice when using single table architecture

I'm currently working on a project where I use DynamoDB as my nosql database. Before I started I tried to learn how to model nosql databases since its really different to our known relational databases. I learned that I have to stick on the single…
0
votes
2 answers

AWS Amplify filter for @searchable annotation

Currently I am using a DynamoDB instance for my social media application. While designing the schema I sticked to the "one table" rule. So I am putting every data in the same table like posts, users, comments etc. Now I want to make flexible queries…
0
votes
1 answer

Is it possible to use enhanced fan-out with DynamoDB Streams?

When using Kinesis Data Streams, it's possible to use the enhanced fan-out feature? DynamoDB Streams API says: The DynamoDB Streams API is intentionally similar to that of Kinesis Streams, a service for real-time processing of streaming data at…
0
votes
1 answer

Empty event object with DynamoDB Stream / Lambda

I've set a DynamoDB stream to trigger a simple Lambda function, which works to trigger the function but returns an empty event object. I'm expecting the usual response with Keys, Oldimage, Newimage etc... The event is passed correctly when I test…
0
votes
1 answer

Swift How to Listen for Changes in AWS DynamoDB

I'm using the AWS Mobile Hub to provide a backend service. So far I understand how to upload data into the DynamoDB and how to retrieve the data. I'm wondering if there's a way to listen for a change in the database without using push notifications.…