Stack Overflow
Stack Overflow

Questions tagged [amazon-dynamodb-streams]

Use this tag for questions related to DynamoDB Streams, which provides a time ordered sequence of item level changes in any DynamoDB table. The changes are de-duplicated and stored for 24 hours. This capability enables you to extend the power of DynamoDB with cross-region replication, continuous analytics with Redshift integration, change notifications, and many other scenarios.

Useful links:

  1. Documentation
  2. Use cases
393 questions
4
votes
1 answer

How to subscribe to changes in DynamoDB

I don't know how to subscribe to changes in DynamoDB database. Let me show an example: User A sends a message (which is saved in the database) to User B and in the User B's app the message automatically appears. I know this is possible with recently…
jared3412341
  • 197
  • 3
  • 12
4
votes
2 answers

Is DynamoDB streams the right option for this use case?

I have a DynamoDB table that contains key value pairs that will be read by a number of applications. On startup each application will read the entire table and cache it in-memory. The problem I'm trying to solve is that of getting the applications…
Henrik
  • 43
  • 1
  • 4
4
votes
1 answer

AWS DynamoDB Stream python convert native format

I've a Lambda function triggered by a DynamoDB Stream. My problem is the strange format of the event received(with type for each key/value). Does exists a workaround to convert a whole document in a native python format(without any types). I'm…
Matt
  • 4,309
  • 7
  • 38
  • 52
4
votes
1 answer

How to read and decrypt dynamodb stream update event?

I store our data in a dynamodb table and on every update, a listener lambda (in Java) receives an update from the dynamodb stream. I was parsing the dynamodb update event using JacksonConverter However, I would like to encode the dynamodb content in…
user3153360
  • 51
  • 3
4
votes
2 answers

Reprocessing all records - DynamoDB Stream

I am using DynamoDB stream with a Aws lambda function + firehose to sync my data with redshift. I would like to know if it's possible to add all DynamoDB records to stream to reprocessing purposes. If not, what's the right approach?
p.magalhaes
  • 7,595
  • 10
  • 53
  • 108
4
votes
2 answers

Why am I getting NoClassDefFoundError on JSONObject in amazon-kinesis-client?

I've incorporated the code from DynamoDB streams adapter demo from aws-dynamodb-examples, into my Maven project, and I'm getting a run-time error: Exception in thread "Thread-2" java.lang.NoClassDefFoundError: com/amazonaws/util/json/JSONObject at…
Adi Levin
  • 5,165
  • 1
  • 17
  • 26
4
votes
2 answers

AWS Lambda - Is there a way to pass parameters to a lambda function when an event occurs

I have a DynamoDB table and whenever a new record is added, I want to archive the old data to S3. So I thought I could use AWS Lambda. So the lambda function will get the new record that is newly added/modified. But I want to pass(to the lambda…
Thiyagu
  • 17,362
  • 5
  • 42
  • 79
3
votes
1 answer

DLQ redrive failed events back to DynamoDB streams?

I have a DynamoDB stream triggering a Lambda, and I want to push any failed events to a DLQ. If the source of a DLQ is an SQS queue, it looks like you can do something called a redrive back to the source queue, where messages in DLQ will be moved…
user1542422
  • 309
  • 1
  • 4
  • 13
3
votes
0 answers

Parse Dynamo Db Stream record to Object in Java

The items from the stream have the data type present in the stream. I am trying to find a library similar to dynamodb-data-types, which can unwrap the dynamoDB structure to json structure for java. My lambda is in java. Eg: I am trying to convert { …
Rahul
  • 493
  • 3
  • 7
  • 25
3
votes
1 answer

DynamoDB streams filter with nested fields not working

I have a Lambda hooked up to my DynamoDB stream. It is configured to trigger if both criteria are met: eventName = "MODIFY" status > 10 My filter looks as follows: {"eventName": ["MODIFY"], "dynamodb": {"NewImage": {"status": [{"numeric": [">",…
Nicolas
  • 69
  • 9
3
votes
1 answer

Filter Criteria in Lambda Function

I want to enable DynamoDB streams on my lambda using AWS CDK which I am able to do but I also want to enable the filter criteria on lambda But I am getting this error: Invalid filter pattern definition. (Service: AWSLambda; Status Code: 400; Error…
Shobhit Arora
  • 33
  • 1
  • 3
3
votes
2 answers

Using dynamodb streams with a single table design - handle only specific item types

Ive been building a serverless app using Dynamodb as the database, and have been following the single table design pattern (e.g. https://www.alexdebrie.com/posts/dynamodb-single-table/). Something that I'm starting to come up against is the use of…
andy mccullough
  • 9,070
  • 6
  • 32
  • 55
3
votes
1 answer

Does Testcontainers/LocalStack work with DynamoDb Streams KCL 1.x?

Problem Statement I have written a program which utilizes DynamoDb Streams to get notified when an update occurs, this code works fine when using AWS Services but doesn't seem to work utilizing Testcontainers/Localstack for my integration…
Jim M.
  • 909
  • 1
  • 12
  • 29
3
votes
1 answer

AWS DynamoDB streams: Can I keep records for longer than 24 hours?

I have a dynamoDB stream and lambda trigger for a table. The lambda trigger basically sync dynamoDB table to DocumentDB. What if, DocumentDB is down for more than 24 hours. How can I put back the all the activity(put, delete, update) happened in…
Avadh Gupta
  • 49
  • 1
  • 1
  • 4
3
votes
3 answers

Invoking Lambda when record inserted to dynamoDB

Need to invoke lambda when record inserted to dynamoDB table, But here i need to invoke lambda after 60 seconds of record insertion, is there any way that invoke lambda after n seconds?
Narendar Reddy M
  • 1,499
  • 1
  • 11
  • 18
1 2 3
…
26 27