Stack Overflow
Stack Overflow

Questions tagged [amazon-dynamodb-streams]

Use this tag for questions related to DynamoDB Streams, which provides a time ordered sequence of item level changes in any DynamoDB table. The changes are de-duplicated and stored for 24 hours. This capability enables you to extend the power of DynamoDB with cross-region replication, continuous analytics with Redshift integration, change notifications, and many other scenarios.

Useful links:

  1. Documentation
  2. Use cases
393 questions
5
votes
1 answer

Metadata in DynamoDB stream event for delete operation?

I intend to use DynamoDB streams to implement a log trail that tracks changes to a number of tables (and writes this to log files on S3). Whenever a modification is made to a table, a lambda function will be invoked from the stream event. Now, I…
JHH
  • 8,567
  • 8
  • 47
  • 91
5
votes
2 answers

Is it possible to add regions later in DynamoDB GlobalTable

AWS recently came up with GlobalTable to enable multi-master, fault tolerance setup across different regions. One of the constraints seems to be that the "Table must be empty" to setup GlobalTable. Question is - Can I start off with 2 regions in US…
Sahas
  • 3,046
  • 6
  • 32
  • 53
5
votes
1 answer

AWS DynamoDB Stream into Redshift

We would like to move data from DynamoDB NoSQL into Redshift Database continously as a stream. I am having hard time understand all the new terms/technologies in AWS. There is 1) DynamoDB Streams 2) AWS Lambda 3) AWS Kinesis Firehose Can someone…
user8280126
5
votes
1 answer

How to configure StreamArn of existing dynamodb table

I'm creating serverless framework project. DynamoDB table is created by other CloudFormation Stack. How I can refer existing dynamodb table's StreamArn in serverless.yml I have configuration as below resources: Resources: MyDbTable:…
Jagdish Idhate
  • 7,513
  • 9
  • 35
  • 51
5
votes
2 answers

DynamoDB TTL: when are items removed

According to the docs: DynamoDB typically deletes expired items within 48 hours of expiration. The exact duration within which an item truly gets deleted after expiration is specific to the nature of the workload and the size of the table Is there…
davids
  • 6,259
  • 3
  • 29
  • 50
5
votes
1 answer

DynamoDB Streams with Lambda, how to process the records in order (by logical groups)?

I want to use DynamoDB Streams + AWS Lambda to process chat messages. Messages regarding the same conversation user_idX:user_idY (a room) must be processed in order. Global ordering is not important. Assuming that I feed DynamoDB in the correct…
AlfredBaudisch
  • 760
  • 1
  • 11
  • 20
5
votes
1 answer

How can I measure the propagation latency of DynamoDB Streams?

I'm using DynamoDB Streams + Kinesis Client Library (KCL). How can I measure latency between when an event was created in a stream and when it was processed on KCL side? As I know, KCL's MillisBehindLatest metric is specific to Kinesis Streams(not…
Ivan Arkhipov
  • 51
  • 3
5
votes
1 answer

amazon dynamodb fiter expression return error

iam created a table in amazon dynamoDB using web console. this is my table structure after adding some data. timestamp | userid | text 101 | manaf | haaaai 102 | manaf | hello I need to get the data between two res limits. this is my code in…
Abdul Manaf
  • 4,933
  • 8
  • 51
  • 95
5
votes
1 answer

AWS Lambda worrisome behaviour after an accidental infinite loop

I accidently deployed some Java code into AWS Lambda which contains the following obviously buggy getter: public String getLocation() { return this.getLocation(); } The Lambda function is configured with a limit of 15 seconds and 320 Mo. It is…
Hatim Khouzaimi
  • 515
  • 4
  • 11
4
votes
1 answer

Sequence numbers in dyamodb streams

I have a stream enabled dynamodb table. A lambda function consumes this stream. Each record in the dynamodb stream has a SequenceNumber assigned to it. What is its significance? Lets say that record1 entered the stream before record2. Does it mean…
mightyMouse
  • 658
  • 15
  • 23
4
votes
4 answers

How to configure dynamodb-to-lambda trigger using amplify framework/cli

The amplify docks here says that we can configure a lambda function as a dynamodb trigger by running **amplify add function** and selecting the "Lambda Trigger" option, but when I run the "amplify add api" (selected Python as runtime language) I am…
Jagadeesh
  • 119
  • 2
  • 7
4
votes
1 answer

How to trigger the lambda function only for INSERT event in dynamodb stream?

How to trigger the lambda function only for INSERT event in dynamodb stream? To reduce the cost of the lambda function, is it possible to trigger the lambda function based on the type of operation INSERT - insert_lambda_function MODIFY -…
Thirumal
  • 8,280
  • 11
  • 53
  • 103
4
votes
2 answers

DynamoDB how to get items count for a partition keys using .net core?

How can I get items count for a particular partition key using .net core preferably using Object Persistence Interface or Document Interfaces? Since I do not see any docs any where, currently I get the number of items count by retrieve all the item…
HExit
  • 696
  • 7
  • 17
4
votes
1 answer

Streams with initial state

I would like to expose something like a subscription or a "sticky query": the goal is to query DynamoDB and return the results via the WebSockets API in API Gateway. Well, whenever DynamoDB changes in a way the query would be affected (I guess I…
Dunken
  • 8,481
  • 7
  • 54
  • 87
4
votes
1 answer

How to set up a lambda alias with the same event source mapping as the LATEST/Unqualified lambda function in terraform

I'm trying to create a lambda alias for my lambda function using terraform. I've been able to successfully create the alias but the created alias is missing the dynamodb as the trigger. how the event source is set up resource…
Hoist
  • 41
  • 3
1 2
3
…
26 27