Stack Overflow
Stack Overflow

Questions tagged [amazon-dynamodb-streams]

Use this tag for questions related to DynamoDB Streams, which provides a time ordered sequence of item level changes in any DynamoDB table. The changes are de-duplicated and stored for 24 hours. This capability enables you to extend the power of DynamoDB with cross-region replication, continuous analytics with Redshift integration, change notifications, and many other scenarios.

Useful links:

  1. Documentation
  2. Use cases
393 questions
0
votes
0 answers

how to create child parent relationship

So I'm totally stuck. I have an array of dictionaries that I need to sort by the 'StartingSequenceNumber'. Before I can do that though I need to modify the list so that child of parent is nested underneath their parent. here is the…
benjamin
  • 3
  • 2
0
votes
1 answer

Saving data to S3 bucket before the TTL attributes deletes the data from DynamoDB table

I am using DynamoDB TTL attributes to delete data after certain time. I am able to save the deleted data by triggering the Lambda function of DynamoDB Streams (processed data). Is it possible to trigger the Lambda function before the TTL attributes…
Kshitiz Jaiswal
  • 123
  • 11
0
votes
1 answer

DynamoDB Stream Remains After Table Dropped/Deleted

If I drop a DynamoDB table with a stream, the table goes away, but I can still see the stream for several days: Why is that? How can I delete those unused streams?
Adam
  • 3,891
  • 3
  • 19
  • 42
0
votes
1 answer

List streams of a particular DynamoDB table using CLI

How can I list all the streams associated with one dynamo db table using CLI (terminal aws command)? Even listing all the streams didn't work for me: aws dynamodb list-streams
Sergey Avdeev
  • 910
  • 1
  • 8
  • 16
0
votes
0 answers

How dynamo DB handles atomic transaction, if further writes are made through dynamo db streams?

The question is how does dynamo DB handles acid transactions if some transactions are assosiated with dynamo DB streams which cause further write to dynamo db tables. Is it gonna revert those writes occured using dynamo DB streams, or leave them…
varnit
  • 1,859
  • 10
  • 21
0
votes
0 answers

Retrieving field values from dynamodb streams using python labmda function

In the below code the print statement does not return anything. import boto3 import json import os # Initiate Firehose client firehose_client = boto3.client('firehose') def lambda_handler(event, context): records = [] batch = [] try…
Chandra Shekhar Devgan
  • 1
  • 1
0
votes
2 answers

Dynamo streams into a different table

I am trying to set up a stream from one dynamo stream so it can put data into another dynamo table, but the data does not seem to be put into the dynamo target table The code executes fine, and cloudwatch does not show any errors. It has enough…
user7553100
0
votes
2 answers

How to make substring of stream dynamodb arn?

I defined DynamoDB table inside nested stack in cloudformaion just have output stream arn string like: arn:aws:dynamodb:us-east-1:123456789012:table/books_table/stream/2015-05-11T21:21:33.291 I want to get the substring of this stream arn and get…
user504909
  • 9,119
  • 12
  • 60
  • 109
0
votes
1 answer

how to get version variable in aws cloudformation?

I have dynamodb arn string and want to combine manually about the string of stream arn. arn:aws:dynamodb:us-east-1:123456789012:table/books_table arn:aws:dynamodb:us-east-1:123456789012:table/books_table/stream/2015-05-11T21:21:33.291 Any one who…
user504909
  • 9,119
  • 12
  • 60
  • 109
0
votes
1 answer

dynamodb query filter with optional parameter

In the below code, language filter condition is optional whether it may contains data or null. If it contains null means dynamodb throws some error. How to overcome this ? Map expressionAttributesNames = new…
born to code
  • 123
  • 8
0
votes
1 answer

How do I use Boto3 and Python to subscribe a lambda function to a DynamoDB stream?

How do I use Boto3 and Python to subscribe an AWS Lambda function to an AWS DynamoDB Stream? Subscribing a Lambda function to a DynamoDB stream is straight-forward enough. However, it's not clear how to do this with code. I need do it in code…
Owen Brown
  • 179
  • 9
0
votes
1 answer

Is there a way to read from Dynamo DB stream with a fixed no of workers and leases without any issue

I am continuously publishing data into dynamoDB which has stream enabled. I am reading this stream using DynamoDB apadter of KCL. I am using 1 KCL worker with 5 leases. At the time of creation my Dynamo table had 1 partition(1 RCU and 999WCU). When…
user2677679
  • 259
  • 2
  • 12
0
votes
1 answer

Getting the latest of multiple values from DynamoDB

If I have a table like below: ID A B C D(ate) ASDF 1 2 1 12/12/2016 ASEF 1 2 3 12/13/2016 AFDS 2 3 1 12/13/2016 ASFA 2 3 4 12/14/2016 And I want to get the latest based on a pair (A, B) and the latest date (D), how would I set up a table to work…
Nathan Hyland
  • 842
  • 2
  • 13
  • 28
0
votes
2 answers

Dynamically Scan DynamoDB collection using multiple fields

I am creating a REST service using springboot and DynamoDB as database. I have a StudentDTO class with the following fields and Subject class which has subjects info as (key,value pair) : @DynamoDBTable(tableName="Students") Class…
A.P
  • 53
  • 3
  • 12
0
votes
1 answer

Wrap Unwrap dynamo DB Streams

I am trying to process dynamoDB streams based on changes in a table. The items from the stream have the data type present in the stream. I am trying to find a library similar to dynamodb-data-types, which can unwrap the dynamoDB structure to json…
tharun
  • 348
  • 6
  • 15
1 2 3
…
26 27