Stack Overflow
Stack Overflow

Questions tagged [amazon-dynamodb-streams]

Use this tag for questions related to DynamoDB Streams, which provides a time ordered sequence of item level changes in any DynamoDB table. The changes are de-duplicated and stored for 24 hours. This capability enables you to extend the power of DynamoDB with cross-region replication, continuous analytics with Redshift integration, change notifications, and many other scenarios.

Useful links:

  1. Documentation
  2. Use cases
393 questions
0
votes
2 answers

Identify trigger or find dynamodb table name from lambda function code

I have a nodejs lambda function with three dynamodb tables associated via trigger. I am indexing the records to elasticsearch based on the event fired using the lambda function code. Basically, I need to find out the table name in which the records…
Dinesh Kumar
  • 2,838
  • 1
  • 16
  • 18
0
votes
1 answer

Get only updated fields along with identifiers in DynamoDB stream

Is there a way to get ONLY updated fields in an object along with some other attributes (ie identifiers for that object, be it primary key or whatever) On amazon documentation:…
Ahmed
  • 121
  • 6
  • 18
0
votes
0 answers

Using java to stream index into elastic-search from dynamodb using trigger

I am a novice on dynamodb and elasticsearch. Need to stream indexes into elastic search from dynamodb table by trigger using Java i.e. whenever a new record is inserted in dynamodb table the same has to updated in the elastic-search. Most of the…
Dinesh Kumar
  • 2,838
  • 1
  • 16
  • 18
0
votes
2 answers

Is it possible to record mp3 files with an android app and store this mp3 in a DynamoDB?

So I have two questions. First, is it possible to record mp3 in an android app and how? Second, is it possible to store this mp3 in a DynamoDB from the Android App and how?
M_B
  • 49
  • 7
0
votes
0 answers

DDB Stream invoke Lambda locally?

I am trying to setup a full local stack for DDB -> DDB stream -> Lambda. What I have done are: Setup local DynamoDB Enable DDB Stream. (Tested with list-streams, get-shard, and get-records) Setup Local Lambda with SAM. (Can invoke/start Lambda to…
toblerones
  • 21
  • 1
  • 3
0
votes
1 answer

How to insert multiple row in dynamoDb using PHP?

I have written below Json for insert in dynamodb, but unable to insert. But if I try single element without array it's working fine. $item = $marshaler->marshalJson(' [ { "PK":"CATG", "SK":"NAME#SMART_PHONE", …
Niloy Rony
  • 602
  • 1
  • 8
  • 23
0
votes
1 answer

Index DynamoDB streams to elastic search

I have a requirement for implementing following entities in a DynamoDB table I have stored these entities in DynamoDB as below. Partition Key : PROJ#ProjectId:CountryId Sort Key : Project Name Company : company data as JSON document Since this is…
Shanaka
  • 1,670
  • 3
  • 21
  • 42
0
votes
1 answer

aws sdk dynamodb scan operation with FilterExpression(contains) is resulting empty items

I am trying to fetch data from AWS Dynamo DB scan with contains FilterExpression .I am using the following param but receiving empty response as: {"Items":[],"Count":0,"ScannedCount":792,"LastEvaluatedKey":{"ID":"b123456789"}}"} where i want to…
vrk
  • 5
  • 3
0
votes
1 answer

New Data aggregation with DynamoDB Stream

We have standard SQL based DB that stores User’s activities. Since there are millions of activities are stored in DB, doing aggregation on the fly will be very expensive so we are thinking of pushing\replicating these activities into DynamoDB and…
apdev
  • 115
  • 2
  • 10
0
votes
1 answer

AWS Lambda - trigger synchronously repeatedly until a condition has been met

I have a use case where i want a scheduled lambda to read from a dynamodb table until there are no records left to process from its dynamodb query. I don't want to run lots of instances of the lamdba as it will hit a REST endpoint each time and…
AnonymousAlias
  • 1,149
  • 2
  • 27
  • 68
0
votes
1 answer

How do I read and write multiple json objects from 1 S3 file to dynamodb python 3.8

I am able to read and write a single json record from S3 bucket to dynamodb. However, when I try to read and write from the file with multiple json objects in it, it gives me error. Please find the code and error below - Request you to please help…
Priti Palekar
  • 13
  • 5
0
votes
1 answer

Multiple DynamoDB streams from same table consumed by same Lambda function

I have a Lambda function which pushes DynamoDB stream messages to SNS. If I put batch size as 10, can it combine records of two different streams? For instance: Stream1 has an array of 2 objects and Stream2 also has an array of 2 objects. If I put…
himanshu saini
  • 123
  • 1
  • 1
  • 9
0
votes
1 answer

Does Kinesis Client Library consumer support AT_TIMESTAMP as a starting position when using Dynamodb streams kinesis adapter

According to doc Dynamodb streams and Kinesis data streams low-level APIs are similar, but they are not 100 percent identical. I notice that Dynamodb streams' GetShardIterator is a bit different i.e it doesn’t support AT_TIMESTAMP as a shard…
reda la
  • 801
  • 1
  • 6
  • 10
0
votes
1 answer

Ordering of DynamoDB stream for transaction write operation

I have a DynamoDB transaction which appends > 1 records at any time in a single DynamoDB table using transactWrite. For example, in a single transaction, I can append A, B, and C records. Note that in my case, the operations are always append only…
drcocoa
  • 1,155
  • 1
  • 14
  • 23
0
votes
2 answers

Get latest 3 entries from DynamoDb

I have a dynamo-db table with following schema { "id": String [hash key] "type": String [range key] } I have a usecase where I need to fetch last 3 rows for a given id when type is unknown.
Alex
  • 31
  • 5
1 2 3
…
26 27