Stack Overflow
Stack Overflow

Questions tagged [amazon-dynamodb-streams]

Use this tag for questions related to DynamoDB Streams, which provides a time ordered sequence of item level changes in any DynamoDB table. The changes are de-duplicated and stored for 24 hours. This capability enables you to extend the power of DynamoDB with cross-region replication, continuous analytics with Redshift integration, change notifications, and many other scenarios.

Useful links:

  1. Documentation
  2. Use cases
393 questions
0
votes
1 answer

How to apply DynamoDB Query/Scan using FilterExpression for nested Json attributes in PHP

Record1: [{ "business_id": 2, "forms": { "f522": { "id": "f522", "is_deleted": 0, "title": "Form 1" }, "f8b6": { "id": "f8b6", "is_deleted": 0, "title": "Form 2" }, "fw56":…
Dipen Patel
  • 11
  • 1
  • 6
0
votes
1 answer

How to get sorted data from dynamodb based on dynamic column

I have a table in Dynamodb named "user" which has two columns, one is "time" and another is "cost". I wanted to get the sorted data based on the column name, say if I provide input param as "time" the top 50 record in ascending order and if I…
Ashish Yadav
  • 350
  • 3
  • 17
0
votes
2 answers

python boto error when inserting data to dynamodb

boto.dynamodb2.exceptions.ValidationException: ValidationException: 400 Bad Request {'__type': 'com.amazon.coral.validate#ValidationException', 'message': 'One or more parameter values were invalid: Type mismatch for key restoreid expected: S…
Arpan Solanki
  • 817
  • 1
  • 17
  • 28
0
votes
1 answer

boto3 dynamodb pass json as parameter

So the following code works import boto3 dynamodb = boto3.resource('dynamodb', region_name='us-east-1') table = dynamodb.Table('mytest') myid = "123" mylocation = "paris" response = table.put_item( Item={ 'myid': myid, …
Arpan Solanki
  • 817
  • 1
  • 17
  • 28
0
votes
2 answers

Spark Streaming Kinesis Integration: Error while initializing LeaseCoordinator in Worker

I have been having some issues when running a simple vanilla spark streaming with kinesis application in scala. I have followed the basic guidances in some tutorials as Snowplow and WordCountASL. Yet i still cannot make it work because of this…
francotestori
  • 63
  • 2
  • 7
0
votes
0 answers

how to support search in DynamoDB similar to LIKE functionality in ORACLE

I need to support a use case where i need to search all attributes that are INPUT given by the user. As DynamoDB doesn't supports regular expression and a full scan is not possible overtime on that attributes. How should i move forward. Users will…
user1747819
  • 301
  • 1
  • 5
  • 11
0
votes
1 answer

DynamoDB indexing on payload

My DynamboDB row item looks like this: (it is given to me) { "id":"123456", "date_time":"01062016 143212", "payload":{ "type":"A", "value":"temp value", } } I added indexes on id + date_time. how can you add…
shay
  • 2,021
  • 1
  • 15
  • 17
0
votes
2 answers

How to index Dynamodb streams data in Amazon Elasticsearch Services via AWS Lambda?

I followed step by step this tutorial but when I'm arriving at the "Testing the result" step, I don't see my table name in the indices time as "all products" is showed in the example. So it means my dynamodb table is not indexed in my Amazon ES…
John doe
  • 3,680
  • 7
  • 31
  • 65
0
votes
0 answers

AWS iOS SDK: Is it possible long poll or be notified when changes are made to a DynamoDB table?

I am working on an app that requires near realtime updates for a certain table. Is there built in functionality with the current AWS iOS SDK to be notified when changes are made to a DynamoDB table. I've done a little reading and know about the…
Nick
  • 1
  • 2
0
votes
0 answers

How to make a real-time and scalable/adaptive search system combining aws cloudsearch and dynamodb?

I want to make a high reactive search system using cloudsearch from aws.I already set a testing process between lambda and dynamodb triggers but the results aren't what i'm expecting. What i want is making my search system to fetch data dynamically…
John doe
  • 3,680
  • 7
  • 31
  • 65
-1
votes
1 answer

Disabling DynamoDB stream leads to inconsistency between tfstate file and tf config files

I am seeing an issue with dynamodb stream where if "stream_enabled" is set to "false" but the "stream_view_type" is set to a variable, in this case it is set to "NEW_AND_OLD_IMAGES", when running tf apply via our pipeline it produces an error:…
Torreygs214
  • 25
  • 4
-1
votes
1 answer

DynamoDB Trigger Lambda Function Call Failed

I am trying to have events in a DynamoDB table trigger Lambda function that moves the events into Kinesis Data Firehose. Kinesis then batches the files and send them to an S3 bucket. The Lambda function I am using as the trigger fails. This is the…
BRE-ZUSES
  • 9
  • 3
-1
votes
1 answer

Dynamodb One table design - scan and filter with limit approach?

So I'm following the one table design and the PK keys that are with the below format P#product1 P#product2 P#product3 W#warehouse1 W#warehouse2 P#product4 .... With this query pattern "get all products" , I need to run a scan to get all records…
Duyth
  • 25
  • 3
-1
votes
1 answer

Best design pattern for modeling leaderboard of counts in DynamoDB

I'm trying to keep a count of people in a room. Currently, people can join and leave rooms (many-many) relationship. I'm modeling this currently by a two-way roomId <-> userId PK/SK swap via a GSI. So I can look up who is in a room, and which room a…
Joe
  • 112
  • 7
-1
votes
1 answer

Aggregating Movie Rental information in a DynamoDB table using Flink

Happy Holidays everyone! tl;dr: I need to aggregate movie rental information that is being stored in one DynamoDB table and store running total of the aggregation in another table. How do I ensure exactly-once aggregation? I currently store movie…
user544192
  • 695
  • 2
  • 10
  • 23
1 2 3
…
26
27