We are unable to simulate the incremental transfer(s) for a flow at Appflow service. Please find the details below and any advice would be appreciated.
Custom connector: Connects to dynamo DB and pushes data to s3.
Existing data from the dynamo document
Flow with incremental transfer flow setup
Incremental transfer def from AWS doc(s)
Expectation was for the first transfer the whole data will be moved and from the next transfer there is no data that will be transferred. But, Appflow treats this flow as full flow and transfers data for every time.
snippet from the S3 that shows same data is being transferred for every 2 minute invocation
Should you need further details, kindly let us know and help to solve the case.
Thanks Sagar
We tried to simulate the incremental transfers where only a new/changed data will be moved from source to destination, but this isn't happening.
Played around with different time zones but no luck.
Thanks