I am trying to load json data from s3 bucket to dynamodb using emr. I uploaded data successfully but my count is mismatching without throwing any error.
Why could that happen?
Asked
Active
Viewed 94 times
0
-
Could happen because of various reasons. Make sure you are using updated DynamoDB connector JAR's and I recommend you to look at counters in job history logs to get more info. – jc mannem Apr 17 '17 at 06:15
-
Also can happen if speculation execution is turned-on on Hadoop end. You also need to check if any other writes coming in on that table. BTW, all the implementation is now open source https://github.com/awslabs/emr-dynamodb-connector – jc mannem May 09 '17 at 17:52