1

While writing to dynamodb with on-demand capacity using hive > INSERT OVERWRITE TABLE t SELECT * FROM s3data; I notice that it writes 1 item at a time which is evident from the writecapacity graph below. Here are the settings

SET dynamodb.throughput.write.percent=1.0;
CREATE EXTERNAL TABLE IF NOT EXISTS t (userId string, categoryName string, score double)
STORED BY 'org.apache.hadoop.hive.dynamodb.DynamoDBStorageHandler'
TBLPROPERTIES ("dynamodb.table.name" = "data.reader-score.test",
"dynamodb.column.mapping" = "userId:userId,categoryName:categoryName,score:score", 
"dynamodb.throughput.write" = "5000");

Is there any other configuration that must be done?

enter image description here

Somasundaram Sekar
  • 5,244
  • 6
  • 43
  • 85

0 Answers0