MSCK REPAIR TABLE working strangely on delta tables

Question

I have a delta table in s3 and for the same table, I have defined an external table in Athena. After creating the Athena table and generating manifests, I am loading the partitions using MSCK REPAIR TABLE. All the partition columns are in snake_case. But still, I am getting

Partitions not in metastore.

Any idea what am I missing here?

are you getting this directly after generation of manifest & MSCK? — Alex Ott, Feb 08 '21 at 15:19
Yes, when I download the output of MSCK, I see these lines in that file. — Ankit Anand, Feb 09 '21 at 03:33

score 1 · Answer 1 · answered Feb 08 '21 at 20:53

1

The IAM user or role doesn't have a policy that allows the glue:BatchCreatePartition action. You have to allow glue:BatchCreatePartition in the IAM policy and it should work.

answered Feb 08 '21 at 20:53

AswinRajaram

1,519
7
18

It is allowed in IAM policy, because similar thing is working with other delta tables. – Ankit Anand Feb 09 '21 at 03:30

score 0 · Accepted Answer · answered Feb 12 '21 at 05:37

0

Resolved the issue. I was putting partition columns in wrong order while creating the table.

answered Feb 12 '21 at 05:37

Ankit Anand

321
3
7

MSCK REPAIR TABLE working strangely on delta tables

2 Answers2