Can not ALTER or DROP a big Imapa partitionned tables - CAUSED BY: MetaException: Timeout when executing

Question

I have a several impala partitionned tables that have more than 50k partitions, it work a good except the Hive Metastore operations, like DROP and ALTER ... RENAME, I face this error message:

Query: drop table cars

ERROR: ImpalaRuntimeException: Error making 'dropTable' RPC to Hive Metastore: CAUSED BY: MetaException: Timeout when executing method: drop_table_with_environment_context; 600003ms exceeds 600000ms

I don't know if it's a memory problem? or it's normal and I should adjust the timeout value.. ? if yes, which one ?

Any help would be appreciated.

Is it External Table or Internal Table? – Surendranatha Reddy Chappidi Nov 27 '17 at 08:58 — Surendranatha Reddy Chappidi, Nov 27 '17 at 08:58
It might be due to Permission issue. – Surendranatha Reddy Chappidi Nov 27 '17 at 08:59 — Surendranatha Reddy Chappidi, Nov 27 '17 at 08:59
@SurendranathaReddyChappidi, it's a internal table. – Mohammed Acharki Nov 28 '17 at 14:59 — Mohammed Acharki, Nov 28 '17 at 14:59

score 2 · Answer 1 · edited Nov 29 '17 at 19:22

2

Try to add CASCADE. If your table has partitions, the query should be

DROP TABLE CARS CASCADE;

edited Nov 29 '17 at 19:22

FelixSFD

6,052
10
43
117

answered Nov 29 '17 at 19:04

Oleg Hmelnits

114
1
10

Now that it has been edited, this is an appropriate answer. – Tom Aranda Nov 29 '17 at 19:22

score 1 · Answer 2 · answered Nov 28 '17 at 09:58

1

This may be related to hive metastore. You could try directly connecting to hms and see if dropping partitions works there, and you'll get more information of why it doesn't work.

answered Nov 28 '17 at 09:58

Amos

3,238
4
19
41

Can not ALTER or DROP a big Imapa partitionned tables - CAUSED BY: MetaException: Timeout when executing

2 Answers2