Does Spark support insert overwrite static partitions?

Question

I noticed in the current Spark Sql manual that inserting into a dynamic partition is not supported:

Major Hive Features

Spark SQL does not currently support inserting to tables using dynamic partitioning.

However, is insert/overwriting into static partitions supported?

score 0 · Answer 1 · edited Dec 15 '14 at 16:28

0

Spark SQL does not currently support inserting to tables using dynamic partitioning as of version spark 1.1

Static is supported, you need to write data in hive table location.

edited Dec 15 '14 at 16:28

Gabe

answered Nov 05 '14 at 16:48

user1989252

So an existing Hive query using 'insert overwrite table tablename partion...' would work, right? Sorry don't yet have an environment setup to test. – JeffLL Nov 05 '14 at 19:16

score 0 · Answer 2 · answered Dec 29 '14 at 02:05

0

According to the release notes, Spark 1.2.0 supports dynamically partitioned inserts. Refer to SPARK-3007.

answered Dec 29 '14 at 02:05

dnlbrky

2 Answers2