I have a table called EMPLOYEE with columns ID, NAME, DESIGNATION, CITY, COUNTRY, CONTINENT. With 3 level partitioning on CONTINENT, COUNTRY, CITY. Now I need to know recently created partitions say after a specific timestamp. Note : Assuming access to mysql metastore is not provided.
Asked
Active
Viewed 967 times
0
-
https://stackoverflow.com/questions/36095790/how-to-find-the-most-recent-partition-in-hive-table --check this – Taha Naqvi Feb 07 '18 at 16:12
-
I'm expecting something where the partitions can be listed according to the creation or last accessed time. More over my partition column is not timestamp or or date type. If I say I need partitions that are created after feb7 11AM then the output should have only those which are created after that time. – Shashank V C Feb 07 '18 at 16:16
-
sort your hdfs directory which contains the partitions https://stackoverflow.com/questions/37022749/is-there-a-hdfs-command-to-list-files-in-hdfs-directory-as-per-timestamp – Taha Naqvi Feb 07 '18 at 16:25
-
Wow great, I'll update you – Shashank V C Feb 07 '18 at 16:29
-
Its working good. Thank you – Shashank V C Feb 09 '18 at 10:09