0

We are reading data from a hive table with hiveContext using a spark dataframe. After doing some aggregations on the data we store this data into another table (which already has data). But the new data is not being appended to the existing table... and not showing any error either...

Note: Before storing into hive I am able to print the dataframe.

Mark
  • 143,421
  • 24
  • 428
  • 436
somu
  • 1
  • Please add relevant information. How are you writing the data to the table? How is the table structured? And other related information that might help the answerers. Also, read [ask] and [mcve]. – philantrovert Nov 28 '17 at 12:01
  • post the code and errors/exceptions which you are using and getting. No one be able to help without that information. They can be so many reasons by theory – Amit Kumar Nov 28 '17 at 12:02
  • grammatical fixes. – Mark Nov 28 '17 at 23:33
  • Thanks for your replay... the was issue resolved... – somu Dec 01 '17 at 16:05

1 Answers1

0
df.write.insertInto(target_db.target_table,overwrite = False)
Sanket
  • 194
  • 11