You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Ashok Kumar <as...@yahoo.com.INVALID> on 2016/05/30 18:37:36 UTC

Does Spark support updates or deletes on underlying Hive tables

Hi,
I can do inserts from Spark on Hive tables. How about updates or deletes. They are failing when I tried?
Thanking

Re: Does Spark support updates or deletes on underlying Hive tables

Posted by Mich Talebzadeh <mi...@gmail.com>.

Hi,

Remember that acidity and transactional support was added to Hive 0.14
onward because of advent of ORC tables.

Now Spark does not support transactions because quote "there is a piece in
the execution side that needs to send heartbeats to Hive metastore saying a
transaction is still alive". That has not been implemented in Spark yet to
my knowledge.

HTH

Dr Mich Talebzadeh

LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*

http://talebzadehmich.wordpress.com

On 30 May 2016 at 19:37, Ashok Kumar <as...@yahoo.com.invalid> wrote:

> Hi,
>
> I can do inserts from Spark on Hive tables. How about updates or deletes.
> They are failing when I tried?
>
> Thanking
>
>
>