You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Ramon Rosa da Silva <ra...@neogrid.com> on 2016/07/22 21:05:31 UTC

Spark jdbc update SaveMode

Hi Folks,

What do you think about allow update SaveMode from DataFrame.write.mode("update")?
Now Spark just has jdbc insert.


This e-mail message, including any attachments, is for the sole use of the person to whom it has been sent and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use it or its attachments. Please notify the sender immediately by return email and permanently delete this message and any attachments. NeoGrid makes no warranty that this email is error or virus free. NeoGrid Europe Limited is a company registered in the United Kingdom with the registration number 7717968. The registered office is 8-10 Upper Marlborough Road, St Albans AL1 3UR, Hertfordshire, UK. NeoGrid Netherlands B.V. is a company registered in the Netherlands with the registration number 3416.6499 and registered office at Science Park 400, 1098 XH Amsterdam, NL. NeoGrid North America Limited is a company registered in the United States with the registration number 52-2242825. The registered office is 55 West Monroe Street, Suite 3590-60603, Chicago, IL, USA. NeoGrid Japan is located at New Otani Garden Court 7F, 4-1 Kioi-cho, Chiyoda-ku, Tokyo 102-0094, Japan. NeoGrid Software SA is a company registered in Brazil, with the registration number CNPJ: 03.553.145/0001-08 and located at Av. Santos Dumont, 935, 89.218-105, Joinville - SC - Brazil.

Esta mensagem pode conter informa??o confidencial ou privilegiada, sendo seu sigilo protegido por lei. Se voc? n?o for o destinat?rio ou a pessoa autorizada a receber esta mensagem, n?o pode usar, copiar ou divulgar as informa??es nela contidas ou tomar qualquer a??o baseada nessas informa??es. Se voc? recebeu esta mensagem por engano, por favor, avise imediatamente ao remetente, respondendo o e-mail e em seguida apague-a. Agradecemos sua coopera??o.

Re: Spark jdbc update SaveMode

Posted by NuthanReddy <nu...@sigmoidanalytics.com>.
Hi Maciej Bryński,

Did you happen to finish that or is there a way to do it?





--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Re: Spark jdbc update SaveMode

Posted by Maciej Bryński <ma...@brynski.pl>.
2016-07-22 23:05 GMT+02:00 Ramon Rosa da Silva <ra...@neogrid.com>:
> Hi Folks,
>
>
>
> What do you think about allow update SaveMode from
> DataFrame.write.mode(“update”)?
>
> Now Spark just has jdbc insert.

I'm working on patch that creates new mode - 'upsert'.
In Mysql it will use 'REPLACE INTO' command.

M.

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org