You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by lu...@sina.com on 2015/05/14 12:26:39 UTC
how to delete data from table in sparksql
Hi guys i got to delete some data from a table by "delete from table where name = xxx", however "delete" is not functioning like the DML operation in hive. I got a info like below:Usage: delete [FILE|JAR|ARCHIVE] <value> [<value>]*
15/05/14 18:18:24 ERROR processors.DeleteResourceProcessor: Usage: delete [FILE|JAR|ARCHIVE] <value> [<value>]*
I checked the list of "Supported Hive Features" , but not found if this dml is supported. So any comments will be appreciated.
--------------------------------
Thanks&Best regards!
San.Luo
Re: how to delete data from table in sparksql
Posted by Michael Armbrust <mi...@databricks.com>.
The list of unsupported hive features should mention that it implicitly
includes features added after Hive 13. You cannot yet compile with Hive >
13, though we are investigating this for 1.5
On Thu, May 14, 2015 at 6:40 AM, Denny Lee <de...@gmail.com> wrote:
> Delete from table is available as part of Hive 0.14 (reference: Apache
> Hive > Language Manual DML - Delete
> <https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DML#LanguageManualDML-Delete>)
> while Spark 1.3 defaults to Hive 0.13. Perhaps rebuild Spark with Hive
> 0.14 or generate a new table filtering out the values you do not want.
>
> On Thu, May 14, 2015 at 3:26 AM <lu...@sina.com> wrote:
>
>> Hi guys
>>
>> i got to delete some data from a table by "delete from table where
>> name = xxx", however "delete" is not functioning like the DML operation in
>> hive. I got a info like below:
>>
>> Usage: delete [FILE|JAR|ARCHIVE] <value> [<value>]*
>>
>> 15/05/14 18:18:24 ERROR processors.DeleteResourceProcessor: Usage: delete
>> [FILE|JAR|ARCHIVE] <value> [<value>]*
>>
>>
>>
>> I checked the list of "Supported Hive Features" , but not found
>> if this dml is supported.
>>
>> So any comments will be appreciated.
>>
>> --------------------------------
>>
>> Thanks&Best regards!
>> San.Luo
>>
>
Re: how to delete data from table in sparksql
Posted by Denny Lee <de...@gmail.com>.
Delete from table is available as part of Hive 0.14 (reference: Apache Hive
> Language Manual DML - Delete
<https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DML#LanguageManualDML-Delete>)
while Spark 1.3 defaults to Hive 0.13. Perhaps rebuild Spark with Hive
0.14 or generate a new table filtering out the values you do not want.
On Thu, May 14, 2015 at 3:26 AM <lu...@sina.com> wrote:
> Hi guys
>
> i got to delete some data from a table by "delete from table where
> name = xxx", however "delete" is not functioning like the DML operation in
> hive. I got a info like below:
>
> Usage: delete [FILE|JAR|ARCHIVE] <value> [<value>]*
>
> 15/05/14 18:18:24 ERROR processors.DeleteResourceProcessor: Usage: delete
> [FILE|JAR|ARCHIVE] <value> [<value>]*
>
>
>
> I checked the list of "Supported Hive Features" , but not found if
> this dml is supported.
>
> So any comments will be appreciated.
>
> --------------------------------
>
> Thanks&Best regards!
> San.Luo
>