You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by lu...@sina.com on 2015/05/14 12:26:39 UTC

how to delete data from table in sparksql

Hi guys       i got to delete some data from a table by "delete from table where name = xxx", however "delete" is not functioning like the DML operation in hive.  I got a info like below:Usage: delete [FILE|JAR|ARCHIVE] <value> [<value>]*
15/05/14 18:18:24 ERROR processors.DeleteResourceProcessor: Usage: delete [FILE|JAR|ARCHIVE] <value> [<value>]*

       I checked the list of "Supported Hive Features" , but not found if this dml is supported.       So any comments will be appreciated.

--------------------------------

 

Thanks&amp;Best regards!
San.Luo

Re: how to delete data from table in sparksql

Posted by Michael Armbrust <mi...@databricks.com>.
The list of unsupported hive features should mention that it implicitly
includes features added after Hive 13.  You cannot yet compile with Hive >
13, though we are investigating this for 1.5

On Thu, May 14, 2015 at 6:40 AM, Denny Lee <de...@gmail.com> wrote:

> Delete from table is available as part of Hive 0.14 (reference: Apache
> Hive > Language Manual DML - Delete
> <https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DML#LanguageManualDML-Delete>)
> while Spark 1.3 defaults to Hive 0.13.    Perhaps rebuild Spark with Hive
> 0.14 or generate a new table filtering out the values you do not want.
>
> On Thu, May 14, 2015 at 3:26 AM <lu...@sina.com> wrote:
>
>> Hi guys
>>
>>        i got to delete some data from a table by "delete from table where
>> name = xxx", however "delete" is not functioning like the DML operation in
>> hive.  I got a info like below:
>>
>> Usage: delete [FILE|JAR|ARCHIVE] <value> [<value>]*
>>
>> 15/05/14 18:18:24 ERROR processors.DeleteResourceProcessor: Usage: delete
>> [FILE|JAR|ARCHIVE] <value> [<value>]*
>>
>>
>>
>>        I checked the list of "Supported Hive Features" , but not found
>> if this dml is supported.
>>
>>        So any comments will be appreciated.
>>
>> --------------------------------
>>
>> Thanks&amp;Best regards!
>> San.Luo
>>
>

Re: how to delete data from table in sparksql

Posted by Denny Lee <de...@gmail.com>.
Delete from table is available as part of Hive 0.14 (reference: Apache Hive
> Language Manual DML - Delete
<https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DML#LanguageManualDML-Delete>)
while Spark 1.3 defaults to Hive 0.13.    Perhaps rebuild Spark with Hive
0.14 or generate a new table filtering out the values you do not want.

On Thu, May 14, 2015 at 3:26 AM <lu...@sina.com> wrote:

> Hi guys
>
>        i got to delete some data from a table by "delete from table where
> name = xxx", however "delete" is not functioning like the DML operation in
> hive.  I got a info like below:
>
> Usage: delete [FILE|JAR|ARCHIVE] <value> [<value>]*
>
> 15/05/14 18:18:24 ERROR processors.DeleteResourceProcessor: Usage: delete
> [FILE|JAR|ARCHIVE] <value> [<value>]*
>
>
>
>        I checked the list of "Supported Hive Features" , but not found if
> this dml is supported.
>
>        So any comments will be appreciated.
>
> --------------------------------
>
> Thanks&amp;Best regards!
> San.Luo
>