You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@phoenix.apache.org by Sanooj Padmakumar <p....@gmail.com> on 2016/08/09 17:15:55 UTC

Delete large data set

Hi All,

What will be the best way to delete huge number of rows ( around 100
million records) from a phoenix table ? Primary key is composite and I know
the value of the column at the first position.Just to add, a normal delete
query throws exception indicating it cannot delete this huge quantity of
data


Thanks!

-- 
Thanks,
Sanooj Padmakumar

Re: Delete large data set

Posted by Sanooj Padmakumar <p....@gmail.com>.

Thanks James, this helps

On 9 Aug 2016 22:58, "James Taylor" <ja...@apache.org> wrote:

> Make sure to set autoCommit on before issuing the DELETE. Otherwise the
> client needs to hold onto all the row keys of the rows being deleted.
>
> On Tuesday, August 9, 2016, Sanooj Padmakumar <p....@gmail.com> wrote:
>
>> Hi All,
>>
>> What will be the best way to delete huge number of rows ( around 100
>> million records) from a phoenix table ? Primary key is composite and I know
>> the value of the column at the first position.Just to add, a normal delete
>> query throws exception indicating it cannot delete this huge quantity of
>> data
>>
>>
>> Thanks!
>>
>> --
>> Thanks,
>> Sanooj Padmakumar
>>
>

Re: Delete large data set

Posted by James Taylor <ja...@apache.org>.

Make sure to set autoCommit on before issuing the DELETE. Otherwise the
client needs to hold onto all the row keys of the rows being deleted.

On Tuesday, August 9, 2016, Sanooj Padmakumar <p....@gmail.com> wrote:

> Hi All,
>
> What will be the best way to delete huge number of rows ( around 100
> million records) from a phoenix table ? Primary key is composite and I know
> the value of the column at the first position.Just to add, a normal delete
> query throws exception indicating it cannot delete this huge quantity of
> data
>
>
> Thanks!
>
> --
> Thanks,
> Sanooj Padmakumar
>