You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@impala.apache.org by Csaba Ringhofer <cs...@cloudera.com> on 2021/11/19 14:57:15 UTC

Re: Data is being inserted even though an INSERT INTO query fails

Hi!

i have added a comment to the Jira.
Generally INSERTs in Impala are not really atomic, unless we use Hive ACID
tables or Iceberg (I am not sure about Kudu).

- Csaba

On Tue, Nov 16, 2021 at 12:36 PM Antoni Ivanov <ai...@vmware.com> wrote:

> Hi,
>
>
>
> Are insert queries supposed to be atomic ?
>
>
>
> Thanks,
>
> Antoni
>
>
>
> *From: *Antoni Ivanov <ai...@vmware.com>
> *Reply to: *"user@impala.apache.org" <us...@impala.apache.org>
> *Date: *Friday, 12 November 2021, 12:52
> *To: *"user@impala.apache.org" <us...@impala.apache.org>
> *Subject: *Data is being inserted even though an INSERT INTO query fails
>
>
>
> Hi,
>
>
>
> A colleague of mine opened
> https://issues.apache.org/jira/browse/IMPALA-11014
> <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FIMPALA-11014&data=04%7C01%7Caivanov%40vmware.com%7Cee60611ca05442a1addc08d9a5ca8698%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637723111527650942%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=hXA1Z9z9MUQG4wd9zsmUJ80YnDbcABSRMoR7n8usUqY%3D&reserved=0>
>
>
>
> It seems there a bug in Impala which can cause insert query to populate
> data even if it fails. That seems pretty serious since it violates
> atomicity of single query operation.
>
> Are you aware of this (we tried to find passed jira issue on similar
> problem but could not) ?  Why could it happen?
>
>
> Thanks,
>
> Antoni
>

Re: Data is being inserted even though an INSERT INTO query fails

Posted by Antoni Ivanov <ai...@vmware.com>.

Thanks for the answers so far.

We have asked a few follow up questions in https://issues.apache.org/jira/browse/IMPALA-11014
If someone can spare the time to look at them I’d be pretty grateful.

Regards,
Antoni

From: Wenzhe Zhou <wz...@cloudera.com>
Reply to: "user@impala.apache.org" <us...@impala.apache.org>
Date: Friday, 19 November 2021, 18:41
To: "user@impala.apache.org" <us...@impala.apache.org>
Subject: Re: Data is being inserted even though an INSERT INTO query fails

Kudu supports transactions for "insert" and "CTAS" now. But transactions for "UPDATE/UPSERT/DELETE" are not done yet.

Wenzhe Zhou
wzhou@cloudera.com<ma...@cloudera.com>
408-568-0101


On Fri, Nov 19, 2021 at 6:57 AM Csaba Ringhofer <cs...@cloudera.com>> wrote:
Hi!

i have added a comment to the Jira.
Generally INSERTs in Impala are not really atomic, unless we use Hive ACID tables or Iceberg (I am not sure about Kudu).

- Csaba

On Tue, Nov 16, 2021 at 12:36 PM Antoni Ivanov <ai...@vmware.com>> wrote:
Hi,

Are insert queries supposed to be atomic ?

Thanks,
Antoni

From: Antoni Ivanov <ai...@vmware.com>>
Reply to: "user@impala.apache.org<ma...@impala.apache.org>" <us...@impala.apache.org>>
Date: Friday, 12 November 2021, 12:52
To: "user@impala.apache.org<ma...@impala.apache.org>" <us...@impala.apache.org>>
Subject: Data is being inserted even though an INSERT INTO query fails

Hi,

A colleague of mine opened https://issues.apache.org/jira/browse/IMPALA-11014<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FIMPALA-11014&data=04%7C01%7Caivanov%40vmware.com%7C0901d1d7c9554f021e5e08d9ab7b8086%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637729369192967048%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=HecmwNewOQwHRxLM4Yb8%2FtV%2Fa62x%2FRzvcgo7ATHWnLc%3D&reserved=0>

It seems there a bug in Impala which can cause insert query to populate data even if it fails. That seems pretty serious since it violates atomicity of single query operation.
Are you aware of this (we tried to find passed jira issue on similar problem but could not) ?  Why could it happen?

Thanks,
Antoni

Re: Data is being inserted even though an INSERT INTO query fails

Posted by Wenzhe Zhou <wz...@cloudera.com>.

Kudu supports transactions for "insert" and "CTAS" now. But transactions
for "UPDATE/UPSERT/DELETE" are not done yet.

Wenzhe Zhou
wzhou@cloudera.com
408-568-0101


On Fri, Nov 19, 2021 at 6:57 AM Csaba Ringhofer <cs...@cloudera.com>
wrote:

> Hi!
>
> i have added a comment to the Jira.
> Generally INSERTs in Impala are not really atomic, unless we use Hive ACID
> tables or Iceberg (I am not sure about Kudu).
>
> - Csaba
>
> On Tue, Nov 16, 2021 at 12:36 PM Antoni Ivanov <ai...@vmware.com> wrote:
>
>> Hi,
>>
>>
>>
>> Are insert queries supposed to be atomic ?
>>
>>
>>
>> Thanks,
>>
>> Antoni
>>
>>
>>
>> *From: *Antoni Ivanov <ai...@vmware.com>
>> *Reply to: *"user@impala.apache.org" <us...@impala.apache.org>
>> *Date: *Friday, 12 November 2021, 12:52
>> *To: *"user@impala.apache.org" <us...@impala.apache.org>
>> *Subject: *Data is being inserted even though an INSERT INTO query fails
>>
>>
>>
>> Hi,
>>
>>
>>
>> A colleague of mine opened
>> https://issues.apache.org/jira/browse/IMPALA-11014
>> <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FIMPALA-11014&data=04%7C01%7Caivanov%40vmware.com%7Cee60611ca05442a1addc08d9a5ca8698%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637723111527650942%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=hXA1Z9z9MUQG4wd9zsmUJ80YnDbcABSRMoR7n8usUqY%3D&reserved=0>
>>
>>
>>
>> It seems there a bug in Impala which can cause insert query to populate
>> data even if it fails. That seems pretty serious since it violates
>> atomicity of single query operation.
>>
>> Are you aware of this (we tried to find passed jira issue on similar
>> problem but could not) ?  Why could it happen?
>>
>>
>> Thanks,
>>
>> Antoni
>>
>