You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kudu.apache.org by "Alexey Serbin (JIRA)" <ji...@apache.org> on 2016/11/14 18:24:00 UTC

[jira] [Updated] (KUDU-1688) Impala 'INSERT IGNORE' is slow due to VLOG(1) logging in client

     [ https://issues.apache.org/jira/browse/KUDU-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alexey Serbin updated KUDU-1688:
--------------------------------
    Status: In Review  (was: In Progress)

> Impala 'INSERT IGNORE' is slow due to VLOG(1) logging in client
> ---------------------------------------------------------------
>
>                 Key: KUDU-1688
>                 URL: https://issues.apache.org/jira/browse/KUDU-1688
>             Project: Kudu
>          Issue Type: Improvement
>          Components: impala, perf
>    Affects Versions: 1.0.0
>            Reporter: Todd Lipcon
>            Assignee: Alexey Serbin
>
> Currently Batcher::ProcessWriteResponse will log a VLOG(1) entry for every row error it experiences. When using INSERT IGNORE in Impala, this can yield thousands of logs per second and makes it extremely slow.
> We should consider bumping this to a higher vlog level, or pushing the 'insert ignore' flag into the operations themselves (even before KUDU-1563 is finished we could just drop the errors inside the client side)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)