[jira] [Commented] (KUDU-1688) Impala 'INSERT IGNORE' is slow due to VLOG(1) logging in client

["Alexey Serbin (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KUDU-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664422#comment-15664422 ] 

Alexey Serbin commented on KUDU-1688:
-------------------------------------

Temporary fix (increased level for verbose log messages): http://gerrit.cloudera.org:8080/5067

> Impala 'INSERT IGNORE' is slow due to VLOG(1) logging in client
> ---------------------------------------------------------------
>
>                 Key: KUDU-1688
>                 URL: https://issues.apache.org/jira/browse/KUDU-1688
>             Project: Kudu
>          Issue Type: Improvement
>          Components: impala, perf
>    Affects Versions: 1.0.0
>            Reporter: Todd Lipcon
>
> Currently Batcher::ProcessWriteResponse will log a VLOG(1) entry for every row error it experiences. When using INSERT IGNORE in Impala, this can yield thousands of logs per second and makes it extremely slow.
> We should consider bumping this to a higher vlog level, or pushing the 'insert ignore' flag into the operations themselves (even before KUDU-1563 is finished we could just drop the errors inside the client side)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)