You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kudu.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2016/10/08 04:42:20 UTC

[jira] [Created] (KUDU-1688) Impala 'INSERT IGNORE' is slow due to VLOG(1) logging in client

Todd Lipcon created KUDU-1688:
---------------------------------

             Summary: Impala 'INSERT IGNORE' is slow due to VLOG(1) logging in client
                 Key: KUDU-1688
                 URL: https://issues.apache.org/jira/browse/KUDU-1688
             Project: Kudu
          Issue Type: Improvement
          Components: impala, perf
    Affects Versions: 1.0.0
            Reporter: Todd Lipcon


Currently Batcher::ProcessWriteResponse will log a VLOG(1) entry for every row error it experiences. When using INSERT IGNORE in Impala, this can yield thousands of logs per second and makes it extremely slow.

We should consider bumping this to a higher vlog level, or pushing the 'insert ignore' flag into the operations themselves (even before KUDU-1563 is finished we could just drop the errors inside the client side)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)