You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kudu.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2016/05/13 00:35:12 UTC

[jira] [Created] (KUDU-1453) Spark executors leak kudu clients and netty threads

Todd Lipcon created KUDU-1453:
---------------------------------

             Summary: Spark executors leak kudu clients and netty threads
                 Key: KUDU-1453
                 URL: https://issues.apache.org/jira/browse/KUDU-1453
             Project: Kudu
          Issue Type: Bug
          Components: spark
    Affects Versions: 0.8.0
            Reporter: Todd Lipcon
            Priority: Blocker


On a test cluster, every time I run a spark SQL query against a table, each of my spark worker tasks end up with another ~500 netty worker threads created. It seems like each Spark partition/task is creating its own KuduClient which then creates a bunch of worker threads and never cleans them up.

I'm calling this a blocker since after ~20 queries or so, the machines woudl run out of threads and crash.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)