You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kudu.apache.org by "Grant Henke (Jira)" <ji...@apache.org> on 2020/06/03 03:04:00 UTC

[jira] [Updated] (KUDU-2485) Enhance Kudu-Spark docs

     [ https://issues.apache.org/jira/browse/KUDU-2485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Grant Henke updated KUDU-2485:
------------------------------
    Component/s: documentation

> Enhance Kudu-Spark docs
> -----------------------
>
>                 Key: KUDU-2485
>                 URL: https://issues.apache.org/jira/browse/KUDU-2485
>             Project: Kudu
>          Issue Type: Improvement
>          Components: documentation, spark
>    Affects Versions: 1.7.1
>            Reporter: William Berkeley
>            Priority: Major
>
> Users often get confused about the right way to use the Kudu-Spark integration. The most common dangerous result is that they create multiple Kudu clients, sometimes even one per task. It's pretty easy to overwhelm the master in this way, e.g., with a 2 second batch window and a client per task in a Spark streaming job. We should take our current minimal Spark docs and provide better examples and bigger, louder, redder warnings about making extra Kudu clients. Users should be directed to use the KuduContext exclusively. When a client is needed, the client instance inside the KuduContext should be used.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)