You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kudu.apache.org by "Hao Hao (JIRA)" <ji...@apache.org> on 2018/01/09 22:57:00 UTC

[jira] [Created] (KUDU-2254) Warn spark applications that create KuduContext in the driver and share it with exectuors

Hao Hao created KUDU-2254:
-----------------------------

             Summary: Warn spark applications that create KuduContext in the driver and share it with exectuors 
                 Key: KUDU-2254
                 URL: https://issues.apache.org/jira/browse/KUDU-2254
             Project: Kudu
          Issue Type: Improvement
          Components: spark
    Affects Versions: 1.5.0
            Reporter: Hao Hao


Since KuduContext carries a bunch of information for client connection, such as authentication token, KuduContext should be created in the driver and shared with executors.

Even if we have put comments for KuduContext class (https://github.com/apache/kudu/blob/master/java/kudu-spark/src/main/scala/org/apache/kudu/spark/kudu/KuduContext.scala#L43), it would be great to provide a way to warn users (e.g Logging) about such behavior since this kind of issues are very subtle to detect.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)