You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kudu.apache.org by "Hao Hao (JIRA)" <ji...@apache.org> on 2018/01/09 22:57:00 UTC
[jira] [Created] (KUDU-2254) Warn spark applications that create
KuduContext in the driver and share it with exectuors
Hao Hao created KUDU-2254:
-----------------------------
Summary: Warn spark applications that create KuduContext in the driver and share it with exectuors
Key: KUDU-2254
URL: https://issues.apache.org/jira/browse/KUDU-2254
Project: Kudu
Issue Type: Improvement
Components: spark
Affects Versions: 1.5.0
Reporter: Hao Hao
Since KuduContext carries a bunch of information for client connection, such as authentication token, KuduContext should be created in the driver and shared with executors.
Even if we have put comments for KuduContext class (https://github.com/apache/kudu/blob/master/java/kudu-spark/src/main/scala/org/apache/kudu/spark/kudu/KuduContext.scala#L43), it would be great to provide a way to warn users (e.g Logging) about such behavior since this kind of issues are very subtle to detect.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)