You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "h2s (JIRA)" <ji...@apache.org> on 2018/01/17 06:00:00 UTC
[jira] [Commented] (SPARK-21697) NPE & ExceptionInInitializerError
trying to load UTF from HDFS
[ https://issues.apache.org/jira/browse/SPARK-21697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16328304#comment-16328304 ]
h2s commented on SPARK-21697:
-----------------------------
my environment : spark-2.2.0 hadoop-2.10.
delete spark/jars/commons-logging-1.1.3.jar,then it works well
> NPE & ExceptionInInitializerError trying to load UTF from HDFS
> --------------------------------------------------------------
>
> Key: SPARK-21697
> URL: https://issues.apache.org/jira/browse/SPARK-21697
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.1.1
> Environment: Spark Client mode, Hadoop 2.6.0
> Reporter: Steve Loughran
> Priority: Minor
>
> Reported on [the PR|https://github.com/apache/spark/pull/17342#issuecomment-321438157] for SPARK-12868: trying to load a UDF of HDFS is triggering an {{ExceptionInInitializerError}}, caused by an NPE which should only happen if the commons-logging {{LOG}} log is null.
> Hypothesis: the commons logging scan for {{commons-logging.properties}} is happening in the classpath with the HDFS JAR; this is triggering a D/L of the JAR, which needs to force in commons-logging, and, as that's not inited yet, NPEs
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org