You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "dori waldman (JIRA)" <ji...@apache.org> on 2016/10/27 12:10:58 UTC
[jira] [Commented] (SPARK-18140) Parquet NPE / Update to 1.9
[ https://issues.apache.org/jira/browse/SPARK-18140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15611691#comment-15611691 ]
dori waldman commented on SPARK-18140:
--------------------------------------
Is there any suggestion how to solve this issue now ? I cant really wait for the next spark version , this issue is in our production
should I recompile spark ? is there any other way to change the parquet jars
> Parquet NPE / Update to 1.9
> ---------------------------
>
> Key: SPARK-18140
> URL: https://issues.apache.org/jira/browse/SPARK-18140
> Project: Spark
> Issue Type: Bug
> Reporter: dori waldman
>
> We are using spark to write parquet files ,
> We are getting nullPointerException due to this issue
> https://issues.apache.org/jira/browse/PARQUET-544
> trying to change to the new fixed parquet version (1.9.0) didnt worked
> In submit.sh added following parameters
> --jars "../lib/parquet-hadoop-1.9.0.jar"
> --conf "spark.driver.userClassPathFirst=true"
> --conf "spark.executor.userClassPathFirst=true"
> Any advise ? its in our production environment
> Thanks
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org