You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "dori waldman (JIRA)" <ji...@apache.org> on 2016/10/27 12:10:58 UTC

[jira] [Commented] (SPARK-18140) Parquet NPE / Update to 1.9

    [ https://issues.apache.org/jira/browse/SPARK-18140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15611691#comment-15611691 ] 

dori waldman commented on SPARK-18140:
--------------------------------------

Is there any suggestion how to solve this issue now ? I cant really wait for the next spark version , this issue is in our production 

should I recompile spark ? is there any other way to change the parquet jars 

> Parquet NPE / Update to 1.9
> ---------------------------
>
>                 Key: SPARK-18140
>                 URL: https://issues.apache.org/jira/browse/SPARK-18140
>             Project: Spark
>          Issue Type: Bug
>            Reporter: dori waldman
>
> We are using spark to write parquet files , 
> We are getting nullPointerException due to this issue 
> https://issues.apache.org/jira/browse/PARQUET-544
> trying to change to the new fixed parquet version (1.9.0) didnt worked 
> In submit.sh added following parameters
> --jars "../lib/parquet-hadoop-1.9.0.jar"
> --conf "spark.driver.userClassPathFirst=true"
> --conf "spark.executor.userClassPathFirst=true"
> Any advise ? its in our production environment
> Thanks 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org