You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2019/10/23 10:48:00 UTC

[jira] [Updated] (ARROW-6958) [Python] tutorial script for arrow in spark throws error

     [ https://issues.apache.org/jira/browse/ARROW-6958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joris Van den Bossche updated ARROW-6958:
-----------------------------------------
    Summary: [Python] tutorial script for arrow in spark throws error  (was: [python] tutorial script for arrow in spark throws error)

> [Python] tutorial script for arrow in spark throws error
> --------------------------------------------------------
>
>                 Key: ARROW-6958
>                 URL: https://issues.apache.org/jira/browse/ARROW-6958
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: Java, Python
>    Affects Versions: 0.15.0
>         Environment: Ubuntu v 18. Cluster spun up on google dataproc - see startup for specs of cluster
>            Reporter: Karl Svensson
>            Priority: Major
>              Labels: newbie
>         Attachments: arrow_error.txt, start-cluster-nl.ps1.txt
>
>
> Running the arrow example for pyspark ([found here |[https://github.com/apache/spark/blob/master/examples/src/main/python/sql/arrow.py]]) causes a java.lang.IllegalArgumentException error. Running the same script with pyarrow v 0.8.0 causes the script to run correctly.
> Attached are the startup settings in google dataproc I'm using to create the cluster, as well as the output (with error text). It isn't immediately obvious to me what is causing the issue.
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)