You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 00:49:00 UTC
[jira] [Commented] (SPARK-23874) Upgrade apache/arrow to 0.10.0
[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564570#comment-16564570 ]
Apache Spark commented on SPARK-23874:
--------------------------------------
User 'BryanCutler' has created a pull request for this issue:
https://github.com/apache/spark/pull/21939
> Upgrade apache/arrow to 0.10.0
> ------------------------------
>
> Key: SPARK-23874
> URL: https://issues.apache.org/jira/browse/SPARK-23874
> Project: Spark
> Issue Type: Improvement
> Components: PySpark
> Affects Versions: 2.3.0
> Reporter: Xiao Li
> Assignee: Bryan Cutler
> Priority: Major
>
> Version 0.10.0 will allow for the following improvements and bug fixes:
> * Allow for adding BinaryType support
> * Bug fix related to array serialization ARROW-1973
> * Python2 str will be made into an Arrow string instead of bytes ARROW-2101
> * Python bytearrays are supported in as input to pyarrow ARROW-2141
> * Java has common interface for reset to cleanup complex vectors in Spark ArrowWriter ARROW-1962
> * Cleanup pyarrow type equality checks ARROW-2423
> * ArrowStreamWriter should not hold references to ArrowBlocks ARROW-2632, ARROW-2645
> * Improved low level handling of messages for RecordBatch ARROW-2704
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org