You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/11/09 21:31:00 UTC
[jira] [Commented] (ARROW-1785) [Format] Remove VectorLayout
metadata from Flatbuffers metadata
[ https://issues.apache.org/jira/browse/ARROW-1785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246577#comment-16246577 ]
ASF GitHub Bot commented on ARROW-1785:
---------------------------------------
wesm opened a new pull request #1297: WIP ARROW-1785: [Format/C++/Java] Remove VectorLayout from serialized schemas
URL: https://github.com/apache/arrow/pull/1297
What's here so far removes this code from the Flatbuffers schema and the C++ implementation. This logic is a little bit entangled on the Java side, I need some help from @icexelloss or @BryanCutler or @julienledem or someone else to handle the Java refactoring. It might be easiest to preserve the ArrowVectorType/TypeLayout/VectorLayout objects for now but simply remove the Flatbuffers dependency (we do need the names of the vectors in the JSON files used for integration testing)
cc @trxcllnt since we may want to roll in the JS changes in this patch
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
> [Format] Remove VectorLayout metadata from Flatbuffers metadata
> ---------------------------------------------------------------
>
> Key: ARROW-1785
> URL: https://issues.apache.org/jira/browse/ARROW-1785
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, Format, Java - Vectors
> Reporter: Wes McKinney
> Assignee: Wes McKinney
> Labels: pull-request-available
> Fix For: 0.8.0
>
>
> Based on the discussions on the mailing list, we should remove the VectorLayout metadata from the Flatbuffers spec for 0.8.0 since we are already breaking the metadata. We should instead make the buffer layouts an immutable part of the format specification so there is no ambiguity about what buffers accompany each type of field in an Arrow payload
> see also ARROW-1693
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)