[jira] [Commented] (ARROW-1389) Support arbitrary precision integers

["Wes McKinney (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137325#comment-16137325 ] 

Wes McKinney commented on ARROW-1389:
-------------------------------------

Sounds like this is a new logical type for the Arrow format. What memory representation do you suggest for an arbitrary precision integer (which can be stored as Binary values)? There's VLQ integers, but what other options are out there and well supported? 

> Support arbitrary precision integers
> ------------------------------------
>
>                 Key: ARROW-1389
>                 URL: https://issues.apache.org/jira/browse/ARROW-1389
>             Project: Apache Arrow
>          Issue Type: Improvement
>            Reporter: Philipp Moritz
>            Priority: Minor
>
> For Python serialization it would be great if we had Arrow support for arbitrary precision integers, see the comment in
> https://github.com/apache/arrow/blob/de7c6715ba244e119913bfa31b8de46dbbd450bf/python/pyarrow/tests/test_serialization.py#L183
> Long integers are for example used in the uuid python module and having this would increase serialization performance for uuids and also make the code cleaner.
> I wonder if this is more generally useful too, any thoughts?



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)