You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Joris Van den Bossche (JIRA)" <ji...@apache.org> on 2019/07/11 13:10:00 UTC

[jira] [Updated] (ARROW-5907) base64 support of bytes-like

     [ https://issues.apache.org/jira/browse/ARROW-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joris Van den Bossche updated ARROW-5907:
-----------------------------------------
    Description: 
Currently pyarrow could not be encoded by base64:

{code}
t = numpy.arange(25, dtype=np.float64)
a = pyarrow.array(t)

s1 = base64.b64encode(t) # this works
s2 = base64.b64encode(a)
{code}

gives "a bytes-like object is required not 'pyarrow.lib.DoubleArray'"

Because it is not bytes-like

A possible scenario could be if we want to push data(like ndarray) to Redis in Python and get it from other language like Java. Arrow could be used to interact between Python and Java using Array of Arrow.

Adding this feature would support some in-queue and out-queue operations like Redis

  was:
Currently pyarrow could not be encoded by base64

Because it is not bytes-like

A possible scenario could be if we want to push data(like ndarray) to Redis in Python and get it from other language like Java. Arrow could be used to interact between Python and Java using Array of Arrow.

Adding this feature would support some in-queue and out-queue operations like Redis


> base64 support of bytes-like
> ----------------------------
>
>                 Key: ARROW-5907
>                 URL: https://issues.apache.org/jira/browse/ARROW-5907
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: Python
>    Affects Versions: 0.14.0
>            Reporter: Litchy
>            Priority: Major
>             Fix For: 0.14.0
>
>
> Currently pyarrow could not be encoded by base64:
> {code}
> t = numpy.arange(25, dtype=np.float64)
> a = pyarrow.array(t)
> s1 = base64.b64encode(t) # this works
> s2 = base64.b64encode(a)
> {code}
> gives "a bytes-like object is required not 'pyarrow.lib.DoubleArray'"
> Because it is not bytes-like
> A possible scenario could be if we want to push data(like ndarray) to Redis in Python and get it from other language like Java. Arrow could be used to interact between Python and Java using Array of Arrow.
> Adding this feature would support some in-queue and out-queue operations like Redis



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)