You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Dominic Dennenmoser (Jira)" <ji...@apache.org> on 2020/05/12 20:42:00 UTC

[jira] [Updated] (ARROW-8779) [R] Unable to write Struct Layout to file (.arrow, .parquet)

     [ https://issues.apache.org/jira/browse/ARROW-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dominic Dennenmoser updated ARROW-8779:
---------------------------------------
    Description: 
It seems there is no method implemented to write a StructArrow (within a TableArrow) to file. A common case would be list columns in a dataframe. If I have understood the documentation correctly, the should be realisable within the current C++ library framework.

I tested this with the follow df structure:
{code:none}
df
|-- ID <column: string>
|-- Data <column: list>
|    |-- a <column: string>
|    |-- b <column: integer>
|    |-- c <column: factor>
|    |-- d <column: double>{code}
 I got the follow error message:
{code:none}
Error in Table__from_dots(dots, schema) : NotImplemented: Converting vector to arrow type struct<a: string, b: int32, c: dictionary<values=string, indices=int8, ordered=0>, d: double> not implemented{code}
 I performed this with {{R}} 3.6.1 and {{arrow}} 0.17.0.

  was:
It seems there is no method implemented to write a StructArrow (within a TableArrow) to file. A common case would be list columns in a dataframe. If I have understood the documentation correctly, the should be realisable within the current C++ library framework.

I tested this with the follow df structure:
{code:none}
df
|-- ID <column: string>
|-- Data <column: list>
|    |-- a <column: string>
|    |-- b <column: integer>
|    |-- c <column: factor>
|    |-- d <column: double>{code}
 I got the follow error message:
{code:none}
Error in Table__from_dots(dots, schema) : NotImplemented: Converting vector to arrow type struct<a: string, b: int32, c: dictionary<values=string, indices=int8, ordered=0>, d: double> not implemented{code}
 


> [R] Unable to write Struct Layout to file (.arrow, .parquet)
> ------------------------------------------------------------
>
>                 Key: ARROW-8779
>                 URL: https://issues.apache.org/jira/browse/ARROW-8779
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: R
>    Affects Versions: 0.16.0, 0.17.0
>            Reporter: Dominic Dennenmoser
>            Priority: Major
>              Labels: features, patch
>
> It seems there is no method implemented to write a StructArrow (within a TableArrow) to file. A common case would be list columns in a dataframe. If I have understood the documentation correctly, the should be realisable within the current C++ library framework.
> I tested this with the follow df structure:
> {code:none}
> df
> |-- ID <column: string>
> |-- Data <column: list>
> |    |-- a <column: string>
> |    |-- b <column: integer>
> |    |-- c <column: factor>
> |    |-- d <column: double>{code}
>  I got the follow error message:
> {code:none}
> Error in Table__from_dots(dots, schema) : NotImplemented: Converting vector to arrow type struct<a: string, b: int32, c: dictionary<values=string, indices=int8, ordered=0>, d: double> not implemented{code}
>  I performed this with {{R}} 3.6.1 and {{arrow}} 0.17.0.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)