You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Torstein Sørnes (Jira)" <ji...@apache.org> on 2021/06/08 12:22:00 UTC
[jira] [Updated] (ARROW-13007) Supporting Sets (HashSets)
[ https://issues.apache.org/jira/browse/ARROW-13007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Torstein Sørnes updated ARROW-13007:
------------------------------------
Description:
Having support for Sets would be great.
{{It is possible to do:}}
{{ pd.DataFrame([[\\{'1': None}]], columns =["s"]).to_feather('/tmp/x')}}
But using a Set instead of a dictionary is not possible
{{pd.DataFrame([[\\{'1'}]], columns =["s"]).to_feather('/tmp/x')}}
{{ArrowInvalid: ("Could not convert \{'1'} with type set: did not recognize Python value type when inferring an Arrow data type", 'Conversion failed for column s with type object')}}
was:
Having support for Sets would be great.
It is possible to do:
```
pd.DataFrame([[\{'1': None}]], columns =["s"]).to_feather('/tmp/x')
```
But using a Set instead of a dictionary is not possible
```
pd.DataFrame([[\{'1'}]], columns =["s"]).to_feather('/tmp/x')
ArrowInvalid: ("Could not convert \{'1'} with type set: did not recognize Python value type when inferring an Arrow data type", 'Conversion failed for column s with type object')
```
> Supporting Sets (HashSets)
> --------------------------
>
> Key: ARROW-13007
> URL: https://issues.apache.org/jira/browse/ARROW-13007
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Python
> Affects Versions: 4.0.1
> Reporter: Torstein Sørnes
> Priority: Major
>
> Having support for Sets would be great.
>
> {{It is possible to do:}}
> {{ pd.DataFrame([[\\{'1': None}]], columns =["s"]).to_feather('/tmp/x')}}
> But using a Set instead of a dictionary is not possible
> {{pd.DataFrame([[\\{'1'}]], columns =["s"]).to_feather('/tmp/x')}}
>
> {{ArrowInvalid: ("Could not convert \{'1'} with type set: did not recognize Python value type when inferring an Arrow data type", 'Conversion failed for column s with type object')}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)