You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/04/05 02:51:00 UTC
[GitHub] [arrow] danilofebba opened a new issue #9886: ArrowNotImplementedError: Cannot write struct type 'test2' with no child field to Parquet. Consider adding a dummy child field.
danilofebba opened a new issue #9886:
URL: https://github.com/apache/arrow/issues/9886
When I make a request for a especific API, its response returns within json a subdict empty. this is preventing me from sending the response directly to a parquet file. there is some workaround for this problem?
```python
import pandas as pd
data = [{'test1':1, 'test2':{}}]
df = pd.DataFrame(data)
df.to_parquet(path='test.parquet', engine='pyarrow')
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] emkornfield commented on issue #9886: ArrowNotImplementedError: Cannot write struct type 'test2' with no child field to Parquet. Consider adding a dummy child field.
Posted by GitBox <gi...@apache.org>.
emkornfield commented on issue #9886:
URL: https://github.com/apache/arrow/issues/9886#issuecomment-815022497
Converting from Pandas to arrow with a specified schema and then writing the arrow table should work. The problem is parquet requires leaf primitives fields. The conversion to Arrow can't infer the intended columns in because the dictionary is empty.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] emkornfield closed issue #9886: ArrowNotImplementedError: Cannot write struct type 'test2' with no child field to Parquet. Consider adding a dummy child field.
Posted by GitBox <gi...@apache.org>.
emkornfield closed issue #9886:
URL: https://github.com/apache/arrow/issues/9886
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org