[GitHub] [arrow-rs] tustvold commented on issue #1915: incompatible arrow schema, expected struct got List

[GitBox <gi...@apache.org>]

tustvold commented on issue #1915:
URL: https://github.com/apache/arrow-rs/issues/1915#issuecomment-1164214873

   Sorry for the slow response, I've been away for the last few days. My immediate hunch is that the writer is embedding a garbled arrow schema in the metadata.
   
   As part of the backwards compatibility logic documented in https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#lists, the schema inference correctly interprets this as a list on read, which then errors because this doesn't match what has been written.
   
   This is a bug, which should be fixed, but I would also recommend writing a (LIST) type as documented in the link above - and not relying on a non-standard representation.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org