You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by "alippai (via GitHub)" <gi...@apache.org> on 2024/05/13 16:13:49 UTC

Re: [I] Reading FixedSizeList from parquet is slower than reading values into more rows [arrow]

alippai commented on issue #34510:
URL: https://github.com/apache/arrow/issues/34510#issuecomment-2108124272

   @AlenkaF the above is still relevant for the new `FixedShapeTensorType` and similar types as of version 16.
   I'm not sure if the metadata of the Arrow FixedSizeList should be used for optimized parquet read or maybe the right solution is extending parquet so it supports dense, fixed length lists not only sparse nested types natively.
   
   What do you think overall?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org