You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "mapleFU (via GitHub)" <gi...@apache.org> on 2023/05/19 19:53:01 UTC

[GitHub] [arrow] mapleFU commented on pull request #35694: GH-35692: [C++][Parquet] Parquet: tiny fixing FixedSizeListReader::AssembleArray

mapleFU commented on PR #35694:
URL: https://github.com/apache/arrow/pull/35694#issuecomment-1555161271

   @spenczar Hi, I think it's just a reader bug. The written data is not corrupt.
   
   1. Parquet will regard `FixedSizeList` as regular list, and write rep-levels and def-levels if possible
   2. When read from Parquet, if no null (or nested null, like `FixedSizeList` doesn't has null but it parent has) is contained, the file can be read correctly
   3. However, when read from Parquet with nullable, the `AssembleArray` will not work well. It takes continuous "child array" and child offsets, and need to reserve extra padding space for "null". Previous reader doesn't implement it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org