You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "tustvold (via GitHub)" <gi...@apache.org> on 2023/04/27 17:56:36 UTC

[GitHub] [arrow-rs] tustvold opened a new issue, #4149: Parquet Page Index Reader Assumes Consecutive Offsets

tustvold opened a new issue, #4149:
URL: https://github.com/apache/arrow-rs/issues/4149

   **Describe the bug**
   <!--
   A clear and concise description of what the bug is.
   -->
   
   The parquet page index reading logic assumes that the index is contiguous, and in the case of the offset index it assumes it is in order.
   
   The [specification](https://github.com/apache/parquet-format/blob/master/PageIndex.md#technical-approach) strongly suggests this is a valid assumption, however, it never explicitly specifies it. We should probably be defensive and assume that there is a writer out there that doesn't do this.
   
   **To Reproduce**
   <!--
   Steps to reproduce the behavior:
   -->
   
   **Expected behavior**
   <!--
   A clear and concise description of what you expected to happen.
   -->
   
   **Additional context**
   <!--
   Add any other context about the problem here.
   -->


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] tustvold closed issue #4149: Parquet Page Index Reader Assumes Consecutive Offsets

Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold closed issue #4149: Parquet Page Index Reader Assumes Consecutive Offsets
URL: https://github.com/apache/arrow-rs/issues/4149


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] tustvold commented on issue #4149: Parquet Page Index Reader Assumes Consecutive Offsets

Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold commented on issue #4149:
URL: https://github.com/apache/arrow-rs/issues/4149#issuecomment-1536259660

   `label_issue.py` automatically added labels {'parquet'} from #4151


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org