You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "tustvold (via GitHub)" <gi...@apache.org> on 2023/05/31 14:11:15 UTC

[GitHub] [arrow-rs] tustvold opened a new issue, #4321: Incorrect PageMetadata Row Count returned for V1 DataPage

tustvold opened a new issue, #4321:
URL: https://github.com/apache/arrow-rs/issues/4321

   **Describe the bug**
   <!--
   A clear and concise description of what the bug is.
   -->
   
   `PageReader::peek_next_page` for `SerializedPageReader` and `InMemoryPageReader` returns num_values for DataPageV1. This is not the row count, and is instead the number of levels. For a column with repetition levels, this will therefore be incorrect.
   
   This in turn will cause the skipping logic to misbehave
   
   **To Reproduce**
   <!--
   Steps to reproduce the behavior:
   -->
   
   **Expected behavior**
   <!--
   A clear and concise description of what you expected to happen.
   -->
   
   **Additional context**
   <!--
   Add any other context about the problem here.
   -->


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] tustvold closed issue #4321: Incorrect PageMetadata Row Count returned for V1 DataPage

Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold closed issue #4321: Incorrect PageMetadata Row Count returned for V1 DataPage
URL: https://github.com/apache/arrow-rs/issues/4321


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] tustvold commented on issue #4321: Incorrect PageMetadata Row Count returned for V1 DataPage

Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold commented on issue #4321:
URL: https://github.com/apache/arrow-rs/issues/4321#issuecomment-1573884707

   `label_issue.py` automatically added labels {'parquet'} from #4326


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org