You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/07/27 15:48:18 UTC
[GitHub] [arrow-rs] tustvold opened a new issue, #2198: Integrate Record Skipping into Column Reader Fuzz Tests
tustvold opened a new issue, #2198:
URL: https://github.com/apache/arrow-rs/issues/2198
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
`parquet::arrow::arrow_reader` contains a fairly extensive set of tests under `run_single_column_reader_tests` that are used to fuzz test the arrow readers. It would significantly boost the coverage of the record skipping logic if we could integrate the row skipping logic into this harness
**Describe the solution you'd like**
Add an optional row selection to `TestOptions` and add examples of using this to the `all_options` list in `run_single_column_reader_tests`.
**Describe alternatives you've considered**
We could not do this
**Additional context**
- #2197
- #1792
FYI @Ted-Jiang
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] tustvold commented on issue #2198: Integrate Record Skipping into Column Reader Fuzz Tests
Posted by GitBox <gi...@apache.org>.
tustvold commented on issue #2198:
URL: https://github.com/apache/arrow-rs/issues/2198#issuecomment-1203722736
Where did we get with this, I think this is the major thing to be confident enough to make the APIs public?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] tustvold closed issue #2198: Integrate Record Skipping into Column Reader Fuzz Tests
Posted by GitBox <gi...@apache.org>.
tustvold closed issue #2198: Integrate Record Skipping into Column Reader Fuzz Tests
URL: https://github.com/apache/arrow-rs/issues/2198
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] tustvold commented on issue #2198: Integrate Record Skipping into Column Reader Fuzz Tests
Posted by GitBox <gi...@apache.org>.
tustvold commented on issue #2198:
URL: https://github.com/apache/arrow-rs/issues/2198#issuecomment-1203801270
Awesome, absolutely no rush on this, was purely curious if you wanted me to pick this up :smile:
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] Ted-Jiang commented on issue #2198: Integrate Record Skipping into Column Reader Fuzz Tests
Posted by GitBox <gi...@apache.org>.
Ted-Jiang commented on issue #2198:
URL: https://github.com/apache/arrow-rs/issues/2198#issuecomment-1203810632
haha, i will try to figure this out ! I feel I can learn a lot from itπ
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] Ted-Jiang commented on issue #2198: Integrate Record Skipping into Column Reader Fuzz Tests
Posted by GitBox <gi...@apache.org>.
Ted-Jiang commented on issue #2198:
URL: https://github.com/apache/arrow-rs/issues/2198#issuecomment-1203797611
I will try to finish this until this weekend.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] Ted-Jiang commented on issue #2198: Integrate Record Skipping into Column Reader Fuzz Tests
Posted by GitBox <gi...@apache.org>.
Ted-Jiang commented on issue #2198:
URL: https://github.com/apache/arrow-rs/issues/2198#issuecomment-1197636431
Will cover it up π, hope no bug any more!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org