You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Alex Levenson (JIRA)" <ji...@apache.org> on 2014/07/24 08:20:41 UTC
[jira] [Created] (PARQUET-37) Record filtering in the filter2 API
could possibly short circuit
Alex Levenson created PARQUET-37:
------------------------------------
Summary: Record filtering in the filter2 API could possibly short circuit
Key: PARQUET-37
URL: https://issues.apache.org/jira/browse/PARQUET-37
Project: Parquet
Issue Type: Improvement
Components: parquet-mr
Reporter: Alex Levenson
Priority: Minor
Record level filtering in the filter2 api still requires visiting every value of the record. We may be able to short circuit as soon as the filter predicate reaches a known state.
Another approach would be to figure out how to get essentially random access to the values referenced by the predicate and check them first. This could be tricky because it would require re-structuring the assembly algorithm.
--
This message was sent by Atlassian JIRA
(v6.2#6252)