You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Alex Levenson (JIRA)" <ji...@apache.org> on 2014/07/24 08:20:41 UTC

[jira] [Created] (PARQUET-37) Record filtering in the filter2 API could possibly short circuit

Alex Levenson created PARQUET-37:
------------------------------------

             Summary: Record filtering in the filter2 API could possibly short circuit
                 Key: PARQUET-37
                 URL: https://issues.apache.org/jira/browse/PARQUET-37
             Project: Parquet
          Issue Type: Improvement
          Components: parquet-mr
            Reporter: Alex Levenson
            Priority: Minor


Record level filtering in the filter2 api still requires visiting every value of the record. We may be able to short circuit as soon as the filter predicate reaches a known state.

Another approach would be to figure out how to get essentially random access to the values referenced by the predicate and check them first. This could be tricky because it would require re-structuring the assembly algorithm. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)