You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Zoltán Borók-Nagy (JIRA)" <ji...@apache.org> on 2018/12/06 18:29:00 UTC

[jira] [Created] (IMPALA-7936) Enable better control over Parquet writing

Zoltán Borók-Nagy created IMPALA-7936:
-----------------------------------------

             Summary: Enable better control over Parquet writing
                 Key: IMPALA-7936
                 URL: https://issues.apache.org/jira/browse/IMPALA-7936
             Project: IMPALA
          Issue Type: Improvement
            Reporter: Zoltán Borók-Nagy


With the introduction of the Parquet page indexes it became desirable to have more control over how Impala writes Parquet files.

These configuration options (probably implemented as query options) would be:
 * enable/disable Parquet page index writing (currently we can do it with a command-line argument)
 * set page-size limits based on row count
 * Set truncation length for string values

They'd enable writing more complete tests for page filtering. They'd be also useful for fine-tuning the page index for better performance.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)