You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Zoltán Borók-Nagy (JIRA)" <ji...@apache.org> on 2019/05/15 14:50:00 UTC
[jira] [Updated] (IMPALA-7936) Enable better control over Parquet
writing
[ https://issues.apache.org/jira/browse/IMPALA-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zoltán Borók-Nagy updated IMPALA-7936:
--------------------------------------
Description:
With the introduction of the Parquet page indexes it became desirable to have more control over how Impala writes Parquet files.
These configuration options (probably implemented as query options) would be:
* enable/disable Parquet page index writing (currently we can do it with a command-line argument)
* set page-size limits based on row count
* Set truncation length for statistics about string values
They'd enable writing more complete tests for page filtering. They'd be also useful for fine-tuning the page index for better performance.
was:
With the introduction of the Parquet page indexes it became desirable to have more control over how Impala writes Parquet files.
These configuration options (probably implemented as query options) would be:
* enable/disable Parquet page index writing (currently we can do it with a command-line argument)
* set page-size limits based on row count
* Set truncation length for string values
They'd enable writing more complete tests for page filtering. They'd be also useful for fine-tuning the page index for better performance.
> Enable better control over Parquet writing
> ------------------------------------------
>
> Key: IMPALA-7936
> URL: https://issues.apache.org/jira/browse/IMPALA-7936
> Project: IMPALA
> Issue Type: Improvement
> Reporter: Zoltán Borók-Nagy
> Assignee: Zoltán Borók-Nagy
> Priority: Major
>
> With the introduction of the Parquet page indexes it became desirable to have more control over how Impala writes Parquet files.
> These configuration options (probably implemented as query options) would be:
> * enable/disable Parquet page index writing (currently we can do it with a command-line argument)
> * set page-size limits based on row count
> * Set truncation length for statistics about string values
> They'd enable writing more complete tests for page filtering. They'd be also useful for fine-tuning the page index for better performance.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org