You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Juan Yu (JIRA)" <ji...@apache.org> on 2018/03/05 22:08:00 UTC

[jira] [Created] (IMPALA-6608) Write in parallel with "Clustered" hint if there is enough memory

Juan Yu created IMPALA-6608:
-------------------------------

             Summary: Write in parallel with "Clustered" hint if there is enough memory
                 Key: IMPALA-6608
                 URL: https://issues.apache.org/jira/browse/IMPALA-6608
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
    Affects Versions: Impala 2.11.0
            Reporter: Juan Yu


With Clustered hint, Impala will write partitions one by one to avoid using too much memory for parquet writer. This is a bit conservative.

When there is enough memory (within query memory limit setting), it's fine to write multiple partitions in parallel to speed up queries.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)