You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "xuekaiqi (Jira)" <ji...@apache.org> on 2020/04/17 09:45:00 UTC

[jira] [Created] (KYLIN-4450) Add the feature that adjusting spark driver memory adaptively

xuekaiqi created KYLIN-4450:
-------------------------------

             Summary: Add the feature that adjusting spark driver memory adaptively
                 Key: KYLIN-4450
                 URL: https://issues.apache.org/jira/browse/KYLIN-4450
             Project: Kylin
          Issue Type: Improvement
          Components: Storage - Parquet
            Reporter: xuekaiqi
            Assignee: wangrupeng
             Fix For: v4.0.0


For now the cubing job can adaptively adjust the following spark properties to use of resources retionally, but the driver memory of the spark job uploaded to cluster haven't been done.

 
{code:java}
spark.executor.memory
spark.executor.cores
spark.executor.memoryOverhead
spark.executor.instances
spark.sql.shuffle.partitions
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)