You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kylin.apache.org by "Shaofeng SHI (JIRA)" <ji...@apache.org> on 2016/07/08 10:43:10 UTC

[jira] [Created] (KYLIN-1861) Hive may fail to create flat table with "GC overhead error"

Shaofeng SHI created KYLIN-1861:
-----------------------------------

             Summary: Hive may fail to create flat table with "GC overhead error"
                 Key: KYLIN-1861
                 URL: https://issues.apache.org/jira/browse/KYLIN-1861
             Project: Kylin
          Issue Type: Test
            Reporter: Shaofeng SHI


in conf/kylin_hive_conf.xml, it enables "hive.auto.convert.join.noconditionaltask", which is the optimization about converting common join into mapjoin based on the input file size, and give a big value (300000000, 300MB) to "hive.auto.convert.join.noconditionaltask.size". So if the memory of the mapper isn't enough, it will cause the error.

To fix the error, user can reduce the  "hive.auto.convert.join.noconditionaltask.size" in conf/kylin_hive_conf.xml, and then retry the job.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)