You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Vihang Karajgaonkar (JIRA)" <ji...@apache.org> on 2018/04/27 23:10:00 UTC

[jira] [Created] (HIVE-19344) Change default value of msck.repair.batch.size

Vihang Karajgaonkar created HIVE-19344:
------------------------------------------

             Summary: Change default value of msck.repair.batch.size 
                 Key: HIVE-19344
                 URL: https://issues.apache.org/jira/browse/HIVE-19344
             Project: Hive
          Issue Type: Improvement
            Reporter: Vihang Karajgaonkar
            Assignee: Vihang Karajgaonkar


{{msck.repair.batch.size}} default to 0 which means msck will try to add all the partitions in one API call to HMS. This can potentially add huge memory pressure on HMS. The default value should be changed to a reasonable number so that in case of large number of partitions we can batch the addition of partitions. Same goes for {{msck.repair.batch.max.retries}}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)