[jira] Updated: (MAPREDUCE-1960) Limit the size of jobconf.

["Mahadev konar (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mahadev konar updated MAPREDUCE-1960:
-------------------------------------

    Attachment: MAPREDUCE-1960-yahoo-hadoop-0.20S.patch

this patch adds a limit parameter at the jobtracker and throws an exception on job submission if the job.xml exceeds this size. The size is set to a default of 10MB. So any job that has a job.xml greater than 10MB will fail on submission.

This patch is for yahoo-0.20 branch with tests. Will upload a patch for trunk soon.



> Limit the size of jobconf.
> --------------------------
>
>                 Key: MAPREDUCE-1960
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1960
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Mahadev konar
>            Assignee: Mahadev konar
>             Fix For: 0.22.0
>
>         Attachments: MAPREDUCE-1960-yahoo-hadoop-0.20S.patch
>
>
> In some of our production cluster users have huge job.xml's that bring down the jobtracker. THis jira is to put limit on the size of the jobconf, so that we dont blow up the memory on jobtracker.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.