You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-issues@hadoop.apache.org by "Jason Lowe (JIRA)" <ji...@apache.org> on 2015/06/29 19:55:05 UTC

[jira] [Updated] (MAPREDUCE-6376) Add avro binary support for jhist files

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jason Lowe updated MAPREDUCE-6376:
----------------------------------
    Summary: Add avro binary support for jhist files  (was: Fix long load times of .jhist file in JobHistoryServer)

Thanks for updating the patch, Ray.  Patch looks good overall except for one issue.  In JobHistoryEventHandler, we can silently ignore an unrecognized encoding directive and fall back to JSON encoding.  This should either throw an error or minimally log a warning stating it doesn't recognize the value, which values are valid, and that it is falling back to json format.

> Add avro binary support for jhist files
> ---------------------------------------
>
>                 Key: MAPREDUCE-6376
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6376
>             Project: Hadoop Map/Reduce
>          Issue Type: Sub-task
>          Components: jobhistoryserver
>    Affects Versions: 2.7.0
>            Reporter: Ray Chiang
>            Assignee: Ray Chiang
>              Labels: supportability
>         Attachments: MAPREDUCE-6376.001.patch, MAPREDUCE-6376.002.patch, MAPREDUCE-6376.003.patch, MAPREDUCE-6376.004.patch
>
>
> When you click on a Job link in the JHS Web UI, it loads the .jhist file.  For jobs which have a large number of tasks, the load time can break UI responsiveness.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)