You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-dev@hadoop.apache.org by "Weiwei Yang (JIRA)" <ji...@apache.org> on 2017/02/15 10:27:41 UTC

[jira] [Created] (MAPREDUCE-6847) Job history server should release jobs from cache after a fixed duration

Weiwei Yang created MAPREDUCE-6847:
--------------------------------------

             Summary: Job history server should release jobs from cache after a fixed duration
                 Key: MAPREDUCE-6847
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6847
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: jobhistoryserver
            Reporter: Weiwei Yang
            Assignee: Weiwei Yang


We found history server is consuming a lot of memory when there are large jobs (with more than 100k of tasks in a single job). Currently JHS cache only evicts entries with size, it's better to add the time expiration as well to reduce heap usage if job has no one accessing for sometime.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org