You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-user@hadoop.apache.org by Dhanasekaran Anbalagan <bu...@gmail.com> on 2013/02/08 10:26:48 UTC

Fair Scheduler Performance issue.

Hi Guys,

We have using CDH4.0.1, we having quite monitoring with fair scheduler with
not handle with more than one lakh mapper.

Is the Bug or configuration tweaking please guide me guys.

My scenario:

We have already having research and tech pool, We configured equal weight=1
in this manner. When tech pool more than one Lakh mapper job assigned means
hole cluster fully using by tech job, The same time Research got very low
mapper.
Below One Lakh mapper working good, fair scheduler equally split the
resources.  More than one lakh. Not proper with Fair scheduler Algo.

please guide me, How to debug.

-Dhanasekaran


Did I learn something today? If not, I wasted it.