fair scheduler issue

[hadoopman <ha...@gmail.com>]

Has anyone had problems with the latest version of hadoop and the fair 
scheduler not placing jobs into pools correctly?  We're digging into it 
currently.  An older version of hadoop (using our config file) is 
working fine however the latest version seems to be putting everything 
into the default pool.

Thoughts on where we can look?

Thanks!

Re: fair scheduler issue

[hadoopman <ha...@gmail.com>]

Here is the version we're currently running.  Pulled from the mapred 
admin page:

Version: 0.20.3-CDH3-SNAPSHOT, r${cloudera.hash}

Compiled: Fri Dec 10 13:33:50 PST 2010 by hadoop

Thanks!


On 04/26/2011 06:52 AM, Saurabh bhutyani wrote:
> Which version of hadoop are you referring to?
>
> Thanks&  Regards,
> Saurabh Bhutyani
>
> Call  : 9820083104
> Gtalk: s4saurabh@gmail.com
>
>
>
> On Tue, Apr 26, 2011 at 5:59 AM, hadoopman<ha...@gmail.com>  wrote:
>
>    
>> Has anyone had problems with the latest version of hadoop and the fair
>> scheduler not placing jobs into pools correctly?  We're digging into it
>> currently.  An older version of hadoop (using our config file) is working
>> fine however the latest version seems to be putting everything into the
>> default pool.
>>
>> Thoughts on where we can look?
>>
>> Thanks!
>>
>>
>>      
>    

Re: fair scheduler issue

[hadoopman <ha...@gmail.com>]

Still digging through it all and playing with multiple versions of 
Hadoop (both the Apache and Cloudera flavors).  Looks like it's a recent 
bug in Cloudera from what we're seeing...

Thanks!


On 04/26/2011 07:15 AM, James Seigel wrote:
> I know cloudera has a bug in their version. They should have filed a
> Jira for it.
>
> Are you getting NPE in the logs?
>
> James
>
> Sent from my mobile. Please excuse the typos.
>
> On 2011-04-26, at 6:53 AM, Saurabh bhutyani<s4...@gmail.com>  wrote:
>
>    
>> Which version of hadoop are you referring to?
>>
>> Thanks&  Regards,
>> Saurabh Bhutyani
>>
>> Call  : 9820083104
>> Gtalk: s4saurabh@gmail.com
>>
>>
>>
>> On Tue, Apr 26, 2011 at 5:59 AM, hadoopman<ha...@gmail.com>  wrote:
>>
>>      
>>> Has anyone had problems with the latest version of hadoop and the fair
>>> scheduler not placing jobs into pools correctly?  We're digging into it
>>> currently.  An older version of hadoop (using our config file) is working
>>> fine however the latest version seems to be putting everything into the
>>> default pool.
>>>
>>> Thoughts on where we can look?
>>>
>>> Thanks!
>>>
>>>
>>>        
>    

Re: fair scheduler issue

[James Seigel <ja...@tynt.com>]

I know cloudera has a bug in their version. They should have filed a
Jira for it.

Are you getting NPE in the logs?

James

Sent from my mobile. Please excuse the typos.

On 2011-04-26, at 6:53 AM, Saurabh bhutyani <s4...@gmail.com> wrote:

> Which version of hadoop are you referring to?
>
> Thanks & Regards,
> Saurabh Bhutyani
>
> Call  : 9820083104
> Gtalk: s4saurabh@gmail.com
>
>
>
> On Tue, Apr 26, 2011 at 5:59 AM, hadoopman <ha...@gmail.com> wrote:
>
>> Has anyone had problems with the latest version of hadoop and the fair
>> scheduler not placing jobs into pools correctly?  We're digging into it
>> currently.  An older version of hadoop (using our config file) is working
>> fine however the latest version seems to be putting everything into the
>> default pool.
>>
>> Thoughts on where we can look?
>>
>> Thanks!
>>
>>

Re: fair scheduler issue

[Saurabh bhutyani <s4...@gmail.com>]

Which version of hadoop are you referring to?

Thanks & Regards,
Saurabh Bhutyani

Call  : 9820083104
Gtalk: s4saurabh@gmail.com



On Tue, Apr 26, 2011 at 5:59 AM, hadoopman <ha...@gmail.com> wrote:

> Has anyone had problems with the latest version of hadoop and the fair
> scheduler not placing jobs into pools correctly?  We're digging into it
> currently.  An older version of hadoop (using our config file) is working
> fine however the latest version seems to be putting everything into the
> default pool.
>
> Thoughts on where we can look?
>
> Thanks!
>
>