You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by ch huang <ju...@gmail.com> on 2013/12/06 02:33:35 UTC

how many job request can be in queue when the first MR JOB is blocked due to lack of resource?

hi,maillist:
                any variables can control it?

Re: how many job request can be in queue when the first MR JOB is blocked due to lack of resource?

Posted by ch huang <ju...@gmail.com>.
i search the code only
src/hadoop-mapreduce1-project/src/contrib/capacity-scheduler/src/test/org/apache/hadoop/mapred/TestCapacitySchedulerConf.java
file has the variables,i did see it on
./src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java


On Fri, Dec 6, 2013 at 10:44 AM, rtejac <rt...@gmail.com> wrote:

> You can take a look at this parameter. This will control number of jobs a
> user can initialize.
>
> *mapred.capacity-scheduler.queue.default.maximum-initialized-jobs-per-user
> = …. *
>
>  On Dec 5, 2013, at 5:33 PM, ch huang <ju...@gmail.com> wrote:
>
>  hi,maillist:
>                 any variables can control it?
>
>
>

Re: how many job request can be in queue when the first MR JOB is blocked due to lack of resource?

Posted by ch huang <ju...@gmail.com>.
i search the code only
src/hadoop-mapreduce1-project/src/contrib/capacity-scheduler/src/test/org/apache/hadoop/mapred/TestCapacitySchedulerConf.java
file has the variables,i did see it on
./src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java


On Fri, Dec 6, 2013 at 10:44 AM, rtejac <rt...@gmail.com> wrote:

> You can take a look at this parameter. This will control number of jobs a
> user can initialize.
>
> *mapred.capacity-scheduler.queue.default.maximum-initialized-jobs-per-user
> = …. *
>
>  On Dec 5, 2013, at 5:33 PM, ch huang <ju...@gmail.com> wrote:
>
>  hi,maillist:
>                 any variables can control it?
>
>
>

Re: how many job request can be in queue when the first MR JOB is blocked due to lack of resource?

Posted by ch huang <ju...@gmail.com>.
i search the code only
src/hadoop-mapreduce1-project/src/contrib/capacity-scheduler/src/test/org/apache/hadoop/mapred/TestCapacitySchedulerConf.java
file has the variables,i did see it on
./src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java


On Fri, Dec 6, 2013 at 10:44 AM, rtejac <rt...@gmail.com> wrote:

> You can take a look at this parameter. This will control number of jobs a
> user can initialize.
>
> *mapred.capacity-scheduler.queue.default.maximum-initialized-jobs-per-user
> = …. *
>
>  On Dec 5, 2013, at 5:33 PM, ch huang <ju...@gmail.com> wrote:
>
>  hi,maillist:
>                 any variables can control it?
>
>
>

Re: how many job request can be in queue when the first MR JOB is blocked due to lack of resource?

Posted by ch huang <ju...@gmail.com>.
i search the code only
src/hadoop-mapreduce1-project/src/contrib/capacity-scheduler/src/test/org/apache/hadoop/mapred/TestCapacitySchedulerConf.java
file has the variables,i did see it on
./src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java


On Fri, Dec 6, 2013 at 10:44 AM, rtejac <rt...@gmail.com> wrote:

> You can take a look at this parameter. This will control number of jobs a
> user can initialize.
>
> *mapred.capacity-scheduler.queue.default.maximum-initialized-jobs-per-user
> = …. *
>
>  On Dec 5, 2013, at 5:33 PM, ch huang <ju...@gmail.com> wrote:
>
>  hi,maillist:
>                 any variables can control it?
>
>
>

Re: how many job request can be in queue when the first MR JOB is blocked due to lack of resource?

Posted by rtejac <rt...@gmail.com>.
You can take a look at this parameter. This will control number of jobs a user can initialize. 

mapred.capacity-scheduler.queue.default.maximum-initialized-jobs-per-user = …. 

On Dec 5, 2013, at 5:33 PM, ch huang <ju...@gmail.com> wrote:

> hi,maillist:
>                 any variables can control it?


Re: how many job request can be in queue when the first MR JOB is blocked due to lack of resource?

Posted by rtejac <rt...@gmail.com>.
You can take a look at this parameter. This will control number of jobs a user can initialize. 

mapred.capacity-scheduler.queue.default.maximum-initialized-jobs-per-user = …. 

On Dec 5, 2013, at 5:33 PM, ch huang <ju...@gmail.com> wrote:

> hi,maillist:
>                 any variables can control it?


Re: how many job request can be in queue when the first MR JOB is blocked due to lack of resource?

Posted by rtejac <rt...@gmail.com>.
You can take a look at this parameter. This will control number of jobs a user can initialize. 

mapred.capacity-scheduler.queue.default.maximum-initialized-jobs-per-user = …. 

On Dec 5, 2013, at 5:33 PM, ch huang <ju...@gmail.com> wrote:

> hi,maillist:
>                 any variables can control it?


Re: how many job request can be in queue when the first MR JOB is blocked due to lack of resource?

Posted by rtejac <rt...@gmail.com>.
You can take a look at this parameter. This will control number of jobs a user can initialize. 

mapred.capacity-scheduler.queue.default.maximum-initialized-jobs-per-user = …. 

On Dec 5, 2013, at 5:33 PM, ch huang <ju...@gmail.com> wrote:

> hi,maillist:
>                 any variables can control it?