You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@tez.apache.org by Johannes Zillmann <jz...@googlemail.com> on 2014/07/23 14:37:15 UTC

Task count

Hey Tez team,

is there some way to get the task count within a vertex from within a task ?
Some equivalent to mapred.map.tasks and mapred.reduce.tasks for map-reduce ?

best
Johannes

Re: Task count

Posted by Hitesh Shah <hi...@apache.org>.

Hi Johannes 

As you have figured out, this information is not available in the *Context APIs exposed to the Processor and/or Inputs/Outputs. Could you file a jira for this improvment? This will be an interesting case to consider given that there is a potential for a VertexManager to change the parallelism at run-time. 

thanks
— Hitesh

On Jul 23, 2014, at 5:37 AM, Johannes Zillmann <jz...@googlemail.com> wrote:

> Hey Tez team,
> 
> is there some way to get the task count within a vertex from within a task ?
> Some equivalent to mapred.map.tasks and mapred.reduce.tasks for map-reduce ?
> 
> best
> Johannes

Re: Task count

Posted by Jeff Zhang <zj...@gmail.com>.

It looks like currently there's no way to get the task count in the IPO
model. What's your use case for requiring this task count ?


On Wed, Jul 23, 2014 at 5:37 AM, Johannes Zillmann <jzillmann@googlemail.com
> wrote:

> Hey Tez team,
>
> is there some way to get the task count within a vertex from within a task
> ?
> Some equivalent to mapred.map.tasks and mapred.reduce.tasks for map-reduce
> ?
>
> best
> Johannes
>



-- 
Best Regards

Jeff Zhang