You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@tez.apache.org by Rohini Palaniswamy <ro...@gmail.com> on 2013/11/06 20:41:38 UTC
Re: Combiner on a Tez edge
Looks like it is not an issue in Tez. Looking at the code, MRCombiner
handles both old and new fine and it is set on OnFileSortedOutput and
ShuffleMergedInput.
On Wed, Nov 6, 2013 at 11:19 AM, Rohini Palaniswamy <rohini.aditya@gmail.com
> wrote:
> Is Tez also affected by
> https://issues.apache.org/jira/browse/MAPREDUCE-5221 ? i.e is the
> combiner applied on both sides of an edge or only on the outbound side
> (map) and not on the inbound side (reduce) for new MR api ?
>
> Regards,
> Rohini
>
Re: Combiner on a Tez edge
Posted by Siddharth Seth <se...@gmail.com>.
Right, it should run with the old or new mapred API.
Thanks
- Sid
On Wed, Nov 6, 2013 at 11:41 AM, Rohini Palaniswamy <rohini.aditya@gmail.com
> wrote:
> Looks like it is not an issue in Tez. Looking at the code, MRCombiner
> handles both old and new fine and it is set on OnFileSortedOutput and
> ShuffleMergedInput.
>
>
> On Wed, Nov 6, 2013 at 11:19 AM, Rohini Palaniswamy <
> rohini.aditya@gmail.com
> > wrote:
>
> > Is Tez also affected by
> > https://issues.apache.org/jira/browse/MAPREDUCE-5221 ? i.e is the
> > combiner applied on both sides of an edge or only on the outbound side
> > (map) and not on the inbound side (reduce) for new MR api ?
> >
> > Regards,
> > Rohini
> >
>
Re: Combiner on a Tez edge
Posted by Siddharth Seth <ss...@apache.org>.
Right, it should run with the old or new mapred API.
Thanks
- Sid
On Wed, Nov 6, 2013 at 11:41 AM, Rohini Palaniswamy <rohini.aditya@gmail.com
> wrote:
> Looks like it is not an issue in Tez. Looking at the code, MRCombiner
> handles both old and new fine and it is set on OnFileSortedOutput and
> ShuffleMergedInput.
>
>
> On Wed, Nov 6, 2013 at 11:19 AM, Rohini Palaniswamy <
> rohini.aditya@gmail.com
> > wrote:
>
> > Is Tez also affected by
> > https://issues.apache.org/jira/browse/MAPREDUCE-5221 ? i.e is the
> > combiner applied on both sides of an edge or only on the outbound side
> > (map) and not on the inbound side (reduce) for new MR api ?
> >
> > Regards,
> > Rohini
> >
>
Re: Combiner on a Tez edge
Posted by Siddharth Seth <ss...@apache.org>.
Right, it should run with the old or new mapred API.
Thanks
- Sid
On Wed, Nov 6, 2013 at 11:41 AM, Rohini Palaniswamy <rohini.aditya@gmail.com
> wrote:
> Looks like it is not an issue in Tez. Looking at the code, MRCombiner
> handles both old and new fine and it is set on OnFileSortedOutput and
> ShuffleMergedInput.
>
>
> On Wed, Nov 6, 2013 at 11:19 AM, Rohini Palaniswamy <
> rohini.aditya@gmail.com
> > wrote:
>
> > Is Tez also affected by
> > https://issues.apache.org/jira/browse/MAPREDUCE-5221 ? i.e is the
> > combiner applied on both sides of an edge or only on the outbound side
> > (map) and not on the inbound side (reduce) for new MR api ?
> >
> > Regards,
> > Rohini
> >
>