Join implementations

[Prashant Kommireddi <pr...@gmail.com>]

Hi All,

What would be a good starting point for me to understand the various Join
implementations in Pig codebase?

Thanks,
Prashant

Re: Join implementations

[Jonathan Coveney <jc...@gmail.com>]

A key class that aids in understanding how the physical layer works is the
LogToPhyTranslationVisitor. You can look at the visitor for the LOJoin
logical operator and see what it does for different join types (FRJoin
being the easier).

The code around plan generation is IMHO some of the most difficult to
understand in Pig, so if you can get your head around how to take the
logical plan and stitch together an optimized join (ie skewed join) then it
will be much easier to debug errors in the physical plan, and potentially
make new operators.


2012/11/13 Prashant Kommireddi <pr...@gmail.com>

> Hi All,
>
> What would be a good starting point for me to understand the various Join
> implementations in Pig codebase?
>
> Thanks,
> Prashant
>

Re: Join implementations

[Prashant Kommireddi <pr...@gmail.com>]

Thanks Jon, Ashutosh.


On Tue, Nov 13, 2012 at 7:01 PM, Ashutosh Chauhan <ha...@apache.org>wrote:

> You can start here :
>
> http://squarecog.wordpress.com/2009/11/03/apache-pig-apittsburgh-hadoop-user-group/
>
> Thanks,
> Ashutosh
>
> On Tue, Nov 13, 2012 at 3:20 PM, Prashant Kommireddi <prash1784@gmail.com
> >wrote:
>
> > Hi All,
> >
> > What would be a good starting point for me to understand the various Join
> > implementations in Pig codebase?
> >
> > Thanks,
> > Prashant
> >
>

Re: Join implementations

[Ashutosh Chauhan <ha...@apache.org>]

You can start here :
http://squarecog.wordpress.com/2009/11/03/apache-pig-apittsburgh-hadoop-user-group/

Thanks,
Ashutosh

On Tue, Nov 13, 2012 at 3:20 PM, Prashant Kommireddi <pr...@gmail.com>wrote:

> Hi All,
>
> What would be a good starting point for me to understand the various Join
> implementations in Pig codebase?
>
> Thanks,
> Prashant
>