You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Krishnan Narayanan <kr...@gmail.com> on 2013/10/09 23:35:19 UTC

Pig Map-reduce process

Hi All,

Can someone explain map-reduce process flow for the below script?

b =  FOREACH a{ P_EVAR =  REPLACE(PEVAR35,'-','');
               P_LEN = LENGTH(P_EVAR);
               P_EVAR_10 = (LENGTH(P_EVAR) == 11 ?
CONCAT(SUBSTRING(P_EVAR,8,11),SUBSTRING(P_EVAR,4,8)) : (LENGTH(P_EVAR) ==
12 ?CONCAT(SUBSTRING(P_EVAR,8,12),SUBSTRING(P_EVAR,4,8)) : (LENGTH(P_EVAR)
== 13 ? CONCAT(SUBSTRING(P_EVAR,9,13),SUBSTRING(P_EVAR,4,9)) : P_EVAR )));
GENERATE P_EVAR,P_LEN,P_EVAR_10;
};

Thanks
Krishnan

Re: Pig Map-reduce process

Posted by Adam Kawa <ka...@gmail.com>.
Did you try to use EXPLAIN operator?
http://pig.apache.org/docs/r0.12.0/test.html#explain.



2013/10/9 Krishnan Narayanan <kr...@gmail.com>

> Hi All,
>
> Can someone explain map-reduce process flow for the below script?
>
> b =  FOREACH a{ P_EVAR =  REPLACE(PEVAR35,'-','');
>                P_LEN = LENGTH(P_EVAR);
>                P_EVAR_10 = (LENGTH(P_EVAR) == 11 ?
> CONCAT(SUBSTRING(P_EVAR,8,11),SUBSTRING(P_EVAR,4,8)) : (LENGTH(P_EVAR) ==
> 12 ?CONCAT(SUBSTRING(P_EVAR,8,12),SUBSTRING(P_EVAR,4,8)) : (LENGTH(P_EVAR)
> == 13 ? CONCAT(SUBSTRING(P_EVAR,9,13),SUBSTRING(P_EVAR,4,9)) : P_EVAR )));
> GENERATE P_EVAR,P_LEN,P_EVAR_10;
> };
>
> Thanks
> Krishnan
>