You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@pig.apache.org by Johannes Zillmann <jz...@101tec.com> on 2008/03/12 17:58:29 UTC

store func

Hi folks,

i like to know more about the characteristics of a StoreFunc.
Does it produce always 1 file or can it produce more files (like the 
hadoop reduce phase does/can) ?
Does it run as map or reduce task or at the pig-server side ?

Thank You
Johannes


-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 
101tec GmbH

Halle (Saale), Saxony-Anhalt, Germany
http://www.101tec.com

Re: store func

Posted by Johannes Zillmann <jz...@101tec.com>.

Hey Benjamin,

thanks a lot!

Johannes

Benjamin Reed wrote:
> It's exactly like Hadoop reduce: each task produces one file. So a foreach of 
> a group by with parallel of 100 will produce 100 output files.
>
> ben
>
> On Wednesday 12 March 2008 09:58:29 Johannes Zillmann wrote:
>   
>> Hi folks,
>>
>> i like to know more about the characteristics of a StoreFunc.
>> Does it produce always 1 file or can it produce more files (like the
>> hadoop reduce phase does/can) ?
>> Does it run as map or reduce task or at the pig-server side ?
>>
>> Thank You
>> Johannes
>>     
>
>
>
>   


-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 
101tec GmbH

Halle (Saale), Saxony-Anhalt, Germany
http://www.101tec.com

Re: store func

Posted by Benjamin Reed <br...@yahoo-inc.com>.

It's exactly like Hadoop reduce: each task produces one file. So a foreach of 
a group by with parallel of 100 will produce 100 output files.

ben

On Wednesday 12 March 2008 09:58:29 Johannes Zillmann wrote:
> Hi folks,
>
> i like to know more about the characteristics of a StoreFunc.
> Does it produce always 1 file or can it produce more files (like the
> hadoop reduce phase does/can) ?
> Does it run as map or reduce task or at the pig-server side ?
>
> Thank You
> Johannes