You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by Vibhor Gupta <vi...@gmail.com> on 2012/05/05 20:20:10 UTC

Loading intermediate data from multiple files

Hi ,
We are working on a project where we are trying to reuse the intermediate
data.
We are splitting the file based on the equivilance class.
Now we are stuck on a point where we need to read from these files.

Can you please specify how to that.

thanks !!

-- 
Thanks ,
Vibhor Gupta

Masters in Computer Science
North Carolina State University

Re: Loading intermediate data from multiple files

Posted by Prashant Kommireddi <pr...@gmail.com>.

Vibhor, how do you define intermediate data here? Is it the final
output from a certain pig job or the tmp files created between
multiple MR jobs created by the same pig script?

Sent from my iPhone

On May 5, 2012, at 7:53 PM, Vibhor Gupta <vi...@gmail.com> wrote:

> Hi ,
> We are working on a project where we are trying to reuse the intermediate
> data.
> We are splitting the file based on the equivilance class.
> Now we are stuck on a point where we need to read from these files.
>
> Can you please specify how to that.
>
> thanks !!
>
> --
> Thanks ,
> Vibhor Gupta
>
> Masters in Computer Science
> North Carolina State University