While/CROSS/FOREACH loop

[Russell Jurney <ru...@gmail.com>]

I need to repeatedly CROSS a data set, then FOREACH it, reduce it with
a filter, then group/test it to test if it's done yet, then repeat
until it is baked.

How do I do that with pig, and maybe some other tool? Twitter has some
ruby stuff that can do this, I think, but is there some way with
nested foreach?

Russell Jurney http://datasyndrome.com

Re: While/CROSS/FOREACH loop

[Russell Jurney <ru...@gmail.com>]

Thanks!

Russell Jurney
twitter.com/rjurney
russell.jurney@gmail.com
datasyndrome.com

On May 25, 2012, at 7:37 PM, Aniket Mokashi <an...@gmail.com> wrote:

> This might be helpful for this use case -
> http://hortonworks.com/blog/new-apache-pig-features-part-2-embedding/
>
> On Tue, May 22, 2012 at 11:31 PM, Russell Jurney
> <ru...@gmail.com>wrote:
>
>> I need to repeatedly CROSS a data set, then FOREACH it, reduce it with
>> a filter, then group/test it to test if it's done yet, then repeat
>> until it is baked.
>>
>> How do I do that with pig, and maybe some other tool? Twitter has some
>> ruby stuff that can do this, I think, but is there some way with
>> nested foreach?
>>
>> Russell Jurney http://datasyndrome.com
>>
>
>
>
> --
> "...:::Aniket:::... Quetzalco@tl"

Re: While/CROSS/FOREACH loop

[Aniket Mokashi <an...@gmail.com>]

This might be helpful for this use case -
http://hortonworks.com/blog/new-apache-pig-features-part-2-embedding/

On Tue, May 22, 2012 at 11:31 PM, Russell Jurney
<ru...@gmail.com>wrote:

> I need to repeatedly CROSS a data set, then FOREACH it, reduce it with
> a filter, then group/test it to test if it's done yet, then repeat
> until it is baked.
>
> How do I do that with pig, and maybe some other tool? Twitter has some
> ruby stuff that can do this, I think, but is there some way with
> nested foreach?
>
> Russell Jurney http://datasyndrome.com
>



-- 
"...:::Aniket:::... Quetzalco@tl"