You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Ayon Sinha <ay...@yahoo.com> on 2011/09/23 03:34:29 UTC
Flatten problem
Hi,
My data looks like
6202445(2284,11096,2931,11168)
6202446(83258,738,10215,12987)
6202447(83258,738,10215,12987)
6202448(1001,1284,11550)
6202449(1560,752,13505,12876,2906)
6202450(1162,11010,13018)
6202451(2784,1729,12987)
6202452(383,12912)
6202453(1201,12987,1202)
6202454(1632,1633,297,10254)
I'm trying to flatten the list
a = load '/home/ayon/test' using PigStorage('\u0001') as (location_id:long, cats:tuple());
a = foreach a generate location_id, flatten(cats);
dump a;
It gives me error:
2011-09-23 01:34:05,528 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2000: Error processing rule PushDownForEachFlatten. Try -t PushDownForEachFlatten
Whats going on?
-Ayon
See My Photos on Flickr
Also check out my Blog for answers to commonly asked questions.
Re: Flatten problem
Posted by Ayon Sinha <ay...@yahoo.com>.
0.8.0-cdh3u0
Time for upgrade, then?
-Ayon
See My Photos on Flickr
Also check out my Blog for answers to commonly asked questions.
________________________________
From: Daniel Dai <da...@hortonworks.com>
To: user@pig.apache.org; Ayon Sinha <ay...@yahoo.com>
Sent: Friday, September 23, 2011 12:21 AM
Subject: Re: Flatten problem
Are you using Pig 0.8.0? It runs fine on Pig 0.8.1 and Pig 0.9.0.
Daniel
On Thu, Sep 22, 2011 at 6:34 PM, Ayon Sinha <ay...@yahoo.com> wrote:
Hi,
>
>My data looks like
>6202445(2284,11096,2931,11168)
>6202446(83258,738,10215,12987)
>6202447(83258,738,10215,12987)
>6202448(1001,1284,11550)
>6202449(1560,752,13505,12876,2906)
>6202450(1162,11010,13018)
>6202451(2784,1729,12987)
>6202452(383,12912)
>6202453(1201,12987,1202)
>6202454(1632,1633,297,10254)
>
>I'm trying to flatten the list
>
>a = load '/home/ayon/test' using PigStorage('\u0001') as (location_id:long, cats:tuple());
>a = foreach a generate location_id, flatten(cats);
>dump a;
>
>It gives me error:
>2011-09-23 01:34:05,528 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2000: Error processing rule PushDownForEachFlatten. Try -t PushDownForEachFlatten
>
>Whats going on?
>-Ayon
>See My Photos on Flickr
>Also check out my Blog for answers to commonly asked questions.
>
Re: Flatten problem
Posted by Daniel Dai <da...@hortonworks.com>.
Are you using Pig 0.8.0? It runs fine on Pig 0.8.1 and Pig 0.9.0.
Daniel
On Thu, Sep 22, 2011 at 6:34 PM, Ayon Sinha <ay...@yahoo.com> wrote:
> Hi,
>
> My data looks like
> 6202445(2284,11096,2931,11168)
> 6202446(83258,738,10215,12987)
> 6202447(83258,738,10215,12987)
> 6202448(1001,1284,11550)
> 6202449(1560,752,13505,12876,2906)
> 6202450(1162,11010,13018)
> 6202451(2784,1729,12987)
> 6202452(383,12912)
> 6202453(1201,12987,1202)
> 6202454(1632,1633,297,10254)
>
> I'm trying to flatten the list
>
> a = load '/home/ayon/test' using PigStorage('\u0001') as (location_id:long,
> cats:tuple());
> a = foreach a generate location_id, flatten(cats);
> dump a;
>
> It gives me error:
> 2011-09-23 01:34:05,528 [main] ERROR org.apache.pig.tools.grunt.Grunt -
> ERROR 2000: Error processing rule PushDownForEachFlatten. Try -t
> PushDownForEachFlatten
>
> Whats going on?
> -Ayon
> See My Photos on Flickr
> Also check out my Blog for answers to commonly asked questions.
>