You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Alan Gates (JIRA)" <ji...@apache.org> on 2009/04/29 03:28:30 UTC
[jira] Created: (PIG-789) coupling load and store in script no
longer works
coupling load and store in script no longer works
-------------------------------------------------
Key: PIG-789
URL: https://issues.apache.org/jira/browse/PIG-789
Project: Pig
Issue Type: Bug
Components: impl
Affects Versions: 0.3.0
Reporter: Alan Gates
Many user's pig script do something like this:
a = load '/user/pig/tests/data/singlefile/studenttab10k' as (name, age, gpa);
c = filter a by age > 500;
e = group c by (name, age);
f = foreach e generate group, COUNT($1);
store f into 'bla';
f1 = load 'bla';
g = order f1 by $1;
dump g;
With the inclusion of the multi-query phase2 patch this appears to no longer work. You get an error:
2009-04-28 18:24:50,776 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2100: hdfs://wilbur11.labs.corp.sp1.yahoo.com/user/gates/bla does not exist.
We shouldn't be checking for bla's existence here because it will be created eventually by the script.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-789) coupling load and store in script no
longer works
Posted by "Gunther Hagleitner (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gunther Hagleitner updated PIG-789:
-----------------------------------
Attachment: dump_bug.patch
Both dump (openIterator) and illustrate (getExamples) show this problem. dump_bug.patch contains a fix; The patch is for the trunk.
> coupling load and store in script no longer works
> -------------------------------------------------
>
> Key: PIG-789
> URL: https://issues.apache.org/jira/browse/PIG-789
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.3.0
> Reporter: Alan Gates
> Assignee: Gunther Hagleitner
> Attachments: dump_bug.patch
>
>
> Many user's pig script do something like this:
> a = load '/user/pig/tests/data/singlefile/studenttab10k' as (name, age, gpa);
> c = filter a by age > 500;
> e = group c by (name, age);
> f = foreach e generate group, COUNT($1);
> store f into 'bla';
> f1 = load 'bla';
> g = order f1 by $1;
> dump g;
> With the inclusion of the multi-query phase2 patch this appears to no longer work. You get an error:
> 2009-04-28 18:24:50,776 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2100: hdfs://wilbur11.labs.corp.sp1.yahoo.com/user/gates/bla does not exist.
> We shouldn't be checking for bla's existence here because it will be created eventually by the script.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (PIG-789) coupling load and store in script no
longer works
Posted by "Alan Gates (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alan Gates reassigned PIG-789:
------------------------------
Assignee: Gunther Hagleitner
> coupling load and store in script no longer works
> -------------------------------------------------
>
> Key: PIG-789
> URL: https://issues.apache.org/jira/browse/PIG-789
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.3.0
> Reporter: Alan Gates
> Assignee: Gunther Hagleitner
>
> Many user's pig script do something like this:
> a = load '/user/pig/tests/data/singlefile/studenttab10k' as (name, age, gpa);
> c = filter a by age > 500;
> e = group c by (name, age);
> f = foreach e generate group, COUNT($1);
> store f into 'bla';
> f1 = load 'bla';
> g = order f1 by $1;
> dump g;
> With the inclusion of the multi-query phase2 patch this appears to no longer work. You get an error:
> 2009-04-28 18:24:50,776 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2100: hdfs://wilbur11.labs.corp.sp1.yahoo.com/user/gates/bla does not exist.
> We shouldn't be checking for bla's existence here because it will be created eventually by the script.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (PIG-789) coupling load and store in script no
longer works
Posted by "Alan Gates (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alan Gates resolved PIG-789.
----------------------------
Resolution: Fixed
Fix Version/s: 0.3.0
Patch checked in. Thanks Gunther.
> coupling load and store in script no longer works
> -------------------------------------------------
>
> Key: PIG-789
> URL: https://issues.apache.org/jira/browse/PIG-789
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.3.0
> Reporter: Alan Gates
> Assignee: Gunther Hagleitner
> Fix For: 0.3.0
>
> Attachments: dump_bug.patch
>
>
> Many user's pig script do something like this:
> a = load '/user/pig/tests/data/singlefile/studenttab10k' as (name, age, gpa);
> c = filter a by age > 500;
> e = group c by (name, age);
> f = foreach e generate group, COUNT($1);
> store f into 'bla';
> f1 = load 'bla';
> g = order f1 by $1;
> dump g;
> With the inclusion of the multi-query phase2 patch this appears to no longer work. You get an error:
> 2009-04-28 18:24:50,776 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2100: hdfs://wilbur11.labs.corp.sp1.yahoo.com/user/gates/bla does not exist.
> We shouldn't be checking for bla's existence here because it will be created eventually by the script.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.