You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Jing Huang (JIRA)" <ji...@apache.org> on 2009/12/03 01:47:20 UTC
[jira] Created: (PIG-1121) [zebre] zebra user forces pig script to
have 'as xxx' in foreach statement in order to be able to store
successfully
[zebre] zebra user forces pig script to have 'as xxx' in foreach statement in order to be able to store successfully
--------------------------------------------------------------------------------------------------------------------
Key: PIG-1121
URL: https://issues.apache.org/jira/browse/PIG-1121
Project: Pig
Issue Type: Bug
Affects Versions: 0.6.0
Reporter: Jing Huang
Fix For: 0.6.0
In the following pig script, if user do
b = foreach a generate m1#'a' ;
describe b will be:
b: {bytearray}
zebra store will fail, since there is no name passed to zebra, and zebra not only need type but also name in order to store.
=========
If user do
b = foreach a generate m1#'a' as ms1;
describe b will be:
b: {ms1: bytearray}
Then zebra store can be succeeded.
=========
Here is the full pig script.
register /grid/0/dev/hadoopqa/jars/zebra.jar;
a = load '1.txt' as (a:int, b:float,c:long,d:double,e:chararray,f:bytearray,r1(f1:chararray,f2:chararray),m1:map[]);
b = foreach a generate m1#'a' as ms1;
describe b;
store b into 'map1' using org.apache.hadoop.zebra.pig.TableStorer('');
========
So, we should either fix it or document it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1121) [zebre] zebra user forces pig script
to have 'as xxx' in foreach statement in order to be able to store
successfully
Posted by "Yan Zhou (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12785463#action_12785463 ]
Yan Zhou commented on PIG-1121:
-------------------------------
Zebra does not support positional reference of a column as PIG does with its $ symbol. Consequently, column name is the only way to refer to a column. Without it, the columns would be useless.
> [zebre] zebra user forces pig script to have 'as xxx' in foreach statement in order to be able to store successfully
> --------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-1121
> URL: https://issues.apache.org/jira/browse/PIG-1121
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Jing Huang
> Fix For: 0.6.0
>
>
> In the following pig script, if user do
> b = foreach a generate m1#'a' ;
> describe b will be:
> b: {bytearray}
> zebra store will fail, since there is no name passed to zebra, and zebra not only need type but also name in order to store.
> =========
> If user do
> b = foreach a generate m1#'a' as ms1;
> describe b will be:
> b: {ms1: bytearray}
> Then zebra store can be succeeded.
> =========
> Here is the full pig script.
> register /grid/0/dev/hadoopqa/jars/zebra.jar;
> a = load '1.txt' as (a:int, b:float,c:long,d:double,e:chararray,f:bytearray,r1(f1:chararray,f2:chararray),m1:map[]);
> b = foreach a generate m1#'a' as ms1;
> describe b;
> store b into 'map1' using org.apache.hadoop.zebra.pig.TableStorer('');
> ========
> So, we should either fix it or document it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1121) [zebre] zebra user forces pig script
to have 'as xxx' in foreach statement in order to be able to store
successfully
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12785454#action_12785454 ]
Ashutosh Chauhan commented on PIG-1121:
---------------------------------------
This came up in one of the earlier jiras as well. Can you briefly explain why zebra *must* have names of columns ?
> [zebre] zebra user forces pig script to have 'as xxx' in foreach statement in order to be able to store successfully
> --------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-1121
> URL: https://issues.apache.org/jira/browse/PIG-1121
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Jing Huang
> Fix For: 0.6.0
>
>
> In the following pig script, if user do
> b = foreach a generate m1#'a' ;
> describe b will be:
> b: {bytearray}
> zebra store will fail, since there is no name passed to zebra, and zebra not only need type but also name in order to store.
> =========
> If user do
> b = foreach a generate m1#'a' as ms1;
> describe b will be:
> b: {ms1: bytearray}
> Then zebra store can be succeeded.
> =========
> Here is the full pig script.
> register /grid/0/dev/hadoopqa/jars/zebra.jar;
> a = load '1.txt' as (a:int, b:float,c:long,d:double,e:chararray,f:bytearray,r1(f1:chararray,f2:chararray),m1:map[]);
> b = foreach a generate m1#'a' as ms1;
> describe b;
> store b into 'map1' using org.apache.hadoop.zebra.pig.TableStorer('');
> ========
> So, we should either fix it or document it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1121) [zebre] zebra user forces pig script to
have 'as xxx' in foreach statement in order to be able to store
successfully
Posted by "Yan Zhou (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yan Zhou updated PIG-1121:
--------------------------
Fix Version/s: (was: 0.7.0)
No plan to address this now. Move it out of next release.
> [zebre] zebra user forces pig script to have 'as xxx' in foreach statement in order to be able to store successfully
> --------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-1121
> URL: https://issues.apache.org/jira/browse/PIG-1121
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Jing Huang
>
> In the following pig script, if user do
> b = foreach a generate m1#'a' ;
> describe b will be:
> b: {bytearray}
> zebra store will fail, since there is no name passed to zebra, and zebra not only need type but also name in order to store.
> =========
> If user do
> b = foreach a generate m1#'a' as ms1;
> describe b will be:
> b: {ms1: bytearray}
> Then zebra store can be succeeded.
> =========
> Here is the full pig script.
> register /grid/0/dev/hadoopqa/jars/zebra.jar;
> a = load '1.txt' as (a:int, b:float,c:long,d:double,e:chararray,f:bytearray,r1(f1:chararray,f2:chararray),m1:map[]);
> b = foreach a generate m1#'a' as ms1;
> describe b;
> store b into 'map1' using org.apache.hadoop.zebra.pig.TableStorer('');
> ========
> So, we should either fix it or document it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1121) [zebre] zebra user forces pig script to
have 'as xxx' in foreach statement in order to be able to store
successfully
Posted by "Jing Huang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jing Huang updated PIG-1121:
----------------------------
Fix Version/s: (was: 0.6.0)
0.7.0
> [zebre] zebra user forces pig script to have 'as xxx' in foreach statement in order to be able to store successfully
> --------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-1121
> URL: https://issues.apache.org/jira/browse/PIG-1121
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Jing Huang
> Fix For: 0.7.0
>
>
> In the following pig script, if user do
> b = foreach a generate m1#'a' ;
> describe b will be:
> b: {bytearray}
> zebra store will fail, since there is no name passed to zebra, and zebra not only need type but also name in order to store.
> =========
> If user do
> b = foreach a generate m1#'a' as ms1;
> describe b will be:
> b: {ms1: bytearray}
> Then zebra store can be succeeded.
> =========
> Here is the full pig script.
> register /grid/0/dev/hadoopqa/jars/zebra.jar;
> a = load '1.txt' as (a:int, b:float,c:long,d:double,e:chararray,f:bytearray,r1(f1:chararray,f2:chararray),m1:map[]);
> b = foreach a generate m1#'a' as ms1;
> describe b;
> store b into 'map1' using org.apache.hadoop.zebra.pig.TableStorer('');
> ========
> So, we should either fix it or document it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1121) [zebre] zebra user forces pig script
to have 'as xxx' in foreach statement in order to be able to store
successfully
Posted by "Jing Huang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787084#action_12787084 ]
Jing Huang commented on PIG-1121:
---------------------------------
for apache trunk
> [zebre] zebra user forces pig script to have 'as xxx' in foreach statement in order to be able to store successfully
> --------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-1121
> URL: https://issues.apache.org/jira/browse/PIG-1121
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Jing Huang
> Fix For: 0.7.0
>
>
> In the following pig script, if user do
> b = foreach a generate m1#'a' ;
> describe b will be:
> b: {bytearray}
> zebra store will fail, since there is no name passed to zebra, and zebra not only need type but also name in order to store.
> =========
> If user do
> b = foreach a generate m1#'a' as ms1;
> describe b will be:
> b: {ms1: bytearray}
> Then zebra store can be succeeded.
> =========
> Here is the full pig script.
> register /grid/0/dev/hadoopqa/jars/zebra.jar;
> a = load '1.txt' as (a:int, b:float,c:long,d:double,e:chararray,f:bytearray,r1(f1:chararray,f2:chararray),m1:map[]);
> b = foreach a generate m1#'a' as ms1;
> describe b;
> store b into 'map1' using org.apache.hadoop.zebra.pig.TableStorer('');
> ========
> So, we should either fix it or document it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1121) [zebre] zebra user forces pig script
to have 'as xxx' in foreach statement in order to be able to store
successfully
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12785470#action_12785470 ]
Ashutosh Chauhan commented on PIG-1121:
---------------------------------------
Thanks for the explanation. Is it by design or adding support for positional reference is on roadmap ?
> [zebre] zebra user forces pig script to have 'as xxx' in foreach statement in order to be able to store successfully
> --------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-1121
> URL: https://issues.apache.org/jira/browse/PIG-1121
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Jing Huang
> Fix For: 0.6.0
>
>
> In the following pig script, if user do
> b = foreach a generate m1#'a' ;
> describe b will be:
> b: {bytearray}
> zebra store will fail, since there is no name passed to zebra, and zebra not only need type but also name in order to store.
> =========
> If user do
> b = foreach a generate m1#'a' as ms1;
> describe b will be:
> b: {ms1: bytearray}
> Then zebra store can be succeeded.
> =========
> Here is the full pig script.
> register /grid/0/dev/hadoopqa/jars/zebra.jar;
> a = load '1.txt' as (a:int, b:float,c:long,d:double,e:chararray,f:bytearray,r1(f1:chararray,f2:chararray),m1:map[]);
> b = foreach a generate m1#'a' as ms1;
> describe b;
> store b into 'map1' using org.apache.hadoop.zebra.pig.TableStorer('');
> ========
> So, we should either fix it or document it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1121) [zebre] zebra user forces pig script
to have 'as xxx' in foreach statement in order to be able to store
successfully
Posted by "Yan Zhou (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12785496#action_12785496 ]
Yan Zhou commented on PIG-1121:
-------------------------------
It is by design. Support of positional reference is not on roadmap as of now.
> [zebre] zebra user forces pig script to have 'as xxx' in foreach statement in order to be able to store successfully
> --------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-1121
> URL: https://issues.apache.org/jira/browse/PIG-1121
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Jing Huang
> Fix For: 0.6.0
>
>
> In the following pig script, if user do
> b = foreach a generate m1#'a' ;
> describe b will be:
> b: {bytearray}
> zebra store will fail, since there is no name passed to zebra, and zebra not only need type but also name in order to store.
> =========
> If user do
> b = foreach a generate m1#'a' as ms1;
> describe b will be:
> b: {ms1: bytearray}
> Then zebra store can be succeeded.
> =========
> Here is the full pig script.
> register /grid/0/dev/hadoopqa/jars/zebra.jar;
> a = load '1.txt' as (a:int, b:float,c:long,d:double,e:chararray,f:bytearray,r1(f1:chararray,f2:chararray),m1:map[]);
> b = foreach a generate m1#'a' as ms1;
> describe b;
> store b into 'map1' using org.apache.hadoop.zebra.pig.TableStorer('');
> ========
> So, we should either fix it or document it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.