You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Olga Natkovich (JIRA)" <ji...@apache.org> on 2008/05/05 20:47:55 UTC
[jira] Created: (PIG-230) auto ship broken is presence of define
for another streaming operator.
auto ship broken is presence of define for another streaming operator.
----------------------------------------------------------------------
Key: PIG-230
URL: https://issues.apache.org/jira/browse/PIG-230
Project: Pig
Issue Type: Bug
Reporter: Olga Natkovich
Assignee: Arun C Murthy
The following works:
A = load 'studenttab10k';
B = foreach A generate $0, $1, $2;
C = stream B through `perl PigStreaming.pl`;
store C into 'out';
But this one causes an error: Can't open perl script "PigStreaming.pl": No such file or directory.
define CMD `perl PigStreamingDep.pl` input(stdin using PigDump) ship(':SCRIPTHOMEPATH:/PigStreamingDep.pl', ':SCRIPTHOMEPATH:/PigStreamingModule.pm');
A = load 'studenttab10k';
B = stream A through `perl PigStreaming.pl`;
C = stream B through CMD as (name, age, gpa);
D = foreach C generate name, age;
store D into 'out';#,
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-230) auto ship broken is presence of define
for another streaming operator.
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated PIG-230:
------------------------------
Attachment: PIG-230_0_20080505.patch
Fixed POMapreduce to handle multiple ship/cache specs; updated TestStreaming to add this as a test-case ...
> auto ship broken is presence of define for another streaming operator.
> ----------------------------------------------------------------------
>
> Key: PIG-230
> URL: https://issues.apache.org/jira/browse/PIG-230
> Project: Pig
> Issue Type: Bug
> Reporter: Olga Natkovich
> Assignee: Arun C Murthy
> Attachments: PIG-230_0_20080505.patch
>
>
> The following works:
> A = load 'studenttab10k';
> B = foreach A generate $0, $1, $2;
> C = stream B through `perl PigStreaming.pl`;
> store C into 'out';
> But this one causes an error: Can't open perl script "PigStreaming.pl": No such file or directory.
> define CMD `perl PigStreamingDep.pl` input(stdin using PigDump) ship(':SCRIPTHOMEPATH:/PigStreamingDep.pl', ':SCRIPTHOMEPATH:/PigStreamingModule.pm');
> A = load 'studenttab10k';
> B = stream A through `perl PigStreaming.pl`;
> C = stream B through CMD as (name, age, gpa);
> D = foreach C generate name, age;
> store D into 'out';#,
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-230) auto ship broken is presence of define
for another streaming operator.
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594333#action_12594333 ]
Olga Natkovich commented on PIG-230:
------------------------------------
yes, it was. Both scripts ran in identical environment.
> auto ship broken is presence of define for another streaming operator.
> ----------------------------------------------------------------------
>
> Key: PIG-230
> URL: https://issues.apache.org/jira/browse/PIG-230
> Project: Pig
> Issue Type: Bug
> Reporter: Olga Natkovich
> Assignee: Arun C Murthy
>
> The following works:
> A = load 'studenttab10k';
> B = foreach A generate $0, $1, $2;
> C = stream B through `perl PigStreaming.pl`;
> store C into 'out';
> But this one causes an error: Can't open perl script "PigStreaming.pl": No such file or directory.
> define CMD `perl PigStreamingDep.pl` input(stdin using PigDump) ship(':SCRIPTHOMEPATH:/PigStreamingDep.pl', ':SCRIPTHOMEPATH:/PigStreamingModule.pm');
> A = load 'studenttab10k';
> B = stream A through `perl PigStreaming.pl`;
> C = stream B through CMD as (name, age, gpa);
> D = foreach C generate name, age;
> store D into 'out';#,
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-230) auto ship broken is presence of define
for another streaming operator.
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594310#action_12594310 ]
Arun C Murthy commented on PIG-230:
-----------------------------------
Olga, was PigStreaming.pl on the PATH? Thanks.
> auto ship broken is presence of define for another streaming operator.
> ----------------------------------------------------------------------
>
> Key: PIG-230
> URL: https://issues.apache.org/jira/browse/PIG-230
> Project: Pig
> Issue Type: Bug
> Reporter: Olga Natkovich
> Assignee: Arun C Murthy
>
> The following works:
> A = load 'studenttab10k';
> B = foreach A generate $0, $1, $2;
> C = stream B through `perl PigStreaming.pl`;
> store C into 'out';
> But this one causes an error: Can't open perl script "PigStreaming.pl": No such file or directory.
> define CMD `perl PigStreamingDep.pl` input(stdin using PigDump) ship(':SCRIPTHOMEPATH:/PigStreamingDep.pl', ':SCRIPTHOMEPATH:/PigStreamingModule.pm');
> A = load 'studenttab10k';
> B = stream A through `perl PigStreaming.pl`;
> C = stream B through CMD as (name, age, gpa);
> D = foreach C generate name, age;
> store D into 'out';#,
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-230) auto ship broken is presence of define
for another streaming operator.
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated PIG-230:
------------------------------
Status: Patch Available (was: Open)
> auto ship broken is presence of define for another streaming operator.
> ----------------------------------------------------------------------
>
> Key: PIG-230
> URL: https://issues.apache.org/jira/browse/PIG-230
> Project: Pig
> Issue Type: Bug
> Reporter: Olga Natkovich
> Assignee: Arun C Murthy
> Attachments: PIG-230_0_20080505.patch
>
>
> The following works:
> A = load 'studenttab10k';
> B = foreach A generate $0, $1, $2;
> C = stream B through `perl PigStreaming.pl`;
> store C into 'out';
> But this one causes an error: Can't open perl script "PigStreaming.pl": No such file or directory.
> define CMD `perl PigStreamingDep.pl` input(stdin using PigDump) ship(':SCRIPTHOMEPATH:/PigStreamingDep.pl', ':SCRIPTHOMEPATH:/PigStreamingModule.pm');
> A = load 'studenttab10k';
> B = stream A through `perl PigStreaming.pl`;
> C = stream B through CMD as (name, age, gpa);
> D = foreach C generate name, age;
> store D into 'out';#,
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-230) auto ship broken is presence of define
for another streaming operator.
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olga Natkovich updated PIG-230:
-------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
latest patch for PIG-232 adds the test case
> auto ship broken is presence of define for another streaming operator.
> ----------------------------------------------------------------------
>
> Key: PIG-230
> URL: https://issues.apache.org/jira/browse/PIG-230
> Project: Pig
> Issue Type: Bug
> Reporter: Olga Natkovich
> Assignee: Arun C Murthy
> Attachments: PIG-230_0_20080505.patch
>
>
> The following works:
> A = load 'studenttab10k';
> B = foreach A generate $0, $1, $2;
> C = stream B through `perl PigStreaming.pl`;
> store C into 'out';
> But this one causes an error: Can't open perl script "PigStreaming.pl": No such file or directory.
> define CMD `perl PigStreamingDep.pl` input(stdin using PigDump) ship(':SCRIPTHOMEPATH:/PigStreamingDep.pl', ':SCRIPTHOMEPATH:/PigStreamingModule.pm');
> A = load 'studenttab10k';
> B = stream A through `perl PigStreaming.pl`;
> C = stream B through CMD as (name, age, gpa);
> D = foreach C generate name, age;
> store D into 'out';#,
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-230) auto ship broken is presence of define
for another streaming operator.
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594664#action_12594664 ]
Olga Natkovich commented on PIG-230:
------------------------------------
Arun, I have committed the patch, thanks. All my tests that used to fail now passing. If you could add a unit test for multiple cache options in addtion to multiple ship options, it would be great.
You could just attache it to this bug. (I will keep it open till then.)
> auto ship broken is presence of define for another streaming operator.
> ----------------------------------------------------------------------
>
> Key: PIG-230
> URL: https://issues.apache.org/jira/browse/PIG-230
> Project: Pig
> Issue Type: Bug
> Reporter: Olga Natkovich
> Assignee: Arun C Murthy
> Attachments: PIG-230_0_20080505.patch
>
>
> The following works:
> A = load 'studenttab10k';
> B = foreach A generate $0, $1, $2;
> C = stream B through `perl PigStreaming.pl`;
> store C into 'out';
> But this one causes an error: Can't open perl script "PigStreaming.pl": No such file or directory.
> define CMD `perl PigStreamingDep.pl` input(stdin using PigDump) ship(':SCRIPTHOMEPATH:/PigStreamingDep.pl', ':SCRIPTHOMEPATH:/PigStreamingModule.pm');
> A = load 'studenttab10k';
> B = stream A through `perl PigStreaming.pl`;
> C = stream B through CMD as (name, age, gpa);
> D = foreach C generate name, age;
> store D into 'out';#,
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.