You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Anitha Raju (Created) (JIRA)" <ji...@apache.org> on 2011/12/21 07:53:30 UTC
[jira] [Created] (PIG-2442) Multiple Stores in pig streaming causes
infinite waiting
Multiple Stores in pig streaming causes infinite waiting
--------------------------------------------------------
Key: PIG-2442
URL: https://issues.apache.org/jira/browse/PIG-2442
Project: Pig
Issue Type: Bug
Affects Versions: 0.9.0, 0.8.1
Reporter: Anitha Raju
Hi,
If there are multiple store in a pig streaming script, it goes into infinite waiting.
Script
{code}
DEFINE SCRIPT `./a.pl` SHIP ('/homes/anithar/a.pl');;
DEFINE SCRIPT1 `./b.pl` SHIP ('/homes/anithar/b.pl');;
A = LOAD 'test.txt' USING PigStorage() ;
B1 = STREAM A THROUGH SCRIPT ;
B1 = foreach B1 generate $0;
STORE B1 INTO 'B1' USING PigStorage();
B2 = STREAM B1 THROUGH SCRIPT1;
STORE B2 INTO 'B2' USING PigStorage();
{code}
a.pl
--------
#! /usr/bin/perl -w
while (my $line = <STDIN>) {
print uc($line);
}
--------
b.pl
---------
#! /usr/bin/perl -w
while (my $line = <STDIN>) {
print $line;
}
---------
This infinite waiting happens randomly causing the job to fail with "Task attempt failed to report
status for 605 seconds. Killing!".
Same happens with 0.8 version too.
Regards,
Anitha
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2442) Multiple Stores in pig streaming causes
infinite waiting
Posted by "Jonathan Coveney (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Coveney updated PIG-2442:
----------------------------------
Attachment: PIG-2442_pig9.patch
This is a rebase of this patch (with Thejas's comment incorporated) for Pig9. I think we should continue to try and backport as many bugfixes as possible to pig0.9, as it's the defacto "stable" branch.
> Multiple Stores in pig streaming causes infinite waiting
> --------------------------------------------------------
>
> Key: PIG-2442
> URL: https://issues.apache.org/jira/browse/PIG-2442
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.1, 0.9.0
> Reporter: Anitha Raju
> Assignee: xuting zhao
> Fix For: 0.10, 0.11
>
> Attachments: PIG-2442-1.patch, PIG-2442_pig9.patch
>
>
> Hi,
> If there are multiple store in a pig streaming script, it goes into infinite waiting.
> Script
> {code}
> DEFINE SCRIPT `./a.pl` SHIP ('/homes/anithar/a.pl');;
> DEFINE SCRIPT1 `./b.pl` SHIP ('/homes/anithar/b.pl');;
> A = LOAD 'test.txt' USING PigStorage() ;
> B1 = STREAM A THROUGH SCRIPT ;
> B1 = foreach B1 generate $0;
> STORE B1 INTO 'B1' USING PigStorage();
> B2 = STREAM B1 THROUGH SCRIPT1;
> STORE B2 INTO 'B2' USING PigStorage();
> {code}
> a.pl
> --------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print uc($line);
> }
> --------
> b.pl
> ---------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print $line;
> }
> ---------
> Input (test.txt)
> {code}
> test
> hi
> hello
> {code}
> This infinite waiting happens randomly causing the job to fail with "Task attempt failed to report
> status for 605 seconds. Killing!".
> Same happens with 0.8 version too.
> Regards,
> Anitha
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2442) Multiple Stores in pig streaming
causes infinite waiting
Posted by "Thejas M Nair (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233957#comment-13233957 ]
Thejas M Nair commented on PIG-2442:
------------------------------------
+1 . Can you make this change before commit ? -
In POSplit.getStreamCloseResult
{code}
if (inpEOP && parentPlan.endOfAllInput) {
{code}
can be changed to
{code}
if (inpEOP ) {
{code}
as the function is called only if parentPlan.endOfAllInput is true.
> Multiple Stores in pig streaming causes infinite waiting
> --------------------------------------------------------
>
> Key: PIG-2442
> URL: https://issues.apache.org/jira/browse/PIG-2442
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.1, 0.9.0
> Reporter: Anitha Raju
> Assignee: xuting zhao
> Fix For: 0.10, 0.11
>
> Attachments: PIG-2442-1.patch
>
>
> Hi,
> If there are multiple store in a pig streaming script, it goes into infinite waiting.
> Script
> {code}
> DEFINE SCRIPT `./a.pl` SHIP ('/homes/anithar/a.pl');;
> DEFINE SCRIPT1 `./b.pl` SHIP ('/homes/anithar/b.pl');;
> A = LOAD 'test.txt' USING PigStorage() ;
> B1 = STREAM A THROUGH SCRIPT ;
> B1 = foreach B1 generate $0;
> STORE B1 INTO 'B1' USING PigStorage();
> B2 = STREAM B1 THROUGH SCRIPT1;
> STORE B2 INTO 'B2' USING PigStorage();
> {code}
> a.pl
> --------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print uc($line);
> }
> --------
> b.pl
> ---------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print $line;
> }
> ---------
> Input (test.txt)
> {code}
> test
> hi
> hello
> {code}
> This infinite waiting happens randomly causing the job to fail with "Task attempt failed to report
> status for 605 seconds. Killing!".
> Same happens with 0.8 version too.
> Regards,
> Anitha
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2442) Multiple Stores in pig streaming causes
infinite waiting
Posted by "Daniel Dai (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-2442:
----------------------------
Attachment: PIG-2442-1.patch
The root cause is POStream inside POSplit does not work.
> Multiple Stores in pig streaming causes infinite waiting
> --------------------------------------------------------
>
> Key: PIG-2442
> URL: https://issues.apache.org/jira/browse/PIG-2442
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.1, 0.9.0
> Reporter: Anitha Raju
> Assignee: xuting zhao
> Fix For: 0.10, 0.11
>
> Attachments: PIG-2442-1.patch
>
>
> Hi,
> If there are multiple store in a pig streaming script, it goes into infinite waiting.
> Script
> {code}
> DEFINE SCRIPT `./a.pl` SHIP ('/homes/anithar/a.pl');;
> DEFINE SCRIPT1 `./b.pl` SHIP ('/homes/anithar/b.pl');;
> A = LOAD 'test.txt' USING PigStorage() ;
> B1 = STREAM A THROUGH SCRIPT ;
> B1 = foreach B1 generate $0;
> STORE B1 INTO 'B1' USING PigStorage();
> B2 = STREAM B1 THROUGH SCRIPT1;
> STORE B2 INTO 'B2' USING PigStorage();
> {code}
> a.pl
> --------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print uc($line);
> }
> --------
> b.pl
> ---------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print $line;
> }
> ---------
> Input (test.txt)
> {code}
> test
> hi
> hello
> {code}
> This infinite waiting happens randomly causing the job to fail with "Task attempt failed to report
> status for 605 seconds. Killing!".
> Same happens with 0.8 version too.
> Regards,
> Anitha
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2442) Multiple Stores in pig streaming causes
infinite waiting
Posted by "Daniel Dai (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-2442:
----------------------------
Fix Version/s: 0.10
> Multiple Stores in pig streaming causes infinite waiting
> --------------------------------------------------------
>
> Key: PIG-2442
> URL: https://issues.apache.org/jira/browse/PIG-2442
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.1, 0.9.0
> Reporter: Anitha Raju
> Assignee: xuting zhao
> Fix For: 0.10, 0.11
>
> Attachments: PIG-2442-1.patch
>
>
> Hi,
> If there are multiple store in a pig streaming script, it goes into infinite waiting.
> Script
> {code}
> DEFINE SCRIPT `./a.pl` SHIP ('/homes/anithar/a.pl');;
> DEFINE SCRIPT1 `./b.pl` SHIP ('/homes/anithar/b.pl');;
> A = LOAD 'test.txt' USING PigStorage() ;
> B1 = STREAM A THROUGH SCRIPT ;
> B1 = foreach B1 generate $0;
> STORE B1 INTO 'B1' USING PigStorage();
> B2 = STREAM B1 THROUGH SCRIPT1;
> STORE B2 INTO 'B2' USING PigStorage();
> {code}
> a.pl
> --------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print uc($line);
> }
> --------
> b.pl
> ---------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print $line;
> }
> ---------
> Input (test.txt)
> {code}
> test
> hi
> hello
> {code}
> This infinite waiting happens randomly causing the job to fail with "Task attempt failed to report
> status for 605 seconds. Killing!".
> Same happens with 0.8 version too.
> Regards,
> Anitha
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (PIG-2442) Multiple Stores in pig streaming
causes infinite waiting
Posted by "Daniel Dai (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai resolved PIG-2442.
-----------------------------
Resolution: Fixed
Fix Version/s: 0.9.3
Hadoop Flags: Reviewed
Patch committed to 0.9/0.10/trunk.
> Multiple Stores in pig streaming causes infinite waiting
> --------------------------------------------------------
>
> Key: PIG-2442
> URL: https://issues.apache.org/jira/browse/PIG-2442
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.1, 0.9.0
> Reporter: Anitha Raju
> Assignee: xuting zhao
> Fix For: 0.10, 0.9.3, 0.11
>
> Attachments: PIG-2442-1.patch, PIG-2442_pig9.patch
>
>
> Hi,
> If there are multiple store in a pig streaming script, it goes into infinite waiting.
> Script
> {code}
> DEFINE SCRIPT `./a.pl` SHIP ('/homes/anithar/a.pl');;
> DEFINE SCRIPT1 `./b.pl` SHIP ('/homes/anithar/b.pl');;
> A = LOAD 'test.txt' USING PigStorage() ;
> B1 = STREAM A THROUGH SCRIPT ;
> B1 = foreach B1 generate $0;
> STORE B1 INTO 'B1' USING PigStorage();
> B2 = STREAM B1 THROUGH SCRIPT1;
> STORE B2 INTO 'B2' USING PigStorage();
> {code}
> a.pl
> --------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print uc($line);
> }
> --------
> b.pl
> ---------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print $line;
> }
> ---------
> Input (test.txt)
> {code}
> test
> hi
> hello
> {code}
> This infinite waiting happens randomly causing the job to fail with "Task attempt failed to report
> status for 605 seconds. Killing!".
> Same happens with 0.8 version too.
> Regards,
> Anitha
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (PIG-2442) Multiple Stores in pig streaming
causes infinite waiting
Posted by "xuting zhao (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
xuting zhao reassigned PIG-2442:
--------------------------------
Assignee: xuting zhao
> Multiple Stores in pig streaming causes infinite waiting
> --------------------------------------------------------
>
> Key: PIG-2442
> URL: https://issues.apache.org/jira/browse/PIG-2442
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.1, 0.9.0
> Reporter: Anitha Raju
> Assignee: xuting zhao
> Fix For: 0.10
>
>
> Hi,
> If there are multiple store in a pig streaming script, it goes into infinite waiting.
> Script
> {code}
> DEFINE SCRIPT `./a.pl` SHIP ('/homes/anithar/a.pl');;
> DEFINE SCRIPT1 `./b.pl` SHIP ('/homes/anithar/b.pl');;
> A = LOAD 'test.txt' USING PigStorage() ;
> B1 = STREAM A THROUGH SCRIPT ;
> B1 = foreach B1 generate $0;
> STORE B1 INTO 'B1' USING PigStorage();
> B2 = STREAM B1 THROUGH SCRIPT1;
> STORE B2 INTO 'B2' USING PigStorage();
> {code}
> a.pl
> --------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print uc($line);
> }
> --------
> b.pl
> ---------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print $line;
> }
> ---------
> Input (test.txt)
> {code}
> test
> hi
> hello
> {code}
> This infinite waiting happens randomly causing the job to fail with "Task attempt failed to report
> status for 605 seconds. Killing!".
> Same happens with 0.8 version too.
> Regards,
> Anitha
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2442) Multiple Stores in pig streaming causes
infinite waiting
Posted by "Anitha Raju (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anitha Raju updated PIG-2442:
-----------------------------
Description:
Hi,
If there are multiple store in a pig streaming script, it goes into infinite waiting.
Script
{code}
DEFINE SCRIPT `./a.pl` SHIP ('/homes/anithar/a.pl');;
DEFINE SCRIPT1 `./b.pl` SHIP ('/homes/anithar/b.pl');;
A = LOAD 'test.txt' USING PigStorage() ;
B1 = STREAM A THROUGH SCRIPT ;
B1 = foreach B1 generate $0;
STORE B1 INTO 'B1' USING PigStorage();
B2 = STREAM B1 THROUGH SCRIPT1;
STORE B2 INTO 'B2' USING PigStorage();
{code}
a.pl
--------
#! /usr/bin/perl -w
while (my $line = <STDIN>) {
print uc($line);
}
--------
b.pl
---------
#! /usr/bin/perl -w
while (my $line = <STDIN>) {
print $line;
}
---------
Input (test.txt)
{code}
test
hi
hello
{code}
This infinite waiting happens randomly causing the job to fail with "Task attempt failed to report
status for 605 seconds. Killing!".
Same happens with 0.8 version too.
Regards,
Anitha
was:
Hi,
If there are multiple store in a pig streaming script, it goes into infinite waiting.
Script
{code}
DEFINE SCRIPT `./a.pl` SHIP ('/homes/anithar/a.pl');;
DEFINE SCRIPT1 `./b.pl` SHIP ('/homes/anithar/b.pl');;
A = LOAD 'test.txt' USING PigStorage() ;
B1 = STREAM A THROUGH SCRIPT ;
B1 = foreach B1 generate $0;
STORE B1 INTO 'B1' USING PigStorage();
B2 = STREAM B1 THROUGH SCRIPT1;
STORE B2 INTO 'B2' USING PigStorage();
{code}
a.pl
--------
#! /usr/bin/perl -w
while (my $line = <STDIN>) {
print uc($line);
}
--------
b.pl
---------
#! /usr/bin/perl -w
while (my $line = <STDIN>) {
print $line;
}
---------
This infinite waiting happens randomly causing the job to fail with "Task attempt failed to report
status for 605 seconds. Killing!".
Same happens with 0.8 version too.
Regards,
Anitha
> Multiple Stores in pig streaming causes infinite waiting
> --------------------------------------------------------
>
> Key: PIG-2442
> URL: https://issues.apache.org/jira/browse/PIG-2442
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.1, 0.9.0
> Reporter: Anitha Raju
>
> Hi,
> If there are multiple store in a pig streaming script, it goes into infinite waiting.
> Script
> {code}
> DEFINE SCRIPT `./a.pl` SHIP ('/homes/anithar/a.pl');;
> DEFINE SCRIPT1 `./b.pl` SHIP ('/homes/anithar/b.pl');;
> A = LOAD 'test.txt' USING PigStorage() ;
> B1 = STREAM A THROUGH SCRIPT ;
> B1 = foreach B1 generate $0;
> STORE B1 INTO 'B1' USING PigStorage();
> B2 = STREAM B1 THROUGH SCRIPT1;
> STORE B2 INTO 'B2' USING PigStorage();
> {code}
> a.pl
> --------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print uc($line);
> }
> --------
> b.pl
> ---------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print $line;
> }
> ---------
> Input (test.txt)
> {code}
> test
> hi
> hello
> {code}
> This infinite waiting happens randomly causing the job to fail with "Task attempt failed to report
> status for 605 seconds. Killing!".
> Same happens with 0.8 version too.
> Regards,
> Anitha
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2442) Multiple Stores in pig streaming causes
infinite waiting
Posted by "Daniel Dai (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-2442:
----------------------------
Fix Version/s: (was: 0.10)
0.11
> Multiple Stores in pig streaming causes infinite waiting
> --------------------------------------------------------
>
> Key: PIG-2442
> URL: https://issues.apache.org/jira/browse/PIG-2442
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.1, 0.9.0
> Reporter: Anitha Raju
> Assignee: xuting zhao
> Fix For: 0.11
>
>
> Hi,
> If there are multiple store in a pig streaming script, it goes into infinite waiting.
> Script
> {code}
> DEFINE SCRIPT `./a.pl` SHIP ('/homes/anithar/a.pl');;
> DEFINE SCRIPT1 `./b.pl` SHIP ('/homes/anithar/b.pl');;
> A = LOAD 'test.txt' USING PigStorage() ;
> B1 = STREAM A THROUGH SCRIPT ;
> B1 = foreach B1 generate $0;
> STORE B1 INTO 'B1' USING PigStorage();
> B2 = STREAM B1 THROUGH SCRIPT1;
> STORE B2 INTO 'B2' USING PigStorage();
> {code}
> a.pl
> --------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print uc($line);
> }
> --------
> b.pl
> ---------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print $line;
> }
> ---------
> Input (test.txt)
> {code}
> test
> hi
> hello
> {code}
> This infinite waiting happens randomly causing the job to fail with "Task attempt failed to report
> status for 605 seconds. Killing!".
> Same happens with 0.8 version too.
> Regards,
> Anitha
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2442) Multiple Stores in pig streaming
causes infinite waiting
Posted by "xuting zhao (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13183422#comment-13183422 ]
xuting zhao commented on PIG-2442:
----------------------------------
A few observations:
(1)If the multiple stores store independent variables, then it works fine. For example,
DEFINE SCRIPT `a.pl` SHIP ('/homes/a.pl');
A = LOAD 'test.txt' USING PigStorage() ;
B1 = STREAM A THROUGH SCRIPT;
B2 = STREAM A THROUGH SCRIPT;
STORE B1 INTO 'B2' USING PigStorage();
STORE B2 INTO 'B2' USING PigStorage();
(2) The problem seems to be the ExecutableManager and the POstream which only read one tuple into the I/O thread in the second stream operation and then close.
I will look further into it. Anyone can give me some suggestion? ：）
Xuting
> Multiple Stores in pig streaming causes infinite waiting
> --------------------------------------------------------
>
> Key: PIG-2442
> URL: https://issues.apache.org/jira/browse/PIG-2442
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.1, 0.9.0
> Reporter: Anitha Raju
> Fix For: 0.10
>
>
> Hi,
> If there are multiple store in a pig streaming script, it goes into infinite waiting.
> Script
> {code}
> DEFINE SCRIPT `./a.pl` SHIP ('/homes/anithar/a.pl');;
> DEFINE SCRIPT1 `./b.pl` SHIP ('/homes/anithar/b.pl');;
> A = LOAD 'test.txt' USING PigStorage() ;
> B1 = STREAM A THROUGH SCRIPT ;
> B1 = foreach B1 generate $0;
> STORE B1 INTO 'B1' USING PigStorage();
> B2 = STREAM B1 THROUGH SCRIPT1;
> STORE B2 INTO 'B2' USING PigStorage();
> {code}
> a.pl
> --------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print uc($line);
> }
> --------
> b.pl
> ---------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print $line;
> }
> ---------
> Input (test.txt)
> {code}
> test
> hi
> hello
> {code}
> This infinite waiting happens randomly causing the job to fail with "Task attempt failed to report
> status for 605 seconds. Killing!".
> Same happens with 0.8 version too.
> Regards,
> Anitha
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2442) Multiple Stores in pig streaming causes
infinite waiting
Posted by "Olga Natkovich (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olga Natkovich updated PIG-2442:
--------------------------------
Fix Version/s: 0.10
> Multiple Stores in pig streaming causes infinite waiting
> --------------------------------------------------------
>
> Key: PIG-2442
> URL: https://issues.apache.org/jira/browse/PIG-2442
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.1, 0.9.0
> Reporter: Anitha Raju
> Fix For: 0.10
>
>
> Hi,
> If there are multiple store in a pig streaming script, it goes into infinite waiting.
> Script
> {code}
> DEFINE SCRIPT `./a.pl` SHIP ('/homes/anithar/a.pl');;
> DEFINE SCRIPT1 `./b.pl` SHIP ('/homes/anithar/b.pl');;
> A = LOAD 'test.txt' USING PigStorage() ;
> B1 = STREAM A THROUGH SCRIPT ;
> B1 = foreach B1 generate $0;
> STORE B1 INTO 'B1' USING PigStorage();
> B2 = STREAM B1 THROUGH SCRIPT1;
> STORE B2 INTO 'B2' USING PigStorage();
> {code}
> a.pl
> --------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print uc($line);
> }
> --------
> b.pl
> ---------
> #! /usr/bin/perl -w
> while (my $line = <STDIN>) {
> print $line;
> }
> ---------
> Input (test.txt)
> {code}
> test
> hi
> hello
> {code}
> This infinite waiting happens randomly causing the job to fail with "Task attempt failed to report
> status for 605 seconds. Killing!".
> Same happens with 0.8 version too.
> Regards,
> Anitha
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira