You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Koji Noguchi (JIRA)" <ji...@apache.org> on 2007/04/24 22:41:15 UTC
[jira] Created: (HADOOP-1293) stderr from streaming skipped after
first 20 lines.
stderr from streaming skipped after first 20 lines.
-----------------------------------------------------
Key: HADOOP-1293
URL: https://issues.apache.org/jira/browse/HADOOP-1293
Project: Hadoop
Issue Type: Bug
Components: contrib/streaming
Reporter: Koji Noguchi
Priority: Minor
It prints to stderr when this condition is true
> if (num < 20 || (now-lastStderrReport > reporterErrDelay_))
Either first 20 lines or certain interval has passed since the last stderr output.
Output is logged to syslog but can be overwritten by streaming infrastructure outputs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1293) stderr from streaming skipped after
first 20 lines.
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Koji Noguchi updated HADOOP-1293:
---------------------------------
Attachment: 1293.patch
1) Took out logprintln(lineStr);
2) Always System.err.println(lineStr);
3) Replaced reporter.setStatus(hline) with reporter.progress(). (since it'll be overwritten by MROutputThread anyway)
If the timeout is set to 0 (HADOOP-491), we don't need a call from the reporter (3).
But since it's configurable, I left the reporter call.
> stderr from streaming skipped after first 20 lines.
> -----------------------------------------------------
>
> Key: HADOOP-1293
> URL: https://issues.apache.org/jira/browse/HADOOP-1293
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Koji Noguchi
> Assigned To: Koji Noguchi
> Priority: Minor
> Attachments: 1293.patch
>
>
> It prints to stderr when this condition is true
> > if (num < 20 || (now-lastStderrReport > reporterErrDelay_))
> Either first 20 lines or certain interval has passed since the last stderr output.
> Output is logged to syslog but can be overwritten by streaming infrastructure outputs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-1293) stderr from streaming skipped after
first 20 lines.
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Koji Noguchi reassigned HADOOP-1293:
------------------------------------
Assignee: Koji Noguchi
> stderr from streaming skipped after first 20 lines.
> -----------------------------------------------------
>
> Key: HADOOP-1293
> URL: https://issues.apache.org/jira/browse/HADOOP-1293
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Koji Noguchi
> Assigned To: Koji Noguchi
> Priority: Minor
>
> It prints to stderr when this condition is true
> > if (num < 20 || (now-lastStderrReport > reporterErrDelay_))
> Either first 20 lines or certain interval has passed since the last stderr output.
> Output is logged to syslog but can be overwritten by streaming infrastructure outputs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1293) stderr from streaming skipped after
first 20 lines.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492251 ]
Hadoop QA commented on HADOOP-1293:
-----------------------------------
Integrated in Hadoop-Nightly #71 (See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/71/)
> stderr from streaming skipped after first 20 lines.
> -----------------------------------------------------
>
> Key: HADOOP-1293
> URL: https://issues.apache.org/jira/browse/HADOOP-1293
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Koji Noguchi
> Assigned To: Koji Noguchi
> Priority: Minor
> Fix For: 0.13.0
>
> Attachments: 1293.patch
>
>
> It prints to stderr when this condition is true
> > if (num < 20 || (now-lastStderrReport > reporterErrDelay_))
> Either first 20 lines or certain interval has passed since the last stderr output.
> Output is logged to syslog but can be overwritten by streaming infrastructure outputs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1293) stderr from streaming skipped after
first 20 lines.
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Koji Noguchi updated HADOOP-1293:
---------------------------------
Status: Patch Available (was: Open)
> stderr from streaming skipped after first 20 lines.
> -----------------------------------------------------
>
> Key: HADOOP-1293
> URL: https://issues.apache.org/jira/browse/HADOOP-1293
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Koji Noguchi
> Assigned To: Koji Noguchi
> Priority: Minor
> Attachments: 1293.patch
>
>
> It prints to stderr when this condition is true
> > if (num < 20 || (now-lastStderrReport > reporterErrDelay_))
> Either first 20 lines or certain interval has passed since the last stderr output.
> Output is logged to syslog but can be overwritten by streaming infrastructure outputs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1293) stderr from streaming skipped after
first 20 lines.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491783 ]
Hadoop QA commented on HADOOP-1293:
-----------------------------------
+1
http://issues.apache.org/jira/secure/attachment/12356262/1293.patch applied and successfully tested against trunk revision r532083.
Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/81/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/81/console
> stderr from streaming skipped after first 20 lines.
> -----------------------------------------------------
>
> Key: HADOOP-1293
> URL: https://issues.apache.org/jira/browse/HADOOP-1293
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Koji Noguchi
> Assigned To: Koji Noguchi
> Priority: Minor
> Attachments: 1293.patch
>
>
> It prints to stderr when this condition is true
> > if (num < 20 || (now-lastStderrReport > reporterErrDelay_))
> Either first 20 lines or certain interval has passed since the last stderr output.
> Output is logged to syslog but can be overwritten by streaming infrastructure outputs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1293) stderr from streaming skipped after
first 20 lines.
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Doug Cutting updated HADOOP-1293:
---------------------------------
Resolution: Fixed
Fix Version/s: 0.13.0
Status: Resolved (was: Patch Available)
I just committed this. Thanks, Koji!
> stderr from streaming skipped after first 20 lines.
> -----------------------------------------------------
>
> Key: HADOOP-1293
> URL: https://issues.apache.org/jira/browse/HADOOP-1293
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Koji Noguchi
> Assigned To: Koji Noguchi
> Priority: Minor
> Fix For: 0.13.0
>
> Attachments: 1293.patch
>
>
> It prints to stderr when this condition is true
> > if (num < 20 || (now-lastStderrReport > reporterErrDelay_))
> Either first 20 lines or certain interval has passed since the last stderr output.
> Output is logged to syslog but can be overwritten by streaming infrastructure outputs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1293) stderr from streaming skipped after
first 20 lines.
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491756 ]
Runping Qi commented on HADOOP-1293:
------------------------------------
+1
This looks goo.
> stderr from streaming skipped after first 20 lines.
> -----------------------------------------------------
>
> Key: HADOOP-1293
> URL: https://issues.apache.org/jira/browse/HADOOP-1293
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Koji Noguchi
> Assigned To: Koji Noguchi
> Priority: Minor
> Attachments: 1293.patch
>
>
> It prints to stderr when this condition is true
> > if (num < 20 || (now-lastStderrReport > reporterErrDelay_))
> Either first 20 lines or certain interval has passed since the last stderr output.
> Output is logged to syslog but can be overwritten by streaming infrastructure outputs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.