You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Koji Noguchi (JIRA)" <ji...@apache.org> on 2007/07/28 09:46:52 UTC
[jira] Created: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
streaming returning 0 when submitJob fails with Exception
---------------------------------------------------------
Key: HADOOP-1663
URL: https://issues.apache.org/jira/browse/HADOOP-1663
Project: Hadoop
Issue Type: Bug
Components: contrib/streaming
Reporter: Koji Noguchi
Fix For: 0.14.0
In streaming, if I pass an input filename that doesn't exist,
bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
...
07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
bash-3.00$ echo $?
*0*
=================
Copy&Pasting Milind's comment.
its a hadoop streaming problem. See the code
below:
}catch( IOException ioe){
LOG.error("Error Launching job : " + ioe.getMessage());
}
finally {
if (error && (running_ != null)) {
LOG.info("killJob...");
running_.killJob();
}
jc_.close();
Note that it catches exception, and does not rethrow it !!!
=================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "lohit (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
lohit updated HADOOP-1663:
--------------------------
Attachment: h-1663-streamexception-simpletestcase.patch
Sorry had updated with wrong patch. Correct patch updated
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Koji Noguchi updated HADOOP-1663:
---------------------------------
Status: Patch Available (was: Open)
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.13.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-mod.patch, h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "lohit (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
lohit updated HADOOP-1663:
--------------------------
Attachment: (was: h-1663-streamexception-simpletestcase.patch)
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-1663:
----------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this. Thanks, Lohit.
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.13.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-as-returncode.patch, h-1663-streamexception-as-returncode.patch, h-1663-streamexception-mod.patch, h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1663) streaming returning 0 when
submitJob fails with Exception
Posted by "lohit (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12517636 ]
lohit commented on HADOOP-1663:
-------------------------------
Tested Koji's patch and included a test case for the same. Right now have a simple test with invalid input for streaming job and expecting an Exception from StreamJob class. Will update https://issues.apache.org/jira/browse/HADOOP-16
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1663) streaming returning 0 when
submitJob fails with Exception
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12518017 ]
Runping Qi commented on HADOOP-1663:
------------------------------------
+1 looks good.
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Koji Noguchi updated HADOOP-1663:
---------------------------------
Status: Open (was: Patch Available)
Resubmitting with minor change.
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.13.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Koji Noguchi updated HADOOP-1663:
---------------------------------
Attachment: h-1663-streamexception-mod.patch
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.13.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-mod.patch, h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1663) streaming returning 0 when
submitJob fails with Exception
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12518225 ]
Hadoop QA commented on HADOOP-1663:
-----------------------------------
-1, build or testing failed
2 attempts failed to build and test the latest attachment http://issues.apache.org/jira/secure/attachment/12363153/h-1663-streamexception-simpletestcase.patch against trunk revision r563270.
Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/520/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/520/console
Please note that this message is automatically generated and may represent a problem with the automation system and not the patch.
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.13.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "Sameer Paranjpye (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sameer Paranjpye updated HADOOP-1663:
-------------------------------------
Fix Version/s: (was: 0.14.0)
0.15.0
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.13.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.15.0
>
> Attachments: h-1663-streamexception-mod.patch, h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "lohit (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
lohit updated HADOOP-1663:
--------------------------
Attachment: h-1663-streamexception-as-returncode.patch
Thanks to Owen for inputs. Now instead the code returns error code which is caught in main of HadoopStreaming and exit accordingly. Attached in the modified patch.
Thanks
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.13.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.15.0
>
> Attachments: h-1663-streamexception-as-returncode.patch, h-1663-streamexception-mod.patch, h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Koji Noguchi updated HADOOP-1663:
---------------------------------
Attachment: h-1663-streamexception.patch
Simple patch to rethrow the exceptions.
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Koji Noguchi updated HADOOP-1663:
---------------------------------
Attachment: h-1663-streamexception-mod.patch
o Making minor changes so that streaming client won't dump the stack trace unless it's an IOException. (Thanks Owen)
o Changing FileNotFoundException to InvalidInputException
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.13.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-mod.patch, h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-1663:
----------------------------------
Status: Open (was: Patch Available)
I tried to use the regression test from the previous patch, but it failed. Can you fix the test, create a unified patch, and resubmit.
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.13.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-mod.patch, h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Koji Noguchi updated HADOOP-1663:
---------------------------------
Attachment: (was: h-1663-streamexception-mod.patch)
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.13.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-mod.patch, h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1663) streaming returning 0 when
submitJob fails with Exception
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12519537 ]
Hadoop QA commented on HADOOP-1663:
-----------------------------------
-1, new javadoc warnings
The javadoc tool appears to have generated warning messages when testing the latest attachment http://issues.apache.org/jira/secure/attachment/12363721/h-1663-streamexception-as-returncode.patch against trunk revision r565434.
Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/548/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/548/console
Please note that this message is automatically generated and may represent a problem with the automation system and not the patch.
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.13.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-as-returncode.patch, h-1663-streamexception-mod.patch, h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley updated HADOOP-1663:
--------------------------------
Fix Version/s: (was: 0.15.0)
0.14.0
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.13.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-as-returncode.patch, h-1663-streamexception-mod.patch, h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1663) streaming returning 0 when
submitJob fails with Exception
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12519823 ]
Hadoop QA commented on HADOOP-1663:
-----------------------------------
-1, could not apply patch.
The patch command could not apply the latest attachment http://issues.apache.org/jira/secure/attachment/12363736/h-1663-streamexception-as-returncode.patch as a patch to trunk revision r565981.
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/555/console
Please note that this message is automatically generated and may represent a problem with the automation system and not the patch.
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.13.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-as-returncode.patch, h-1663-streamexception-as-returncode.patch, h-1663-streamexception-mod.patch, h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1663) streaming returning 0 when
submitJob fails with Exception
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12518860 ]
Hadoop QA commented on HADOOP-1663:
-----------------------------------
-1, build or testing failed
2 attempts failed to build and test the latest attachment http://issues.apache.org/jira/secure/attachment/12363153/h-1663-streamexception-simpletestcase.patch against trunk revision r564382.
Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/539/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/539/console
Please note that this message is automatically generated and may represent a problem with the automation system and not the patch.
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.13.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "lohit (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
lohit updated HADOOP-1663:
--------------------------
Attachment: h-1663-streamexception-as-returncode.patch
Resubmitting with Nigel & Owens inputs. Formated with proper error codes.
Thanks,
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.13.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-as-returncode.patch, h-1663-streamexception-as-returncode.patch, h-1663-streamexception-mod.patch, h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "lohit (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
lohit updated HADOOP-1663:
--------------------------
Attachment: h-1663-streamexception-simpletestcase.patch
Updated patch with simple test case
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "lohit (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
lohit updated HADOOP-1663:
--------------------------
Status: Patch Available (was: Open)
Patch Available
thanks
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.13.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.15.0
>
> Attachments: h-1663-streamexception-as-returncode.patch, h-1663-streamexception-mod.patch, h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Koji Noguchi reassigned HADOOP-1663:
------------------------------------
Assignee: Koji Noguchi
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1663) streaming returning 0 when submitJob
fails with Exception
Posted by "lohit (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
lohit updated HADOOP-1663:
--------------------------
Affects Version/s: 0.13.1
Status: Patch Available (was: Open)
Patch Available. Thanks.
> streaming returning 0 when submitJob fails with Exception
> ---------------------------------------------------------
>
> Key: HADOOP-1663
> URL: https://issues.apache.org/jira/browse/HADOOP-1663
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.13.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Fix For: 0.14.0
>
> Attachments: h-1663-streamexception-simpletestcase.patch, h-1663-streamexception.patch
>
>
> In streaming, if I pass an input filename that doesn't exist,
> bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
> ...
> 07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
> bash-3.00$ echo $?
> *0*
> =================
> Copy&Pasting Milind's comment.
> its a hadoop streaming problem. See the code
> below:
> }catch( IOException ioe){
> LOG.error("Error Launching job : " + ioe.getMessage());
> }
> finally {
> if (error && (running_ != null)) {
> LOG.info("killJob...");
> running_.killJob();
> }
> jc_.close();
> Note that it catches exception, and does not rethrow it !!!
> =================
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.