You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "lohit vijayarenu (JIRA)" <ji...@apache.org> on 2007/10/01 21:02:50 UTC

[jira] Created: (HADOOP-1977) hadoop job -kill , -status

hadoop job -kill , -status 
---------------------------

                 Key: HADOOP-1977
                 URL: https://issues.apache.org/jira/browse/HADOOP-1977
             Project: Hadoop
          Issue Type: Bug
    Affects Versions: 0.14.1
            Reporter: lohit vijayarenu
             Fix For: 0.14.2


hadoop job -kill/-status seems to cause NullPointerException

As an example, I started a streaming job and tried to kill it. This raises NullPointerException

[lohit@krygw1000 mapred]$ bin/hadoop job  -Dmapred.job.tracker=kry1443:56225 -kill job_200710011856_0001
07/10/01 18:57:07 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
Exception in thread "main" java.lang.NullPointerException
        at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
        at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
        at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
        at org.apache.hadoop.mapred.JobClient.run(JobClient.java:791)
        at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
        at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
[lohit@krygw1000 mapred]$ 

So does 'hadoop job -status'
[lohit@krygw1000 mapred]$hadoop job -Dmapred.job.tracker=kry1443:56225 -status job_200710011856_0001
07/10/01 18:57:21 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
Exception in thread "main" java.lang.NullPointerException
        at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
        at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
        at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
        at org.apache.hadoop.mapred.JobClient.run(JobClient.java:782)
        at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
        at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
[lohit@krygw1000 mapred]$



-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (HADOOP-1977) hadoop job -kill , -status causes NullPointerException

Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Enis Soztutar reassigned HADOOP-1977:
-------------------------------------

    Assignee: Enis Soztutar

> hadoop job -kill , -status causes NullPointerException
> ------------------------------------------------------
>
>                 Key: HADOOP-1977
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1977
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.1
>            Reporter: lohit vijayarenu
>            Assignee: Enis Soztutar
>            Priority: Blocker
>             Fix For: 0.14.2
>
>
> hadoop job -kill/-status seems to cause NullPointerException
> As an example, I started a streaming job and tried to kill it. This raises NullPointerException
> [lohit@krygw1000 mapred]$ bin/hadoop job  -Dmapred.job.tracker=kry1443:56225 -kill job_200710011856_0001
> 07/10/01 18:57:07 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:791)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$ 
> So does 'hadoop job -status'
> [lohit@krygw1000 mapred]$hadoop job -Dmapred.job.tracker=kry1443:56225 -status job_200710011856_0001
> 07/10/01 18:57:21 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:782)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1977) hadoop job -kill , -status causes NullPointerException

Posted by "lohit vijayarenu (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12531709 ] 

lohit vijayarenu commented on HADOOP-1977:
------------------------------------------

Hi Enis,

I tried your patch on 0.14.1 and both -status and -kill works. 

Thanks!

> hadoop job -kill , -status causes NullPointerException
> ------------------------------------------------------
>
>                 Key: HADOOP-1977
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1977
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.1
>            Reporter: lohit vijayarenu
>            Assignee: Enis Soztutar
>            Priority: Blocker
>             Fix For: 0.14.2
>
>         Attachments: NPEinJobClient_v1.hadoop-0.14.patch, NPEinJobClient_v1.patch
>
>
> hadoop job -kill/-status seems to cause NullPointerException
> As an example, I started a streaming job and tried to kill it. This raises NullPointerException
> [lohit@krygw1000 mapred]$ bin/hadoop job  -Dmapred.job.tracker=kry1443:56225 -kill job_200710011856_0001
> 07/10/01 18:57:07 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:791)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$ 
> So does 'hadoop job -status'
> [lohit@krygw1000 mapred]$hadoop job -Dmapred.job.tracker=kry1443:56225 -status job_200710011856_0001
> 07/10/01 18:57:21 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:782)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1977) hadoop job -kill , -status causes NullPointerException

Posted by "lohit vijayarenu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

lohit vijayarenu updated HADOOP-1977:
-------------------------------------

    Priority: Blocker  (was: Major)

> hadoop job -kill , -status causes NullPointerException
> ------------------------------------------------------
>
>                 Key: HADOOP-1977
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1977
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.1
>            Reporter: lohit vijayarenu
>            Priority: Blocker
>             Fix For: 0.14.2
>
>
> hadoop job -kill/-status seems to cause NullPointerException
> As an example, I started a streaming job and tried to kill it. This raises NullPointerException
> [lohit@krygw1000 mapred]$ bin/hadoop job  -Dmapred.job.tracker=kry1443:56225 -kill job_200710011856_0001
> 07/10/01 18:57:07 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:791)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$ 
> So does 'hadoop job -status'
> [lohit@krygw1000 mapred]$hadoop job -Dmapred.job.tracker=kry1443:56225 -status job_200710011856_0001
> 07/10/01 18:57:21 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:782)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1977) hadoop job -kill , -status causes NullPointerException

Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Enis Soztutar updated HADOOP-1977:
----------------------------------

    Attachment: NPEinJobClient_v1.hadoop-0.14.patch

Previous patch was against trunk, this one is targeted at 0.14.2. 

> hadoop job -kill , -status causes NullPointerException
> ------------------------------------------------------
>
>                 Key: HADOOP-1977
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1977
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.1
>            Reporter: lohit vijayarenu
>            Assignee: Enis Soztutar
>            Priority: Blocker
>             Fix For: 0.14.2
>
>         Attachments: NPEinJobClient_v1.hadoop-0.14.patch, NPEinJobClient_v1.patch
>
>
> hadoop job -kill/-status seems to cause NullPointerException
> As an example, I started a streaming job and tried to kill it. This raises NullPointerException
> [lohit@krygw1000 mapred]$ bin/hadoop job  -Dmapred.job.tracker=kry1443:56225 -kill job_200710011856_0001
> 07/10/01 18:57:07 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:791)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$ 
> So does 'hadoop job -status'
> [lohit@krygw1000 mapred]$hadoop job -Dmapred.job.tracker=kry1443:56225 -status job_200710011856_0001
> 07/10/01 18:57:21 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:782)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1977) hadoop job -kill , -status causes NullPointerException

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12531615 ] 

Owen O'Malley commented on HADOOP-1977:
---------------------------------------

I looked at this problem. It stems from the fact that JobClient creates a new JobConf rather than use the Configuration from ToolBase. It would be nice to have a version of the CLI parsing library that wasn't based on ToolBase and OO inheritance, since clearly part of what happened here was too much OO magic not making the required usage clear.

> hadoop job -kill , -status causes NullPointerException
> ------------------------------------------------------
>
>                 Key: HADOOP-1977
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1977
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.1
>            Reporter: lohit vijayarenu
>            Priority: Blocker
>             Fix For: 0.14.2
>
>
> hadoop job -kill/-status seems to cause NullPointerException
> As an example, I started a streaming job and tried to kill it. This raises NullPointerException
> [lohit@krygw1000 mapred]$ bin/hadoop job  -Dmapred.job.tracker=kry1443:56225 -kill job_200710011856_0001
> 07/10/01 18:57:07 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:791)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$ 
> So does 'hadoop job -status'
> [lohit@krygw1000 mapred]$hadoop job -Dmapred.job.tracker=kry1443:56225 -status job_200710011856_0001
> 07/10/01 18:57:21 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:782)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1977) hadoop job -kill , -status causes NullPointerException

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12531705 ] 

Hadoop QA commented on HADOOP-1977:
-----------------------------------

+1 overall.  Here are the results of testing the latest attachment 
http://issues.apache.org/jira/secure/attachment/12366884/NPEinJobClient_v1.hadoop-0.14.patch
against trunk revision r581101.

    @author +1.  The patch does not contain any @author tags.

    javadoc +1.  The javadoc tool did not generate any warning messages.

    javac +1.  The applied patch does not generate any new compiler warnings.

    findbugs +1.  The patch does not introduce any new Findbugs warnings.

    core tests +1.  The patch passed core unit tests.

    contrib tests +1.  The patch passed contrib unit tests.

Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/862/testReport/
Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/862/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/862/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/862/console

This message is automatically generated.

> hadoop job -kill , -status causes NullPointerException
> ------------------------------------------------------
>
>                 Key: HADOOP-1977
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1977
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.1
>            Reporter: lohit vijayarenu
>            Assignee: Enis Soztutar
>            Priority: Blocker
>             Fix For: 0.14.2
>
>         Attachments: NPEinJobClient_v1.hadoop-0.14.patch, NPEinJobClient_v1.patch
>
>
> hadoop job -kill/-status seems to cause NullPointerException
> As an example, I started a streaming job and tried to kill it. This raises NullPointerException
> [lohit@krygw1000 mapred]$ bin/hadoop job  -Dmapred.job.tracker=kry1443:56225 -kill job_200710011856_0001
> 07/10/01 18:57:07 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:791)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$ 
> So does 'hadoop job -status'
> [lohit@krygw1000 mapred]$hadoop job -Dmapred.job.tracker=kry1443:56225 -status job_200710011856_0001
> 07/10/01 18:57:21 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:782)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1977) hadoop job -kill , -status causes NullPointerException

Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Enis Soztutar updated HADOOP-1977:
----------------------------------

    Status: Patch Available  (was: Open)

> hadoop job -kill , -status causes NullPointerException
> ------------------------------------------------------
>
>                 Key: HADOOP-1977
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1977
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.1
>            Reporter: lohit vijayarenu
>            Assignee: Enis Soztutar
>            Priority: Blocker
>             Fix For: 0.14.2
>
>         Attachments: NPEinJobClient_v1.hadoop-0.14.patch, NPEinJobClient_v1.patch
>
>
> hadoop job -kill/-status seems to cause NullPointerException
> As an example, I started a streaming job and tried to kill it. This raises NullPointerException
> [lohit@krygw1000 mapred]$ bin/hadoop job  -Dmapred.job.tracker=kry1443:56225 -kill job_200710011856_0001
> 07/10/01 18:57:07 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:791)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$ 
> So does 'hadoop job -status'
> [lohit@krygw1000 mapred]$hadoop job -Dmapred.job.tracker=kry1443:56225 -status job_200710011856_0001
> 07/10/01 18:57:21 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:782)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1977) hadoop job -kill , -status causes NullPointerException

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HADOOP-1977:
----------------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

I just committed this. Thanks, Enis!

> hadoop job -kill , -status causes NullPointerException
> ------------------------------------------------------
>
>                 Key: HADOOP-1977
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1977
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.1
>            Reporter: lohit vijayarenu
>            Assignee: Enis Soztutar
>            Priority: Blocker
>             Fix For: 0.14.2
>
>         Attachments: NPEinJobClient_v1.hadoop-0.14.patch, NPEinJobClient_v1.patch
>
>
> hadoop job -kill/-status seems to cause NullPointerException
> As an example, I started a streaming job and tried to kill it. This raises NullPointerException
> [lohit@krygw1000 mapred]$ bin/hadoop job  -Dmapred.job.tracker=kry1443:56225 -kill job_200710011856_0001
> 07/10/01 18:57:07 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:791)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$ 
> So does 'hadoop job -status'
> [lohit@krygw1000 mapred]$hadoop job -Dmapred.job.tracker=kry1443:56225 -status job_200710011856_0001
> 07/10/01 18:57:21 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:782)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1977) hadoop job -kill , -status causes NullPointerException

Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12531624 ] 

Raghu Angadi commented on HADOOP-1977:
--------------------------------------

> It would be nice to have a version of the CLI parsing library that wasn't based on ToolBase and OO inheritance,

See GenericOptionsParser that Enis added under util. This is the one used by ToolBase.

> hadoop job -kill , -status causes NullPointerException
> ------------------------------------------------------
>
>                 Key: HADOOP-1977
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1977
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.1
>            Reporter: lohit vijayarenu
>            Priority: Blocker
>             Fix For: 0.14.2
>
>
> hadoop job -kill/-status seems to cause NullPointerException
> As an example, I started a streaming job and tried to kill it. This raises NullPointerException
> [lohit@krygw1000 mapred]$ bin/hadoop job  -Dmapred.job.tracker=kry1443:56225 -kill job_200710011856_0001
> 07/10/01 18:57:07 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:791)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$ 
> So does 'hadoop job -status'
> [lohit@krygw1000 mapred]$hadoop job -Dmapred.job.tracker=kry1443:56225 -status job_200710011856_0001
> 07/10/01 18:57:21 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:782)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1977) hadoop job -kill , -status causes NullPointerException

Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Enis Soztutar updated HADOOP-1977:
----------------------------------

    Attachment: NPEinJobClient_v1.patch

The problem is ındeed in the JobConf initialization. The patch fixes the problem, changes {{LocalJobRunner#getJobStatus}} and {{#getJobProfile}} to return null if job could not be found. Now we have undocumented feature that the methods at {{JobSubmissionProtocol}} expects valid arguments(existing jobid's), but  {{JobSubmissionProtocol#getJobStatus()}} and {{JobSubmissionProtocol#getJobProfile()}} does not. 

lohit could you please try the patch, and report back if it works.  

> hadoop job -kill , -status causes NullPointerException
> ------------------------------------------------------
>
>                 Key: HADOOP-1977
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1977
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.1
>            Reporter: lohit vijayarenu
>            Assignee: Enis Soztutar
>            Priority: Blocker
>             Fix For: 0.14.2
>
>         Attachments: NPEinJobClient_v1.patch
>
>
> hadoop job -kill/-status seems to cause NullPointerException
> As an example, I started a streaming job and tried to kill it. This raises NullPointerException
> [lohit@krygw1000 mapred]$ bin/hadoop job  -Dmapred.job.tracker=kry1443:56225 -kill job_200710011856_0001
> 07/10/01 18:57:07 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:791)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$ 
> So does 'hadoop job -status'
> [lohit@krygw1000 mapred]$hadoop job -Dmapred.job.tracker=kry1443:56225 -status job_200710011856_0001
> 07/10/01 18:57:21 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:782)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1977) hadoop job -kill , -status causes NullPointerException

Posted by "lohit vijayarenu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

lohit vijayarenu updated HADOOP-1977:
-------------------------------------

    Component/s: mapred
        Summary: hadoop job -kill , -status causes NullPointerException  (was: hadoop job -kill , -status )

> hadoop job -kill , -status causes NullPointerException
> ------------------------------------------------------
>
>                 Key: HADOOP-1977
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1977
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.1
>            Reporter: lohit vijayarenu
>             Fix For: 0.14.2
>
>
> hadoop job -kill/-status seems to cause NullPointerException
> As an example, I started a streaming job and tried to kill it. This raises NullPointerException
> [lohit@krygw1000 mapred]$ bin/hadoop job  -Dmapred.job.tracker=kry1443:56225 -kill job_200710011856_0001
> 07/10/01 18:57:07 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:791)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$ 
> So does 'hadoop job -status'
> [lohit@krygw1000 mapred]$hadoop job -Dmapred.job.tracker=kry1443:56225 -status job_200710011856_0001
> 07/10/01 18:57:21 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:782)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1977) hadoop job -kill , -status causes NullPointerException

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12531950 ] 

Hudson commented on HADOOP-1977:
--------------------------------

Integrated in Hadoop-Nightly #258 (See [http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/258/])

> hadoop job -kill , -status causes NullPointerException
> ------------------------------------------------------
>
>                 Key: HADOOP-1977
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1977
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.14.1
>            Reporter: lohit vijayarenu
>            Assignee: Enis Soztutar
>            Priority: Blocker
>             Fix For: 0.14.2
>
>         Attachments: NPEinJobClient_v1.hadoop-0.14.patch, NPEinJobClient_v1.patch
>
>
> hadoop job -kill/-status seems to cause NullPointerException
> As an example, I started a streaming job and tried to kill it. This raises NullPointerException
> [lohit@krygw1000 mapred]$ bin/hadoop job  -Dmapred.job.tracker=kry1443:56225 -kill job_200710011856_0001
> 07/10/01 18:57:07 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:791)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$ 
> So does 'hadoop job -status'
> [lohit@krygw1000 mapred]$hadoop job -Dmapred.job.tracker=kry1443:56225 -status job_200710011856_0001
> 07/10/01 18:57:21 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.access$600(LocalJobRunner.java:51)
>         at org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:296)
>         at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:512)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:782)
>         at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:827)
> [lohit@krygw1000 mapred]$

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.