You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Mayank Bansal (JIRA)" <ji...@apache.org> on 2011/09/17 01:25:08 UTC
[jira] [Created] (MAPREDUCE-3026) When user adds hierarchical
queues to the cluster, mapred queue -list returns NULL Pointer Exception
When user adds hierarchical queues to the cluster, mapred queue -list returns NULL Pointer Exception
----------------------------------------------------------------------------------------------------
Key: MAPREDUCE-3026
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3026
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: jobtracker
Reporter: Mayank Bansal
Fix For: 0.22.0
When User adds the hierarchical queues, and try to see them from the command line using
mapred queue -list
It returns Null Pointer Exception.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3026) When user adds hierarchical
queues to the cluster, mapred queue -list returns NULL Pointer Exception
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13114073#comment-13114073 ]
Hudson commented on MAPREDUCE-3026:
-----------------------------------
Integrated in Hadoop-Mapreduce-22-branch #73 (See [https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/73/])
MAPREDUCE-3026. Fix NPE in mapred queue -list with hierarchical queues. Contributed by Mayank Bansal.
shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1175218
Files :
* /hadoop/common/branches/branch-0.22/mapreduce/CHANGES.txt
* /hadoop/common/branches/branch-0.22/mapreduce/src/java/org/apache/hadoop/mapred/JobQueueInfo.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/java/org/apache/hadoop/mapred/JobTracker.java
> When user adds hierarchical queues to the cluster, mapred queue -list returns NULL Pointer Exception
> ----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3026
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3026
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.22.0
> Reporter: Mayank Bansal
> Labels: patch
> Fix For: 0.22.0
>
> Attachments: patch-22, patch-22.patch
>
>
> When User adds the hierarchical queues, and try to see them from the command line using
> mapred queue -list
> It returns Null Pointer Exception.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3026) When user adds hierarchical
queues to the cluster, mapred queue -list returns NULL Pointer Exception
Posted by "Mayank Bansal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mayank Bansal updated MAPREDUCE-3026:
-------------------------------------
Attachment: patch-22
Initial patch for review
> When user adds hierarchical queues to the cluster, mapred queue -list returns NULL Pointer Exception
> ----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3026
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3026
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Reporter: Mayank Bansal
> Fix For: 0.22.0
>
> Attachments: patch-22
>
>
> When User adds the hierarchical queues, and try to see them from the command line using
> mapred queue -list
> It returns Null Pointer Exception.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3026) When user adds hierarchical
queues to the cluster, mapred queue -list returns NULL Pointer Exception
Posted by "Mayank Bansal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mayank Bansal updated MAPREDUCE-3026:
-------------------------------------
Release Note: (was: There are two changes which needs to be done in order to fix the Null Pointer Exception.
1. Job tracker was not setting the job statuses for the leaf queues, so we need to fix the job tracker to set the running job statuses for the leaf queues.
2. When we are decserializing the jobqueueInfo object at the client side then it was actually expecting the jobqueueInfo object however from the Queinfo class we were passing the Queinfo object which needs to be changed to jobqueueInfo object.)
There are two changes which needs to be done in order to fix the Null Pointer Exception.
1. Job tracker was not setting the job statuses for the leaf queues, so we need to fix the job tracker to set the running job statuses for the leaf queues.
2. When we are decserializing the jobqueueInfo object at the client side then it was actually expecting the jobqueueInfo object however from the Queinfo class we were passing the Queinfo object which needs to be changed to jobqueueInfo object.
> When user adds hierarchical queues to the cluster, mapred queue -list returns NULL Pointer Exception
> ----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3026
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3026
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.22.0
> Reporter: Mayank Bansal
> Labels: patch
> Fix For: 0.22.0
>
> Attachments: patch-22
>
>
> When User adds the hierarchical queues, and try to see them from the command line using
> mapred queue -list
> It returns Null Pointer Exception.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3026) When user adds hierarchical
queues to the cluster, mapred queue -list returns NULL Pointer Exception
Posted by "Mayank Bansal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mayank Bansal updated MAPREDUCE-3026:
-------------------------------------
Labels: patch (was: )
Affects Version/s: 0.22.0
Release Note:
There are two changes which needs to be done in order to fix the Null Pointer Exception.
1. Job tracker was not setting the job statuses for the leaf queues, so we need to fix the job tracker to set the running job statuses for the leaf queues.
2. When we are decserializing the jobqueueInfo object at the client side then it was actually expecting the jobqueueInfo object however from the Queinfo class we were passing the Queinfo object which needs to be changed to jobqueueInfo object.
Status: Patch Available (was: Open)
> When user adds hierarchical queues to the cluster, mapred queue -list returns NULL Pointer Exception
> ----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3026
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3026
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.22.0
> Reporter: Mayank Bansal
> Labels: patch
> Fix For: 0.22.0
>
> Attachments: patch-22
>
>
> When User adds the hierarchical queues, and try to see them from the command line using
> mapred queue -list
> It returns Null Pointer Exception.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3026) When user adds hierarchical
queues to the cluster, mapred queue -list returns NULL Pointer Exception
Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13108276#comment-13108276 ]
Konstantin Shvachko commented on MAPREDUCE-3026:
------------------------------------------------
+1 looks good. Could you please run test-patch target and paste the results here.
> When user adds hierarchical queues to the cluster, mapred queue -list returns NULL Pointer Exception
> ----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3026
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3026
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.22.0
> Reporter: Mayank Bansal
> Labels: patch
> Fix For: 0.22.0
>
> Attachments: patch-22
>
>
> When User adds the hierarchical queues, and try to see them from the command line using
> mapred queue -list
> It returns Null Pointer Exception.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3026) When user adds hierarchical
queues to the cluster, mapred queue -list returns NULL Pointer Exception
Posted by "Mayank Bansal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mayank Bansal updated MAPREDUCE-3026:
-------------------------------------
Attachment: patch-22.patch
Latest patch
> When user adds hierarchical queues to the cluster, mapred queue -list returns NULL Pointer Exception
> ----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3026
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3026
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.22.0
> Reporter: Mayank Bansal
> Labels: patch
> Fix For: 0.22.0
>
> Attachments: patch-22, patch-22.patch
>
>
> When User adds the hierarchical queues, and try to see them from the command line using
> mapred queue -list
> It returns Null Pointer Exception.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3026) When user adds hierarchical
queues to the cluster, mapred queue -list returns NULL Pointer Exception
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13108135#comment-13108135 ]
Hadoop QA commented on MAPREDUCE-3026:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12495140/patch-22
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/789//console
This message is automatically generated.
> When user adds hierarchical queues to the cluster, mapred queue -list returns NULL Pointer Exception
> ----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3026
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3026
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.22.0
> Reporter: Mayank Bansal
> Labels: patch
> Fix For: 0.22.0
>
> Attachments: patch-22
>
>
> When User adds the hierarchical queues, and try to see them from the command line using
> mapred queue -list
> It returns Null Pointer Exception.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3026) When user adds hierarchical
queues to the cluster, mapred queue -list returns NULL Pointer Exception
Posted by "Mayank Bansal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13109191#comment-13109191 ]
Mayank Bansal commented on MAPREDUCE-3026:
------------------------------------------
Test is not included as it is a command line option for show the listing of the queues
mapred queue -list
[exec] -1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] -1 tests included. The patch doesn't appear to include any new or modified tests.
[exec] Please justify why no new tests are needed for this patch.
[exec] Also please list what manual steps were performed to verify this patch.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
[exec]
[exec] +1 system test framework. The patch passed system test framework compile.
[exec]
[exec]
[exec]
[exec]
[exec] ======================================================================
[exec] ======================================================================
[exec] Finished build.
[exec] ======================================================================
[exec] ======================================================================
> When user adds hierarchical queues to the cluster, mapred queue -list returns NULL Pointer Exception
> ----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3026
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3026
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.22.0
> Reporter: Mayank Bansal
> Labels: patch
> Fix For: 0.22.0
>
> Attachments: patch-22, patch-22.patch
>
>
> When User adds the hierarchical queues, and try to see them from the command line using
> mapred queue -list
> It returns Null Pointer Exception.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3026) When user adds hierarchical
queues to the cluster, mapred queue -list returns NULL Pointer Exception
Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Shvachko updated MAPREDUCE-3026:
-------------------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I just committed this. Thank you Mayank.
I assume this is not applicable for trunk.
> When user adds hierarchical queues to the cluster, mapred queue -list returns NULL Pointer Exception
> ----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3026
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3026
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.22.0
> Reporter: Mayank Bansal
> Labels: patch
> Fix For: 0.22.0
>
> Attachments: patch-22, patch-22.patch
>
>
> When User adds the hierarchical queues, and try to see them from the command line using
> mapred queue -list
> It returns Null Pointer Exception.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3026) When user adds hierarchical
queues to the cluster, mapred queue -list returns NULL Pointer Exception
Posted by "Konstantin Shvachko (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Shvachko updated MAPREDUCE-3026:
-------------------------------------------
Description:
When User adds the hierarchical queues, and try to see them from the command line using
mapred queue -list
It returns Null Pointer Exception.
was:
When User adds the hierarchical queues, and try to see them from the command line using
mapred queue -list
It returns Null Pointer Exception.
Assignee: Mayank Bansal
> When user adds hierarchical queues to the cluster, mapred queue -list returns NULL Pointer Exception
> ----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3026
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3026
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.22.0
> Reporter: Mayank Bansal
> Assignee: Mayank Bansal
> Labels: patch
> Fix For: 0.22.0
>
> Attachments: patch-22, patch-22.patch
>
>
> When User adds the hierarchical queues, and try to see them from the command line using
> mapred queue -list
> It returns Null Pointer Exception.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3026) When user adds hierarchical
queues to the cluster, mapred queue -list returns NULL Pointer Exception
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13109198#comment-13109198 ]
Hadoop QA commented on MAPREDUCE-3026:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12495310/patch-22.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/806//console
This message is automatically generated.
> When user adds hierarchical queues to the cluster, mapred queue -list returns NULL Pointer Exception
> ----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3026
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3026
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.22.0
> Reporter: Mayank Bansal
> Labels: patch
> Fix For: 0.22.0
>
> Attachments: patch-22, patch-22.patch
>
>
> When User adds the hierarchical queues, and try to see them from the command line using
> mapred queue -list
> It returns Null Pointer Exception.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira