You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Bikas Saha (JIRA)" <ji...@apache.org> on 2012/09/14 00:37:08 UTC

[jira] [Commented] (MAPREDUCE-4657) WindowsResourceCalculatorPlugin has NPE

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13455380#comment-13455380 ] 

Bikas Saha commented on MAPREDUCE-4657:
---------------------------------------

The NPE is occurring because of not handling null return when systeminfo shell call throws exception (for any reason).
Ideally the exception would be propagated but the ResourceCalculatorPlugin interface does not support it.
                
> WindowsResourceCalculatorPlugin has NPE
> ---------------------------------------
>
>                 Key: MAPREDUCE-4657
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4657
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Bikas Saha
>            Priority: Minor
>
> When Shell command execution is interrupted then WindowsResourceCalculatorPlugin has NPE.
> code}
> 2012-08-31 13:01:00,140 ERROR [Thread-771] util.WindowsResourceCalculatorPlugin(69): java.io.IOException: java.lang.InterruptedException^M
>         at org.apache.hadoop.util.Shell.runCommand(Shell.java:424)^M
>         at org.apache.hadoop.util.Shell.run(Shell.java:336)^M
>         at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:540)^M
>         at org.apache.hadoop.util.WindowsResourceCalculatorPlugin.getSystemInfoInfoFromShell(WindowsResourceCalculatorPlugin.java:66)^M
>         at org.apache.hadoop.util.WindowsResourceCalculatorPlugin.refreshIfNeeded(WindowsResourceCalculatorPlugin.java:81)^M
>         at org.apache.hadoop.util.WindowsResourceCalculatorPlugin.getAvailableVirtualMemorySize(WindowsResourceCalculatorPlugin.java:126)^M
>         at org.apache.hadoop.mapred.TaskTracker.getAvailableVirtualMemoryOnTT(TaskTracker.java:1933)^M
>         at org.apache.hadoop.mapred.TaskTracker.transmitHeartBeat(TaskTracker.java:1834)^M
>         at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:1664)^M
>         at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:2516)^M
>         at org.apache.hadoop.mapred.MiniMRCluster$TaskTrackerRunner.run(MiniMRCluster.java:217)^M
>         at java.lang.Thread.run(Thread.java:662)^M
> ^M
> 2012-08-31 13:01:00,140 ERROR [Thread-771] mapred.TaskTracker(1766): Caught exception: java.lang.NullPointerException^M
>         at org.apache.hadoop.util.WindowsResourceCalculatorPlugin.refreshIfNeeded(WindowsResourceCalculatorPlugin.java:83)^M
>         at org.apache.hadoop.util.WindowsResourceCalculatorPlugin.getAvailableVirtualMemorySize(WindowsResourceCalculatorPlugin.java:126)^M
>         at org.apache.hadoop.mapred.TaskTracker.getAvailableVirtualMemoryOnTT(TaskTracker.java:1933)^M
>         at org.apache.hadoop.mapred.TaskTracker.transmitHeartBeat(TaskTracker.java:1834)^M
>         at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:1664)^M
>         at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:2516)^M
>         at org.apache.hadoop.mapred.MiniMRCluster$TaskTrackerRunner.run(MiniMRCluster.java:217)^M
>         at java.lang.Thread.run(Thread.java:662)^M
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira