You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Nishan Shetty (JIRA)" <ji...@apache.org> on 2012/08/09 11:36:18 UTC
[jira] [Created] (YARN-16) NM throws "ArithmeticException: / by
zero" when there is no available space on configured local dir
Nishan Shetty created YARN-16:
---------------------------------
Summary: NM throws "ArithmeticException: / by zero" when there is no available space on configured local dir
Key: YARN-16
URL: https://issues.apache.org/jira/browse/YARN-16
Project: Hadoop YARN
Issue Type: Bug
Components: nodemanager
Affects Versions: 2.1.0-alpha
Reporter: Nishan Shetty
Priority: Minor
{code:xml}
12/08/09 13:59:49 INFO mapreduce.Job: Task Id : attempt_1344492468506_0023_m_000000_0, Status : FAILED
java.lang.ArithmeticException: / by zero
at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:371)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:115)
at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.getLocalPathForWrite(LocalDirsHandlerService.java:257)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:849)
{code}
Instead of throwing exception directly we can log a warning saying no available space on configured local dir
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (YARN-16) NM throws "ArithmeticException: / by
zero" when there is no available space on configured local dir
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/YARN-16?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated YARN-16:
-----------------------------
Attachment: YARN-16.patch
The bug is in LocalDirAllocator.
The patch is to check if the total available space is 0 and throw an exception with appropriate message.
> NM throws "ArithmeticException: / by zero" when there is no available space on configured local dir
> ---------------------------------------------------------------------------------------------------
>
> Key: YARN-16
> URL: https://issues.apache.org/jira/browse/YARN-16
> Project: Hadoop YARN
> Issue Type: Bug
> Components: nodemanager
> Affects Versions: 2.1.0-alpha
> Reporter: Nishan Shetty
> Priority: Minor
> Attachments: YARN-16.patch
>
>
> 12/08/09 13:59:49 INFO mapreduce.Job: Task Id : attempt_1344492468506_0023_m_000000_0, Status : FAILED
> java.lang.ArithmeticException: / by zero
> at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:371)
> at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
> at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
> at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:115)
> at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.getLocalPathForWrite(LocalDirsHandlerService.java:257)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:849)
> Instead of throwing exception directly we can log a warning saying no available space on configured local dir
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (YARN-16) NM throws "ArithmeticException: / by
zero" when there is no available space on configured local dir
Posted by "Nishan Shetty (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/YARN-16?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nishan Shetty updated YARN-16:
------------------------------
Description:
12/08/09 13:59:49 INFO mapreduce.Job: Task Id : attempt_1344492468506_0023_m_000000_0, Status : FAILED
java.lang.ArithmeticException: / by zero
at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:371)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:115)
at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.getLocalPathForWrite(LocalDirsHandlerService.java:257)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:849)
Instead of throwing exception directly we can log a warning saying no available space on configured local dir
was:
{code:xml}
12/08/09 13:59:49 INFO mapreduce.Job: Task Id : attempt_1344492468506_0023_m_000000_0, Status : FAILED
java.lang.ArithmeticException: / by zero
at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:371)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:115)
at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.getLocalPathForWrite(LocalDirsHandlerService.java:257)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:849)
{code}
Instead of throwing exception directly we can log a warning saying no available space on configured local dir
> NM throws "ArithmeticException: / by zero" when there is no available space on configured local dir
> ---------------------------------------------------------------------------------------------------
>
> Key: YARN-16
> URL: https://issues.apache.org/jira/browse/YARN-16
> Project: Hadoop YARN
> Issue Type: Bug
> Components: nodemanager
> Affects Versions: 2.1.0-alpha
> Reporter: Nishan Shetty
> Priority: Minor
>
> 12/08/09 13:59:49 INFO mapreduce.Job: Task Id : attempt_1344492468506_0023_m_000000_0, Status : FAILED
> java.lang.ArithmeticException: / by zero
> at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:371)
> at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
> at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
> at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:115)
> at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.getLocalPathForWrite(LocalDirsHandlerService.java:257)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:849)
> Instead of throwing exception directly we can log a warning saying no available space on configured local dir
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira