You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@giraph.apache.org by "Rafal Wojdyla (JIRA)" <ji...@apache.org> on 2013/12/14 02:14:06 UTC
[jira] [Commented] (GIRAPH-819) Number of containers required for a
job
[ https://issues.apache.org/jira/browse/GIRAPH-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13848124#comment-13848124 ]
Rafal Wojdyla commented on GIRAPH-819:
--------------------------------------
Problem seems to be GiraphYarnClient.java, where in *if* statement we check the number of requested containers and number of available containers on the cluster. To fix the issue I changed operator from less to greater.
> Number of containers required for a job
> ---------------------------------------
>
> Key: GIRAPH-819
> URL: https://issues.apache.org/jira/browse/GIRAPH-819
> Project: Giraph
> Issue Type: Bug
> Components: lib, mapreduce
> Affects Versions: 1.1.0
> Reporter: Rafal Wojdyla
> Labels: patch
> Fix For: 1.1.0
>
> Attachments: GIRAPH-819.patch
>
>
> Java 1.6.x
> Giraph trunk - revert java 1.7 support.
> Hadoop 2.2.0.x
> Job submission fails due to:
> {noformat}
> 13/11/28 12:02:14 INFO yarn.GiraphYarnClient: Running Client
> 13/11/28 12:02:14 INFO client.RMProxy: Connecting to ResourceManager at master/192.168.1.100:8045
> 13/11/28 12:02:15 INFO yarn.GiraphYarnClient: Got node report from ASM for, nodeId=kreator:46477, nodeAddresskreator:8042, nodeRackName/default-rack, nodeNumContainers7
> 13/11/28 12:02:15 INFO yarn.GiraphYarnClient: Got node report from ASM for, nodeId=exotica:46645, nodeAddressexotica:8042, nodeRackName/default-rack, nodeNumContainers8
> Exception in thread "main" java.lang.RuntimeException: Giraph job requires 2 containers to run; cluster only hosts 15
> at org.apache.giraph.yarn.GiraphYarnClient.checkPerNodeResourcesAvailable(GiraphYarnClient.java:230)
> at org.apache.giraph.yarn.GiraphYarnClient.run(GiraphYarnClient.java:125)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.1.4#6159)