You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@giraph.apache.org by Jyoti Yadav <ra...@gmail.com> on 2014/01/09 11:20:04 UTC
(Unknown)
Hi..
Is anyone familiar with below mentioned error*??*
*ERROR:*org.apache.giraph.master.BspServiceMaster: checkWorkers: Did not
receive enough processes in time (only 0 of 1 required) after waiting
600000msecs). This occurs if you do not have enough map tasks available
simultaneously on your Hadoop instance to fulfill the number of requested
workers.
Thanks
Jyoti
Re:
Posted by Jyoti Yadav <ra...@gmail.com>.
Thanks Lukas..I tried in other way.. I gave giraph.SpliMasterWorker=true
while running the job..
On Thu, Jan 9, 2014 at 4:23 PM, Lukas Nalezenec <
lukas.nalezenec@firma.seznam.cz> wrote:
> I thing you cluster is busy, you need to increase timeout
> -Dgiraph.maxMasterSuperstepWaitMsecs=...
>
>
> On 9.1.2014 11:20, Jyoti Yadav wrote:
>
> Hi..
> Is anyone familiar with below mentioned error*??*
>
> * ERROR:*org.apache.giraph.master.BspServiceMaster: checkWorkers: Did not
> receive enough processes in time (only 0 of 1 required) after waiting
> 600000msecs). This occurs if you do not have enough map tasks available
> simultaneously on your Hadoop instance to fulfill the number of requested
> workers.
>
> Thanks
> Jyoti
>
>
>
Re:
Posted by Lukas Nalezenec <lu...@firma.seznam.cz>.
I thing you cluster is busy, you need to increase timeout
-Dgiraph.maxMasterSuperstepWaitMsecs=...
On 9.1.2014 11:20, Jyoti Yadav wrote:
> Hi..
> Is anyone familiar with below mentioned error*??*
> *
> ERROR:*org.apache.giraph.master.BspServiceMaster: checkWorkers: Did
> not receive enough processes in time (only 0 of 1 required) after
> waiting 600000msecs). This occurs if you do not have enough map tasks
> available simultaneously on your Hadoop instance to fulfill the number
> of requested workers.
>
> Thanks
> Jyoti
Re:
Posted by Jyoti Yadav <ra...@gmail.com>.
Hi Sebastian..
I simply gave following command..
hadoop jar
$GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner
org.apache.giraph.examples.MyShortestDistance -vif
org.apache.giraph.examples.io.formats.MyShortestDistanceVertexInputFormat
-vip /user/hduser/sp_input/closeness_input.txt -vof
org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
/user/hduser/sp_output226/sd_output -w 1 -mc
org.apache.giraph.examples.MyShortestDistance\$MyMasterCompute
14/01/09 14:08:27 INFO utils.ConfigurationUtils: No edge input format
specified. Ensure your InputFormat does not require one.
14/01/09 14:08:27 INFO utils.ConfigurationUtils: No edge output format
specified. Ensure your OutputFormat does not require one.
14/01/09 14:08:27 INFO job.GiraphJob: run: Since checkpointing is disabled
(default), do not allow any task retries (setting mapred.map.max.attempts =
0, old value = 4)
14/01/09 14:08:35 INFO job.GiraphJob: run: Tracking URL:
http://localhost:50030/jobdetails.jsp?jobid=job_201401090955_0005
14/01/09 14:09:47 INFO
job.HaltApplicationUtils$DefaultHaltInstructionsWriter:
writeHaltInstructions: To halt after next superstep execute:
'bin/halt-application --zkServer kanha-Vostro-1014:22181 --zkNode
/_hadoopBsp/job_201401090955_0005/_haltComputation'
14/01/09 14:09:47 INFO mapred.JobClient: Running job: job_201401090955_0005
14/01/09 14:09:48 INFO mapred.JobClient: map 50% reduce 0%
14/01/09 14:19:40 INFO mapred.JobClient: Job complete: job_201401090955_0005
14/01/09 14:19:40 INFO mapred.JobClient: Counters: 5
14/01/09 14:19:40 INFO mapred.JobClient: Job Counters
14/01/09 14:19:40 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=623745
14/01/09 14:19:40 INFO mapred.JobClient: Total time spent by all
reduces waiting after reserving slots (ms)=0
14/01/09 14:19:40 INFO mapred.JobClient: Total time spent by all maps
waiting after reserving slots (ms)=0
14/01/09 14:19:40 INFO mapred.JobClient: Launched map tasks=1
14/01/09 14:19:40 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=12677
On Thu, Jan 9, 2014 at 3:51 PM, Sebastian Schelter <ss...@apache.org> wrote:
> Did you try to increase the number of map slots in your cluster, as
> suggested?
>
>
> On 01/09/2014 11:20 AM, Jyoti Yadav wrote:
>
>> Hi..
>> Is anyone familiar with below mentioned error*??*
>>
>> *ERROR:*org.apache.giraph.master.BspServiceMaster: checkWorkers: Did not
>>
>> receive enough processes in time (only 0 of 1 required) after waiting
>> 600000msecs). This occurs if you do not have enough map tasks available
>> simultaneously on your Hadoop instance to fulfill the number of requested
>> workers.
>>
>> Thanks
>> Jyoti
>>
>>
>
Re:
Posted by Sebastian Schelter <ss...@apache.org>.
Did you try to increase the number of map slots in your cluster, as
suggested?
On 01/09/2014 11:20 AM, Jyoti Yadav wrote:
> Hi..
> Is anyone familiar with below mentioned error*??*
>
> *ERROR:*org.apache.giraph.master.BspServiceMaster: checkWorkers: Did not
> receive enough processes in time (only 0 of 1 required) after waiting
> 600000msecs). This occurs if you do not have enough map tasks available
> simultaneously on your Hadoop instance to fulfill the number of requested
> workers.
>
> Thanks
> Jyoti
>