Error in executing shortest path problem while working with own input data

[Phalguni Mukherjee <ph...@gmail.com>]

I have written my own JSON data format as

[{"id":0,"name":"father","value":0},[{"id":1,"name":"father","value":1},{"id":3,"name":"mother","value":3}]]
[{"id":1,"name":"father","value":0},[{"id":0,"name":"father","value":1},{"id":2,"name":"mother","value":2},{"id":4,"name":"mother","value":4}]]
[{"id":2,"name":"father","value":0},[{"id":1,"name":"father","value":2},{"id":4,"name":"mother","value":4}]]

But when I run the code I get error as:

"org.apache.hadoop.mapred.Counters$CountersExceededException: Error:
Exceeded limits on number of counters - Counters=120 Limit=120
at
org.apache.hadoop.mapred.Counters$Group.getCounterForName(Counters.java:319)
at org.apache.hadoop.mapred.Counters.findCounter(Counters.java:446)
at org.apache.hadoop.mapred.Task$TaskReporter.getCounter(Task.java:601)
at org.apache.hadoop.mapred.Task$TaskReporter.getCounter(Task.java:541)
at
org.apache.hadoop.mapreduce.TaskInputOutputContext.getCounter(TaskInputOutputContext.java:88)
at
org.apache.giraph.counters.HadoopCountersBase.getCounter(HadoopCountersBase.java:60)
at
org.apache.giraph.counters.GiraphTimers.getSuperstepMs(GiraphTimers.java:125)
at org.apache.giraph.master.MasterThread.run(MasterThread.java:140)"

The same algorithm runs fine with default input format i.e

[0,0,[[1,1],[3,3]]]
[1,0,[[0,1],[2,2],[3,1]]]
[2,0,[[1,2],[4,4]]]
[3,0,[[0,3],[1,1],[4,4]]]
[4,0,[[3,4],[2,4]]]


and get output as:

0 1.0

2 2.0

1 0.0

3 1.0

4 5.0


I have checked in my input format and algorithm code in the git hub
location:


https://github.com/phalguni1007/PhalguniGiraphLearn


Please help

-- 
*Thanks & Regards*
*Phalguni Mukherjee*

Re: Error in executing shortest path problem while working with own input data

[Fredrik Einarsson <ei...@gmail.com>]

Thanks so much for your answer. However it didn't solve it. I think I had
some problem related to hadoop giraph versions. I downloaded precompiled
packages and now it is working :)

*Kind regards*
Fredrik Einarsson

2015-01-29 11:50 GMT+01:00 Phalguni Mukherjee <
phalgunimukherjee1007@gmail.com>:

> I have written my own JSON data format as
>
>
> [{"id":0,"name":"father","value":0},[{"id":1,"name":"father","value":1},{"id":3,"name":"mother","value":3}]]
>
> [{"id":1,"name":"father","value":0},[{"id":0,"name":"father","value":1},{"id":2,"name":"mother","value":2},{"id":4,"name":"mother","value":4}]]
>
> [{"id":2,"name":"father","value":0},[{"id":1,"name":"father","value":2},{"id":4,"name":"mother","value":4}]]
>
> But when I run the code I get error as:
>
> "org.apache.hadoop.mapred.Counters$CountersExceededException: Error:
> Exceeded limits on number of counters - Counters=120 Limit=120
> at
>
> org.apache.hadoop.mapred.Counters$Group.getCounterForName(Counters.java:319)
> at org.apache.hadoop.mapred.Counters.findCounter(Counters.java:446)
> at org.apache.hadoop.mapred.Task$TaskReporter.getCounter(Task.java:601)
> at org.apache.hadoop.mapred.Task$TaskReporter.getCounter(Task.java:541)
> at
>
> org.apache.hadoop.mapreduce.TaskInputOutputContext.getCounter(TaskInputOutputContext.java:88)
> at
>
> org.apache.giraph.counters.HadoopCountersBase.getCounter(HadoopCountersBase.java:60)
> at
>
> org.apache.giraph.counters.GiraphTimers.getSuperstepMs(GiraphTimers.java:125)
> at org.apache.giraph.master.MasterThread.run(MasterThread.java:140)"
>
> The same algorithm runs fine with default input format i.e
>
> [0,0,[[1,1],[3,3]]]
> [1,0,[[0,1],[2,2],[3,1]]]
> [2,0,[[1,2],[4,4]]]
> [3,0,[[0,3],[1,1],[4,4]]]
> [4,0,[[3,4],[2,4]]]
>
>
> and get output as:
>
> 0 1.0
>
> 2 2.0
>
> 1 0.0
>
> 3 1.0
>
> 4 5.0
>
>
> I have checked in my input format and algorithm code in the git hub
> location:
>
>
> https://github.com/phalguni1007/PhalguniGiraphLearn
>
>
> Please help
>
> --
> *Thanks & Regards*
> *Phalguni Mukherjee*
>