[jira] [Commented] (HAMA-944) Add JSON format option to fastgen command

["Edward J. Yoon (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HAMA-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14485003#comment-14485003 ] 

Edward J. Yoon commented on HAMA-944:
-------------------------------------

It throws NoClassDefFoundError. To fix this problem, you can simply move json dependency to core/pom.xml file. I recommend you always to build and test using CLI command instead of IDE. :-)

{code}
edward@tserver:/media/edward/disk/home/eddieyoon/workspace/hama-trunk$ bin/hama jar examples/target/hama-examples-0.7.0-SNAPSHOT.jar gen fastgen -s 30000 -m 10000 -p /tmp/ed2 -t 1 -of Json15/04/08 18:40:28 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
15/04/08 18:40:28 INFO Configuration.deprecation: user.name is deprecated. Instead, use mapreduce.job.user.name
15/04/08 18:40:28 WARN conf.Configuration: org.apache.hadoop.fs.ChecksumFileSystem$FSDataBoundedInputStream@6d2a209c:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
15/04/08 18:40:28 WARN conf.Configuration: org.apache.hadoop.fs.ChecksumFileSystem$FSDataBoundedInputStream@6d2a209c:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
15/04/08 18:40:28 INFO Configuration.deprecation: user.name is deprecated. Instead, use mapreduce.job.user.name
15/04/08 18:40:28 INFO bsp.BSPJobClient: Running job: job_localrunner_0001
15/04/08 18:40:28 INFO bsp.LocalBSPRunner: Setting up a new barrier for 1 tasks!
15/04/08 18:40:28 INFO Configuration.deprecation: mapred.cache.localFiles is deprecated. Instead, use mapreduce.job.cache.local.files
15/04/08 18:40:28 ERROR bsp.LocalBSPRunner: Exception during BSP execution!
java.util.concurrent.ExecutionException: java.lang.NoClassDefFoundError: org/json/simple/JSONArray
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at org.apache.hama.bsp.LocalBSPRunner$ThreadObserver.run(LocalBSPRunner.java:315)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NoClassDefFoundError: org/json/simple/JSONArray
	at org.apache.hama.examples.util.FastGraphGen$FastGraphGenBSP.bsp(FastGraphGen.java:83)
	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:257)
	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:287)
	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:211)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	... 1 more
Caused by: java.lang.ClassNotFoundException: org.json.simple.JSONArray
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	... 10 more
{code}

> Add JSON format option to fastgen command
> -----------------------------------------
>
>                 Key: HAMA-944
>                 URL: https://issues.apache.org/jira/browse/HAMA-944
>             Project: Hama
>          Issue Type: Improvement
>          Components: examples
>    Affects Versions: 0.6.4
>            Reporter: Edward J. Yoon
>            Assignee: Minho Kim
>            Priority: Trivial
>             Fix For: 0.7.0
>
>         Attachments: HAMA-944.patch, HAMA-944_v1.patch
>
>
> To generate easy compatible input data w/ giraph.
> {code}
> [0,0,[[1,1],[3,3]]]
> [1,0,[[0,1],[2,2],[3,1]]]
> [2,0,[[1,2],[4,4]]]
> [3,0,[[0,3],[1,1],[4,4]]]
> [4,0,[[3,4],[2,4]]]
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)