You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by lewis john mcgibbney <le...@gmail.com> on 2011/08/29 22:56:48 UTC

InvocationTargetException with Nutch 2.0 Gora 0.2 and Cassandra 0.8.4

Hi,

I believe the following error can be attributed to the java compiler finding
(or not finding) more than one version of
me.prettyprint.hector.api.Serializer. Has anyone experienced this whilst
getting the above (or similar) setup configured and running?

lewis@lewis-01:~/ASF/trunk/runtime/local$ bin/nutch inject crawldb urls
InjectorJob: starting
InjectorJob: urlDir: crawldb
InjectorJob: org.apache.gora.util.GoraException:
java.lang.reflect.InvocationTargetException
    at
org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:110)
    at
org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:93)
    at
org.apache.nutch.storage.StorageUtils.createWebStore(StorageUtils.java:59)
    at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:243)
    at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:268)
    at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:282)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
    at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:292)
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
    at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
    at
org.apache.gora.util.ReflectionUtils.newInstance(ReflectionUtils.java:76)
    at
org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:103)
    ... 7 more
Caused by: java.lang.NoClassDefFoundError:
me/prettyprint/hector/api/Serializer
    at
org.apache.gora.cassandra.store.CassandraStore.<init>(CassandraStore.java:60)
    ... 13 more
Caused by: java.lang.ClassNotFoundException:
me.prettyprint.hector.api.Serializer
    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
    ... 14 more
-- 
*Lewis*

Re: InvocationTargetException with Nutch 2.0 Gora 0.2 and Cassandra 0.8.4

Posted by Alexis <al...@gmail.com>.

Hi Tom,

I'm having the same issue.
The two missing jars in the nutch-2.0-dev.job, cassandra-all-0.8.0.jar
and hector-core-0.8.0-1.jar, have been manually uploaded for the Gora
build to work into gora-cassandra/lib-ext SVN directory, because for
some reason I did not get them downloaded through Maven...



On Tue, Aug 30, 2011 at 3:30 AM, lewis john mcgibbney
<le...@gmail.com> wrote:
> Hi Tom,
>
> Well this is strange...
>
> No versions of hector in Nutch 2.0/runtime/deploy/nutch-2.0-dev.job or
> /local/lib however Gora 0.2 uses it a dependency as per
> /gora-cassandra/lib/hector-core0.8.0-1.jar
>
> I'm going to take some time later and try various debug combinations within
> eclipse to get to the bottom of this one.
>
> On Mon, Aug 29, 2011 at 10:00 PM, Tom Davidson <td...@covario.com>
> wrote:
>>
>> I had similar classpath issues. Are there any versions of Hector in your
>> classpath (in your Hadoop lib folder?) that are not the same as in your
>> nutch deployment jar?
>>
>>
>>
>> From: lewis john mcgibbney [mailto:lewis.mcgibbney@gmail.com]
>> Sent: Monday, August 29, 2011 1:57 PM
>> To: dev@nutch.apache.org
>> Subject: InvocationTargetException with Nutch 2.0 Gora 0.2 and Cassandra
>> 0.8.4
>>
>>
>>
>> Hi,
>>
>> I believe the following error can be attributed to the java compiler
>> finding (or not finding) more than one version of
>> me.prettyprint.hector.api.Serializer. Has anyone experienced this whilst
>> getting the above (or similar) setup configured and running?
>>
>> lewis@lewis-01:~/ASF/trunk/runtime/local$ bin/nutch inject crawldb urls
>> InjectorJob: starting
>> InjectorJob: urlDir: crawldb
>> InjectorJob: org.apache.gora.util.GoraException:
>> java.lang.reflect.InvocationTargetException
>>     at
>> org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:110)
>>     at
>> org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:93)
>>     at
>> org.apache.nutch.storage.StorageUtils.createWebStore(StorageUtils.java:59)
>>     at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:243)
>>     at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:268)
>>     at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:282)
>>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>>     at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:292)
>> Caused by: java.lang.reflect.InvocationTargetException
>>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
>> Method)
>>     at
>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
>>     at
>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
>>     at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
>>     at
>> org.apache.gora.util.ReflectionUtils.newInstance(ReflectionUtils.java:76)
>>     at
>> org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:103)
>>     ... 7 more
>> Caused by: java.lang.NoClassDefFoundError:
>> me/prettyprint/hector/api/Serializer
>>     at
>> org.apache.gora.cassandra.store.CassandraStore.<init>(CassandraStore.java:60)
>>     ... 13 more
>> Caused by: java.lang.ClassNotFoundException:
>> me.prettyprint.hector.api.Serializer
>>     at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>>     at java.security.AccessController.doPrivileged(Native Method)
>>     at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>     at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
>>     ... 14 more
>> --
>> Lewis
>
>
> --
> Lewis
>
>

Re: InvocationTargetException with Nutch 2.0 Gora 0.2 and Cassandra 0.8.4

Posted by lewis john mcgibbney <le...@gmail.com>.

Hi Tom,

Well this is strange...

No versions of hector in Nutch 2.0/runtime/deploy/nutch-2.0-dev.job or
/local/lib however Gora 0.2 uses it a dependency as per
/gora-cassandra/lib/hector-core0.8.0-1.jar

I'm going to take some time later and try various debug combinations within
eclipse to get to the bottom of this one.

On Mon, Aug 29, 2011 at 10:00 PM, Tom Davidson <td...@covario.com>wrote:

>  I had similar classpath issues. Are there any versions of Hector in your
> classpath (in your Hadoop lib folder?) that are not the same as in your
> nutch deployment jar?****
>
> ** **
>
> *From:* lewis john mcgibbney [mailto:lewis.mcgibbney@gmail.com]
> *Sent:* Monday, August 29, 2011 1:57 PM
> *To:* dev@nutch.apache.org
> *Subject:* InvocationTargetException with Nutch 2.0 Gora 0.2 and Cassandra
> 0.8.4****
>
> ** **
>
> Hi,
>
> I believe the following error can be attributed to the java compiler
> finding (or not finding) more than one version of
> me.prettyprint.hector.api.Serializer. Has anyone experienced this whilst
> getting the above (or similar) setup configured and running?
>
> lewis@lewis-01:~/ASF/trunk/runtime/local$ bin/nutch inject crawldb urls
> InjectorJob: starting
> InjectorJob: urlDir: crawldb
> InjectorJob: org.apache.gora.util.GoraException:
> java.lang.reflect.InvocationTargetException
>     at
> org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:110)
>     at
> org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:93)
>     at
> org.apache.nutch.storage.StorageUtils.createWebStore(StorageUtils.java:59)
>     at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:243)
>     at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:268)
>     at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:282)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>     at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:292)
> Caused by: java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>     at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
>     at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
>     at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
>     at
> org.apache.gora.util.ReflectionUtils.newInstance(ReflectionUtils.java:76)
>     at
> org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:103)
>     ... 7 more
> Caused by: java.lang.NoClassDefFoundError:
> me/prettyprint/hector/api/Serializer
>     at
> org.apache.gora.cassandra.store.CassandraStore.<init>(CassandraStore.java:60)
>     ... 13 more
> Caused by: java.lang.ClassNotFoundException:
> me.prettyprint.hector.api.Serializer
>     at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>     at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>     at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>     at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
>     ... 14 more
> --
> *Lewis* ****
>



-- 
*Lewis*

RE: InvocationTargetException with Nutch 2.0 Gora 0.2 and Cassandra 0.8.4

Posted by Tom Davidson <td...@covario.com>.

I had similar classpath issues. Are there any versions of Hector in your classpath (in your Hadoop lib folder?) that are not the same as in your nutch deployment jar?

From: lewis john mcgibbney [mailto:lewis.mcgibbney@gmail.com]
Sent: Monday, August 29, 2011 1:57 PM
To: dev@nutch.apache.org
Subject: InvocationTargetException with Nutch 2.0 Gora 0.2 and Cassandra 0.8.4

Hi,

I believe the following error can be attributed to the java compiler finding (or not finding) more than one version of me.prettyprint.hector.api.Serializer. Has anyone experienced this whilst getting the above (or similar) setup configured and running?

lewis@lewis-01:~/ASF/trunk/runtime/local$ bin/nutch inject crawldb urls
InjectorJob: starting
InjectorJob: urlDir: crawldb
InjectorJob: org.apache.gora.util.GoraException: java.lang.reflect.InvocationTargetException
    at org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:110)
    at org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:93)
    at org.apache.nutch.storage.StorageUtils.createWebStore(StorageUtils.java:59)
    at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:243)
    at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:268)
    at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:282)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
    at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:292)
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
    at org.apache.gora.util.ReflectionUtils.newInstance(ReflectionUtils.java:76)
    at org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:103)
    ... 7 more
Caused by: java.lang.NoClassDefFoundError: me/prettyprint/hector/api/Serializer
    at org.apache.gora.cassandra.store.CassandraStore.<init>(CassandraStore.java:60)
    ... 13 more
Caused by: java.lang.ClassNotFoundException: me.prettyprint.hector.api.Serializer
    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
    ... 14 more
--
Lewis